lkml.org 
[lkml]   [2006]   [Apr]   [6]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: RT task scheduling
Ingo Molnar wrote:
> * Darren Hart <darren@dvhart.com> wrote:
>
>> My last mail specifically addresses preempt-rt, but I'd like to know
>> people's thoughts regarding this issue in the mainline kernel. Please
>> see my previous post "realtime-preempt scheduling - rt_overload
>> behavior" for a testcase that produces unpredictable scheduling
>> results.
>
> the rt_overload feature i intend to push upstream-wards too, i just
> didnt separate it out of -rt yet.
>
> "RT overload scheduling" is a totally orthogonal mechanism to the SMP
> load-balancer (and this includes smpnice too) that is more or less
> equivalent to having a 'global runqueue' for real-time tasks, without
> the SMP overhead associated with that. If there is no "RT overload" [the
> common case even on Linux systems that _do_ make use of RT tasks
> occasionally], the new mechanism is totally inactive and there's no
> overhead. But once there are more RT tasks than CPUs, the scheduler will
> do "global" decisions for what RT tasks to run on which CPU. To put even
> less overhead on the mainstream kernel, i plan to introduce a new
> SCHED_FIFO_GLOBAL scheduling policy to trigger this behavior. [it doesnt
> make much sense to extend SCHED_RR in that direction.]
>
> my gut feeling is that it would be wrong to integrate this feature into
> smpnice: SCHED_FIFO is about determinism, and smpnice is a fundamentally
> statistical approach. Also, smpnice doesnt have to try as hard to pick
> the right task as rt_overload does, so there would be constant
> 'friction' between "overhead" optimizations (dont be over-eager) and
> "latency" optimizations (dont be _under_-eager). So i'm quite sure we
> want this feature separate. [nevertheless i'd happy to be proven wrong
> via some good and working smpnice based solution]

I was thinking about this over night and came to similar conclusions.
I.e. for RT tasks it's really a problem of selecting the right CPU at
wake up time rather than a general load balancing problem. The solution
that I thought of was different (though) and involved modifying
wake_idle() so that when the woken task was high priority as well as
looking for idle CPUs it looked for the one with the lowest priority
current task and if it couldn't find an idle CPU it returned the one
with the lowest priority current task. The aim was to maximize the
probability that the newly woken task went straight onto a CPU (either
by finding an idle one or preemption).

Although aimed at this specific problem, this solution would also help
smpnice to attain equal "average load per task" values for groups/queues
which I think is a desirable secondary aim to equatable distribution of
weighted load. If both of these aims are met I think a natural outcome
would be that the highest priority tasks are well distributed among the
CPUs (but, as you imply, this would be a statistical trend rather than
an deterministic).

In summary, I think that smpnice can be modified in ways that will help
with this problem but if you need determinism then special measures are
probably necessary.

Peter
---
Peter Williams pwil3058@bigpond.net.au

"Learning, n. The kind of ignorance distinguishing the studious."
-- Ambrose Bierce
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

\
 
 \ /
  Last update: 2006-04-07 01:08    [W:0.229 / U:0.308 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site