Messages in this thread | | | Date | Fri, 01 May 2009 17:46:43 -0400 | From | Rik van Riel <> | Subject | Re: [PATCH] vmscan: evict use-once pages first (v2) |
| |
Andrew Morton wrote: > On Fri, 01 May 2009 16:05:55 -0400 > Rik van Riel <riel@redhat.com> wrote: > >> Are you open to evaluating other methods that could lead, on >> desktop systems, to a behaviour similar to the one achieved >> by the preserve-mapped-pages mechanism? > > Well.. it's more a matter of retaining what we've learnt (unless we > feel it's wrong, or technilogy change broke it) and carefully listening > to and responding to what's happening in out-there land.
Treating mapped pages specially is a bad implementation, because it does not scale. The reason is the same reason we dropped "treat referenced active file pages special" right before the split LRU code was merged by Linus.
Also, it does not help workloads that have a large number of unmapped pages, where we want to protect the frequently used ones from a giant stream of used-once pages. NFS and FTP servers would be a typical example of this, but so would a database server with postgres or mysql in a default setup.
> The number of problem reports we're seeing from the LRU changes is > pretty low. Hopefully that's because the number of problems _is_ > low.
I believe the number of problems is low. However, the severity of this particular problem means that we'll probably want to do something about it.
> Given the low level of problem reports, the relative immaturity of the > code and our difficulty with determining what effect our changes will > have upon everyone, I'd have thought that sit-tight-and-wait-and-see > would be the prudent approach for the next few months. > > otoh if you have a change and it proves good in your testing then sure, > sooner rather than later.
I believe the patch I submitted in this thread should fix the problem. I have experimented with the patch before and Elladan's results show that the situation is resolved for him.
Furthermore, Peter and I believe the patch has a minimal risk of side effects.
Of course, there may be better ideas yet. It would be nice if people could try to shoot holes in the concept of the patch - if anybody can even think of a way in which it could break, we can try to come up with a way of fixing it.
> I still haven't forgotten prev_priority tho!
The whole priority thing could be(come) a problem too, with us scanning WAY too many pages at once in a gigantic memory zone. Scanning a million pages at once will probably lead to unacceptable latencies somewhere :)
-- All rights reversed.
| |