[lkml]   [2005]   [Jun]   [3]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    SubjectRe: Avoiding external fragmentation with a placement policy Version 12
    On Fri, 3 Jun 2005, Nick Piggin wrote:

    > On Thu, 2005-06-02 at 10:52 -0500, Joel Schopp wrote:
    > > > I see your point... Mel's patch has failure cases though.
    > > > For example, someone turns swap off, or mlocks some memory
    > > > (I guess we then add the page migration defrag patch and
    > > > problem is solved?).
    > >
    > > This reminds me that page migration defrag will be pretty useless
    > > without something like this done first. There will be stuff that can't
    > > be migrated and it needs to be grouped together somehow.
    > >
    > > In summary here are the reasons I see to run with Mel's patch:
    > >
    > > 1. It really helps with medium-large allocations under memory pressure.
    > > 2. Page migration defrag will need it.
    > > 3. Memory hotplug remove will need it.
    > >
    > I guess I'm now more convinced of its need ;)
    > add:
    > 4. large pages
    > 5. (hopefully) helps with smaller allocations (ie. order 3)

    6. Avoid calls to the page allocator

    If a subsystem needs 8 pages to do a job, it should only have to call the
    allocator once, not 8 times only to spend more time breaking the work up
    into page-sized chunks.

    If you look at rmqueue_bulk() in the patch, you'll see that it tries to
    fill the per-cpu lists of order-0 pages with one call to the allocator
    which saved some time. The additional statistics patch shows how many of
    these bulk requests are made and what sizes were actually allocated. It
    shows that a sizable number of additional calls to the buddy allocator are

    > It would really help your cause in the short term if you can
    > demonstrate improvements for say order-3 allocations (eg. use
    > gige networking, TSO, jumbo frames, etc).

    I will work on this early next week unless someone else does not beat me
    to it. Right now, I need to catch a flight and I'll be offline for a few

    Once I start, I'm going to be running tests on network filesystems mounted
    on the loopback device to see what sort of results I find.

    > > On the downside we have:
    > >
    > > 1. Slightly more complexity in the allocator.
    > >
    > For some definitions of 'slightly', perhaps :(

    Does it need more documentation? If so, I'll write up a detailed blurb on
    how it works and drop it into Documentation/

    > Although I can't argue that a buddy allocator is no good without
    > being able to satisfy higher order allocations.

    Unfortunately, it is a fundemental flaw of the buddy allocator that it
    fragments badly. The thing is, other allocators that do not fragment are
    also slower.

    > So in that case, I'm personally OK with it going into -mm. Hopefully
    > there will be a bit more review and hopefully some simplification if
    > possible.

    Fingers crossed. I would be very interested to see anything that makes it

    > Last question: how does it go on systems with really tiny memories?
    > (4MB, 8MB, that kind of thing).

    I tested it with mem=16M (anything lower and my machine doesn't boot the
    standard kernel with going OOM, let alone the patched one). There was no
    significant change in performance of the aim9 benchmarks. The additional
    memory overhead of the patch is insignificant.

    However, at low memory, the fragmentation strategy does not work unless
    MAX_ORDER is also dropped. As the block reservations are 2^MAX_ORDER in
    size, there is no point reserving anything if the system only has 4
    MAX_ORDER blocks to being with.

    Mel Gorman
    Part-time Phd Student Java Applications Developer
    University of Limerick IBM Dublin Software Lab
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to
    More majordomo info at
    Please read the FAQ at

     \ /
      Last update: 2005-06-03 15:09    [W:3.815 / U:0.820 seconds]
    ©2003-2017 Jasper Spaans. hosted at Digital OceanAdvertise on this site