Messages in this thread | | | Date | Wed, 09 May 2007 09:43:02 +1000 | From | Nick Piggin <> | Subject | Re: [PATCH] MM: implement MADV_FREE lazy freeing of anonymous memory |
| |
Jakub Jelinek wrote: > On Tue, May 08, 2007 at 04:12:00PM +1000, Nick Piggin wrote: > >>I didn't actually check system and user times for the mysql >>benchmark, but that's exactly what I had in mind when I >>mentioned the poor cache behaviour this patch could cause. I >>definitely did see user times go up in benchmarks where I >>measured. >> >>We have percpu and cache affine page allocators, so when >>userspace just frees a page, it is likely to be cache hot, so >>we want to free it up so it can be reused by this CPU ASAP. >>Likewise, when we newly allocate a page, we want it to be one >>that is cache hot on this CPU. > > > malloc has per-thread arenas, so when using MADV_FREE the pages > should be local to the thread as well (unless the thread has switched > to a different CPU also to the CPU) and in case of sysbench should > be cache hot as well (it is reused RSN).
Right, but the kernel also wants to use cache hot pages for other things, and it also frees back its own cache hot pages into the allocator.
The fact that sysbench is a good candidate for this but does not show any improvements is telling... if the workload does not reuse the page RSN, or if it is reclaiming them, we could actually see regressions.
> With MADV_DONTNEED you need to > clear the pages while that is not necessary with MADV_FREE.
With MADV_FREE, you don't need to zero the memory, but the page is uninitialised. So you need to initialise it *somehow* (ie. use either a zeroing alloc, or initialise it with application specific data). At that point, you have to touch the cachelines anyway, so the extra zeroing is going to cost very little (and you can see that single threaded performance isn't improved).
-- SUSE Labs, Novell Inc. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
| |