Messages in this thread |  | | | Date | Tue, 07 Oct 2008 09:38:28 -0500 | | From | Christoph Lameter <> | | Subject | Re: [PATCH 3/3] Convert the UDP hash lock to RCU |
| |
Evgeniy Polyakov wrote: > On Tue, Oct 07, 2008 at 09:16:13AM -0500, Christoph Lameter (cl@linux-foundation.org) wrote: >>> I tested skb destruction via RCU path, and got 2.5 times worse numbers >>> with small-packets-bulk-transfer workload. >> Was this with regular RCU freeing? This will cool down the cacheline before >> frees. You need SLAB_DESTROY_BY_RCU to keep the objects cache hot. > > I believe there were no SLAB_DESTROY_BY_RCU 2 yars ago :)
Its been awhile. Hugh created it
> It was pure call_rcu(&skb->rcu, real_skb_freeing), where > real_skb_freeing() just did usual kfree().
Right. That results in cacheline cooldown. You'd want to recycle the object as they are cache hot on a per cpu basis. That is screwed up by the delayed regular rcu processing. We have seen multiple regressions due to cacheline cooldown.
The only choice in cacheline hot sensitive areas is to deal with the complexity that comes with SLAB_DESTROY_BY_RCU or give up on RCU.
|  |