lkml.org 
[lkml]   [2023]   [Mar]   [28]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    Patch in this message
    /
    Date
    SubjectRe: [PATCH v1 5/9] memcg: replace stats_flush_lock with an atomic
    From
    On Tue, Mar 28, 2023 at 06:16:34AM +0000, Yosry Ahmed wrote:
    [...]
    > @@ -585,8 +585,8 @@ mem_cgroup_largest_soft_limit_node(struct mem_cgroup_tree_per_node *mctz)
    > */
    > static void flush_memcg_stats_dwork(struct work_struct *w);
    > static DECLARE_DEFERRABLE_WORK(stats_flush_dwork, flush_memcg_stats_dwork);
    > -static DEFINE_SPINLOCK(stats_flush_lock);
    > static DEFINE_PER_CPU(unsigned int, stats_updates);
    > +static atomic_t stats_flush_ongoing = ATOMIC_INIT(0);
    > static atomic_t stats_flush_threshold = ATOMIC_INIT(0);
    > static u64 flush_next_time;
    >
    > @@ -636,15 +636,18 @@ static inline void memcg_rstat_updated(struct mem_cgroup *memcg, int val)
    >
    > static void __mem_cgroup_flush_stats(void)
    > {
    > - unsigned long flag;
    > -
    > - if (!spin_trylock_irqsave(&stats_flush_lock, flag))
    > + /*
    > + * We always flush the entire tree, so concurrent flushers can just
    > + * skip. This avoids a thundering herd problem on the rstat global lock
    > + * from memcg flushers (e.g. reclaim, refault, etc).
    > + */
    > + if (atomic_xchg(&stats_flush_ongoing, 1))

    Have you profiled this? I wonder if we should replace the above with

    if (atomic_read(&stats_flush_ongoing) || atomic_xchg(&stats_flush_ongoing, 1))

    to not always dirty the cacheline. This would not be an issue if there
    is no cacheline sharing but I suspect percpu stats_updates is sharing
    the cacheline with it and may cause false sharing with the parallel stat
    updaters (updaters only need to read the base percpu pointer).

    Other than that the patch looks good.

    \
     
     \ /
      Last update: 2023-03-28 16:16    [W:3.891 / U:0.020 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site