lkml.org 
[lkml]   [2018]   [Apr]   [12]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    Date
    From
    SubjectRe: [PATCH 1/3] mm: introduce NR_INDIRECTLY_RECLAIMABLE_BYTES
    On Thu 12-04-18 15:38:33, Roman Gushchin wrote:
    > On Thu, Apr 12, 2018 at 01:52:17PM +0200, Michal Hocko wrote:
    > > On Thu 12-04-18 08:52:52, Vlastimil Babka wrote:
    > > > On 04/11/2018 03:56 PM, Roman Gushchin wrote:
    > > > > On Wed, Apr 11, 2018 at 03:16:08PM +0200, Vlastimil Babka wrote:
    > > [...]
    > > > >> With that in mind, can we at least for now put the (manually maintained)
    > > > >> byte counter in a variable that's not directly exposed via /proc/vmstat,
    > > > >> and then when printing nr_slab_reclaimable, simply add the value
    > > > >> (divided by PAGE_SIZE), and when printing nr_slab_unreclaimable,
    > > > >> subtract the same value. This way we would be simply making the existing
    > > > >> counters more precise, in line with their semantics.
    > > > >
    > > > > Idk, I don't like the idea of adding a counter outside of the vm counters
    > > > > infrastructure, and I definitely wouldn't touch the exposed
    > > > > nr_slab_reclaimable and nr_slab_unreclaimable fields.
    > >
    > > Why?
    >
    > Both nr_slab_reclaimable and nr_slab_unreclaimable have a very simple
    > meaning: they are numbers of pages used by corresponding slab caches.

    Right, but if names are reclaimable then they should end up in the
    reclaimable slabs and to be accounted as such. Objects themselves are
    not sufficient to reclaim the accounted memory.

    > In the answer to the very first version of this patchset
    > Andrew suggested to generalize the idea to allow further
    > accounting of non-kmalloc() allocations.
    > I like the idea, even if don't have a good example right now.

    Well, I have to disagree here. It sounds completely ad-hoc without
    a reasoable semantic. Or how does it help users when they do not know
    what is the indirect dependency and how to trigger it.

    > The problem with external names existed for many years before
    > we've accidentally hit it, so if we don't have other examples
    > right now, it doesn't mean that we wouldn't have them in the future.
    >
    > >
    > > > We would be just making the reported values more precise wrt reality.
    > >
    > > I was suggesting something similar in an earlier discussion. I am not
    > > really happy about the new exposed counter either. It is just arbitrary
    > > by name yet very specific for this particular usecase.
    > >
    > > What is a poor user supposed to do with the new counter? Can this be
    > > used for any calculations?
    >
    > For me the most important part is to fix the overcommit logic, because it's
    > a real security and production issue.

    Sure, the problem is ugly. Not the first one when the unaccounted kernel
    allocation can eat a lot of memory. We have many other such. The usual
    answer was to use kmemcg accounting.

    --
    Michal Hocko
    SUSE Labs

    \
     
     \ /
      Last update: 2018-04-12 16:47    [W:3.998 / U:0.348 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site