Messages in this thread Patch in this message | | | Date | Thu, 20 Aug 2009 10:49:29 +0800 | From | Wu Fengguang <> | Subject | [PATCH] mm: do batched scans for mem_cgroup |
| |
For mem_cgroup, shrink_zone() may call shrink_list() with nr_to_scan=1, in which case shrink_list() _still_ calls isolate_pages() with the much larger SWAP_CLUSTER_MAX. It effectively scales up the inactive list scan rate by up to 32 times.
For example, with 16k inactive pages and DEF_PRIORITY=12, (16k >> 12)=4. So when shrink_zone() expects to scan 4 pages in the active/inactive list, it will be scanned SWAP_CLUSTER_MAX=32 pages in effect.
The accesses to nr_saved_scan are not lock protected and so not 100% accurate, however we can tolerate small errors and the resulted small imbalanced scan rates between zones.
This batching won't blur up the cgroup limits, since it is driven by "pages reclaimed" rather than "pages scanned". When shrink_zone() decides to cancel (and save) one smallish scan, it may well be called again to accumulate up nr_saved_scan.
It could possibly be a problem for some tiny mem_cgroup (which may be _full_ scanned too much times in order to accumulate up nr_saved_scan).
CC: Rik van Riel <riel@redhat.com> CC: Minchan Kim <minchan.kim@gmail.com> CC: Balbir Singh <balbir@linux.vnet.ibm.com> CC: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com> CC: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com> Signed-off-by: Wu Fengguang <fengguang.wu@intel.com> --- include/linux/memcontrol.h | 3 +++ mm/memcontrol.c | 12 ++++++++++++ mm/vmscan.c | 9 +++++---- 3 files changed, 20 insertions(+), 4 deletions(-)
--- linux.orig/include/linux/memcontrol.h 2009-08-20 10:41:05.000000000 +0800 +++ linux/include/linux/memcontrol.h 2009-08-20 10:43:22.000000000 +0800 @@ -98,6 +98,9 @@ int mem_cgroup_inactive_file_is_low(stru unsigned long mem_cgroup_zone_nr_pages(struct mem_cgroup *memcg, struct zone *zone, enum lru_list lru); +unsigned long *mem_cgroup_get_saved_scan(struct mem_cgroup *memcg, + struct zone *zone, + enum lru_list lru); struct zone_reclaim_stat *mem_cgroup_get_reclaim_stat(struct mem_cgroup *memcg, struct zone *zone); struct zone_reclaim_stat* --- linux.orig/mm/memcontrol.c 2009-08-20 10:43:20.000000000 +0800 +++ linux/mm/memcontrol.c 2009-08-20 10:43:22.000000000 +0800 @@ -115,6 +115,7 @@ struct mem_cgroup_per_zone { */ struct list_head lists[NR_LRU_LISTS]; unsigned long count[NR_LRU_LISTS]; + unsigned long nr_saved_scan[NR_LRU_LISTS]; struct zone_reclaim_stat reclaim_stat; }; @@ -597,6 +598,17 @@ unsigned long mem_cgroup_zone_nr_pages(s return MEM_CGROUP_ZSTAT(mz, lru); } +unsigned long *mem_cgroup_get_saved_scan(struct mem_cgroup *memcg, + struct zone *zone, + enum lru_list lru) +{ + int nid = zone->zone_pgdat->node_id; + int zid = zone_idx(zone); + struct mem_cgroup_per_zone *mz = mem_cgroup_zoneinfo(memcg, nid, zid); + + return &mz->nr_saved_scan[lru]; +} + struct zone_reclaim_stat *mem_cgroup_get_reclaim_stat(struct mem_cgroup *memcg, struct zone *zone) { --- linux.orig/mm/vmscan.c 2009-08-20 10:40:56.000000000 +0800 +++ linux/mm/vmscan.c 2009-08-20 10:43:22.000000000 +0800 @@ -1534,6 +1534,7 @@ static void shrink_zone(int priority, st for_each_evictable_lru(l) { int file = is_file_lru(l); unsigned long scan; + unsigned long *saved_scan; scan = zone_nr_pages(zone, sc, l); if (priority || noswap) { @@ -1541,11 +1542,11 @@ static void shrink_zone(int priority, st scan = (scan * percent[file]) / 100; } if (scanning_global_lru(sc)) - nr[l] = nr_scan_try_batch(scan, - &zone->lru[l].nr_saved_scan, - swap_cluster_max); + saved_scan = &zone->lru[l].nr_saved_scan; else - nr[l] = scan; + saved_scan = mem_cgroup_get_saved_scan(sc->mem_cgroup, + zone, l); + nr[l] = nr_scan_try_batch(scan, saved_scan, swap_cluster_max); } while (nr[LRU_INACTIVE_ANON] || nr[LRU_ACTIVE_FILE] ||
| |