Messages in this thread | | | Subject | Limit hash table size | Date | Thu, 8 Jan 2004 15:12:16 -0800 | From | "Chen, Kenneth W" <> |
| |
The issue of exceedingly large hash tables has been discussed on the mailing list a while back, but seems to slip through the cracks.
What we found is it's not a problem for x86 (and most other architectures) because __get_free_pages won't be able to get anything beyond order MAX_ORDER-1 (10) which means at most those hash tables are 4MB each (assume 4K page size). However, on ia64, in order to support larger hugeTLB page size, the MAX_ORDER is bumped up to 18, which now means a 2GB upper limits enforced by the page allocator (assume 16K page size). PPC64 is another example that bumps up MAX_ORDER.
Last time I checked, the tcp ehash table is taking a whooping (insane!) 2GB on one of our large machine. dentry and inode hash tables also take considerable amount of memory.
This patch just enforces all the hash tables to have a max order of 10, which limits them down to 16MB each on ia64. People can clean up other part of table size calculation. But minimally, this patch doesn't change any hash sizes already in use on x86.
Andrew, would you please apply?
- Ken Chen <<hashtable.patch>> [unhandled content-type:application/octet-stream] | |