Messages in this thread |  | | Date | Wed, 12 Sep 2001 12:38:09 -0500 (CDT) | From | kelley eicher <> | Subject | Re: 2.4.9-10pre4 kernel: __alloc_pages errors |
| |
all-
after upgrading to the 2.4.10-pre6 kernel i still have no luck in avoiding alloc_pages() errors.
this time i have included an kernel oops dump by calling BUG() from mm/page_alloc.c immediately after the call to printk() that prints __alloc_pages errors. i have also included the `ksymoops` interpretation of that oops. coincidentally, i was able to grab a partial `cat` of /proc/slabinfo milliseonds before the oops so i've attached that as well.
again, the alloc_page() errors that i'm constantly seeing are 0-order with gfp=0x70/1
oops1.txt --------------------------------------------------------------
ofs1# more oops1.txt Sep 12 11:30:15 ofs1 kernel: __alloc_pages: 0-order allocation failed (gfp=0x70/1). Sep 12 11:30:15 ofs1 kernel: invalid operand: 0000 Sep 12 11:30:15 ofs1 kernel: CPU: 0 Sep 12 11:30:15 ofs1 kernel: EIP: 0010:[__alloc_pages+591/604] Sep 12 11:30:15 ofs1 kernel: EFLAGS: 00010286 Sep 12 11:30:15 ofs1 kernel: eax: 0000003a ebx: 00000000 ecx: f7df6000 edx: 00000000 Sep 12 11:30:15 ofs1 kernel: esi: c028b208 edi: 00000000 ebp: f7df6000 esp: f7df7e74 Sep 12 11:30:15 ofs1 kernel: ds: 0018 es: 0018 ss: 0018 Sep 12 11:30:15 ofs1 kernel: Process kswapd (pid: 4, stackpage=f7df7000) Sep 12 11:30:15 ofs1 kernel: Stack: 00000070 00000001 00000008 c02f7a00 00000001 c028b1fc 00000070 c012700e Sep 12 11:30:15 ofs1 kernel: c0415a20 c012a499 c0415a20 c012a5ac f4ac0240 00000001 00000008 c02f7a00 Sep 12 11:30:15 ofs1 kernel: c01a97c7 00000001 f4ac0240 00003009 f4ac0240 1f9f8d60 19a175af c02f7a28 Sep 12 11:30:15 ofs1 kernel: Call Trace: [_alloc_pages+22/24] [alloc_bounce_page+13/120] [create_bounce+40/380] [__make_request+135/1596] [ip_rcv+806/860] Sep 12 11:30:15 ofs1 kernel: [generic_make_request+288/304] [submit_bh+69/96] [ll_rw_block+299/396] [sync_page_buffers+71/84] [try_to_free_buffers+281/316] [page_launder+603/1376] Sep 12 11:30:15 ofs1 kernel: [do_try_to_free_pages+64/184] [kswapd+105/172] [kernel_thread+40/56] Sep 12 11:30:15 ofs1 kernel: Sep 12 11:30:15 ofs1 kernel: Code: 0f 0b 31 c0 5b 5e 5f 5d 83 c4 0c c3 90 83 fa 09 77 09 e8 82
--------------------------------------------------------------------------
ksymoops output: ---------------------------------------------------------
ofs1# ./ksymoops -m /kernel/System.map < oops1.txt ksymoops 2.4.2 on i686 2.4.10-pre6. Options used -V (default) -k /proc/ksyms (default) -l /proc/modules (default) -o /lib/modules/2.4.10-pre6/ (default) -m /kernel/System.map (specified)
Warning (compare_maps): mismatch on symbol partition_name , ksyms_base says c01f6a80, System.map says c0145bd0. Ignoring ksyms_base entry Sep 12 11:30:15 ofs1 kernel: invalid operand: 0000 Sep 12 11:30:15 ofs1 kernel: CPU: 0 Sep 12 11:30:15 ofs1 kernel: EIP: 0010:[__alloc_pages+591/604] Sep 12 11:30:15 ofs1 kernel: EFLAGS: 00010286 Sep 12 11:30:15 ofs1 kernel: eax: 0000003a ebx: 00000000 ecx: f7df6000 edx: 00000000 Sep 12 11:30:15 ofs1 kernel: esi: c028b208 edi: 00000000 ebp: f7df6000 esp: f7df7e74 Sep 12 11:30:15 ofs1 kernel: ds: 0018 es: 0018 ss: 0018 Sep 12 11:30:15 ofs1 kernel: Process kswapd (pid: 4, stackpage=f7df7000) Sep 12 11:30:15 ofs1 kernel: Stack: 00000070 00000001 00000008 c02f7a00 00000001 c028b1fc 00000070 c012700e Sep 12 11:30:15 ofs1 kernel: c0415a20 c012a499 c0415a20 c012a5ac f4ac0240 00000001 00000008 c02f7a00 Sep 12 11:30:15 ofs1 kernel: c01a97c7 00000001 f4ac0240 00003009 f4ac0240 1f9f8d60 19a175af c02f7a28 Sep 12 11:30:15 ofs1 kernel: Call Trace: [_alloc_pages+22/24] [alloc_bounce_page+13/120] [create_bounce+40/380] [__make_request+135/1596] [ip_rcv+806/860] Sep 12 11:30:15 ofs1 kernel: Code: 0f 0b 31 c0 5b 5e 5f 5d 83 c4 0c c3 90 83 fa 09 77 09 e8 82 Using defaults from ksymoops -t elf32-i386 -a i386
Code; 00000000 Before first symbol 00000000 <_EIP>: Code; 00000000 Before first symbol 0: 0f 0b ud2a Code; 00000002 Before first symbol 2: 31 c0 xorl %eax,%eax Code; 00000004 Before first symbol 4: 5b popl %ebx Code; 00000004 Before first symbol 5: 5e popl %esi Code; 00000006 Before first symbol 6: 5f popl %edi Code; 00000006 Before first symbol 7: 5d popl %ebp Code; 00000008 Before first symbol 8: 83 c4 0c addl $0xc,%esp Code; 0000000a Before first symbol b: c3 ret Code; 0000000c Before first symbol c: 90 nop Code; 0000000c Before first symbol d: 83 fa 09 cmpl $0x9,%edx Code; 00000010 Before first symbol 10: 77 09 ja 1b <_EIP+0x1b> 0000001a Before first symbol Code; 00000012 Before first symbol 12: e8 82 00 00 00 call 99 <_EIP+0x99> 00000098 Before first symbol
1 warning issued. Results may not be reliable. ofs1# --------------------------------------------------------------------------
/proc/slabinfo ---------------*partial*-----------------------------------
kmem_cache 58 68 112 2 2 1 ip_conntrack 25 33 352 3 3 1 tcp_tw_bucket 0 0 96 0 0 1 tcp_bind_bucket 9 113 32 1 1 1 tcp_open_request 0 0 64 0 0 1 inet_peer_cache 5 59 64 1 1 1 ip_fib_hash 10 113 32 1 1 1 ip_dst_cache 38 48 160 2 2 1 arp_cache 11 30 128 1 1 1 blkdev_requests 512 520 96 13 13 1 nfs_read_data 0 0 384 0 0 1 nfs_write_data 0 0 384 0 0 1 nfs_page 0 0 96 0 0 1 dnotify cache 0 0 20 0 0 1 file lock cache 2 42 92 1 1 1 fasync cache 0 0 16 0 0 1 uid_cache 6 113 32 1 1 1 skbuff_head_cache 229 264 160 11 11 1 sock 31 36 832 4 4 2 sigqueue 0 0 132 0 0 1 cdev_cache 16 59 64 1 1 1 bdev_cache 8 59 64 1 1 1
------------------------------------------------------------------------
i can probide any additional information neccessary to help you debug this problem.
for ease of use, i have attached the 3 files pasted above as oops1.txt, ksymoops1.txt and slabinfo1.txt respectively.
thanx, -kelley
ps: my thoughts to those of you with any family involved in yesterday's most heinous event.
ofs1# ./ksymoops -m /kernel/System.map < oops1.txt ksymoops 2.4.2 on i686 2.4.10-pre6. Options used -V (default) -k /proc/ksyms (default) -l /proc/modules (default) -o /lib/modules/2.4.10-pre6/ (default) -m /kernel/System.map (specified)
Warning (compare_maps): mismatch on symbol partition_name , ksyms_base says c01f6a80, System.map says c0145bd0. Ignoring ksyms_base entry Sep 12 11:30:15 ofs1 kernel: invalid operand: 0000 Sep 12 11:30:15 ofs1 kernel: CPU: 0 Sep 12 11:30:15 ofs1 kernel: EIP: 0010:[__alloc_pages+591/604] Sep 12 11:30:15 ofs1 kernel: EFLAGS: 00010286 Sep 12 11:30:15 ofs1 kernel: eax: 0000003a ebx: 00000000 ecx: f7df6000 edx: 00000000 Sep 12 11:30:15 ofs1 kernel: esi: c028b208 edi: 00000000 ebp: f7df6000 esp: f7df7e74 Sep 12 11:30:15 ofs1 kernel: ds: 0018 es: 0018 ss: 0018 Sep 12 11:30:15 ofs1 kernel: Process kswapd (pid: 4, stackpage=f7df7000) Sep 12 11:30:15 ofs1 kernel: Stack: 00000070 00000001 00000008 c02f7a00 00000001 c028b1fc 00000070 c012700e Sep 12 11:30:15 ofs1 kernel: c0415a20 c012a499 c0415a20 c012a5ac f4ac0240 00000001 00000008 c02f7a00 Sep 12 11:30:15 ofs1 kernel: c01a97c7 00000001 f4ac0240 00003009 f4ac0240 1f9f8d60 19a175af c02f7a28 Sep 12 11:30:15 ofs1 kernel: Call Trace: [_alloc_pages+22/24] [alloc_bounce_page+13/120] [create_bounce+40/380] [__make_request+135/1596] [ip_rcv+806/860] Sep 12 11:30:15 ofs1 kernel: Code: 0f 0b 31 c0 5b 5e 5f 5d 83 c4 0c c3 90 83 fa 09 77 09 e8 82 Using defaults from ksymoops -t elf32-i386 -a i386
Code; 00000000 Before first symbol 00000000 <_EIP>: Code; 00000000 Before first symbol 0: 0f 0b ud2a Code; 00000002 Before first symbol 2: 31 c0 xorl %eax,%eax Code; 00000004 Before first symbol 4: 5b popl %ebx Code; 00000004 Before first symbol 5: 5e popl %esi Code; 00000006 Before first symbol 6: 5f popl %edi Code; 00000006 Before first symbol 7: 5d popl %ebp Code; 00000008 Before first symbol 8: 83 c4 0c addl $0xc,%esp Code; 0000000a Before first symbol b: c3 ret Code; 0000000c Before first symbol c: 90 nop Code; 0000000c Before first symbol d: 83 fa 09 cmpl $0x9,%edx Code; 00000010 Before first symbol 10: 77 09 ja 1b <_EIP+0x1b> 0000001a Before first symbol Code; 00000012 Before first symbol 12: e8 82 00 00 00 call 99 <_EIP+0x99> 00000098 Before first symbol
1 warning issued. Results may not be reliable. ofs1# kmem_cache 58 68 112 2 2 1 ip_conntrack 25 33 352 3 3 1 tcp_tw_bucket 0 0 96 0 0 1 tcp_bind_bucket 9 113 32 1 1 1 tcp_open_request 0 0 64 0 0 1 inet_peer_cache 5 59 64 1 1 1 ip_fib_hash 10 113 32 1 1 1 ip_dst_cache 38 48 160 2 2 1 arp_cache 11 30 128 1 1 1 blkdev_requests 512 520 96 13 13 1 nfs_read_data 0 0 384 0 0 1 nfs_write_data 0 0 384 0 0 1 nfs_page 0 0 96 0 0 1 dnotify cache 0 0 20 0 0 1 file lock cache 2 42 92 1 1 1 fasync cache 0 0 16 0 0 1 uid_cache 6 113 32 1 1 1 skbuff_head_cache 229 264 160 11 11 1 sock 31 36 832 4 4 2 sigqueue 0 0 132 0 0 1 cdev_cache 16 59 64 1 1 1 bdev_cache 8 59 64 1 1 1 Sep 12 11:30:15 ofs1 kernel: __alloc_pages: 0-order allocation failed (gfp=0x70/1). Sep 12 11:30:15 ofs1 kernel: invalid operand: 0000 Sep 12 11:30:15 ofs1 kernel: CPU: 0 Sep 12 11:30:15 ofs1 kernel: EIP: 0010:[__alloc_pages+591/604] Sep 12 11:30:15 ofs1 kernel: EFLAGS: 00010286 Sep 12 11:30:15 ofs1 kernel: eax: 0000003a ebx: 00000000 ecx: f7df6000 edx: 00000000 Sep 12 11:30:15 ofs1 kernel: esi: c028b208 edi: 00000000 ebp: f7df6000 esp: f7df7e74 Sep 12 11:30:15 ofs1 kernel: ds: 0018 es: 0018 ss: 0018 Sep 12 11:30:15 ofs1 kernel: Process kswapd (pid: 4, stackpage=f7df7000) Sep 12 11:30:15 ofs1 kernel: Stack: 00000070 00000001 00000008 c02f7a00 00000001 c028b1fc 00000070 c012700e Sep 12 11:30:15 ofs1 kernel: c0415a20 c012a499 c0415a20 c012a5ac f4ac0240 00000001 00000008 c02f7a00 Sep 12 11:30:15 ofs1 kernel: c01a97c7 00000001 f4ac0240 00003009 f4ac0240 1f9f8d60 19a175af c02f7a28 Sep 12 11:30:15 ofs1 kernel: Call Trace: [_alloc_pages+22/24] [alloc_bounce_page+13/120] [create_bounce+40/380] [__make_request+135/1596] [ip_rcv+806/860] Sep 12 11:30:15 ofs1 kernel: [generic_make_request+288/304] [submit_bh+69/96] [ll_rw_block+299/396] [sync_page_buffers+71/84] [try_to_free_buffers+281/316] [page_launder+603/1376] Sep 12 11:30:15 ofs1 kernel: [do_try_to_free_pages+64/184] [kswapd+105/172] [kernel_thread+40/56] Sep 12 11:30:15 ofs1 kernel: Sep 12 11:30:15 ofs1 kernel: Code: 0f 0b 31 c0 5b 5e 5f 5d 83 c4 0c c3 90 83 fa 09 77 09 e8 82
|  |