Messages in this thread | | | Date | Fri, 13 Nov 1998 14:06:21 +0300 | From | Vladimir Ivaschenok <> | Subject | 2.0.35 crash report |
| |
Several days ago I had a 2.0.35 crash on one of my servers (MII-166 CPU, IWILL motherboard). This happened for the first time on this machine and didn't ever happen again. RedHat 4.2 libc5+glibc 2.0.6. An interesting fact that server was half-functioning after the first Oops for sometime, i.e. telnet didnt work (never gave a login:), while ftpd, nfs were ok. I didn't wait until it went fully dead - it was night, and I wanted to sleep (I wasn't at the office), but I assume that it did. In the morning the server was rebooted without me. Here is some info saved to my log, bzImage is available on request :) :
Nov 8 01:21:27 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24 Nov 8 01:21:27 bbs kernel: current->tss.cr3 = 02ce7000, 4r3 = 02ce7000 Nov 8 01:21:27 bbs kernel: *pde = 00000000 Nov 8 01:21:27 bbs kernel: Oops: 0002 Nov 8 01:21:27 bbs kernel: CPU: 0 Nov 8 01:21:28 bbs kernel: EIP: 0010:[refill_freelist+485/1144] Nov 8 01:21:28 bbs kernel: EFLAGS: 00010206 Nov 8 01:21:28 bbs kernel: eax: 00000000 ebx: 035de198 ecx: 035de198 edx: 12c3bb18 Nov 8 01:21:28 bbs kernel: esi: 00000000 edi: 00000400 ebp: 0000d400 esp: 00e9ce5c Nov 8 01:21:28 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018 Nov 8 01:21:28 bbs kernel: Process find (pid: 8756, process nr: 34, stackpage=00e9c000) Nov 8 01:21:28 bbs kernel: Stack: 002aa010 001f1603 00000001 002aa010 00000009 000000be 000024f7 00000b31 Nov 8 01:21:28 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 002aa010 001f2c14 Nov 8 01:21:28 bbs kernel: 02530700 00000580 00000001 0012661e 00001603 002aa010 00000400 000003e8 Nov 8 01:21:28 bbs kernel: Call Trace: [getblk+854/952] [bread+22/120] [ext2_read_inode+244/848] [__iget+302/544] [ext2_lookup+129/364] [ext2_lookup+179/364] [lookup+221/244] Nov 8 01:21:28 bbs kernel: [_namei+83/216] [lnamei+44/68] [sys_newlstat+39/84] [system_call+85/128] Nov 8 01:21:28 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74 Nov 8 01:21:28 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24 Nov 8 01:21:28 bbs kernel: current->tss.cr3 = 00449000, 4r3 = 00449000 Nov 8 01:21:28 bbs kernel: *pde = 00000000 Nov 8 01:21:28 bbs kernel: Oops: 0002 Nov 8 01:21:28 bbs kernel: CPU: 0 Nov 8 01:21:28 bbs kernel: EIP: 0010:[refill_freelist+485/1144] Nov 8 01:21:28 bbs kernel: EFLAGS: 00010206 Nov 8 01:21:28 bbs kernel: eax: 00000000 ebx: 017e4d8c ecx: 035de198 edx: 12c3bb18 Nov 8 01:21:28 bbs kernel: esi: 00000000 edi: 00000098 ebp: 00010000 esp: 017e4d74 Nov 8 01:21:28 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018 Nov 8 01:21:28 bbs kernel: Process sort (pid: 8757, process nr: 36, stackpage=017e4000) Nov 8 01:21:28 bbs kernel: Stack: 000009ba 001f0342 00000001 000029b4 000009ba 000000be 000024fd 00000b16 Nov 8 01:21:28 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 000009ba 001f2758 Nov 8 01:21:28 bbs kernel: 0009cc00 000029b4 00000001 0015c775 00000342 000029b4 00000400 000029b4 Nov 8 01:21:28 bbs kernel: Call Trace: [getblk+854/952] [ext2_new_block+2077/2348] [getblk+53/952] [ext2_alloc_block+359/376] [inode_getblk+234/408] [ext2_getblk+183/528] [ext2_file_write+387/1112] Nov 8 01:21:28 bbs kernel: [ext2_create+335/356] [do_no_page+436/776] [do_no_page+382/776] [do_no_page+0/776] [sys_write+325/384] [error_code+64/80] [system_call+85/128] Nov 8 01:21:28 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74 Nov 8 01:21:38 bbs named[493]: unapproved query from [10.0.1.10].1034 for "blkseanet.com" Nov 8 01:22:17 bbs named[493]: unapproved query from [10.0.1.10].1035 for "esrouter" Nov 8 01:22:36 bbs named[493]: unapproved query from [10.0.1.10].1036 for "\164\249\255" Nov 8 01:22:38 bbs named[493]: unapproved query from [10.0.1.10].1037 for "\164\249\255" Nov 8 01:22:41 bbs named[493]: unapproved query from [10.0.1.10].1038 for "www.\164\249\255.com" Nov 8 01:22:43 bbs named[493]: unapproved query from [10.0.1.10].1039 for "www.\164\249\255.edu" Nov 8 01:22:46 bbs named[493]: unapproved query from [10.0.1.10].1040 for "www.\164\249\255.org" Nov 8 01:22:48 bbs named[493]: unapproved query from [10.0.1.10].1041 for "\164\249\255.com" Nov 8 01:22:50 bbs named[493]: unapproved query from [10.0.1.10].1042 for "\164\249\255.edu" Nov 8 01:22:53 bbs named[493]: unapproved query from [10.0.1.10].1043 for "\164\249\255.org" Nov 8 01:22:59 bbs named[493]: unapproved query from [10.0.1.10].1044 for "home.microsoft.com" Nov 8 01:23:07 bbs named[493]: unapproved query from [10.0.1.10].1045 for "blkseanet.com" Nov 8 01:23:10 bbs named[493]: unapproved query from [10.0.1.10].1046 for "www.\164\249\255.com" Nov 8 01:23:10 bbs named[493]: unapproved query from [10.0.1.10].1047 for "blkseanet.com" Nov 8 01:24:08 bbs named[493]: unapproved query from [10.0.1.10].1048 for "www.blkseanet.com" Nov 8 01:24:19 bbs named[493]: unapproved query from [10.0.1.10].1049 for "www.microsoft.com" Nov 8 01:24:59 bbs named[493]: unapproved query from [10.0.1.10].1050 for "www.blkseanet.com" Nov 8 01:25:10 bbs named[493]: unapproved query from [10.0.1.10].1051 for "www.iechannelguide.com" Nov 8 01:25:20 bbs gated[32054]: trace_rotate: rotating /var/log/gated.log Nov 8 01:25:20 bbs gated[32054]: trace_on: tracing to "/var/log/gated.log" started Nov 8 01:25:23 bbs named[493]: unapproved query from [10.0.1.10].1052 for "www.iechannelguide.com" Nov 8 01:25:25 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24 Nov 8 01:25:25 bbs kernel: current->tss.cr3 = 0293b000, 4r3 = 0293b000 Nov 8 01:25:25 bbs kernel: *pde = 00000000 Nov 8 01:25:25 bbs kernel: Oops: 0002 Nov 8 01:25:25 bbs kernel: CPU: 0 Nov 8 01:25:25 bbs kernel: EIP: 0010:[refill_freelist+485/1144] Nov 8 01:25:25 bbs kernel: EFLAGS: 00010206 Nov 8 01:25:25 bbs kernel: eax: 00000000 ebx: 02829e54 ecx: 035de198 edx: 12c3bb18 Nov 8 01:25:25 bbs kernel: esi: 00000000 edi: 00000098 ebp: 0000f000 esp: 02829e3c Nov 8 01:25:25 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018 Nov 8 01:25:25 bbs kernel: Process in.nnrpd (pid: 9035, process nr: 69, stackpage=02829000) Nov 8 01:25:25 bbs kernel: Stack: 001fc0d8 001f1603 00000001 001fc0d8 001fc0d8 000000be 00002550 00000a8b Nov 8 01:25:25 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 001fc0d8 001f2c14 Nov 8 01:25:25 bbs kernel: 0186fc00 00032400 00000001 0012661e 00001603 001fc0d8 00000400 000003e8 Nov 8 01:25:25 bbs kernel: Call Trace: [getblk+854/952] [bread+22/120] [ext2_read_inode+244/848] [__iget+302/544] [ext2_lookup+341/364] [lookup+221/244] [open_namei+516/1032] Nov 8 01:25:25 bbs kernel: [do_open+87/284] [sys_open+57/112] [system_call+85/128] Nov 8 01:25:25 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74 Nov 8 01:28:10 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24 Nov 8 01:28:10 bbs kernel: current->tss.cr3 = 01b18000, 4r3 = 01b18000 Nov 8 01:28:10 bbs kernel: *pde = 00000000 Nov 8 01:28:10 bbs kernel: Oops: 0002 Nov 8 01:28:10 bbs kernel: CPU: 0 Nov 8 01:28:10 bbs kernel: EIP: 0010:[refill_freelist+485/1144] Nov 8 01:28:10 bbs kernel: EFLAGS: 00010206 Nov 8 01:28:10 bbs kernel: eax: 00000000 ebx: 03c6ddd4 ecx: 035de198 edx: 12c3bb18 Nov 8 01:28:10 bbs kernel: esi: 00000000 edi: 00000098 ebp: 0000e000 esp: 03c6ddbc Nov 8 01:28:10 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018 Nov 8 01:28:10 bbs kernel: Process gated (pid: 32054, process nr: 51, stackpage=03c6d000) Nov 8 01:28:10 bbs kernel: Stack: 002721d6 03c61603 00000001 002721d6 002721d6 000000be 00002530 00000a55 Nov 8 01:28:10 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 002721d6 03c6def4 Nov 8 01:28:10 bbs kernel: 001f2c14 002721d6 00000001 0015e72e 00001603 002721d6 00000400 00000000 Nov 8 01:28:10 bbs kernel: Call Trace: [getblk+854/952] [ext2_alloc_block+122/376] [getblk+53/952] [block_getblk+347/612] [ext2_getblk+253/528] [ext2_file_write+387/1112] [sys_write+325/384] Nov 8 01:28:10 bbs kernel: [sys_gettimeofday+44/112] [system_call+85/128] Nov 8 01:28:10 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74 Nov 8 01:35:37 bbs named[493]: unapproved query from [10.0.1.12].1076 for "www.vitalsigns.com" Nov 8 01:35:37 bbs named[493]: unapproved query from [10.0.1.12].1077 for "www.vitalsigns.com" Nov 8 01:54:42 bbs named[493]: unapproved query from [10.0.1.10].1053 for "blkseanet.com" Nov 8 01:57:12 bbs named[493]: unapproved query from [10.0.1.10].1054 for "blkseanet.com" Nov 8 02:01:00 bbs gdc: performing a "gdc start" command for user root Nov 8 02:01:09 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24
Here the log stops - seems that syslog died. In the morning the server is rebooted, and the logging starts again, I saved it so you could see kernel configuration:
Nov 8 10:37:30 bbs syslogd 1.3-3: restart. Nov 8 10:37:30 bbs kernel: klogd 1.3-3, log source = /proc/kmsg started. Nov 8 10:37:30 bbs kernel: Loaded 4176 symbols from /usr/src/linux/System.map. Nov 8 10:37:30 bbs kernel: Symbols match kernel version 2.0.35. Nov 8 10:37:31 bbs kernel: Loaded 21 symbols from 5 modules. Nov 8 10:37:31 bbs kernel: Console: 16 point font, 400 scans Nov 8 10:37:31 bbs kernel: Console: colour VGA+ 80x25, 1 virtual console (max 63) Nov 8 10:37:31 bbs kernel: pcibios_init : BIOS32 Service Directory structure at 0x000facd0 Nov 8 10:37:31 bbs kernel: pcibios_init : BIOS32 Service Directory entry at 0xfb150 Nov 8 10:37:31 bbs kernel: pcibios_init : PCI BIOS revision 2.10 entry at 0xfb180 Nov 8 10:37:31 bbs kernel: Probing PCI hardware. Nov 8 10:37:31 bbs kernel: Calibrating delay loop.. ok - 133.12 BogoMIPS Nov 8 10:37:31 bbs kernel: Memory: 63092k/65536k available (728k kernel code, 384k reserved, 1332k data) Nov 8 10:37:31 bbs kernel: This processor honours the WP bit even when in supervisor mode. Good. Nov 8 10:37:31 bbs kernel: Swansea University Computer Society NET3.035 for Linux 2.0 Nov 8 10:37:31 bbs kernel: NET3: Unix domain sockets 0.13 for Linux NET3.035. Nov 8 10:37:31 bbs kernel: Swansea University Computer Society TCP/IP for NET3.034 Nov 8 10:37:31 bbs kernel: IP Protocols: IGMP, ICMP, UDP, TCP Nov 8 10:37:31 bbs kernel: Linux IP multicast router 0.07. Nov 8 10:37:31 bbs kernel: VFS: Diskquotas version dquot_5.6.0 initialized Nov 8 10:37:31 bbs kernel: Nov 8 10:37:31 bbs kernel: Checking 386/387 coupling... Ok, fpu using exception 16 error reporting. Nov 8 10:37:31 bbs kernel: Checking 'hlt' instruction... Ok. Nov 8 10:37:31 bbs kernel: Linux version 2.0.35 (root@bbs.blkseanet.ru) (gcc version 2.7.2) #15 Thu Oct 22 02:35:42 MSK 1998 Nov 8 10:37:31 bbs kernel: Starting kswapd v 1.4.2.2 Nov 8 10:37:31 bbs kernel: Serial driver version 4.13 with no serial options enabled Nov 8 10:37:31 bbs kernel: tty00 at 0x03f8 (irq = 4) is a 16550A Nov 8 10:37:31 bbs kernel: tty01 at 0x02f8 (irq = 3) is a 16550A Nov 8 10:37:31 bbs kernel: Ramdisk driver initialized : 16 ramdisks of 4096K size Nov 8 10:37:31 bbs kernel: hda: Seagate Technology 1275MB - ST31276A, 1221MB w/0kB Cache, CHS=620/64/63 Nov 8 10:37:31 bbs kernel: hdb: FUJITSU M1638TAU, 2452MB w/128kB Cache, CHS=622/128/63 Nov 8 10:37:31 bbs kernel: hdc: QUANTUM BIGFOOT_CY4320A, 4134MB w/67kB Cache, CHS=8960/15/63 Nov 8 10:37:31 bbs kernel: hdd: CD620E, ATAPI CDROM drive Nov 8 10:37:31 bbs kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 Nov 8 10:37:31 bbs kernel: ide1 at 0x170-0x177,0x376 on irq 15 Nov 8 10:37:31 bbs kernel: FDC 0 is a post-1991 82077 Nov 8 10:37:31 bbs kernel: md driver 0.36.3 MAX_MD_DEV=4, MAX_REAL=8 Nov 8 10:37:31 bbs kernel: Ethernet Bridge 002 for NET3.035 (Linux 2.0) Nov 8 10:37:31 bbs kernel: eth0: PCnet/PCI II 79C970A at 0x6400, 00 00 01 35 95 58pcnet32.c:v0.99B 4/4/98 DJBecker/TSBogend. Nov 8 10:37:31 bbs kernel: Partition check: Nov 8 10:37:31 bbs kernel: hda: hda1 hda2 Nov 8 10:37:31 bbs kernel: hdb: hdb1 hdb2 hdb3 Nov 8 10:37:31 bbs kernel: hdc: hdc1 hdc2 hdc3 Nov 8 10:37:31 bbs kernel: VFS: Mounted root (ext2 filesystem) readonly. Nov 8 10:37:31 bbs kernel: Adding Swap: 130748k swap-space (priority -1) Nov 8 10:37:31 bbs kernel: raid0 personality registered Nov 8 10:37:31 bbs kernel: raid1 personality registered Nov 8 10:37:31 bbs kernel: raid5 personality registered Nov 8 10:37:31 bbs kernel: REGISTER_DEV hda1 to md0 done Nov 8 10:37:31 bbs kernel: REGISTER_DEV hdc1 to md0 done Nov 8 10:37:31 bbs kernel: raid0 : Allocating 4928 bytes for hash. Nov 8 10:37:31 bbs kernel: REGISTER_DEV hda2 to md1 done Nov 8 10:37:31 bbs kernel: REGISTER_DEV hdb1 to md1 done Nov 8 10:37:31 bbs kernel: REGISTER_DEV hdc2 to md1 done Nov 8 10:37:31 bbs kernel: md: 09:01: raid array is not clean -- run ckraid Nov 8 10:37:31 bbs kernel: raid5: device 03:02 operational as raid disk 0 Nov 8 10:37:31 bbs kernel: raid5: device 03:41 operational as raid disk 1 Nov 8 10:37:31 bbs kernel: raid5: device 16:02 operational as raid disk 2 Nov 8 10:37:31 bbs kernel: raid5: raid level 5 set 09:01 active with 3 out of 3 devices, algorithm 2 Nov 8 10:37:31 bbs kernel: md: updating raid superblock on device 03:02, sb_offset == 435392 Nov 8 10:37:31 bbs kernel: md: updating raid superblock on device 03:41, sb_offset == 435328 Nov 8 10:37:31 bbs kernel: md: updating raid superblock on device 16:02, sb_offset == 434624 Nov 8 10:37:31 bbs kernel: Swansea University Computer Society IPX 0.34 for NET3.035 Nov 8 10:37:31 bbs kernel: IPX Portions Copyright (c) 1995 Caldera, Inc. Nov 8 10:37:31 bbs kernel: Manual mode (use sbniautodetect=<number of SBNI> to Autodetect mode) Nov 8 10:37:31 bbs kernel: Counting num specified card....1 cards specified. Nov 8 10:37:31 bbs kernel: SBNI adapter probe at 0x210: Nov 8 10:37:31 bbs kernel: sbni0: sbni adapter at 0x210, using assigned IRQ 5 Nov 8 10:37:31 bbs kernel: sbni0: receive level: 0x3 (fixed), baud rate: 3 Nov 8 10:37:52 bbs PAM_pwdb[410]: (su) session opened for user news by (uid=9) Nov 8 10:37:52 bbs PAM_pwdb[410]: (su) session closed for user news Nov 8 10:37:55 bbs kernel: irqtune/0.4: setting system IRQ priority to 3/14 Nov 8 10:37:55 bbs kernel: CSLIP: code copyright 1989 Regents of the University of California Nov 8 10:37:55 bbs kernel: PPP: version 2.2.0 (dynamic channel allocation) Nov 8 10:37:55 bbs kernel: PPP Dynamic channel allocation code copyright 1995 Caldera, Inc. Nov 8 10:37:55 bbs kernel: PPP line discipline registered. Nov 8 10:37:55 bbs kernel: PPP BSD Compression module registered Nov 8 10:38:15 bbs kernel: Cyclades driver 2.1.1.9 1998/09/02 14:47:01 Nov 8 10:38:15 bbs kernel: built Oct 22 1998 02:15:21 Nov 8 10:38:15 bbs kernel: Cyclom-Y/ISA #1: 0xd6000-0xd7fff, IRQ10, 8 channels starting from port 0.
If you answer, please email me directly, as I'm not subscribed to linux-kernel. BTW, I run the same kernel now and everything is ok.
- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.rutgers.edu Please read the FAQ at http://www.tux.org/lkml/
| |