Messages in this thread | | | Date | Sat, 1 Nov 1997 17:36:40 -0600 (CST) | From | Mike Perry <> | Subject | Possible EXT2 Problem in 2.0.31? |
| |
Just today, my entire /usr/include directory (part of the root fs) went on the blink, and almost all of the files disappeared. I rebooted, forced fsck (which reported NO errors), and then logged in. All the the files returned.
Attached is that session's /var/log/messages (which logs all but "secure" messages), and my dmesg output is appended to that.
What follows is a more lengthy description of what is on my machine, and what was happening at the time.
I run a Redhat 4.1 based system. Libc5.4.39, 2.0.31. I have two Western Digital Caviars. One 420, and one 2giger. The 2 gig one is the one that went down. I have been running 2.0.31 since the day it was released, and have had no problems until now.
Note: At about the same time RedHat 4.1 was released, another WD 2gig Caviar I had crashed, and I had to get it replaced with one of the same make and model. But when that one crashed, it didn't come back, and fsck blew its brains out just trying to check it... I also had none of these errors.
My system was running two X sessions. One on localhost with XF86 3.3.1, and the other across an ne2k network with a win95 Xwin32(2 hour demo version). The win95 session issued make -j on a 20-30 source file compile. The compile went fine, (albeit a little slow). So the user added a new include dependency, and issued the make command without a j setting. The program complained about missing stdio.h, so the user did a ls on /usr/include, and saw only a fraction of the proper files remaining.
Meanwhile, I noticed these errors on my syslog watcher: (many more of them can be found in the attached Klog file)
EXT2-fs error (device 03:03): ext2_readdir: bad entry in directory #69633: inode out of bounds - offset=252, inode=637784, rec_len=16, name_len=7 EXT2-fs error (device 03:03): ext2_find_entry: bad entry in directory #69633: inode out of bounds - offset=1276, inode=12242840, rec_len=16, name_len=7
If I can submit anything else that may be helpful, please let me know.
Mike Perry --- BEGIN Logs for the day --- Nov 1 14:58:57 mikepery kernel: klogd 1.3-3, log source = /proc/kmsg started. Nov 1 14:58:57 mikepery kernel: Loaded 2654 symbols from /boot/System.map. Nov 1 14:58:57 mikepery kernel: Symbols match kernel version 2.0.31. Nov 1 14:58:57 mikepery kernel: Loaded 50 symbols from 3 modules. Nov 1 14:58:57 mikepery kernel: Console: 16 point font, 400 scans Nov 1 14:58:57 mikepery kernel: Console: colour VGA+ 80x25, 1 virtual console (max 63) Nov 1 14:58:57 mikepery kernel: pcibios_init : BIOS32 Service Directory structure at 0x000fae80 Nov 1 14:58:57 mikepery kernel: pcibios_init : BIOS32 Service Directory entry at 0xfb310 Nov 1 14:58:57 mikepery kernel: pcibios_init : PCI BIOS revision 2.10 entry at 0xfb340 Nov 1 14:58:57 mikepery kernel: Probing PCI hardware. Nov 1 14:58:57 mikepery kernel: Calibrating delay loop.. ok - 53.25 BogoMIPS Nov 1 14:58:57 mikepery kernel: Memory: 31232k/32768k available (488k kernel code, 384k reserved, 664k data) Nov 1 14:58:57 mikepery kernel: Swansea University Computer Society NET3.035 for Linux 2.0 Nov 1 14:58:57 mikepery kernel: NET3: Unix domain sockets 0.13 for Linux NET3.035. Nov 1 14:58:57 mikepery kernel: Swansea University Computer Society TCP/IP for NET3.034 Nov 1 14:58:57 mikepery kernel: IP Protocols: ICMP, UDP, TCP Nov 1 14:58:57 mikepery kernel: Checking 386/387 coupling... Ok, fpu using exception 16 error reporting. Nov 1 14:58:57 mikepery kernel: Checking 'hlt' instruction... Ok. Nov 1 14:58:57 mikepery kernel: Linux version 2.0.31 (root@mikepery.pr.mcs.net) (gcc version 2.7.2.3) #1 Sun Oct 19 00:40:38 CDT 1997 Nov 1 14:58:57 mikepery kernel: Starting kswapd v 1.4.2.2 Nov 1 14:58:57 mikepery kernel: ide: i82371 PIIX (Triton) on PCI bus 0 function 57 Nov 1 14:58:57 mikepery kernel: ide0: BM-DMA at 0x3000-0x3007 Nov 1 14:58:57 mikepery kernel: ide1: BM-DMA at 0x3008-0x300f Nov 1 14:58:57 mikepery kernel: hda: WDC AC22100H, 2014MB w/128kB Cache, CHS=1023/64/63, DMA Nov 1 14:58:57 mikepery kernel: hdb: Conner Peripherals 425MB - CFS425A, 406MB w/64kB Cache, CHS=839/16/62 Nov 1 14:58:57 mikepery kernel: hdc: NEC CD-ROM DRIVE:273, ATAPI CDROM drive Nov 1 14:58:57 mikepery kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 Nov 1 14:58:57 mikepery kernel: ide1 at 0x170-0x177,0x376 on irq 15 Nov 1 14:58:57 mikepery kernel: Partition check: Nov 1 14:58:57 mikepery kernel: hda: hda1 hda2 hda3 Nov 1 14:58:57 mikepery kernel: hdb: hdb1 hdb2 hdb3 Nov 1 14:58:57 mikepery kernel: VFS: Mounted root (ext2 filesystem) readonly. Nov 1 14:58:57 mikepery kernel: Adding Swap: 32252k swap-space (priority -1) Nov 1 14:58:57 mikepery kernel: inserting floppy driver for 2.0.31 Nov 1 14:58:57 mikepery kernel: Floppy drive(s): fd0 is 1.44M Nov 1 14:58:57 mikepery kernel: FDC 0 is an 8272A Nov 1 14:58:57 mikepery kernel: VFS: Disk change detected on device 02:00 Nov 1 14:58:57 mikepery kernel: end_request: I/O error, dev 02:00, sector 0 Nov 1 14:59:01 mikepery amd[165]: My ip addr is 0x100007f Nov 1 14:59:01 mikepery amd[166]: file server localhost type local starts up Nov 1 14:59:01 mikepery amd[167]: linux mount: type nfs Nov 1 14:59:01 mikepery amd[167]: linux mount: version 1 Nov 1 14:59:01 mikepery amd[167]: linux mount: fd 7 Nov 1 14:59:01 mikepery amd[167]: linux mount: hostname 127.0.0.1 Nov 1 14:59:01 mikepery amd[167]: linux mount: port 1023 Nov 1 14:59:01 mikepery amd[167]: linux mount: fsname mikepery:(pid166) Nov 1 14:59:01 mikepery amd[167]: linux mount: type (mntent) auto Nov 1 14:59:01 mikepery amd[167]: linux mount: opts intr,rw,port=1023,timeo=8,retrans=110,indirect,map=/etc/amd.conf Nov 1 14:59:01 mikepery amd[167]: linux mount: dir /net Nov 1 14:59:02 mikepery amd[166]: /etc/amd.conf mounted fstype toplvl on /net Nov 1 14:59:03 mikepery sendmail[184]: daemon invoked without full pathname; kill -1 won't work Nov 1 14:59:03 mikepery sendmail[185]: starting daemon (8.8.6): SMTP+queueing@01:00:00 Nov 1 14:59:04 mikepery kernel: Serial driver version 4.13 with no serial options enabled Nov 1 14:59:04 mikepery kernel: tty00 at 0x03f8 (irq = 4) is a 16550A Nov 1 14:59:04 mikepery kernel: tty01 at 0x02f8 (irq = 3) is a 16550A Nov 1 14:59:04 mikepery kernel: tty03 at 0x02e8 (irq = 3) is a 16550A Nov 1 14:59:05 mikepery icmpinfo: started, PID=212. Nov 1 14:59:06 mikepery kernel: irqtune: setting system IRQ priority to 3/14 Nov 1 14:59:17 mikepery login: pam_unix authentication session started, user mikepery, service login Nov 1 14:59:26 mikepery su: mikepery on /dev/tty1 Nov 1 14:59:26 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 15:02:07 mikepery kernel: CSLIP: code copyright 1989 Regents of the University of California Nov 1 15:02:07 mikepery kernel: SLIP: version 0.8.4-NET3.019-NEWTTY-MODULAR (dynamic channels, max=256). Nov 1 15:02:07 mikepery modprobe: Can't locate module net-pf-4 Nov 1 15:02:07 mikepery modprobe: Can't locate module net-pf-5 Nov 1 15:02:07 mikepery dip[294]: root dial-up 204.95.35.57/204.95.35.57 to remote 1.0.0.1/1.0.0.1 with CSLIP/296 Nov 1 15:02:52 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 15:04:17 mikepery su: on /dev/ttyp0 Nov 1 15:04:17 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 15:13:06 mikepery icmpinfo: ICMP_Echo < 192.160.127.85 [mars] sz=258(+20) Nov 1 15:13:12 mikepery last message repeated 24 times Nov 1 15:13:23 mikepery icmpinfo: ICMP_Echo_Reply < 128.173.247.211 [ftp.goof.com] sz=64(+20) Nov 1 15:13:25 mikepery icmpinfo: ICMP_Echo_Reply < 128.173.247.211 [ftp.goof.com] sz=64(+20) Nov 1 15:16:12 mikepery kernel: loading device 'eth0'... Nov 1 15:16:12 mikepery kernel: ne.c:v1.10 9/23/94 Donald Becker (becker@cesdis.gsfc.nasa.gov) Nov 1 15:16:12 mikepery kernel: NE*000 ethercard probe at 0x300: 00 c0 f0 12 23 3e Nov 1 15:16:12 mikepery kernel: eth0: NE2000 found at 0x300, using IRQ 10. Nov 1 15:16:12 mikepery kernel: loading device 'eth1'... Nov 1 15:16:12 mikepery modprobe: Can't locate module net-pf-4 Nov 1 15:16:12 mikepery modprobe: Can't locate module net-pf-5 Nov 1 15:20:07 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 15:20:52 mikepery login: 1 FAILED LOGINS FROM 192.168.1.2 FOR mikepery, Authentication failure Nov 1 15:20:56 mikepery login: 2 FAILED LOGINS FROM 192.168.1.2 FOR smaug, Authentication failure Nov 1 15:21:02 mikepery su: on /dev/ttyp0 Nov 1 15:21:02 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 15:21:39 mikepery login: pam_unix authentication session started, user smaug, service login Nov 1 15:22:19 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 15:22:37 mikepery su: smaug on /dev/ttyp3 Nov 1 15:22:37 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 15:30:18 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 15:30:46 mikepery su: smaug on /dev/ttyp3 Nov 1 15:30:46 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 15:31:03 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 15:31:16 mikepery login: pam_unix authentication session finished, user smaug, service login Nov 1 15:44:52 mikepery su: on /dev/ttyp0 Nov 1 15:44:52 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 16:33:35 mikepery kernel: EXT2-fs error (device 03:03): ext2_find_entry: bad entry in directory #69633: inode out of bounds - offset=1276, inode=8101784, rec_len=16, name_len=7 Nov 1 16:33:35 mikepery last message repeated 3 times Nov 1 16:33:47 mikepery kernel: EXT2-fs error (device 03:03): ext2_find_entry: bad entry in directory #69633: inode out of bounds - offset=1276, inode=32487832, rec_len=16, name_len=7 Nov 1 16:33:47 mikepery last message repeated 4 times Nov 1 16:34:26 mikepery kernel: EXT2-fs error (device 03:03): ext2_find_entry: bad entry in directory #69633: inode out of bounds - offset=1276, inode=12239768, rec_len=16, name_len=7 Nov 1 16:34:26 mikepery last message repeated 2 times Nov 1 16:34:31 mikepery kernel: EXT2-fs error (device 03:03): ext2_readdir: bad entry in directory #69633: inode out of bounds - offset=252, inode=12241816, rec_len=16, name_len=7 Nov 1 16:34:31 mikepery kernel: EXT2-fs error (device 03:03): ext2_readdir: bad entry in directory #69633: inode out of bounds - offset=252, inode=12241816, rec_len=16, name_len=7 Nov 1 16:34:35 mikepery kernel: EXT2-fs error (device 03:03): ext2_readdir: bad entry in directory #69633: inode out of bounds - offset=252, inode=637784, rec_len=16, name_len=7 Nov 1 16:34:35 mikepery last message repeated 3 times Nov 1 16:34:53 mikepery kernel: EXT2-fs error (device 03:03): ext2_find_entry: bad entry in directory #69633: inode out of bounds - offset=1276, inode=12241048, rec_len=16, name_len=7 Nov 1 16:34:53 mikepery last message repeated 3 times Nov 1 16:34:59 mikepery kernel: EXT2-fs error (device 03:03): ext2_readdir: bad entry in directory #69633: inode out of bounds - offset=252, inode=637784, rec_len=16, name_len=7 Nov 1 16:35:02 mikepery last message repeated 13 times Nov 1 16:35:02 mikepery kernel: EXT2-fs error (device 03:03): ext2_find_entry: bad entry in directory #69633: inode out of bounds - offset=1276, inode=12242840, rec_len=16, name_len=7 Nov 1 16:35:07 mikepery kernel: EXT2-fs error (device 03:03): ext2_readdir: bad entry in directory #69633: inode out of bounds - offset=252, inode=637784, rec_len=16, name_len=7 Nov 1 16:35:09 mikepery last message repeated 5 times Nov 1 16:36:03 mikepery modprobe: Can't locate module net-pf-4 Nov 1 16:36:03 mikepery modprobe: Can't locate module net-pf-5 Nov 1 16:36:04 mikepery dip[294]: root down CSLIP link to remote 1.0.0.1/1.0.0.1 Nov 1 16:36:05 mikepery dip[294]: Total online:5636s in:0 bytes 0 pkts; out:0 bytes 0 pkts Nov 1 16:46:10 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 16:46:31 mikepery su: mikepery on /dev/tty1 Nov 1 16:46:31 mikepery syslog: pam_unix authentication session started, user root, service su Nov 1 16:48:28 mikepery syslog: pam_unix authentication session finished, user root, service su Nov 1 16:49:04 mikepery kernel: CSLIP: code copyright 1989 Regents of the University of California Nov 1 16:49:04 mikepery kernel: SLIP: version 0.8.4-NET3.019-NEWTTY-MODULAR (dynamic channels, max=256). Nov 1 16:49:04 mikepery modprobe: Can't locate module net-pf-4 Nov 1 16:49:04 mikepery modprobe: Can't locate module net-pf-5 Nov 1 16:49:04 mikepery dip[2056]: root dial-up 204.95.35.57/204.95.35.57 to remote 1.0.0.1/1.0.0.1 with CSLIP/296 Nov 1 16:50:08 mikepery login: pam_unix authentication session started, user root, service login Nov 1 16:50:08 mikepery login: ROOT LOGIN ON tty13 Nov 1 16:55:17 mikepery login: pam_unix authentication session finished, user root, service login Nov 1 16:55:39 mikepery login: pam_unix authentication session finished, user mikepery, service login Nov 1 16:55:44 mikepery init: Switching to runlevel: 6 Nov 1 16:55:44 mikepery getty[2131]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[2130]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[219]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[220]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[222]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[223]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[227]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[228]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[221]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[225]: exiting on TERM signal Nov 1 16:55:45 mikepery getty[226]: exiting on TERM signal Nov 1 16:55:50 mikepery amd[166]: WARNING: automounter going down on signal 15 Nov 1 16:55:50 mikepery amd[166]: /etc/amd.conf unmounted fstype toplvl from /net Nov 1 16:55:51 mikepery amd[166]: Finishing with status 0 Nov 1 17:00:02 mikepery syslogd 1.3-3: restart.
--- Begin DMESG --- Console: 16 point font, 400 scans Console: colour VGA+ 80x25, 1 virtual console (max 63) pcibios_init : BIOS32 Service Directory structure at 0x000fae80 pcibios_init : BIOS32 Service Directory entry at 0xfb310 pcibios_init : PCI BIOS revision 2.10 entry at 0xfb340 Probing PCI hardware. Calibrating delay loop.. ok - 53.25 BogoMIPS Memory: 31232k/32768k available (488k kernel code, 384k reserved, 664k data) Swansea University Computer Society NET3.035 for Linux 2.0 NET3: Unix domain sockets 0.13 for Linux NET3.035. Swansea University Computer Society TCP/IP for NET3.034 IP Protocols: ICMP, UDP, TCP Checking 386/387 coupling... Ok, fpu using exception 16 error reporting. Checking 'hlt' instruction... Ok. Linux version 2.0.31 (root@mikepery.pr.mcs.net) (gcc version 2.7.2.3) #1 Sun Oct 19 00:40:38 CDT 1997 Starting kswapd v 1.4.2.2 ide: i82371 PIIX (Triton) on PCI bus 0 function 57 ide0: BM-DMA at 0x3000-0x3007 ide1: BM-DMA at 0x3008-0x300f hda: WDC AC22100H, 2014MB w/128kB Cache, CHS=1023/64/63, DMA hdb: Conner Peripherals 425MB - CFS425A, 406MB w/64kB Cache, CHS=839/16/62 hdc: NEC CD-ROM DRIVE:273, ATAPI CDROM drive ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 ide1 at 0x170-0x177,0x376 on irq 15 Partition check: hda: hda1 hda2 hda3 hdb: hdb1 hdb2 hdb3 VFS: Mounted root (ext2 filesystem) readonly. Adding Swap: 32252k swap-space (priority -1) inserting floppy driver for 2.0.31 Floppy drive(s): fd0 is 1.44M FDC 0 is an 8272A VFS: Disk change detected on device 02:00 end_request: I/O error, dev 02:00, sector 0 Serial driver version 4.13 with no serial options enabled tty00 at 0x03f8 (irq = 4) is a 16550A tty01 at 0x02f8 (irq = 3) is a 16550A tty03 at 0x02e8 (irq = 3) is a 16550A irqtune: setting system IRQ priority to 3/14 CSLIP: code copyright 1989 Regents of the University of California SLIP: version 0.8.4-NET3.019-NEWTTY-MODULAR (dynamic channels, max=256). loading device 'eth0'... ne.c:v1.10 9/23/94 Donald Becker (becker@cesdis.gsfc.nasa.gov) NE*000 ethercard probe at 0x300: 00 c0 f0 12 23 3e eth0: NE2000 found at 0x300, using IRQ 10. loading device 'eth1'...
| |