lkml.org 
[lkml]   [1996]   [Oct]   [30]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
Subject(Q) Frequent inexplicable PPro crashes
Hi,

I am curious about an error I have been experiencing lately on a 200 MHz
PPro - REGARDLESS of kernel version or distribution (we changed from
Slackware 3.1 back to 3.0). Configuration

Intel motherboard
128 MB Ram
Aha3940 SCSI controller.
3c509 ethernet adapter.
s3 based graphics.

The system runs smoothly for several hours the bang:

---------------------
general protection: 091c
CPU: 0
EIP: 0010:[<0010a4e5>]
EFLAGS: 00010202
eax: 00000000 ebx: 00401334 ecx: 07c13c0c edx: 001b8e28
esi: 001b8744 edi: 00000000 ebp: 0000091c esp: 001b86ec
ds: 0018 es: 0018 fs: 002b gs: 0018 ss: 0018
Process swapper (pid: 0, process nr: 0, stackpage=001b6764)
Stack: 001095c4 0000091c 001097d4 001b8e28 0010a419 00000100 001092f8 00000016
001b8744 00000000 0000091c ffffffda 00000018 00000018 00100018 001a0018
00000070 00108fff 00000010 00000246 00109183 00000000 756e6547 000994c1
Call Trace: [<001095c4>] [<001097d4>] [<0010a419>] [<001092f8>] [<001a0018>] [<00109183>] [<00115a74>]
Code: cf 90 90 90 90 90 90 90 90 90 90 89 e1 51 f7 41 38 00 00 02
------------------------
immediately followed by

-------
kfree of non-kmalloced memory: 001b87a4, next= 00000000, order=0
kfree of non-kmalloced memory: 001b8794, next= 00000000, order=0
kfree of non-kmalloced memory: 001b8bc8, next= 00000000, order=0
-------
and then

---------
idle task may not sleep
----------
After this other processes get into trouble. (usually tar, nfsd, rm
gzip). It is the same kinds of error, namely protection faults. I have
also seen paging faults. I have included the syslog messages from
1.3.98. They are very much alike in all kernels - except that 2.1.5
dies silently.

The curious thing is that we have been able to compile kernels without
much trouble, but after a while the system hangs. We have tried kernels
2.0.21 2.0.23 2.1.5 and finally 1.3.98 they all yield the same problem -
with near identical messages.

We thought it was memory, and we have replaced it. We have also
downclocked the CPU. Nothing really seems to help much. My next step is
to compile the kernel on a different machine - if that doesn't help I am
at my wit's end.

The question is:

a, What can be the the problem. If anyone has suggestions I would really
like to hear about them.

b, Information (or pointers to such) about the interpretation of the error
messages above would be appreciated. My problems (regarding how to
understand it) are:

Why always the ``swapper'' - pid 0. Pid 0 is the idle task (right ?) Why
is this the first process to get into trouble?

According to the System.map the function that is at fault is

0010a460 T ret_from_sys_call

It buggles my mind that this call should somehow fail.

Furthermore:

The code 091c probably means something, but i have failed to find out
what exactly the code means. I guess someone knows.

So there must be an ominous reality behind this error that I don't
grasp. If some knowledgeable person could explain how the ``swapper
process'' may get into this kind of trouble, please do.

I include the syslog from bootup until a few faults have occurred. The
system hasn't crashed yet, but empirically - it will. I have also
included the .config file afterwards. If you nedd somehting else, just
tell me :)

Thanks to anyone who can/will help.

Andreas

-------------------
Oct 29 11:42:25 www2 kernel: Console: 16 point font, 400 scans
Oct 29 11:42:25 www2 kernel: Console: colour VGA+ 80x25, 1 virtual console (max 63)
Oct 29 11:42:25 www2 kernel: pcibios_init : BIOS32 Service Directory structure at 0x000fccf0
Oct 29 11:42:25 www2 kernel: pcibios_init : BIOS32 Service Directory entry at 0xfcd00
Oct 29 11:42:25 www2 kernel: pcibios_init : PCI BIOS revision 2.10 entry at 0xfcd21
Oct 29 11:42:25 www2 kernel: Probing PCI hardware.
Oct 29 11:42:25 www2 kernel: PCI bridge optimization.
Oct 29 11:42:25 www2 kernel: Cache L2: Not supported.
Oct 29 11:42:25 www2 kernel: CPU-PCI posted write: off.Changed! Now on.
Oct 29 11:42:25 www2 kernel: CPU-Memory posted write: off.Changed! Now on.
Oct 29 11:42:25 www2 kernel: PCI-Memory posted write: off.Changed! Now on.
Oct 29 11:42:25 www2 kernel: PCI burst: off.Changed! Now on.
Oct 29 11:42:25 www2 kernel: Calibrating delay loop.. ok - 180.22 BogoMIPS
Oct 29 11:42:25 www2 kernel: Memory: 127960k/131072k available (656k kernel code, 384k reserved, 2072k data)
Oct 29 11:42:25 www2 kernel: Swansea University Computer Society NET3.034 for Linux 1.3.77
Oct 29 11:42:25 www2 kernel: NET3: Unix domain sockets 0.12 for Linux NET3.033.
Oct 29 11:42:25 www2 kernel: Swansea University Computer Society TCP/IP for NET3.034
Oct 29 11:42:25 www2 kernel: IP Protocols: IGMP, ICMP, UDP, TCP
Oct 29 11:42:25 www2 kernel: Checking 386/387 coupling... Ok, fpu using exception 16 error reporting.
Oct 29 11:42:25 www2 kernel: Checking 'hlt' instruction... Ok.
Oct 29 11:42:25 www2 kernel: Linux version 1.3.98 (root@www2) (gcc version 2.7.0) #2 Sat Oct 26 17:58:24 GMT+0100 1996
Oct 29 11:42:25 www2 kernel: Started kswapd v 1.4.2.2
Oct 29 11:42:25 www2 kernel: aic7xxx: BurstLen = 8 DWDs, Latency Timer = 64 PCLKS
Oct 29 11:42:25 www2 kernel: aic7xxx: devconfig = 0x180.
Oct 29 11:42:25 www2 kernel: aic7xxx: Reading SEEPROM...done.
Oct 29 11:42:25 www2 kernel: aic7xxx: Extended translation enabled.
Oct 29 11:42:25 www2 kernel: aic7xxx: Using 16 SCB's after checking for SCB memory.
Oct 29 11:42:25 www2 kernel: aic7xxx: Enabling wide channel of AHA-3940-Wide.
Oct 29 11:42:25 www2 kernel: AHA-3940-WIDE (PCI-bus):
Oct 29 11:42:25 www2 kernel: irq 10
Oct 29 11:42:25 www2 kernel: bus release time 2 bclks
Oct 29 11:42:25 www2 kernel: data fifo threshold 100
Oct 29 11:42:25 www2 kernel: SCSI CHANNEL A:
Oct 29 11:42:25 www2 kernel: scsi id 7
Oct 29 11:42:25 www2 kernel: scsi selection timeout 256 ms
Oct 29 11:42:25 www2 kernel: scsi bus reset at power-on enabled
Oct 29 11:42:25 www2 kernel: scsi bus parity enabled
Oct 29 11:42:25 www2 kernel: scsi bus termination (low byte) enabled
Oct 29 11:42:25 www2 kernel: scsi bus termination (high byte) enabled
Oct 29 11:42:25 www2 kernel: aic7xxx: Downloading sequencer code...done.
Oct 29 11:42:25 www2 kernel: aic7xxx: Resetting the SCSI bus...done.
Oct 29 11:42:25 www2 kernel: aic7xxx: BurstLen = 8 DWDs, Latency Timer = 64 PCLKS
Oct 29 11:42:25 www2 kernel: aic7xxx: devconfig = 0x180.
Oct 29 11:42:25 www2 kernel: aic7xxx: Reading SEEPROM...done.
Oct 29 11:42:25 www2 kernel: aic7xxx: Extended translation enabled.
Oct 29 11:42:25 www2 kernel: aic7xxx: Using 16 SCB's after checking for SCB memory.
Oct 29 11:42:25 www2 kernel: aic7xxx: Enabling wide channel of AHA-3940-Wide.
Oct 29 11:42:25 www2 kernel: AHA-3940-WIDE (PCI-bus):
Oct 29 11:42:25 www2 kernel: irq 9
Oct 29 11:42:25 www2 kernel: bus release time 2 bclks
Oct 29 11:42:25 www2 kernel: data fifo threshold 100
Oct 29 11:42:25 www2 kernel: SCSI CHANNEL A:
Oct 29 11:42:25 www2 kernel: scsi id 7
Oct 29 11:42:25 www2 kernel: scsi selection timeout 256 ms
Oct 29 11:42:26 www2 sendmail[586]: NOQUEUE: SYSERR(root): Warning: .cf version level (6) exceeds program functionality (5)
Oct 29 11:42:26 www2 sendmail[586]: NOQUEUE: SYSERR(root): cannot chdir((null)): Bad address
Oct 29 11:42:25 www2 kernel: scsi bus reset at power-on enabled
Oct 29 11:42:25 www2 kernel: scsi bus parity enabled
Oct 29 11:42:25 www2 kernel: scsi bus termination (low byte) enabled
Oct 29 11:42:25 www2 kernel: scsi bus termination (high byte) enabled
Oct 29 11:42:25 www2 kernel: aic7xxx: Downloading sequencer code...done.
Oct 29 11:42:25 www2 kernel: aic7xxx: Resetting the SCSI bus...done.
Oct 29 11:42:25 www2 kernel: scsi0 : Adaptec AHA274x/284x/294x (EISA/VLB/PCI-Fast SCSI) 3.0/3.0/3.0
Oct 29 11:42:25 www2 kernel: scsi1 : Adaptec AHA274x/284x/294x (EISA/VLB/PCI-Fast SCSI) 3.0/3.0/3.0
Oct 29 11:42:25 www2 kernel: scsi : 2 hosts.
Oct 29 11:42:25 www2 kernel: aic7xxx: Scanning channel A for devices.
Oct 29 11:42:25 www2 kernel: aic7xxx: Scanning channel A for devices.
Oct 29 11:42:25 www2 kernel: aic7xxx: Target 0, channel A, now synchronous at 10.0MHz, offset(0xf).
Oct 29 11:42:25 www2 kernel: Vendor: Quantum Model: XP34300W Rev: L912
Oct 29 11:42:25 www2 kernel: Type: Direct-Access ANSI SCSI revision: 02
Oct 29 11:42:25 www2 kernel: Detected scsi disk sda at scsi1, channel 0, id 0, lun 0
Oct 29 11:42:25 www2 kernel: scsi : detected 1 SCSI disk total.
Oct 29 11:42:25 www2 kernel: SCSI device sda: hdwr sector= 512 bytes. Sectors= 8399520 [4101 MB] [4.1 GB]
Oct 29 11:42:25 www2 kernel: eth0: 3c509 at 0x300 tag 1, 10baseT port, address 00 a0 24 13 55 fd, IRQ 5.
Oct 29 11:42:25 www2 kernel: 3c509.c:1.07 6/15/95 becker@cesdis.gsfc.nasa.gov
Oct 29 11:42:25 www2 kernel: Partition check:
Oct 29 11:42:25 www2 kernel: sda: sda1 sda2
Oct 29 11:42:25 www2 kernel: VFS: Mounted root (ext2 filesystem) readonly.
Oct 29 11:42:25 www2 kernel: Adding Swap: 130748k swap-space
Oct 29 11:42:25 www2 kernel: eth0: Setting Rx mode to 1 addresses.
Oct 29 11:42:25 www2 kernel: fcntl_setlk() called by process 578 with broken flock() emulation
Oct 29 11:42:25 www2 kernel: fcntl_setlk() called by process 580 with broken flock() emulation
Oct 29 11:42:34 www2 kernel: fcntl_setlk() called by process 590 with broken flock() emulation
Oct 29 11:42:34 www2 kernel: fcntl_setlk() called by process 593 with broken flock() emulation
Oct 29 11:42:34 www2 kernel: fcntl_setlk() called by process 592 with broken flock() emulation

Oct 29 23:21:09 www2 kernel: general protection: 091c
Oct 29 23:21:09 www2 kernel: CPU: 0
Oct 29 23:21:09 www2 kernel: EIP: 0010:[<0010a4e5>]
Oct 29 23:21:09 www2 kernel: EFLAGS: 00010202
Oct 29 23:21:09 www2 kernel: eax: 00000000 ebx: 00401334 ecx: 07c13c0c edx: 001b8e28
Oct 29 23:21:09 www2 kernel: esi: 001b8744 edi: 00000000 ebp: 0000091c esp: 001b86ec
Oct 29 23:21:09 www2 kernel: ds: 0018 es: 0018 fs: 002b gs: 0018 ss: 0018
Oct 29 23:21:09 www2 kernel: Process swapper (pid: 0, process nr: 0, stackpage=001b6764)
Oct 29 23:21:09 www2 kernel: Stack: 001095c4 0000091c 001097d4 001b8e28 0010a419 00000100 001092f8 00000016
Oct 29 23:21:09 www2 kernel: 001b8744 00000000 0000091c ffffffda 00000018 00000018 00100018 001a0018
Oct 29 23:21:09 www2 kernel: 00000070 00108fff 00000010 00000246 00109183 00000000 756e6547 000994c1
Oct 29 23:21:09 www2 kernel: Call Trace: [<001095c4>] [<001097d4>] [<0010a419>] [<001092f8>] [<001a0018>] [<00109183>] [<00115a74>]
Oct 29 23:21:09 www2 kernel: Code: cf 90 90 90 90 90 90 90 90 90 90 89 e1 51 f7 41 38 00 00 02
Oct 29 23:21:09 www2 kernel: kfree of non-kmalloced memory: 001b87a4, next= 00000000, order=0
Oct 29 23:21:09 www2 kernel: kfree of non-kmalloced memory: 001b8794, next= 00000000, order=0
Oct 29 23:21:09 www2 kernel: kfree of non-kmalloced memory: 001b8bc8, next= 00000000, order=0
Oct 29 23:21:09 www2 kernel: idle task may not sleep
Oct 29 23:21:09 www2 last message repeated 4 times
Oct 29 23:53:54 www2 kernel: general protection: 0000
Oct 29 23:53:54 www2 kernel: CPU: 0
Oct 29 23:53:54 www2 kernel: EIP: 0010:[<00122a98>]
Oct 29 23:53:54 www2 kernel: EFLAGS: 00010292
Oct 29 23:53:54 www2 kernel: eax: f000eb10 ebx: 05130801 ecx: 00000400 edx: 00008dbc
Oct 29 23:53:54 www2 kernel: esi: 000b8d17 edi: 00000801 ebp: 000b8516 esp: 07ba5e6c
Oct 29 23:53:54 www2 kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Oct 29 23:53:54 www2 kernel: Process rpc.nfsd (pid: 583, process nr: 19, stackpage=07ba5000)
Oct 29 23:53:54 www2 kernel: Stack: 05134a5c 000b8516 00000801 00000002 07be73d0 001240bd 00000801 000b8516
Oct 29 23:53:54 www2 kernel: 00000400 07ba5f20 00000010 00000000 07be73d0 000b8516 00123bf5 00000801
Oct 29 23:53:54 www2 kernel: 00000100 0035b6bc 051349d4 047b0801 00000000 051349d4 05134a18 047be7b4
Oct 29 23:53:54 www2 kernel: Call Trace: [<001240bd>] [<00123bf5>] [<001244ed>] [<0011ae04>] [<0011af01>] [<0011b369>] [<00120f42>]
Oct 29 23:53:54 www2 kernel: [<0010a419>]
Oct 29 23:53:54 www2 kernel: Code: 39 28 75 28 66 39 58 04 75 22 8b 4c 24 20 39 48 20 74 22 57
Oct 30 00:01:08 www2 kernel: general protection: 0000
Oct 30 00:01:08 www2 kernel: CPU: 0
Oct 30 00:01:08 www2 kernel: EIP: 0010:[<00122a98>]
Oct 30 00:01:08 www2 kernel: EFLAGS: 00010282
Oct 30 00:01:08 www2 kernel: eax: f000eb10 ebx: 07410801 ecx: 00000400 edx: 00008dbc
Oct 30 00:01:08 www2 kernel: esi: 00198c45 edi: 00000801 ebp: 00198444 esp: 05935e6c
Oct 30 00:01:08 www2 kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Oct 30 00:01:08 www2 kernel: Process tar (pid: 3583, process nr: 25, stackpage=05935000)
Oct 30 00:01:08 www2 kernel: Stack: 0741b330 00198444 00000801 00000001 068beb70 001240bd 00000801 00198444
Oct 30 00:01:08 www2 kernel: 00000400 05935f20 00000144 00000000 068beb70 00198444 00123bf5 00000801
Oct 30 00:01:08 www2 kernel: 00000100 0029330c 0741b3fc 079e0801 00000000 0741b3fc 00156391 079e1d8c
Oct 30 00:01:08 www2 kernel: Call Trace: [<00198444>] [<001240bd>] [<00198444>] [<00198444>] [<00123bf5>] [<00156391>] [<001244ed>]
Oct 30 00:01:08 www2 kernel: [<00198443>] [<00198444>] [<00198445>] [<00198446>] [<0011ae04>] [<0011af01>] [<0011b369>] [<00120f42>]
Oct 30 00:01:08 www2 kernel: [<0010a419>]
Oct 30 00:01:08 www2 kernel: Code: 39 28 75 28 66 39 58 04 75 22 8b 4c 24 20 39 48 20 74 22 57
Oct 30 00:22:38 www2 sendmail[3668]: NOQUEUE: SYSERR(root): Warning: .cf version level (6) exceeds program functionality (5)
Oct 30 00:22:38 www2 sendmail[3668]: NOQUEUE: SYSERR(root): cannot chdir((null)): Bad address
#
# Automatically generated by make menuconfig: don't edit
#

#
# Code maturity level options
#
# CONFIG_EXPERIMENTAL is not set

#
# Loadable module support
#
CONFIG_MODULES=y
# CONFIG_MODVERSIONS is not set
# CONFIG_KERNELD is not set

#
# General setup
#
# CONFIG_MATH_EMULATION is not set
CONFIG_NET=y
# CONFIG_MAX_16M is not set
CONFIG_PCI=y
CONFIG_PCI_OPTIMIZE=y
CONFIG_SYSVIPC=y
CONFIG_BINFMT_AOUT=y
CONFIG_BINFMT_ELF=y
CONFIG_KERNEL_ELF=y
CONFIG_M686=y

#
# Floppy, IDE, and other block devices
#
CONFIG_BLK_DEV_FD=y
CONFIG_BLK_DEV_IDE=y
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDECD=y
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDE_PCMCIA is not set
CONFIG_BLK_DEV_CMD640=y
CONFIG_BLK_DEV_RZ1000=y
# CONFIG_BLK_DEV_TRITON is not set
# CONFIG_IDE_CHIPSETS is not set
# CONFIG_BLK_DEV_RAM is not set
# CONFIG_BLK_DEV_LOOP is not set
# CONFIG_BLK_DEV_XD is not set
# CONFIG_BLK_DEV_MD is not set

#
# Networking options
#
# CONFIG_FIREWALL is not set
CONFIG_NET_ALIAS=y
CONFIG_INET=y
CONFIG_IP_FORWARD=y
CONFIG_IP_MULTICAST=y
# CONFIG_IP_ACCT is not set
# CONFIG_IP_ROUTER is not set
# CONFIG_NET_IPIP is not set
# CONFIG_IP_MROUTE is not set
CONFIG_IP_ALIAS=y
# CONFIG_INET_PCTCP is not set
# CONFIG_INET_RARP is not set
# CONFIG_NO_PATH_MTU_DISCOVERY is not set
# CONFIG_TCP_NAGLE_OFF is not set
CONFIG_IP_NOSR=y
CONFIG_SKB_LARGE=y
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_AX25 is not set
# CONFIG_NETLINK is not set

#
# SCSI support
#
CONFIG_SCSI=y
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
# CONFIG_BLK_DEV_SR is not set
# CONFIG_CHR_DEV_SG is not set
# CONFIG_SCSI_MULTI_LUN is not set
# CONFIG_SCSI_CONSTANTS is not set

#
# SCSI low-level drivers
#
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_AHA152X is not set
# CONFIG_SCSI_AHA1542 is not set
# CONFIG_SCSI_AHA1740 is not set
CONFIG_SCSI_AIC7XXX=y
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_DTC3280 is not set
# CONFIG_SCSI_EATA_DMA is not set
# CONFIG_SCSI_EATA_PIO is not set
# CONFIG_SCSI_U14_34F is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GENERIC_NCR5380 is not set
# CONFIG_SCSI_NCR53C7xx is not set
# CONFIG_SCSI_IN2000 is not set
# CONFIG_SCSI_PAS16 is not set
# CONFIG_SCSI_QLOGIC is not set
# CONFIG_SCSI_SEAGATE is not set
# CONFIG_SCSI_T128 is not set
# CONFIG_SCSI_ULTRASTOR is not set
# CONFIG_SCSI_7000FASST is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_NCR53C406A is not set
# CONFIG_SCSI_PPA is not set
# CONFIG_SCSI_AM53C974 is not set

#
# Network device support
#
CONFIG_NETDEVICES=y
CONFIG_DUMMY=y
# CONFIG_EQUALIZER is not set
# CONFIG_PLIP is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_NET_RADIO is not set
CONFIG_NET_ETHERNET=y
CONFIG_NET_VENDOR_3COM=y
# CONFIG_EL1 is not set
# CONFIG_EL2 is not set
CONFIG_EL3=y
# CONFIG_VORTEX is not set
# CONFIG_LANCE is not set
# CONFIG_NET_VENDOR_SMC is not set
# CONFIG_NET_ISA is not set
# CONFIG_NET_EISA is not set
# CONFIG_NET_POCKET is not set
# CONFIG_TR is not set
# CONFIG_ARCNET is not set

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# CD-ROM drivers (not for SCSI or IDE/ATAPI drives)
#
# CONFIG_CD_NO_IDESCSI is not set

#
# Filesystems
#
# CONFIG_QUOTA is not set
CONFIG_MINIX_FS=y
# CONFIG_EXT_FS is not set
CONFIG_EXT2_FS=y
# CONFIG_XIA_FS is not set
CONFIG_FAT_FS=y
CONFIG_MSDOS_FS=y
# CONFIG_VFAT_FS is not set
# CONFIG_UMSDOS_FS is not set
CONFIG_PROC_FS=y
CONFIG_NFS_FS=y
# CONFIG_ROOT_NFS is not set
# CONFIG_SMB_FS is not set
CONFIG_ISO9660_FS=y
# CONFIG_HPFS_FS is not set
# CONFIG_SYSV_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_UFS_FS is not set

#
# Character devices
#
CONFIG_SERIAL=y
# CONFIG_DIGI is not set
# CONFIG_CYCLADES is not set
# CONFIG_STALDRV is not set
# CONFIG_RISCOM8 is not set
# CONFIG_PRINTER is not set
# CONFIG_BUSMOUSE is not set
# CONFIG_PSMOUSE is not set
# CONFIG_MS_BUSMOUSE is not set
# CONFIG_ATIXL_BUSMOUSE is not set
# CONFIG_UMISC is not set
# CONFIG_QIC02_TAPE is not set
# CONFIG_FTAPE is not set
# CONFIG_APM is not set
# CONFIG_WATCHDOG is not set
# CONFIG_RTC is not set

#
# Sound
#
# CONFIG_SOUND is not set

#
# Kernel hacking
#
# CONFIG_PROFILE is not set


---
J. Andreas Baerentzen - jab@image.dk
Image Scandinavia ApS
http://www.image.dk

\
 
 \ /
  Last update: 2005-03-22 13:38    [from the cache]
©2003-2011 Jasper Spaans