lkml.org 
[lkml]   [2007]   [Apr]   [27]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: [2.6.20] system sometimes stops responding
Today the problem occured again after 4 days of uptime.
System not responding to ssh, login on the console and also bind did not seem to respond to anything at all.

I don't know if it is of any help, but here's the alt+sysreg+m output:

[49824.174292] SysRq : Show Memory
[49824.174367] Mem-info:
[49824.174403] DMA per-cpu:
[49824.174438] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[49824.174478] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[49824.174520] Normal per-cpu:
[49824.174556] CPU 0: Hot: hi: 186, btch: 31 usd: 9 Cold: hi: 62, btch: 15 usd: 12
[49824.174598] CPU 1: Hot: hi: 186, btch: 31 usd: 27 Cold: hi: 62, btch: 15 usd: 2
[49824.174638] HighMem per-cpu:
[49824.174673] CPU 0: Hot: hi: 186, btch: 31 usd: 12 Cold: hi: 62, btch: 15 usd: 2
[49824.174713] CPU 1: Hot: hi: 186, btch: 31 usd: 168 Cold: hi: 62, btch: 15 usd: 11
[49824.174755] Active:149895 inactive:82114 dirty:189 writeback:3 unstable:0
[49824.174756] free:220745 slab:60772 mapped:11447 pagetables:1007 bounce:9
[49824.174837] DMA free:15968kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[49824.174888] lowmem_reserve[]: 0 873 2015
[49824.175058] Normal free:606000kB min:3744kB low:4680kB high:5616kB active:10212kB inactive:4844kB present:894080kB pages_scanned:0 all_unreclaimable? no
[49824.175111] lowmem_reserve[]: 0 0 9137
[49824.175278] HighMem free:261012kB min:512kB low:1736kB high:2960kB active:589368kB inactive:323612kB present:1169608kB pages_scanned:0 all_unreclaimable? no
[49824.175332] lowmem_reserve[]: 0 0 0
[49824.175499] DMA: 2*4kB 3*8kB 2*16kB 3*32kB 3*64kB 2*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 3*4096kB = 15968kB
[49824.175942] Normal: 1*4kB 1*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 147*4096kB = 605964kB
[49824.176377] HighMem: 53*4kB 39*8kB 16*16kB 10*32kB 3*64kB 1*128kB 0*256kB 1*512kB 1*1024kB 0*2048kB 63*4096kB = 261004kB
[49824.176824] Swap cache: add 0, delete 0, find 0/0, race 0+0
[49824.176867] Free swap = 454600kB
[49824.176907] Total swap = 454600kB
[49824.176947] Free swap: 454600kB
[49824.183611] 524080 pages of RAM
[49824.183657] 294704 pages of HIGHMEM
[49824.183700] 5946 reserved pages
[49824.183740] 85824 pages shared
[49824.183779] 0 pages swap cached
[49824.183818] 189 pages dirty
[49824.183858] 3 pages writeback
[49824.183897] 11447 pages mapped
[49824.183942] 60772 pages slab
[49824.183985] 1007 pages pagetables

Nothing in the logging (I debug *.* to /var/log/all) and logging just stopped at a certain point with the last message being:

Apr 26 23:47:11 muur upsd[2828]: Client on 127.0.0.1 logged out


On Mon, Apr 23, 2007 at 05:58:06PM +0200, Folkert van Heusden wrote:
> System: kernel 2.6.20
> P4
> 2GB ram
> 512 MB swap
>
> Situation:
> Sometimes systems stops. SSH session stop. New logins proceed but just
> before the command-prompt they exit again (after a delay of, say, 30s)
> and return to the login prompt. New ssh logins do not even reach the
> login-prompt. Network seems to still forward traffic and also the system
> seems still be doing diskflushes.
>
> I pressed sysreq m which gives:
>
> [3535562.643029] SysRq : Show Memory
> [3535562.643113] Mem-info:
> [3535562.643153] DMA per-cpu:
> [3535562.643193] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
> [3535562.643242] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
> [3535562.643290] Normal per-cpu:
> [3535562.643330] CPU 0: Hot: hi: 186, btch: 31 usd: 152 Cold: hi: 62, btch: 15 usd: 13
> [3535562.643379] CPU 1: Hot: hi: 186, btch: 31 usd: 128 Cold: hi: 62, btch: 15 usd: 0
> [3535562.643426] HighMem per-cpu:
> [3535562.643466] CPU 0: Hot: hi: 186, btch: 31 usd: 156 Cold: hi: 62, btch: 15 usd: 14
> [3535562.643516] CPU 1: Hot: hi: 186, btch: 31 usd: 81 Cold: hi: 62, btch: 15 usd: 9
> [3535562.643566] Active:321905 inactive:152128 dirty:18 writeback:0 unstable:0 free:21864 slab:16213 mapped:15187 pagetables:1797
> [3535562.643619] DMA free:9876kB min:68kB low:84kB high:100kB active:1276kB inactive:3616kB present:16256kB pages_scanned:0 all_unreclaimable? no
> [3535562.643670] lowmem_reserve[]: 0 873 2015
> [3535562.643838] Normal free:71724kB min:3744kB low:4680kB high:5616kB active:349232kB inactive:375312kB present:894080kB pages_scanned:0 all_unreclaimable? no
> [3535562.643891] lowmem_reserve[]: 0 0 9137
> [3535562.644060] HighMem free:5856kB min:512kB low:1736kB high:2960kB active:937112kB inactive:229584kB present:1169608kB pages_scanned:0 all_unreclaimable? no
> [3535562.644113] lowmem_reserve[]: 0 0 0
> [3535562.644280] DMA: 339*4kB 47*8kB 161*16kB 50*32kB 8*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 9876kB
> [3535562.644713] Normal: 2151*4kB 2684*8kB 1327*16kB 486*32kB 20*64kB 6*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 71724kB
> [3535562.645147] HighMem: 432*4kB 406*8kB 11*16kB 10*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5856kB
> [3535562.645588] Swap cache: add 2474, delete 2458, find 601/816, race 0+0
> [3535562.645633] Free swap = 454424kB
> [3535562.645675] Total swap = 454600kB
> [3535562.645714] Free swap: 454424kB
> [3535562.653672] 524080 pages of RAM
> [3535562.653725] 294704 pages of HIGHMEM
> [3535562.653765] 5929 reserved pages
> [3535562.653807] 175200 pages shared
> [3535562.653846] 16 pages swap cached
> [3535562.653886] 18 pages dirty
> [3535562.653926] 0 pages writeback
> [3535562.653966] 15187 pages mapped
> [3535562.654005] 16213 pages slab
> [3535562.654046] 1797 pages pagetables
> [3535580.176308] SysRq : Emergency Sync
>
> So it looks like it is NOT out of memory.
>
> Last messages before I pressed sysreg m:
>
> [3535514.466556] Sig 3 send to 5432 owned by 0.0 (login)
> [3535514.466748] kobject_uevent_env
> [3535514.466795] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.466919] kobject vcs3: cleaning up
> [3535514.466970] kobject_uevent_env
> [3535514.467014] fill_kobj_path: path = '/class/vc/vcsa3'
> [3535514.467110] kobject vcsa3: cleaning up
> [3535514.467774] kobject vcs3: registering. parent: vc, set: devices
> [3535514.467863] kobject_uevent_env
> [3535514.467927] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.468272] kobject vcsa3: registering. parent: vc, set: devices
> [3535514.468356] kobject_uevent_env
> [3535514.468414] fill_kobj_path: path = '/class/vc/vcsa3'
> [3535514.469533] kobject_uevent_env
> [3535514.469586] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.469729] kobject vcs3: cleaning up
> [3535514.469781] kobject_uevent_env
> [3535514.469822] fill_kobj_path: path = '/class/vc/vcsa3'
> [3535514.469919] kobject vcsa3: cleaning up
> [3535514.469998] kobject vcs3: registering. parent: vc, set: devices
> [3535514.470059] kobject_uevent_env
> [3535514.470102] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.470207] kobject vcsa3: registering. parent: vc, set: devices
> [3535514.470260] kobject_uevent_env
> [3535514.470305] fill_kobj_path: path = '/class/vc/vcsa3'
>
> (as you can see, the login process gets shot by signal 3 (SIGQUIT))
>
> Anything else I can try?
> I also found a list of stacktraces of all processes running in the
> system.
>
>
> Folkert van Heusden
>
> --
> To MultiTail einai ena polymorfiko ergaleio gia ta logfiles kai tin
> eksodo twn entolwn. Prosferei: filtrarisma, xrwmatismo, sygxwneysi,
> diaforetikes provoles. http://www.vanheusden.com/multitail/
> ----------------------------------------------------------------------
> Phone: +31-6-41278122, PGP-key: 1F28D8AE, www.vanheusden.com


Folkert van Heusden

--
MultiTail är en flexibel redskap för att fälja logfilar, utför av
commandoer, filtrera, ge färg, sammanfoga, o.s.v. följa.
http://www.vanheusden.com/multitail/
----------------------------------------------------------------------
Phone: +31-6-41278122, PGP-key: 1F28D8AE, www.vanheusden.com
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

\
 
 \ /
  Last update: 2007-04-27 13:53    [W:0.120 / U:0.140 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site