lkml.org 
[lkml]   [2012]   [Jan]   [28]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    Date
    Subjecttask blocked on page_fault and epoll_wait for more than 120 seconds
    From
    Hi,

    I have a AIO-based webcache on an ISP.

    When traffic peaks on traffic higher 100Mbps with 14.000 packets per
    second, I started getting these on dmesg:


    cached D ffff880321861670 0 1177 29036 0x00000000
    ffff880395b59e20 0000000000000082 ffffea0008314b00 ffff880395b59fd8
    0000000000012580 ffff880395b59fd8 ffff880321861670 0000000000012580
    0000000000012580 0000000000012580 0000000000012580 ffff880321861670
    Call Trace:
    [<ffffffff81522d3b>] rwsem_down_failed_common+0x96/0xc8
    [<ffffffff81522dbd>] rwsem_down_read_failed+0x26/0x30
    [<ffffffff81036128>] ? get_parent_ip+0x11/0x41
    [<ffffffff8122a5c4>] call_rwsem_down_read_failed+0x14/0x30
    [<ffffffff815224a0>] ? down_read+0x12/0x14
    [<ffffffff81022038>] do_page_fault+0x12c/0x239
    [<ffffffff8152384f>] page_fault+0x1f/0x30



    cached D 0000000000000002 0 1286 29036 0x00000000
    ffff88026502be20 0000000000000082 ffffffff81089b28 ffff88026502bfd8
    0000000000012580 ffff88026502bfd8 ffff88042e174350 0000000000012580
    0000000000012580 0000000000012580 0000000000012580 ffff88042e174350
    Call Trace:
    [<ffffffff81089b28>] ? perf_event_task_sched_in+0x1c/0x98
    [<ffffffff81522d3b>] rwsem_down_failed_common+0x96/0xc8
    [<ffffffff81522fd7>] ? _raw_spin_unlock_irqrestore+0x2c/0x37
    [<ffffffff81522dbd>] rwsem_down_read_failed+0x26/0x30
    [<ffffffff815223f3>] ? do_nanosleep+0x7b/0xb3
    [<ffffffff8122a5c4>] call_rwsem_down_read_failed+0x14/0x30
    [<ffffffff815224a0>] ? down_read+0x12/0x14
    [<ffffffff81022038>] do_page_fault+0x12c/0x239
    [<ffffffff8152384f>] page_fault+0x1f/0x30


    Even on epoll_wait I started being blocked:


    cached D 0000000000000005 0 1292 29036 0x00000000
    ffff8803cbd39a00 0000000000000082 0000000000000000 ffff8803cbd39fd8
    0000000000012580 ffff8803cbd39fd8 ffff88043d01c350 0000000000012580
    0000000000012580 0000000000012580 0000000000012580 ffff88043d01c350
    Call Trace:
    [<ffffffff81522d3b>] rwsem_down_failed_common+0x96/0xc8
    [<ffffffff81522dbd>] rwsem_down_read_failed+0x26/0x30
    [<ffffffff8122a5c4>] call_rwsem_down_read_failed+0x14/0x30
    [<ffffffff812297bd>] ? copy_user_generic_string+0x2d/0x40
    [<ffffffff815224a0>] ? down_read+0x12/0x14
    [<ffffffff81022038>] do_page_fault+0x12c/0x239
    [<ffffffff8152384f>] page_fault+0x1f/0x30
    [<ffffffff812297bd>] ? copy_user_generic_string+0x2d/0x40
    [<ffffffff814959c7>] ? copy_from_user+0x9/0xb
    [<ffffffff81497fcb>] tcp_sendmsg+0x53b/0x8b5
    [<ffffffff81449fe9>] __sock_sendmsg+0x67/0x73
    [<ffffffff8144a528>] sock_sendmsg+0xa3/0xbc
    [<ffffffff81089b28>] ? perf_event_task_sched_in+0x1c/0x98
    [<ffffffff81036128>] ? get_parent_ip+0x11/0x41
    [<ffffffff81036128>] ? get_parent_ip+0x11/0x41
    [<ffffffff8103637f>] ? add_preempt_count+0xad/0xb2
    [<ffffffff81036128>] ? get_parent_ip+0x11/0x41
    [<ffffffff810bffd8>] ? fget_light+0x93/0xa9
    [<ffffffff8144a5a9>] ? sockfd_lookup_light+0x1b/0x53
    [<ffffffff8144bfa2>] sys_sendto+0xfa/0x120
    [<ffffffff810eb90d>] ? sys_epoll_wait+0x28f/0x2a7
    [<ffffffff81002a2b>] system_call_fastpath+0x16/0x1b


    My uname -a is:


    Linux cached 2.6.35.13 #2 SMP PREEMPT Mon Jan 16 18:11:04 BRST 2012
    x86_64 Intel(R) Xeon(R) CPU X3440 @ 2.53GHz GenuineIntel GNU/Linux

    Is there any more info I can provide to help track down this issue?

    Thanks,

    - Robert


    \
     
     \ /
      Last update: 2012-01-28 16:37    [W:0.020 / U:0.280 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site