[lkml]   [2011]   [May]   [10]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    SubjectRe: Kernel page allocation failure (ixgbe)

    On Tue, May 10, 2011 at 4:20 PM, Yehuda Sadeh Weinraub
    <> wrote:
    > On Tue, May 10, 2011 at 7:04 AM, Stefan Majer <> wrote:
    >> Hi,
    >> im running 4 nodes with ceph on top of btrfs with a dualport Intel
    >> X520 10Gb Ethernet Card with the latest 3.3.9 ixgbe driver.
    >> during benchmarks i get the following stack.
    >> I can easily reproduce this by simply running rados bench from a fast
    >> machine using this 4 nodes as ceph cluster.
    >> We saw this with stock ixgbe driver from and with the latest
    >> 3.3.9 ixgbe.
    >> This kernel is tainted because we use fusion-io iodrives as journal
    >> devices for btrfs.
    >> Any hints to nail this down are welcome.
    >> Greetings Stefan Majer
    >> May 10 15:26:40 os02 kernel: [ 3652.485219] cosd: page allocation
    >> failure. order:2, mode:0x4020
    > It looks like the machine running the cosd is crashing, is that the case?

    No the machine is still running. Even the cosd is still there.

    > Are you running both ceph kernel module on the same machine by any
    > chance? If not, it can be some other fs bug (e.g., the underlying
    > btrfs). Also, the stack here is quite deep, there's a chance for a
    > stack overflow.

    There is only the cosd running on these machines. We have 3 seperate
    mons and clients which uses qemu-rbd.

    > Thanks,
    > Yehuda

    Stefan Majer

     \ /
      Last update: 2011-05-10 17:59    [W:0.033 / U:50.932 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site