lkml.org 
[lkml]   [2003]   [Mar]   [10]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    Date
    From
    Subjectaacraid (dell PERC) cannot handle a degraded mirror

    If you are running Linux 2.4.x and using aacraid, and a mirror degrades
    (ie. one of the disks goes bad or otherwise detaches itself from the
    mirror) the system will panic and crash.

    This is, of course, incorrect behavior - if a mirror degrades the system
    should continue running because half of the mirror is still there.

    Here is a scenario I have seen about ten times in the last few months -
    and it is only this frequency and consistency that has provoked me to send
    this email:

    1. I start getting things like this in /var/log/messages

    Mar 9 07:12:36 system kernel: aacraid:ID(0:02:0); Error Event
    [command:0x28]
    Mar 9 07:12:36 system kernel: aacraid:ID(0:02:0); Medium Error, Block
    Range 435200 : 435327
    Mar 9 07:12:36 system kernel: aacraid:ID(0:02:0); Error Too Long To
    Correct
    Mar 9 07:12:36 system kernel: aacraid:ID(0:02:0) Medium Error, LBN Range
    435200:435327
    Mar 9 07:12:36 system kernel: aacraid:ID(0:02:0) Starting BBR sequence

    Ok, fair enough - disk 2 on channel 0 is bad or is going bad. Good thing
    I have a mirror ... wrong!


    2. The problem gets worse:

    Mar 9 07:13:00 system kernel: scsi : aborting command due to timeout :
    pid
    162469964, scsi0, channel 0, id 1, lun 0 Read (10) 00 00 06 a3 ff 00 00 08
    00
    Mar 9 07:13:06 system kernel: scsi : aborting command due to timeout :
    pid
    162470312, scsi0, channel 0, id 1, lun 0 Read (10) 00 03 c2 c2 fb 00 00 02
    00
    Mar 9 07:13:06 system kernel: scsi : aborting command due to timeout :
    pid
    162470320, scsi0, channel 0, id 1, lun 0 Read (10) 00 05 79 83 77 00 00 02
    00
    Mar 9 07:13:07 system kernel: scsi : aborting command due to timeout :
    pid
    162470322, scsi0, channel 0, id 1, lun 0 Read (10) 00 01 b6 c3 71 00 00 02
    00
    Mar 9 07:13:07 system kernel: aacraid:ID(0:02:0); Error Event
    [command:0x28]
    Mar 9 07:13:07 system kernel: aacraid:ID(0:02:0); Medium Error, Block
    Range 435234 : 435234
    Mar 9 07:13:07 system kernel: aacraid:ID(0:02:0); Error Too Long To
    Correct


    3. disk 2 on channel 0 fails. No problem, it's a mirror, right ?


    Mar 9 07:13:30 system kernel: SCSI host 0 abort (pid 162469964) timed out
    - resetting
    Mar 9 07:13:30 system kernel: SCSI bus is being reset for host 0 channel
    0.
    Mar 9 07:13:36 system kernel: scsi : aborting command due to timeout :
    pid
    162470312, scsi0, channel 0, id 1, lun 0 Read (10) 00 03 c2 c2 fb 00 00 02
    00
    Mar 9 07:13:36 system kernel: SCSI host 0 abort (pid 162470312) timed out
    - resetting
    Mar 9 07:13:36 system kernel: SCSI bus is being reset for host 0 channel
    0.
    Mar 9 07:13:36 system kernel: scsi : aborting command due to timeout :
    pid
    162470320, scsi0, channel 0, id 1, lun 0 Read (10) 00 05 79 83 77 00 00 02
    00
    Mar 9 07:13:36 system kernel: SCSI host 0 abort (pid 162470320) timed out
    - resetting
    Mar 9 07:13:36 system kernel: SCSI bus is being reset for host 0 channel
    0.
    Mar 9 07:13:36 system kernel: aacraid: BBR timed out at Block 0x6a42d
    Mar 9 07:13:36 system kernel: aacraid:Drive 0:2:0 returning error
    Mar 9 07:13:36 system kernel: aacraid:ID(0:02:0) - IO failed, Cmd[0x28]


    4. System panics and crashes (which makes _no_ sense, because the other
    disk is totally healthy, has reported no errors, and makes up the other
    half of the _mirror_.


    Mar 9 07:13:41 system kernel: Unable to handle kernel paging request at
    virtual address 405a2200
    Mar 9 07:13:41 system kernel: printing eip:
    Mar 9 07:13:41 system kernel: c0114d0f
    Mar 9 07:13:41 system kernel: *pde = 14629067
    Mar 9 07:13:41 system kernel: *pte = 00000000
    Mar 9 07:13:41 system kernel: Oops: 0000


    5. upon system boot, the Dell PERC 3si reports that the mirror is
    degraded, but that the other disk in the mirror is totally healthy, and
    that the container is present.

    6. system boots _just fine_ on the broken mirror, as it should - system
    runs fine on broken mirror, as it should.


    So, why does the system run fine on the broken mirror, but panics and
    crashes when the mirror actually breaks ?

    This is very frustrating - one of the reasons we spent money to mirror
    things was to reduce possible downtimes (since a disk failure will not
    crash the machine) but ... a disk failure does crash the machine.
    Explanations welcome.

    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at http://www.tux.org/lkml/

    \
     
     \ /
      Last update: 2005-03-22 13:33    [W:0.025 / U:0.120 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site