lkml.org 
[lkml]   [2012]   [Mar]   [8]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    Date
    From
    SubjectRe: [PATCH 0/6] Add a per-dimm structure
    On Wed, Mar 07, 2012 at 08:40:32AM -0300, Mauro Carvalho Chehab wrote:
    > Prepare the internal structures to represent the memory properties per dimm,
    > instead of per csrow.
    >
    > This is needed for modern controllers with more than 2 channels, as the memories
    > at the same slot number but on different channels (or channel pairs) may be
    > different.

    Ok, so I this thing looks pretty fishy to me. I've booted it on a box which has
    the following config on the first memory controller:

    [ 12.058897] EDAC MC: DCT0 chip selects:
    [ 12.063091] EDAC amd64: MC: 0: 2048MB 1: 2048MB
    [ 12.068155] EDAC amd64: MC: 2: 2048MB 3: 2048MB
    [ 12.073219] EDAC amd64: MC: 4: 0MB 5: 0MB
    [ 12.078281] EDAC amd64: MC: 6: 0MB 7: 0MB
    [ 12.093305] EDAC MC: DCT1 chip selects:
    [ 12.097499] EDAC amd64: MC: 0: 2048MB 1: 2048MB
    [ 12.102562] EDAC amd64: MC: 2: 2048MB 3: 2048MB
    [ 12.107623] EDAC amd64: MC: 4: 0MB 5: 0MB
    [ 12.112690] EDAC amd64: MC: 6: 0MB 7: 0MB

    Yes, 2 dual-ranked DIMMs per MCT, i.e. 4 DIMMs in the DIMM slots on the
    node (+ 4 more for the other MCT because it is a dual-node CPU). With
    your patchset I got 8 ranks, 1024MB each, not good.

    $ tree /sys/devices/system/edac/mc/mc0/rank?/
    /sys/devices/system/edac/mc/mc0/rank0/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank1/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank2/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank3/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank4/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank5/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank6/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size
    /sys/devices/system/edac/mc/mc0/rank7/
    |-- dimm_dev_type
    |-- dimm_edac_mode
    |-- dimm_label
    |-- dimm_location
    |-- dimm_mem_type
    `-- dimm_size

    Also, what does the nomenclature

    [ 12.196138] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 0: dimm0 (0:0:0): row 0, chan 0
    [ 12.204636] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 1: dimm1 (0:1:0): row 0, chan 1
    [ 12.213127] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 2: dimm2 (1:0:0): row 1, chan 0
    [ 12.221613] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 3: dimm3 (1:1:0): row 1, chan 1
    [ 12.230103] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 4: dimm4 (2:0:0): row 2, chan 0
    [ 12.238590] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 5: dimm5 (2:1:0): row 2, chan 1
    [ 12.247078] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 6: dimm6 (3:0:0): row 3, chan 0
    [ 12.255560] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 7: dimm7 (3:1:0): row 3, chan 1
    [ 12.264058] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 8: dimm8 (4:0:0): row 4, chan 0
    [ 12.272552] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 9: dimm9 (4:1:0): row 4, chan 1
    [ 12.281041] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 10: dimm10 (5:0:0): row 5, chan 0
    [ 12.289699] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 11: dimm11 (5:1:0): row 5, chan 1
    [ 12.298362] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 12: dimm12 (6:0:0): row 6, chan 0
    [ 12.307018] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 13: dimm13 (6:1:0): row 6, chan 1
    [ 12.315684] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 14: dimm14 (7:0:0): row 7, chan 0
    [ 12.324352] EDAC DEBUG: edac_mc_alloc: edac_mc_alloc: 15: dimm15 (7:1:0): row 7, chan 1

    mean? 16 DIMMs? No way.

    Basically, the problem with the DIMM nomenclature is that you cannot
    know from the hardware how many chip selects, aka ranks, comprise
    one DIMM. IOW, you cannot know whether your DIMMs are single-ranked,
    dual-ranked or quad-ranked and thus you cannot combine the csrows into
    DIMM structs.

    Thanks.

    --
    Regards/Gruss,
    Boris.

    Advanced Micro Devices GmbH
    Einsteinring 24, 85609 Dornach
    GM: Alberto Bozzo
    Reg: Dornach, Landkreis Muenchen
    HRB Nr. 43632 WEEE Registernr: 129 19551



    \
     
     \ /
      Last update: 2012-03-08 22:59    [W:0.045 / U:29.384 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site