lkml.org 
[lkml]   [2009]   [May]   [11]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: [PATCH 3/3] x86: fix node_possible_map logic -v2
On Mon, 11 May 2009, H. Peter Anvin wrote:

> > In your example of two cpus (0-1) that are remote to the system's only
> > memory and two cpus (2-3) that have affinity to that memory, it appears as
> > though the kernel is considering cpus 2-3 and the memory to be a node and
> > cpus 0-1 to be a memoryless node.
> >
> > That's a pretty useless scenario for memoryless node support, actually,
> > unless there's a third node with memory that cpus 0-1 have a different
> > distance to. cpus 0-1 have no memory that is local, so the "remote" memory
> > should be considered local to them.
> >
>
> Should it? It seems to me that CPUs 0-1 should be antipreferentially
> scheduled, since they will have slower access to the memory than CPUs 2-3.
> Since in this case all the memory is in the same place you could argue that
> SMP distances could do the same job, which is of course true.
>
> However, consider now:
>
> CPU [0-1] - no memory
> CPU [2-3] - memory
> CPU [4-5] - memory
>
> Each node is equidistant, but for the memory nodes there is differences
> between their own local memory and the remote memory.
>
> CPU [0-1] cannot be considered local in either node, since they are further
> away from the memory than either, and furthermore, unlike either of the memory
> nodes, they have no preference for memory from either of the other two nodes
> (quite on the contrary; they would probably benefit from drawing from both.)
>

Right, there's no difference from Jack's scenario if the three nodes are
equiadistant. I was thinking of a topology where cpu 0-1 was closer to,
for example, cpu 2-3's memory than cpu 4-5's.

The particular topology you're referring to should have a slit that
describes the relative distances in each direction differently. The pxms
that these cpus belong to will always be local to itself, but ACPI 3.0
allows distances for different directions between the same pxms to be
different.

That means it's possible that cpus 0-1 above have local distance to all
memory and cpus 2-3 (and cpus 4-5) have remote distance to all nodes other
than itself.

numactl --hardware would show something like this:

0 1 2
0 10 10 10
1 20 10 20
2 20 20 10

which is valid according to the ACPI specification. This is based on the
pxms to which the cpus belong so this topology would describe all members
of those pxms and not just memory.


\
 
 \ /
  Last update: 2009-05-12 00:29    [W:0.231 / U:0.344 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site