lkml.org 
[lkml]   [2011]   [Aug]   [12]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: [PATCH 2/7] perf, x86: Implement IBS initialization
On 02.08.11 07:49:01, Peter Zijlstra wrote:
> On Thu, 2011-07-28 at 15:46 +0200, Robert Richter wrote:
> > +/*
> > + * This runs only on the current cpu. We try to find an LVT offset and
> > + * setup the local APIC. For this we must disable preemption. On
> > + * success we initialize all nodes with this offset. This updates then
> > + * the offset in the IBS_CTL per-node msr. The per-core APIC setup of
> > + * the IBS interrupt vector is handled by perf_ibs_cpu_notifier that
> > + * is using the new offset.
> > + */
> > +static int force_ibs_eilvt_setup(void)
> > +{
> > + int offset;
> > + int ret;
> > +
> > + preempt_disable();
> > + /* find the next free available EILVT entry, skip offset 0 */
> > + for (offset = 1; offset < APIC_EILVT_NR_MAX; offset++) {
> > + if (get_eilvt(offset))
> > + break;
> > + }
> > + preempt_enable();
> > +
> > + if (offset == APIC_EILVT_NR_MAX) {
> > + printk(KERN_DEBUG "No EILVT entry available\n");
> > + return -EBUSY;
> > + }
> > +
> > + ret = setup_ibs_ctl(offset);
> > + if (ret)
> > + goto out;
> > +
> > + if (!ibs_eilvt_valid()) {
> > + ret = -EFAULT;
> > + goto out;
> > + }
> > +
> > + pr_err(FW_BUG "using offset %d for IBS interrupts\n", offset);
> > + pr_err(FW_BUG "workaround enabled for IBS LVT offset\n");
> > +
> > + return 0;
> > +out:
> > + preempt_disable();
> > + put_eilvt(offset);
> > + preempt_enable();
> > + return ret;
> > +}
>
> So I don't get any of that preempt_disable/enable crap in this patch,
> but the above is esp. confusing. How is that preempt_disable() at out:
> still valid? We could be running on an entirely different cpu from when
> we did get_eilvt at the start.

Yes, this code is strange due to the hardware mixing up per-cpu and
per-node configuration. This code did many iterations in the oprofile
driver.

get/put_eilvt() accesses APIC registers on one *cpu* and then globally
reserves/releases the offset by keeping it in eilvt_offsets[]. To
avoid switching cpus in the middle of an apic access the funcions are
protected with preempt_disable/enable.

setup_ibs_ctl() then sets up this offset on all *nodes*. During node
setup the pci cpu devices are accessed and thus may not be called with
preemption disabled.

The offset is later taken from the per-node msr IBS_CTL and used for a
per-core setup of the NMI vector on each cpu.

It is save to have get_eilvt and put_eilvt on different cpus as the
offset is kept globally.

I was thinking of moving preempt_disable/enable to get/put_eilvt, but
also wanted to avoid switching to a different cpu while searching for
an offset in the for-loop.

-Robert

--
Advanced Micro Devices, Inc.
Operating System Research Center



\
 
 \ /
  Last update: 2011-08-12 19:53    [from the cache]
©2003-2014 Jasper Spaans. Advertise on this site