lkml.org 
[lkml]   [2013]   [Apr]   [1]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: [RFC] perf: need to expose sched_clock to correlate user samples with kernel samples
On 04/01/2013 03:29 PM, David Ahern wrote:
> On 4/1/13 12:29 PM, John Stultz wrote:
>>> Any chance a decision can be reached in time for 3.10? Seems like the
>>> simplest option is the perf event based ioctl.
>>
>> I'm still not sold on the CLOCK_PERF posix clock. The semantics are
>> still too hand-wavy and implementation specific.
>>
>> While I'd prefer perf to export some existing semi-sane time domain
>> (using interpolation if necessary), I realize the hardware constraints
>> and performance optimizations make this unlikely (though I'm
>> disappointed I've not seen any attempt or proof point that it won't
>> work).
>>
>> Thus if we must expose this kernel detail to userland, I think we should
>> be careful about how publicly we expose such an interface, as it has the
>> potential for misuse and eventual user-land breakage.
>
> But perf_clock timestamps are already exposed to userland. This new
> API -- be it a posix clock or an ioctl -- just allows retrieval of a
> timestamp outside of a generated event.

Although perf_clock timestamps are not exposed to applications in a way
they can use for their own purposes, no? Just as timestamp data
correlated with other perf data.

My big concern here is that if we applications can retrieve these
timestamps for their own use, folks will see CLOCK_PERF as a cheaper
alternative to CLOCK_MONOTONIC, and then end up getting bitten when the
CLOCK_PERF semantics change. So until someone will hammer out exactly
the behavior CLOCK_PERF should have forever going forward, I'd rather
not add it as a generic clockid.

If we're going to have to expose the perf timestamps to userland, then
I'd prefer we do it in a less public way, where its clearly tied to the
perf interface and not as a generic clockid. (And either the ioctl or
dynamic posix clock id would be a way to go there).


>
>>
>> So while having a perf specific ioctl is still exposing what I expect
>> will be non-static kernel internal behavior to userland, it at least it
>> exposes it in a less generic fashion, which is preferable to me.
>>
>>
>>
>> The next point of conflict is likely if the ioctl method will be
>> sufficient given performance concerns. Something I'd be interested in
>> hearing about from the folks pushing this. Right now it seems any method
>> is preferable then not having an interface - but I want to make sure
>> that's really true.
>>
>> For example, if the ioctl interface is really too slow, its likely folks
>> will end up using periodic perf ioctl samples and interpolating using
>> normal vdso clock_gettime() timestamps.
>
> The performance/speed depends on how often is called. I have no idea
> what Stephane's use case is but for me it is to correlate perf_clock
> timestamps to timeofday. In my perf-based daemon that tracks process
> schedulings, I update the correlation every 5-10 minutes.

So that sounds like the ioctl approach would have no penalty from a
performance perspective.


>
>>
>> If that is acceptable, then why not invert the solution and just have
>> perf injecting periodic CLOCK_MONOTONIC timestamps into the log, then
>> have perf report fast, but less-accurate sched_clock deltas from that
>> CLOCK_MONOTONIC boundary.
>
> Something similar to that approach has been discussed as well. i.e,
> add a realtime clock event and have it injected into the stream e.g.,
> https://lkml.org/lkml/2011/2/27/158
>
> But there are cons to this approach -- e.g, you need that first event
> generated that tells you realtime to perf_clock correlation and you
> don't want to have to scan an unknown length of events looking for the
> first one to get the correlation only to backup and process the events.
>
> And an ioctl to generate that first event was shot down as well...
> https://lkml.org/lkml/2011/3/1/174
> https://lkml.org/lkml/2011/3/2/186

Hrm.

So from my quick read of that thread, what it seems Thomas is getting at
there is having the periodic CLOCK_REALTIME injection isn't valuable
without the tracepoints on timekeeping changes. But once those are
there, the periodic timestamp injection would seemingly provide _most_
of what you need.

The missing bit is the desire to inject arbitrary timestamp "fences"
into the log, which Peter and Thomas apparently don't like, but actually
sounds useful to me.

But maybe there is a way to do this without adding an ioctl?

For instance, and this is just spitballing here, if you had a tracepoint
for clock_gettime() which returned the clockid and value, you could
create these fences just by requesting the time from userland. The VDSO
clock_gettime() would avoid the syscall, so you'd have to actually call
the syscall directly from userland. But this would have the added
benefit of not slowing down normal userspace that doesn't want to cause
these fences in the log.

I realize these half-baked "brainstorming" ideas are probably a bit
unwelcome after you've spent quite a bit of time trying different
approaches without any decisive resolution from maintainers. But maybe
Thomas and Peter can chime in here and maybe help to clarify their
objections?

thanks
-john



\
 
 \ /
  Last update: 2013-04-02 01:21    [W:0.204 / U:1.184 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site