lkml.org 
[lkml]   [2008]   [Jun]   [24]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
SubjectRe: [rfc patch 3/4] splice: remove confirm from pipe_buf_operations
From
Date
> > 
> > OK it could be done, possibly at great pain. But why is it important?
> > What's the use case where it matters that splice-in should not block
> > on the read?
>
> If you're splicing from one file to another, the _goal_ you should have is
> that you want to have a mode where you can literally steal the page, and
> never _ever_ be IO-synchronous (well, meta-data accesses will be, you
> can't really avoid that sanely).
>
> IOW, it should be possible to do a
>
> - splice() file->pipe with SPLICE_STEAL
> don't even wait for the read to finish!
>
> - splice() pipe->file
> insert the page into the destination page cache, mark it dirty
>
> an no, we probably do not support that yet (for example, I wouldn't be
> surprised if "dirty + !uptodate" is considered an error for the VM even
> though the page should still be locked from the read), but it really was a
> design goal.

OK. But currently we have an implementation that

1) doesn't do any of this, unless readahead is disabled

2) if readhead is disabled, it does the async splice-in (file->pipe),
but blocks on splice-out (pipe->any)

3) it blocks on read(pipefd, ...) even if pipefd is set to O_NONBLOCK

And in addition, splice-in and splice-out can return a short count or
even zero count if the filesystem invalidates the cached pages during
the splicing (data became stale for example). Are these the right
semantics? I'm not sure.

> Also, asynchronous is important even when you "just" want to overlap IO
> with CPU, so even if it's going to the network, then if you can delay the
> "wait for IO to complete" until the last possible moment (ie the _second_
> splice, when you end up copying it into an SKB, then both your throughput
> and your latency are likely going to be noticeably better, because you've
> now been able to do a lot of the costly CPU work (system exit + entry at
> the least, but hopefully a noticeable portion of the TCP stack too)
> overlapped with the disk seeking.

My feeling is (and I'm not an expert in this area at all) is that disk
seeking will be many orders of magnitude slower than any CPU work
associated with getting the data out to the network.

> So asynchronous ops was really one of the big goals for splice.

Well, if it can be implemented right, I have nothing against that.
But what we currently have is very far from that, and it seems to me
there are very big hurdles to overcome yet.

Miklos


\
 
 \ /
  Last update: 2008-06-24 20:27    [W:0.083 / U:0.092 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site