[lkml]   [2002]   [Oct]   [9]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
SubjectRe: [PATCH] O_STREAMING - flag for optimal streaming I/O
On Wed, 2002-10-09 at 23:29, Erik Andersen wrote:

> I don't think grep is a very good candidate for O_STREAMING. I
> usually want the stuff I grep to stay in cache. O_STREAMING is
> much better suited to applications like ogle, vlc, xine, xmovie,
> xmms etc since there is little reason for the OS to cache things
> like songs and movies you aren't likely to hear/see again any
> time soon.

Yes. Good point. People are taking this too far. There is a big
difference between being just sequential and use-once. Grep(1) is a
great example of something that _should_ use the pagecache. Subsequent
file accesses, which will occur, should hit.

Look, the pagecache is already smart. New stuff will replace unusued
old stuff. On VM pressure, the pagecache will be pruned. Streaming I/O
is a fundamentally different problem in that the data is so large it
_continually_ thrashes the pagecache. Such I/O is sequential and
use-once. You end up with a permanent waste of memory (the cached

Let's prove we have a solution to this problem before going after
tangent ones.

Robert Love

To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to
More majordomo info at
Please read the FAQ at

 \ /
  Last update: 2005-03-22 13:29    [W:0.215 / U:3.200 seconds]
©2003-2018 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site