Messages in this thread |  | | | From | Roger Larsson <> | | Subject | Re: [resent PATCH] Re: very slow parallel read performance | | Date | Fri, 24 Aug 2001 20:28:37 +0200 |
| |
On Friday den 24 August 2001 19:43, Rik van Riel wrote: > On Fri, 24 Aug 2001, Roger Larsson wrote: > > I earlier questioned this too... > > And I found out that read ahead was too short for modern disks. > > This is a patch I did it does also enable the profiling, the only needed > > line is the > > -#define MAX_READAHEAD 31 > > +#define MAX_READAHEAD 511 > > I have not tried to push it further up since this resulted in virtually > > equal total throughput for read two files than for read one. > > Note that this can have HORRIBLE effects if the total > size of all the readahead windows combined doesn't fit > in your memory. > > If you have 100 IO streams going on and you have space > for 50 of them, you'll find yourself with 100 threads > continuously pushing each other's read-ahead data out > of RAM.
Not having the patch gives you another effect - disk arm is moving from track to track in a furiously tempo... The time it takes to move is longer than the time it is allowed to read - this is not effective! That would limit throughput to half the possible. If less than 511 - 31 pages are thrown away you probably gain anyway...
One optimization to do would be to stop readahead at file fragments.
But READA pages are special since they might be read never! Streaming puts interesting kinds of pressure on VM...
/RogerL
-- Roger Larsson Skellefteå Sweden - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
|  |