Re: [resent PATCH] Re: very slow parallel read performance

From: Rik van Riel (riel@conectiva.com.br)
Date: Fri Aug 24 2001 - 22:09:25 EST


On Sat, 25 Aug 2001, Marc A. Lehmann wrote:
> On Fri, Aug 24, 2001 at 05:19:07PM -0300, Rik van Riel <riel@conectiva.com.br> wrote:
> > Actually, no. FIFO would be ok if you had ONE readahead
> > stream going on, but when you have multiple readahead
>
> Do we all agree that read-ahead is actually the problem? ATM, I serve
> ~800 files, read()ing them in turn. When I increase the number of
> threads I have more reads at the same time in the kernel, but the
> absolute number of read() requests decreases.

        [snip evidence beyond all doubt]

Earlier today some talking between VM developers resulted
in us agreeing on trying to fix this problem by implementing
dynamic window scaling for readahead, using heuristics not
all that much different from TCP window scaling.

This should make the system able to withstand a higher load
than currently, while also allowing fast data streams to
work with more efficiently than currently.

regards,

Rik

-- 
IA64: a worthy successor to i860.

http://www.surriel.com/ http://distro.conectiva.com/

Send all your spam to aardvark@nl.linux.org (spam digging piggy)

- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Fri Aug 31 2001 - 21:00:16 EST