Re: [PATCH -V14 0/11] Generic name to handle and open by handle syscalls

From: Andreas Dilger
Date: Thu Jul 08 2010 - 00:31:14 EST


On 2010-07-07, at 12:05, Nick Piggin wrote:
> On Wed, Jul 07, 2010 at 11:02:47AM -0600, Andreas Dilger wrote:
>> I think you are assuming too much about the use of the file handle. What I'm interested in is not a userspace file server, but rather a more efficient way to have 10000's to millions of clients to be able to open the same regular file, without having to do full path traversal for each one.
>
> Really? What kind of clients? What sort of speedups do you hope to see?
> Path traversal can get vastly cheaper in both single threaded and parallel
> cases with my locking changes.

This is for Lustre clients, but really any kind of network filesystem is equally affected. This isn't really an issue of the local dcache performance, but rather network latency for each component of the path traversal, and for a large number of clients the metadata server is the bottleneck for doing the traversal.

> It is not acceptable to work around fixable deficiencies in our critical
> infrastructure like path walking with hacks like this. If path walking
> is still much too expensive, that's another story...

Two different problems, I'm afraid.

Cheers, Andreas
--
Andreas Dilger
Lustre Technical Lead
Oracle Corporation Canada Inc.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/