Re: Maximum files per Directory

From: H. Peter Anvin (hpa@transmeta.com)
Date: Wed May 02 2001 - 11:13:07 EST


Ingo Oeser wrote:
>
> On Tue, May 01, 2001 at 03:03:44PM -0700, H. Peter Anvin wrote:
> > > Bit of both. You exceeded the max link count, and your
> > > performance would have been abominable too. cyrus should be
> > > using heirarchies of directories for very large amounts of
> > > stuff.
> Right.
>
> > But also showing, once again, that this particular scalability problem
> > really is a headache for some people.
>
> If you do ls on that directory as an admin, you'll see, what the
> REAL cause of this headache is:
>
> The application doing such stupid thing!
>
> People (writing applications) building up such large directories
> should be forced to read every entry of it aloud.
>
> Then they'll learn[1] and the problem is solved.
>

"Violence is the last refuge of the incompetent."

Seriously, I don't buy this "the application is doing something stupid."
The application is using the VFS the way it is advertised to work. If
you think doing ls on an extrememly large directory is painful, you have
never seen the droppings of an application which tries to do
load-balancing between directories by doing real hashing. THAT is
painful! At least in the first case you can use grep.

The only ones we fool by repeating the mantra "stupid admin, stupid
application" is ourselves.

        -hpa

-- 
<hpa@transmeta.com> at work, <hpa@zytor.com> in private!
"Unix gives you enough rope to shoot yourself in the foot."
http://www.zytor.com/~hpa/puzzle.txt
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Mon May 07 2001 - 21:00:13 EST