Re: reiserfs, xfs, ext2, ext3

From: Martin Hamilton (martin@net.lut.ac.uk)
Date: Thu May 10 2001 - 08:14:27 EST


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Content-Type: text/plain; charset=us-ascii

Just to pick up on this thread, to operate the JANET Web Cache Service
(proxy caching thingy used by a lot of ac.uk folk) we currently run
Squid on top of 2.2.18 + Linux Virtual Server 1.0.5 + ReiserFS 3.5.31
and the Magic-SysRq-over-serial-console patch.

In almost a year of operation (admittedly covering a couple of earlier
kernel/ReiserFS/... combos, and gradually migrated to our 40-odd cache
servers) we've only ever had a couple of wibbles which directly
implicated ReiserFS - and these on servers which later turned out to
have hardware problems. Lockups on the older 3c905 and eepro100
drivers have caused us some problems historically, though.

As the JANET backbone has migrated to 2.5Gbit/s we've seen our daily
transaction rate rise to over 100m URLs, with one peak of 120m. Moving
our cache filesystems from ext2 to ReiserFS almost tripled the number
of requests we could process per second before a cache box became
overloaded, and our fastest machines (6 x 10,000 RPM Ultra160 SCSI
cache disks) are now shipping some 230 requests/s with around 50ms
latency for a cache hit.

FWIW, we're currently using Squid 2.2.STABLE5-hno.20000202 and using
ReiserFS as a regular filesystem rather than raw, so there ought to be
quite a bit of scope for improvement. Commercial caching systems have
demonstrated thoughput of thousands of requests/s with similar
hardware, but I suspect Tux-ification of Squid will be necessary to
catch up with them. This (in the form of our old chum the proprietary
loadable kernel module :-) seems to be the direction the commercial
vendors are going in to get maximal performance out of their Linux
ports...

Cheers,

Martin

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.4 (GNU/Linux)
Comment: Exmh version 2.1.1 10/15/1999 + martin

iD8DBQE6+pQyVw+hz3xBJfQRApYsAKCuy1yPe/KarPluSeTB6OKgmfQ+8wCfYPi2
li9nQT05bhlj7Us3fXf3+l8=
=biJi
-----END PGP SIGNATURE-----

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Tue May 15 2001 - 21:00:22 EST