2.2.17 poor performace with many processes

From: David Lang (david.lang@digitalinsight.com)
Date: Fri Nov 17 2000 - 16:06:36 EST


-----BEGIN PGP SIGNED MESSAGE-----

Last night I attempted to install a firewall system that runs over a
thousand processes (useing the TIS FWTK proxies). I upped the NR_TASKS to
4090 to allow them all to run.

the way the particular proxies work is to have a listener for each port
that forks off a copy of itself to handle the connection.

one issue that I was seeing however is that under a light load (~30-50
simultanious connections, ~20-30 new connections/sec) vmstat was showing
~10% user, 40%system CPU utilization.

at teh time it was useing ~80MB of ram. each proxy logs to syslog, while I
had syslog configured to write to a local file system time went up by
~10%. configuring syslog to write out a serial port makes it so running
syslog or not makes no noticable difference in the sup utilization

unfortunantly the system is no longer in production, approx 2 hours after
I went home this morning it hit the max FD limit (I had bumped it up to
16K) at ~100 connections/sec and we had to pull it out as nobody was
available to do diagnostics.

hardware is AMD thunderbird 950MHz, 512MB PC133 ram, 7200rpm ATA/66 drive

is this something that 2.4 should improve? or are there other tuning
paramaters I need to fiddle with?

David Lang

-----BEGIN PGP SIGNATURE-----
Version: PGP 6.5.2

iQEVAwUBOhWd3z7msCGEppcbAQGsQwf6A2AAnSDwtUlftuaHuIaLleu6VKEDVwwI
X2cWQfavGQFebLC01KzL9tTyEJwLHaKAhNsoKvOy7FwPFIVaOPafXlSR33tJokAD
VC/899S39MTuD1huNP7sdjVfdovqmz7KaIXxqasymiUFlB7woFsxHhfjV0T6VKi4
jkJRJCPJ7yilli2DqOllES6MBC+tMqfiZ9mnMmaiRKcbZSHEMLI/eFM06kgjzBTI
EDT0XNgj575Xa0SUC9JmOS9csxwTodfXCnfiqHwgqEAt/qGyfEZUgI1xID6HHTqH
QfNt4mejDGhsJ3uFd6sYxN/Z/DrtoQLeYU8uYB/yfH7XZA31SGJYVQ==
=qrrI
-----END PGP SIGNATURE-----
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
Please read the FAQ at http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Thu Nov 23 2000 - 21:00:14 EST