Re: -mm merge plans for 2.6.23

From: Ingo Molnar
Date: Thu Jul 26 2007 - 05:20:51 EST



* Frank Kingswood <frank@xxxxxxxxxxxxxxxxxxxxxxxxxx> wrote:

> > Disadvantage would be that the userland would need to be patched,
> > but I guess it's better than adding very dubious heuristics to the
> > kernel.
>
> Are you going to change every single large memory application in the
> world? As I wrote before, it is *not* about updatedb, but about all
> applications that use a lot of memory, and then terminate.

it is about multiple problems, _one_ problem is updatedb. The _second_
problem is large memory applications.

note that updatedb is not a "large memory application". It simply scans
through the filesystem and has pretty minimal memory footprint.

the _kernel_ ends up blowing up the dentry cache to a rather large size
(because it has no idea that updatedb uses every dentry only once).

Once we give the kernel the knowledge that the dentry wont be used again
by this app, the kernel can do a lot more intelligent decision and not
baloon the dentry cache.

( we _do_ want to baloon the dentry cache otherwise - for things like
"find" - having a fast VFS is important. But known-use-once things
like the daily updatedb job can clearly be annotated properly. )

the 'large memory apps' are a second category of problems. And those are
where swap-prefetch could indeed help. (as long as it only 'fills up'
the free memory that a large-memory-exit left behind it.)

the 'morning after' phenomenon that the majority of testers complained
about will likely be resolved by the updatedb change. The second
category is likely an improvement too, for swap-happy desktop (and
server) workloads.

Ingo
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/