Re: [Unionfs] Re: + ecryptfs-dont-muck-with-the-existing-nameidata-structures.patch added to -mm tree

[Erez Zadok]

Mike, and everyone who wants to consider stacking:

If you want a stackable system to work well (instead of giving up and
"ripping it out" of your VFS), then you have to allow every major object
that is involved in the file system's implementation, to be stacked upon.
You have to think about a making things work not just for one-to-one stack,
but a stack of N levels (N > 2); or even fan-out stacks (ala Unionfs).

This means that, at the VERY least, every such object should have a way of
connecting it to its corresponding lower one(s).  More specifically, every
object needs to have some void* that is at the file system's control, into
which we can stuff info about lower objects, etc.

In all of the stackable file systems we've developed, we found it relatively
straightforward to handle struct inode, dentry, file, and superblock -- b/c
they have such a void* (or equivalent).

Things got more difficult when we had to deal w/ struct page, partly b/c
there's no easy way to have one page point to a lower page.  Struct page
also has the annoying problem that it back-refs *one* inode, via the
mapping->host (this is one major reason for the "double caching" problem).

When we ported the stackable file systems to 2.6, we noticed this new
nameidata structure being passed around to file systems.  Our initial desire
was to stack on it -- b/c that's the safest way avoid mixing objects b/t
layers.  But nameidata has no void* that one can use to stack on another.
So, instead, we looked at how precisely it was used by lower file systems.
We found out that, at least back when we did the 2.6 port, that it was ok to
just pass the nd we got from above to lower file systems, and that some file
systems didn't use it at all, so we could even just pass a null.  That
strategy may no longer work (b/c of nfsv4, it appears).

For years I've worked around similar VFS limitations, in my strong desire
not to require users to modify their kernel to use my stackable file
systems.  And this strategy was successful: stackable file systems had
become more and more popular (cf. Halcrow/IBM and www.unionfs.org :-)

But, if we we're now going to consider stacking seriously in linux, then I
think it would be best to do it cleanly.  This means that some changes to
the VFS are going to be unfortunately unavoidable.

Finally, note that just adding a void* to some structures won't
automatically make the code cleanly stackable.  Some VFS changes may be
needed, such as what Al did in 2.3: various VFS functions were split into
private VFS functions, and exported, reentrant vfs_* methods; these vfs_*
methods were very useful to us.

Sincerely,
Erez.
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/