[PATCH RFC 0/4] change sb_writers to use percpu_rw_semaphore
From: Oleg Nesterov
Date: Mon Jul 13 2015 - 17:27:36 EST
Hello,
Al, Jan, could you comment? I mean the intent, the patches are
obviously not for inclusion yet.
We can remove everything from struct sb_writers except frozen
(which can become a boolean, it seems) and add the array of
percpu_rw_semaphore's instead.
__sb_start/end_write() can use percpu_down/up_read(), and
freeze/thaw_super() can use percpu_down/up_write().
Why:
- Firstly, __sb_start_write() looks simply buggy. I does
__sb_end_write() if it sees ->frozen, but if it migrates
to another CPU before percpu_counter_dec() sb_wait_write()
can wrongly succeed if there is another task which holds
the same "semaphore": sb_wait_write() can miss the result
of the previous percpu_counter_inc() but see the result
of this percpu_counter_dec().
- This code doesn't look simple. It would be better to rely
on the generic locking code.
- __sb_start_write() will be a little bit faster, but this
is minor.
Todo:
- __sb_start_write(wait => false) always fail.
Thivial, we already have percpu_down_read_trylock() just
this patch wasn't merged yet.
- sb_lockdep_release() and sb_lockdep_acquire() play with
percpu_rw_semaphore's internals.
Trivial, we need a couple of new helper in percpu-rwsem.c.
- Fix get_super_thawed(), it will spin if MS_RDONLY...
It is not clear to me what exactly should we do, but this
doesn't look hard. Perhaps it can just return if MS_RDONLY.
- Most probably I missed something else, and I do not need
how to test.
Finally. freeze_super() calls synchronize_sched_expedited() 3 times in
a row. This is bad and just stupid. But if we change percpu_rw_semaphore
to use rcu_sync (see https://lkml.org/lkml/2015/7/11/211) we can avoid
this and do synchronize_sched() only once. Just we need some more simple
changes in percpu-rwsem.c, so that all sb_writers->rw_sem[] semaphores
could use the single sb_writers->rss.
In this case destroy_super() needs some modifications too,
percpu_free_rwsem() will be might_sleep(). But this looks simple too.
Oleg.
fs/super.c | 147 +++++++++++++++++++--------------------------------
include/linux/fs.h | 14 +----
2 files changed, 58 insertions(+), 103 deletions(-)
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/