[PATCH tip/core/rcu 0/18] No-CBs cblist updates for v5.3-rc2

From: Paul E. McKenney
Date: Thu Aug 01 2019 - 19:08:14 EST


Hello!

This series reduces memory footprint (RCU callbacks posted by no-CBs CPUs)
by causing the no-CBs CPUs to use the existing ->cblist segmented callback
list. This allows these callbacks to take advantage of RCU grace periods
that were started by something other than the corresponding rcuog kthread:

1. Use separate flag to indicate disabled ->cblist.

2. Use separate flag to indicate offloaded ->cblist.

3. Add checks for offloaded callback processing.

4. Make rcutree_migrate_callbacks() start at leaf rcu_node structure.

5. Check for deferred nocb wakeups before nohz_full early exit.

6. Remove deferred wakeup checks for extended quiescent states.

7. Allow lockless use of rcu_segcblist_restempty().

8. Allow lockless use of rcu_segcblist_empty().

9. Leave ->cblist enabled for no-CBs CPUs.

10. Use rcu_segcblist for no-CBs CPUs.

11. Remove obsolete nocb_head and nocb_tail fields.

12. Remove obsolete nocb_q_count and nocb_q_count_lazy fields.

13. Remove obsolete nocb_cb_tail and nocb_cb_head fields.

14. Remove obsolete nocb_gp_head and nocb_gp_tail fields.

15. Use build-time no-CBs check in rcu_do_batch().

16. Use build-time no-CBs check in rcu_core().

17. Use build-time no-CBs check in rcu_pending().

18. Suppress uninitialized false-positive in nocb_gp_wait().

Thanx, Paul

------------------------------------------------------------------------

include/linux/rcu_segcblist.h | 2
include/trace/events/rcu.h | 1
kernel/rcu/rcu_segcblist.c | 64 +++-
kernel/rcu/rcu_segcblist.h | 16 -
kernel/rcu/tree.c | 188 +++++++------
kernel/rcu/tree.h | 29 --
kernel/rcu/tree_plugin.h | 588 ++++++++++++++----------------------------
7 files changed, 374 insertions(+), 514 deletions(-)