[PATCH v4 0/11] futex: Add support task local hash maps.
From: Sebastian Andrzej Siewior
Date: Tue Dec 03 2024 - 11:43:50 EST
Hi,
this is a follow up on
https://lore.kernel.org/ZwVOMgBMxrw7BU9A@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
and adds support for task local futex_hash_bucket. It can be created via
prctl().
This version supports resize at runtime, auto resize while creating
threads. The upper limit is at 256 * num_possible_cpus() but I guess we
can lower that.
I posted performance numbers of "perf bench futex hash"
https://lore.kernel.org/all/20241101110810.R3AnEqdu@xxxxxxxxxxxxx/
I didn't do any new. While the performance of the 16 default bucket look
worse than the 512 (after that the performance hardly changes while
before that doubles) be aware those are now task local (and not shared
with others) and it seems to be sufficient in general.
For the systems with 512CPUs and one db application we can have the
resize. So either the application needs to resize it or we offer auto
resize based on threads and CPUs. But be aware that workloads like
"xz huge_file.tar" will happily acquire all CPUs in the system and only
use a few locks in total and not very often. So it would probably
perform with two hash buckets as good as 512 in this scenario.
v3…v4: https://lore.kernel.org/all/20241115172035.795842-1-bigeasy@xxxxxxxxxxxxx/
- Completed resize. Tested with wait/wake, lock_pi, requeue and
requeue_pi.
- Added auto resize during thread creation.
- Fixed bucket initialisation of the global hash bucket resilting in a
crash sometimes.
v2…v3 https://lore.kernel.org/all/20241028121921.1264150-1-bigeasy@xxxxxxxxxxxxx/
- The default auto size for auto creation is 16.
- For the private hash jhash2 is used and only for the address.
- My "perf bench futex hash" hacks have been added.
- The structure moved from signal's struct to mm.
- It is possible resize it at runtime.
v1…v2 https://lore.kernel.org/all/20241026224306.982896-1-bigeasy@xxxxxxxxxxxxx/:
- Moved to struct signal_struct and is used process wide.
- Automaticly allocated once the first thread is created.
Sebastian