[RFC] block/nvme: exploring asynchronous durability notification semantics
From: Esteban Cerutti
Date: Thu Apr 02 2026 - 17:22:56 EST
Hi,
I would like to explore whether current NVMe completion semantics
unnecessarily conflate execution completion with durability, and
whether there is room for a more explicit, asynchronous durability
notification model between host and device.
Today, a successful write completion indicates command execution,
but not necessarily physical persistence to non-volatile media unless
FUA or Flush is used. This forces the kernel and filesystems to assume
worst-case durability behavior and rely on synchronous flushes and
barriers for safety.
The device internally knows when data is staged in volatile buffers
versus committed to NAND (or equivalent persistent media), but this
information is not exposed to the host.
This RFC explores a potential extension model with two components:
1) Multi-phase completion semantics
- Normal completion continues to signal execution.
- The device assigns a persistence token ID.
- When the data is physically committed to non-volatile media,
the device emits an asynchronous durability confirmation
referencing that token.
This would decouple execution throughput from durability
confirmation and potentially allow filesystems to close journal
transactions only upon confirmed persistence, without forcing
synchronous flush fences.
2) Advisory write intent classification
- Host-provided hints such as EPHEMERAL, STANDARD, or CRITICAL.
- CRITICAL writes would request immediate durability.
- EPHEMERAL writes could tolerate extended volatile staging.
Additionally, I am curious whether host power-state awareness
could be relevant in such a model. For example, if the kernel
can detect battery-backed operation or confirmed UPS
infrastructure, it could advertise a bounded persistence
relaxation window (e.g. guaranteed power for N ms), allowing
the device to safely extend volatile staging within that
window. This would be advisory and revocable, not a mandatory
trust model.
Questions for discussion:
- Has asynchronous durability acknowledgment been previously
explored in NVMe or block-layer discussions?
- Are there fundamental architectural reasons why separating
execution completion from durability confirmation would not
be viable?
- Would such semantics belong strictly in NVMe specification
work, or is there room for experimentation in the Linux NVMe
driver as a prototype?
- Are there known workloads where this model would clearly fail
or provide no measurable benefit?
This is not a proposal for immediate implementation, but an
attempt to identify whether the current binary durability model
(completion vs flush) leaves performance or efficiency on the
table due to lack of explicit state sharing between host and
device.
Feedback, criticism, or pointers to prior art are very welcome.
Thanks,
Esteban Cerutti