[GIT PULL] Btrfs updates for 6.6

From: David Sterba
Date: Mon Aug 28 2023 - 13:48:38 EST

Next message: Justin Stitt: "Re: [PATCH 4/3] selftests/hid: more fixes to build with older kernel"
Previous message: Nathan Chancellor: "Re: [PATCH] Revert "Revert "powerpc/xmon: Relax frame size for clang"""
Next in thread: pr-tracker-bot: "Re: [GIT PULL] Btrfs updates for 6.6"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Hi,

there are no new features, the bulk of the changes are fixes,
refactoring and cleanups. The notable fix is the scrub performance
restoration after rewrite in 6.4, though still only partial.

There's one change to mm/, removing prototype of folio_account_redirty().

Please pull, thanks.

User visible changes:

- sysfs, export if ACLs have been built in (CONFIG_BTRFS_FS_POSIX_ACL)

- print name and pid when device scanning processes race

Fixes:

- scrub performance drop due to rewrite in 6.4 partially restored
- do IO grouping by blg_plug/blk_unplug again
- avoid unnecessary tree searches when processing stripes, in extent
and checksum trees
- the drop is noticeable on fast PCIe devices, -66% and restored to
-33% of the original
- backports to 6.4 planned

- handle more corner cases of transaction commit during orphan cleanup
or delayed ref processing

- use correct fsid/metadata_uuid when validating super block

- copy directory permissions and time when creating a stub subvolume

Core:

- debugging feature integrity checker deprecated, to be removed in 6.7

- in zoned mode, zones are activated just before the write, making error
handling easier, now the overcommit mechanism can be enabled again
which improves performance by avoiding more frequent flushing

- v0 extent handling completely removed, deprecated long time ago

- error handling improvements

- tests
- extent buffer bitmap tests
- pinned extent splitting tests

- cleanups and refactoring
- compression writeback
- extent buffer bitmap
- space flushing, ENOSPC handling

----------------------------------------------------------------
The following changes since commit 706a741595047797872e669b3101429ab8d378ef:

Linux 6.5-rc7 (2023-08-20 15:02:52 +0200)

are available in the Git repository at:

git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git tags/for-6.6-tag

for you to fetch changes up to c02d35d89b317994bd713ba82e160c5e7f22d9c8:

btrfs: zoned: skip splitting and logical rewriting on pre-alloc write (2023-08-22 14:19:59 +0200)

----------------------------------------------------------------
Anand Jain (7):
btrfs: sysfs: show if ACL support has been compiled in
btrfs: print name and pid when device scanning processes race
btrfs: add a helper to read the superblock metadata_uuid
btrfs: simplify memcpy either of metadata_uuid or fsid
btrfs: use the correct superblock to compare fsid in btrfs_validate_super
btrfs: compare the correct fsid/metadata_uuid in btrfs_validate_super
btrfs: drop redundant check to use fs_devices::metadata_uuid

Boris Burkov (2):
btrfs: free qgroup rsv on io failure
btrfs: fix start transaction qgroup rsv double free

Christoph Hellwig (28):
btrfs: simplify the no-bioc fast path condition in btrfs_map_block
btrfs: pass a flags argument to cow_file_range
btrfs: don't create inline extents in fallback_to_cow
btrfs: split page locking out of __process_pages_contig
btrfs: remove btrfs_writepage_endio_finish_ordered
btrfs: remove end_extent_writepage
btrfs: reduce debug spam from submit_compressed_extents
btrfs: remove the return value from submit_uncompressed_range
btrfs: remove the return value from extent_write_locked_range
btrfs: improve the delalloc_to_write calculation in writepage_delalloc
btrfs: reduce the number of arguments to btrfs_run_delalloc_range
btrfs: clean up the check for uncompressed ranges in submit_one_async_extent
btrfs: don't clear async_chunk->inode in async_cow_start
btrfs: merge async_cow_start and compress_file_range
btrfs: merge submit_compressed_extents and async_cow_submit
btrfs: streamline compress_file_range
btrfs: further simplify the compress or not logic in compress_file_range
btrfs: use a separate label for the incompressible case in compress_file_range
btrfs: share the code to free the page array in compress_file_range
btrfs: don't redirty pages in compress_file_range
btrfs: refactor the zoned device handling in cow_file_range
btrfs: don't redirty locked_page in run_delalloc_zoned
btrfs: fix zoned handling in submit_uncompressed_range
mm: remove folio_account_redirty
btrfs: fix error handling when in a COW window in run_delalloc_nocow
btrfs: cleanup the COW fallback logic in run_delalloc_nocow
btrfs: consolidate the error handling in run_delalloc_nocow
btrfs: move the !zoned assert into run_delalloc_cow

Colin Ian King (2):
btrfs: scrub: remove redundant division of stripe_nr
btrfs: remove redundant initialization of variables in log_new_ancestors

David Sterba (1):
btrfs: use helper sizeof_field in struct accessors

Filipe Manana (25):
btrfs: update documentation for add_new_free_space()
btrfs: rename add_new_free_space() to btrfs_add_new_free_space()
btrfs: make btrfs_destroy_marked_extents() return void
btrfs: make btrfs_destroy_pinned_extent() return void
btrfs: make find_first_extent_bit() return a boolean
btrfs: open code trivial btrfs_add_excluded_extent()
btrfs: move btrfs_free_excluded_extents() into block-group.c
btrfs: don't start transaction when joining with TRANS_JOIN_NOSTART
btrfs: update comment for btrfs_join_transaction_nostart()
btrfs: print target number of bytes when dumping free space
btrfs: print block group super and delalloc bytes when dumping space info
btrfs: print available space for a block group when dumping a space info
btrfs: print available space across all block groups when dumping space info
btrfs: don't steal space from global rsv after a transaction abort
btrfs: store the error that turned the fs into error state
btrfs: return real error when orphan cleanup fails due to a transaction abort
btrfs: fail priority metadata ticket with real fs error
btrfs: make btrfs_cleanup_fs_roots() static
btrfs: make find_free_dev_extent() static
btrfs: merge find_free_dev_extent() and find_free_dev_extent_start()
btrfs: avoid starting new transaction when flushing delayed items and refs
btrfs: avoid starting and committing empty transaction when flushing space
btrfs: avoid start and commit empty transaction when starting qgroup rescan
btrfs: avoid start and commit empty transaction when flushing qgroups
btrfs: remove pointless empty list check when reading delayed dir indexes

Goldwyn Rodrigues (1):
btrfs: remove duplicate free_async_extent_pages() on reservation error

Josef Bacik (6):
btrfs: move comments to btrfs_loop_type definition
btrfs: wait on uncached block groups on every allocation loop
btrfs: set page extent mapped after read_folio in relocate_one_page
btrfs: tests: add extent_map tests for dropping with odd layouts
btrfs: tests: add a test for btrfs_add_extent_mapping
btrfs: tests: test invalid splitting when skipping pinned drop extent_map

Julia Lawall (1):
btrfs: zoned: use vcalloc instead of for vzalloc in btrfs_get_dev_zone_info

Lee Trager (1):
btrfs: copy dir permission and time when creating a stub subvolume

Minjie Du (1):
btrfs: use folio_next_index() helper in extent_write_cache_pages

Naohiro Aota (12):
btrfs: introduce struct to consolidate extent buffer write context
btrfs: zoned: introduce block group context to btrfs_eb_write_context
btrfs: zoned: return int from btrfs_check_meta_write_pointer
btrfs: zoned: defer advancing meta write pointer
btrfs: zoned: update meta write pointer on zone finish
btrfs: zoned: reserve zones for an active metadata/system block group
btrfs: zoned: activate metadata block group on write time
btrfs: zoned: no longer count fresh BG region as zone unusable
btrfs: zoned: don't activate non-DATA BG on allocation
btrfs: zoned: re-enable metadata over-commit for zoned mode
btrfs: zoned: do not zone finish data relocation block group
btrfs: zoned: skip splitting and logical rewriting on pre-alloc write

Qu Wenruo (22):
btrfs: add comments for btrfs_map_block()
btrfs: raid56: remove unused BTRFS_RBIO_REBUILD_MISSING
btrfs: tracepoints: simplify raid56 events
btrfs: deprecate integrity checker feature
btrfs: scrub: remove unused btrfs_path in scrub_simple_mirror()
btrfs: move eb subpage preallocation out of the loop
btrfs: tests: enhance extent buffer bitmap tests
btrfs: tests: add self tests for extent buffer memory operations
btrfs: refactor extent buffer bitmaps operations
btrfs: use write_extent_buffer() to implement write_extent_buffer_*id()
btrfs: refactor main loop in copy_extent_buffer_full()
btrfs: copy all pages at once at the end of btrfs_clone_extent_buffer()
btrfs: refactor main loop in memcpy_extent_buffer()
btrfs: refactor main loop in memmove_extent_buffer()
btrfs: handle errors properly in update_inline_extent_backref()
btrfs: output extra debug info if we failed to find an inline backref
btrfs: remove v0 extent handling
btrfs: scrub: avoid unnecessary extent tree search preparing stripes
btrfs: scrub: avoid unnecessary csum tree search preparing stripes
btrfs: scrub: fix grouping of read IO
btrfs: scrub: don't go ordered workqueue for dev-replace
btrfs: scrub: move write back of repaired sectors to scrub_stripe_read_repair_worker()

Ruan Jinjie (1):
btrfs: use LIST_HEAD() to initialize the list_head

fs/btrfs/Kconfig | 4 +-
fs/btrfs/accessors.h | 23 +-
fs/btrfs/backref.c | 29 +-
fs/btrfs/block-group.c | 73 ++--
fs/btrfs/block-group.h | 4 +-
fs/btrfs/btrfs_inode.h | 6 +-
fs/btrfs/delayed-inode.c | 3 -
fs/btrfs/dev-replace.c | 6 +-
fs/btrfs/disk-io.c | 177 ++++-----
fs/btrfs/disk-io.h | 1 -
fs/btrfs/extent-io-tree.c | 14 +-
fs/btrfs/extent-io-tree.h | 6 +-
fs/btrfs/extent-tree.c | 290 ++++++++------
fs/btrfs/extent-tree.h | 16 +-
fs/btrfs/extent_io.c | 684 +++++++++++++--------------------
fs/btrfs/extent_io.h | 35 +-
fs/btrfs/file-item.c | 34 +-
fs/btrfs/file-item.h | 6 +-
fs/btrfs/file.c | 3 +-
fs/btrfs/free-space-cache.c | 18 +-
fs/btrfs/free-space-tree.c | 13 +-
fs/btrfs/fs.h | 15 +-
fs/btrfs/inode.c | 790 +++++++++++++++-----------------------
fs/btrfs/messages.c | 16 +-
fs/btrfs/messages.h | 2 -
fs/btrfs/ordered-data.c | 8 +-
fs/btrfs/print-tree.c | 10 +-
fs/btrfs/qgroup.c | 19 +-
fs/btrfs/raid56.c | 29 +-
fs/btrfs/raid56.h | 1 -
fs/btrfs/relocation.c | 33 +-
fs/btrfs/scrub.c | 240 +++++++-----
fs/btrfs/send.c | 6 +-
fs/btrfs/space-info.c | 85 ++--
fs/btrfs/super.c | 6 +
fs/btrfs/sysfs.c | 7 +
fs/btrfs/tests/extent-io-tests.c | 306 ++++++++++++---
fs/btrfs/tests/extent-map-tests.c | 412 ++++++++++++++++++++
fs/btrfs/transaction.c | 39 +-
fs/btrfs/tree-log.c | 8 +-
fs/btrfs/volumes.c | 94 +++--
fs/btrfs/volumes.h | 3 +-
fs/btrfs/zoned.c | 292 +++++++++++---
fs/btrfs/zoned.h | 28 +-
include/linux/writeback.h | 5 -
include/trace/events/btrfs.h | 30 +-
include/uapi/linux/btrfs_tree.h | 6 +-
mm/page-writeback.c | 49 +--
48 files changed, 2289 insertions(+), 1695 deletions(-)

Next message: Justin Stitt: "Re: [PATCH 4/3] selftests/hid: more fixes to build with older kernel"
Previous message: Nathan Chancellor: "Re: [PATCH] Revert "Revert "powerpc/xmon: Relax frame size for clang"""
Next in thread: pr-tracker-bot: "Re: [GIT PULL] Btrfs updates for 6.6"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]