[PATCH v1 0/5] mm, kpageflags: support folio and fix output for compound pages

From: Naoya Horiguchi
Date: Tue Oct 10 2023 - 10:35:58 EST

Next message: Jonathan Cameron: "Re: [PATCH 2/2] iio: light: Add support for APDS9306 Light Sensor"
Previous message: Matthew Maurer: "Re: [PATCH] x86: Enable IBT in Rust if enabled in C"
Next in thread: Naoya Horiguchi: "[PATCH v1 5/5] tools/mm/page-types.c: hide compound pages in non-raw mode"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Hi everyone,

This patchset addresses 2 issues in /proc/kpageflags.

1. We can't easily tell folio from thp, because currently both pages are
judged as thp, and
2. we see some garbage data in records of compound tail pages because
we use tail pages to store some internal data.

These issues require userspace programs to do additional work to understand
the page status, which makes situation more complicated.

This patchset tries to solve these by defining KPF_FOLIO for issue 1., and
by hiding part of page flag info on tail pages of compound pages for issue 2.

I think that technically some compound pages like thp/hugetlb/slab could be
considered as folio, but in this version KPF_FOLIO is set only on folios
in pagecache (so "folios in narrower meaning"). I'm not confident about
this choice, so if you have any idea about this, please let me know.

How we can see using tools/mm/page-types.c will change like below (only focusing
on compound pages).

Before patchset:

// anonymous thp
voffset offset len flags
...
700000000 156c00 1 ___U_l_____Ma_bH______t_____________f_d_____1
700000001 156c01 1 L__U_______Ma___T_____t_____________f_______1
700000002 156c02 1fe ___________Ma___T_____t_____________f_______1

// file thp
700000000 15d600 1 __RUDl_____M__bH______t_____________f__I____1
700000001 15d601 1 L__U_______M____T_____t_____________f_______1
700000002 15d602 1fe ___________M____T_____t_____________f_______1

// large folio
700000000 154f84 1 __RU_l_____M___H______t________P____f_____F_1
700000001 154f85 1 ________W__M____T_____t_____________f_____F_1
700000002 154f86 2 ___________M____T_____t_____________f_____F_1
700000004 14d0a4 1 __RU_l_____M___H______t________P____f_____F_1
700000005 14d0a5 1 ________W__M____T_____t_____________f_____F_1
700000006 14d0a6 2 ___________M____T_____t_____________f_____F_1
...

// free hugetlb (HVO disabled)
offset len flags
...
106a00 1 _______________H_G___________________________
106a01 1 L__U__A_________TG___________________________
106a02 1fe ________________TG___________________________

// anonymous hugetlb (HVO disabled)
700000000 157200 1 ___U_______Ma__H_G__________________f_d_____1
700000001 157201 1 L__U__A____Ma___TG__________________f_______1
700000002 157202 1fe ___________Ma___TG__________________f_______1

// free hugetlb (HVO enabled)
12a600 1 _______________H_G___________________________
12a601 1 L__U__A_________TG___________________________
12a602 3f ________________TG___________________________
12a641 1 L__U__A_________TG___________________________
12a642 3f ________________TG___________________________
...

// anonymous hugetlb (HVO enabled)
700000000 15e600 1 ___U_______Ma__H_G__________________f_d_____1
700000001 15e601 1 L__U__A____Ma___TG__________________f_______1
700000002 15e602 3e ___________Ma___TG__________________f_______1
700000040 15e640 1 ___U_______Ma___TG__________________f_d_____1
700000041 15e641 1 L__U__A____Ma___TG__________________f_______1
700000042 15e642 3e ___________Ma___TG__________________f_______1
...

// slab
flags page-count MB symbolic-flags long-symbolic-flags
0x0000000000000080 5304 20 _______S_____________________________________ slab
0x0000000000008080 1488 5 _______S_______H_____________________________ slab,compound_head
0x0000000000010081 365 1 L______S________T____________________________ locked,slab,compound_tail
0x0000000000010080 4142 16 _______S________T____________________________ slab,compound_tail
0x0000000000010180 649 2 _______SW_______T____________________________ slab,writeback,compound_tail
0x0000000000010181 474 1 L______SW_______T____________________________ locked,slab,writeback,compound_tail
0x0000000000201080 192 0 _______S____a________x_______________________ slab,anonymous,ksm
0x0000000000001080 427 1 _______S____a________________________________ slab,anonymous
0x0000000000409080 237 0 _______S____a__H______t______________________ slab,anonymous,compound_head,thp
0x0000000000411081 78 0 L______S____a___T_____t______________________ locked,slab,anonymous,compound_tail,thp
0x0000000000609080 77 0 _______S____a__H_____xt______________________ slab,anonymous,compound_head,ksm,thp
0x0000000000611081 32 0 L______S____a___T____xt______________________ locked,slab,anonymous,compound_tail,ksm,thp
0x0000000000411080 698 2 _______S____a___T_____t______________________ slab,anonymous,compound_tail,thp
0x0000000000611080 142 0 _______S____a___T____xt______________________ slab,anonymous,compound_tail,ksm,thp
0x0000000000611180 32 0 _______SW___a___T____xt______________________ slab,writeback,anonymous,compound_tail,ksm,thp
0x0000000000411181 95 0 L______SW___a___T_____t______________________ locked,slab,writeback,anonymous,compound_tail,thp
0x0000000000411180 64 0 _______SW___a___T_____t______________________ slab,writeback,anonymous,compound_tail,thp
0x0000000000611181 13 0 L______SW___a___T____xt______________________ locked,slab,writeback,anonymous,compound_tail,ksm,thp

After patchset:

// anonymous thp
700000000 117000 1 ___U_l_____Ma_bH______t_____________f_d_____1
700000001 117001 1ff ________________T_____t_____________f_______1

// file thp
700000000 118400 1 __RUDl_____M__bH______t_____________f__I____1
700000001 118401 1ff ________________T_____t_____________f_______1

// large folio
700000000 148da4 1 __RU_l_____M___H___________f___P____f_____F_1
700000001 148da5 3 ________________T__________f________f_____F_1
700000004 148da8 1 __RU_l_____M___H___________f___P____f_____F_1
700000005 148da9 3 ________________T__________f________f_____F_1

// free hugetlb (HVO disabled)
116000 1 _______________H_G___________________________
116001 1ff ________________TG___________________________

// anonymous hugetlb (HVO disabled)
700000000 116000 1 ___U_______Ma__H_G__________________f_d_____1
700000001 116001 1ff ________________TG__________________f_______1

// free hugetlb (HVO enabled)
116000 1 _______________H_G___________________________
116001 1ff ________________TG___________________________

// anonymous hugetlb (HVO enabled)
700000000 116000 1 ___U_______Ma__H_G__________________f_d_____1
700000001 116001 1ff ________________TG__________________f_______1

// slab
0x0000000000000080 5659 22 _______S_____________________________________ slab
0x0000000000008080 1644 6 _______S_______H_____________________________ slab,compound_head
0x0000000000010080 6196 24 _______S________T____________________________ slab,compound_tail

Thanks,
Naoya Horiguchi
---
Summary:

Naoya Horiguchi (5):
include/uapi/linux/kernel-page-flags.h: define KPF_FOLIO
mm: kpageflags: distinguish thp and folio
mm, kpageflags: separate code path for hugetlb pages
mm, kpageflags: fix invalid output for PageSlab
tools/mm/page-types.c: hide compound pages in non-raw mode

fs/proc/page.c | 90 +++++++++++++++++++---------------
include/uapi/linux/kernel-page-flags.h | 1 +
tools/mm/page-types.c | 3 +-
3 files changed, 53 insertions(+), 41 deletions(-)

Next message: Jonathan Cameron: "Re: [PATCH 2/2] iio: light: Add support for APDS9306 Light Sensor"
Previous message: Matthew Maurer: "Re: [PATCH] x86: Enable IBT in Rust if enabled in C"
Next in thread: Naoya Horiguchi: "[PATCH v1 5/5] tools/mm/page-types.c: hide compound pages in non-raw mode"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]