Re: [LKP] [lkp] [xfs] 68a9f5e700: aim7.jobs-per-min -13.6% regression

From: Fengguang Wu
Date: Tue Aug 16 2016 - 09:26:28 EST

On Sun, Aug 14, 2016 at 06:17:24PM +0200, Christoph Hellwig wrote:
Snipping the long contest:

I think there are three observations here:

(1) removing the mark_page_accessed (which is the only significant
change in the parent commit) hurts the
aim7/1BRD_48G-xfs-disk_rr-3000-performance/ivb44 test.
I'd still rather stick to the filemap version and let the
VM people sort it out. How do the numbers for this test
look for XFS vs say ext4 and btrfs?

Here is a basic comparison of the 3 filesystems based on 99091700 ("
Merge tag 'nfs-for-4.8-2' of git://git.linux-nfs.org/projects/trondmy/linux-nfs").

% compare -a -g 99091700659f4df965e138b38b4fa26a29b7eade -d fs xfs ext4 btrfs

xfs ext4 btrfs testcase/testparams/testbox
---------------- -------------------------- -------------------------- ---------------------------
%stddev change %stddev change %stddev
\ | \ | \
193335 -27% 141400 -100% 8 GEO-MEAN aim7.jobs-per-min
267649 Â 3% -51% 130085 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
485217 Â 3% 402% 2434088 Â 3% 350% 2184471 Â 4% aim7/1BRD_48G-disk_rd-9000-performance/ivb44
360286 -64% 130351 aim7/1BRD_48G-disk_rr-3000-performance/ivb44
338114 -78% 73280 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
60130 Â 5% 361% 277035 aim7/1BRD_48G-disk_src-3000-performance/ivb44
403144 -68% 127584 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
26327 -60% 10571 aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
2652 -96% 118 -82% 468 GEO-MEAN fsmark.files_per_sec
393 Â 4% -6% 368 Â 3% 10% 433 Â 5% fsmark/1x-1t-1BRD_48G-4M-40G-NoSync-performance/ivb44
200 -4% 191 -7% 185 Â 6% fsmark/1x-1t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
1583 Â 3% -29% 1130 -31% 1088 fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
21363 59% 33958 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
11033 -17% 9117 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
11833 12% 13234 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
2381976 -100% 6598 -96% 100973 GEO-MEAN fsmark.app_overhead
564520 Â 7% 21% 681192 Â 3% 63% 919364 Â 3% fsmark/1x-64t-1BRD_48G-4M-40G-NoSync-performance/ivb44
860074 Â 5% 112% 1820590 Â 14% 47% 1262443 Â 3% fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
12232633 -18% 10085199 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
3143334 -11% 2784178 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
4107347 -21% 3248210 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

Thanks,
Fengguang
---

Some less important numbers.

xfs ext4 btrfs
---------------- -------------------------- --------------------------
1314 222% 4225 -100% 2 GEO-MEAN aim7.time.system_time
1491 Â 6% 302% 6004 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
4786 Â 3% -89% 502 Â 7% -87% 632 Â 7% aim7/1BRD_48G-disk_rd-9000-performance/ivb44
756 689% 5971 aim7/1BRD_48G-disk_rr-3000-performance/ivb44
891 1146% 11108 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
940 Â 5% 70% 1598 aim7/1BRD_48G-disk_src-3000-performance/ivb44
599 925% 6148 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
2496 390% 12225 aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
154597 185% 440025 GEO-MEAN aim7.time.minor_page_faults
156203 144% 381038 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
155952 132% 362294 Â 3% aim7/1BRD_48G-disk_rr-3000-performance/ivb44
157550 266% 577044 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
153880 152% 387212 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
149531 Â 5% 258% 534809 Â 4% aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
86.94 37% 119.10 -98% 1.59 GEO-MEAN aim7.time.elapsed_time
67.56 Â 3% 105% 138.61 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
112.15 Â 3% -80% 22.93 Â 3% -77% 25.48 Â 4% aim7/1BRD_48G-disk_rd-9000-performance/ivb44
50.19 176% 138.32 aim7/1BRD_48G-disk_rr-3000-performance/ivb44
53.46 360% 245.91 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
300.63 Â 5% -78% 65.30 aim7/1BRD_48G-disk_src-3000-performance/ivb44
44.88 215% 141.35 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
136.82 149% 340.59 aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
22.55 27% 28.54 GEO-MEAN aim7.time.user_time
18.74 46% 27.27 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
28.71 28% 36.88 aim7/1BRD_48G-disk_rr-3000-performance/ivb44
29.59 38% 40.74 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
41.42 Â 4% -50% 20.90 aim7/1BRD_48G-disk_src-3000-performance/ivb44
10.93 61% 17.61 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
18.26 96% 35.85 aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
1171009 -44% 660859 -100% 4 GEO-MEAN aim7.time.voluntary_context_switches
325355 -7% 303228 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
58321 Â 8% -48% 30407 -44% 32487 Â 3% aim7/1BRD_48G-disk_rd-9000-performance/ivb44
437880 -37% 275709 aim7/1BRD_48G-disk_rr-3000-performance/ivb44
395047 31% 518201 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
31067301 -93% 2034955 Â 5% aim7/1BRD_48G-disk_src-3000-performance/ivb44
506749 -38% 315597 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
58429810 11% 65070475 aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
41445 658% 314065 -100% 4 GEO-MEAN aim7.time.involuntary_context_switches
21627 Â 5% 3118% 695989 aim7/1BRD_48G-disk_cp-3000-performance/ivb44
594383 Â 5% -96% 25928 Â 7% -94% 38082 Â 11% aim7/1BRD_48G-disk_rd-9000-performance/ivb44
12980 5128% 678629 aim7/1BRD_48G-disk_rr-3000-performance/ivb44
14729 10572% 1571856 aim7/1BRD_48G-disk_rw-3000-performance/ivb44
5894 Â 3% 249% 20595 Â 8% aim7/1BRD_48G-disk_src-3000-performance/ivb44
8950 7842% 710852 aim7/1BRD_48G-disk_wrt-3000-performance/ivb44
1620035 -34% 1069492 aim7/1BRD_48G-sync_disk_rw-600-performance/ivb44

xfs ext4 btrfs
---------------- -------------------------- --------------------------
132117 -100% 216 -99% 990 GEO-MEAN fsmark.time.involuntary_context_switches
14651 -99% 86 Â 3% -99% 120 Â 9% fsmark/1x-1t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
553 413% 2840 Â 3% 8078% 45278 Â 31% fsmark/1x-64t-1BRD_48G-4M-40G-NoSync-performance/ivb44
19895 Â 3% -33% 13242 487% 116776 Â 3% fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
6206551 -99% 31906 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
1992225 -100% 1236 Â 5% fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
2664982 -100% 1202 Â 10% fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
1755485 -100% 3248 -93% 120902 GEO-MEAN fsmark.time.voluntary_context_switches
542900 -98% 10270 -98% 10291 fsmark/1x-1t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
36634 Â 6% -17% 30317 3893% 1462650 Â 9% fsmark/1x-64t-1BRD_48G-4M-40G-NoSync-performance/ivb44
162300 Â 15% -55% 72808 89% 306208 fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
58499255 -11% 51789210 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
10792062 168% 28969245 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
14361647 63% 23390858 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
391 -98% 7 -88% 47 GEO-MEAN fsmark.time.elapsed_time
591 -37% 371 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
285 21% 345 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
354 -11% 317 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
294.98 -88% 36.23 -51% 145.31 GEO-MEAN fsmark.time.system_time
45.16 Â 5% 157% 116.15 820% 415.73 Â 7% fsmark/1x-64t-1BRD_48G-4M-40G-NoSync-performance/ivb44
262.79 Â 4% 29% 338.49 21% 316.76 Â 4% fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
1419.35 12% 1587.76 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
320.95 124% 719.99 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
413.11 65% 683.20 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
222 -68% 70 -27% 161 GEO-MEAN fsmark.time.percent_of_cpu_this_job_got
91 Â 4% 9% 99 7% 97 fsmark/1x-1t-1BRD_48G-4M-40G-NoSync-performance/ivb44
95 3% 98 3% 98 fsmark/1x-1t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
214 Â 3% 152% 540 807% 1940 Â 9% fsmark/1x-64t-1BRD_48G-4M-40G-NoSync-performance/ivb44
3938 -7% 3668 -17% 3286 fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
253 75% 443 fsmark/8-1SSD-16-9B-48G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
118 80% 213 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
123 80% 221 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
15893 -96% 649 46% 23186 GEO-MEAN fsmark.time.minor_page_faults
10532 34% 14137 125% 23697 Â 5% fsmark/1x-64t-1BRD_48G-4M-40G-NoSync-performance/ivb44
17053 14% 19388 9% 18557 fsmark/1x-64t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
22352 Â 34% 27% 28346 Â 28% fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4

xfs ext4 btrfs
---------------- -------------------------- --------------------------
30857819 -100% 5089 405% 1.559e+08 GEO-MEAN fsmark.time.file_system_outputs
6400000 Â 50% 25% 8000000 2051% 1.377e+08 fsmark/1x-1t-1BRD_32G-4K-4G-fsyncBeforeClose-1fpd-performance/ivb43
83886080 83886080 85633962 fsmark/1x-1t-1BRD_48G-4M-40G-fsyncBeforeClose-performance/ivb44
50331648 352% 2.277e+08 fsmark/8-1SSD-4-8K-24G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4
33554432 555% 2.199e+08 fsmark/8-1SSD-4-9B-16G-fsyncBeforeClose-16d-256fpd-performance/lkp-hsw-ep4