[linux-next:master] [mm/hugetlb_vmemmap] 875fa64577: vm-scalability.throughput -34.3% regression

From: kernel test robot
Date: Tue Jul 09 2024 - 01:11:43 EST




Hello,

kernel test robot noticed a -34.3% regression of vm-scalability.throughput on:


commit: 875fa64577da9bc8e9963ee14fef8433f20653e7 ("mm/hugetlb_vmemmap: fix race with speculative PFN walkers")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

[still regression on linux-next/master 0b58e108042b0ed28a71cd7edf5175999955b233]

testcase: vm-scalability
test machine: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz (Ice Lake) with 256G memory
parameters:

runtime: 300s
size: 512G
test: anon-cow-rand-hugetlb
cpufreq_governor: performance




If you fix the issue in a separate patch/commit (i.e. not just a new version of
the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <oliver.sang@xxxxxxxxx>
| Closes: https://lore.kernel.org/oe-lkp/202407091001.1250ad4a-oliver.sang@xxxxxxxxx


Details are as below:
-------------------------------------------------------------------------------------------------->


The kernel config and materials to reproduce are available at:
https://download.01.org/0day-ci/archive/20240709/202407091001.1250ad4a-oliver.sang@xxxxxxxxx

=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/size/tbox_group/test/testcase:
gcc-13/performance/x86_64-rhel-8.3/debian-12-x86_64-20240206.cgz/300s/512G/lkp-icl-2sp2/anon-cow-rand-hugetlb/vm-scalability

commit:
73236245e0 ("cachestat: do not flush stats in recency check")
875fa64577 ("mm/hugetlb_vmemmap: fix race with speculative PFN walkers")

73236245e0b47ea3 875fa64577da9bc8e9963ee14fe
---------------- ---------------------------
%stddev %change %stddev
\ | \
4.447e+09 ± 13% +342.0% 1.966e+10 ± 7% cpuidle..time
753730 ± 2% +1105.0% 9082792 ± 6% cpuidle..usage
582089 ± 6% +20.7% 702337 ± 8% numa-numastat.node0.local_node
658053 ± 5% +18.3% 778277 ± 3% numa-numastat.node0.numa_hit
255.89 ± 2% +32.4% 338.76 ± 3% uptime.boot
10264 ± 7% +147.3% 25384 ± 5% uptime.idle
2.00 ± 76% +72475.0% 1451 ±125% perf-c2c.DRAM.local
38.50 ± 13% +20427.7% 7903 ± 92% perf-c2c.DRAM.remote
23.33 ± 17% +1567.9% 389.17 ± 61% perf-c2c.HITM.local
11.33 ± 35% +1902.9% 227.00 ± 84% perf-c2c.HITM.remote
17.44 ± 10% +208.4% 53.80 ± 2% vmstat.cpu.id
71.79 ± 2% -37.5% 44.87 ± 3% vmstat.cpu.us
107.92 ± 2% -43.9% 60.57 ± 3% vmstat.procs.r
2724 ± 4% +151.1% 6842 ± 3% vmstat.system.cs
134997 ± 4% -23.8% 102899 ± 7% vmstat.system.in
16.63 ± 11% +36.8 53.43 ± 2% mpstat.cpu.all.idle%
0.34 ± 3% -0.1 0.21 ± 2% mpstat.cpu.all.irq%
0.03 ± 6% +0.0 0.04 ± 9% mpstat.cpu.all.soft%
10.61 ± 3% -9.5 1.15 ± 38% mpstat.cpu.all.sys%
72.40 ± 2% -27.2 45.16 ± 3% mpstat.cpu.all.usr%
6.83 ± 34% +195.1% 20.17 ± 3% mpstat.max_utilization.seconds
102366 ± 29% +115.2% 220258 ± 7% meminfo.AnonHugePages
70562810 +14.4% 80723780 meminfo.CommitLimit
43743 ± 2% -22.7% 33821 ± 2% meminfo.HugePages_Surp
43743 ± 2% -22.7% 33821 ± 2% meminfo.HugePages_Total
89587444 ± 2% -22.7% 69265470 ± 2% meminfo.Hugetlb
66355 ± 18% -40.8% 39283 ± 15% meminfo.Mapped
1.341e+08 +15.3% 1.545e+08 meminfo.MemAvailable
1.351e+08 +15.1% 1.555e+08 meminfo.MemFree
95643557 ± 2% -21.4% 75182673 ± 2% meminfo.Memused
49588 ± 2% -31.7% 33871 ± 3% vm-scalability.median
8.02 ± 9% -2.6 5.40 ± 12% vm-scalability.median_stddev%
6842353 -34.3% 4498326 ± 2% vm-scalability.throughput
205.20 ± 2% +40.7% 288.76 ± 4% vm-scalability.time.elapsed_time
205.20 ± 2% +40.7% 288.76 ± 4% vm-scalability.time.elapsed_time.max
149773 ± 2% -47.3% 78866 ± 3% vm-scalability.time.involuntary_context_switches
10634 ± 2% -43.5% 6008 ± 3% vm-scalability.time.percent_of_cpu_this_job_got
2772 ± 5% -84.9% 419.47 ± 42% vm-scalability.time.system_time
19039 -11.2% 16908 vm-scalability.time.user_time
14514 ± 2% +4380.2% 650265 vm-scalability.time.voluntary_context_switches
617106 ± 42% -67.8% 198580 ±130% numa-vmstat.node0.nr_file_pages
8937 ± 42% -65.6% 3075 ±110% numa-vmstat.node0.nr_mapped
18779 ± 30% -35.4% 12124 ± 40% numa-vmstat.node0.nr_slab_reclaimable
603050 ± 43% -70.7% 176415 ±148% numa-vmstat.node0.nr_unevictable
603050 ± 43% -70.7% 176415 ±148% numa-vmstat.node0.nr_zone_unevictable
657413 ± 5% +18.2% 776975 ± 3% numa-vmstat.node0.numa_hit
581443 ± 6% +20.6% 701035 ± 8% numa-vmstat.node0.numa_local
214166 ±122% +192.8% 627105 ± 40% numa-vmstat.node1.nr_file_pages
11263349 ± 5% +35.8% 15297395 ± 7% numa-vmstat.node1.nr_free_pages
9478 ± 59% +72.7% 16368 ± 29% numa-vmstat.node1.nr_slab_reclaimable
163852 ±161% +260.4% 590489 ± 44% numa-vmstat.node1.nr_unevictable
163852 ±161% +260.4% 590489 ± 44% numa-vmstat.node1.nr_zone_unevictable
49.90 ± 29% +115.4% 107.47 ± 7% proc-vmstat.nr_anon_transparent_hugepages
3345235 +15.3% 3857626 proc-vmstat.nr_dirty_background_threshold
6698650 +15.3% 7724685 proc-vmstat.nr_dirty_threshold
33770919 +15.2% 38900683 proc-vmstat.nr_free_pages
196929 -2.3% 192368 proc-vmstat.nr_inactive_anon
16843 ± 18% -40.4% 10031 ± 14% proc-vmstat.nr_mapped
2693 -7.6% 2487 proc-vmstat.nr_page_table_pages
196929 -2.3% 192368 proc-vmstat.nr_zone_inactive_anon
1404664 +9.0% 1530693 ± 3% proc-vmstat.numa_hit
1271130 +9.3% 1389279 ± 3% proc-vmstat.numa_local
69467 ± 7% -34.8% 45284 ± 22% proc-vmstat.pgactivate
1263160 +12.8% 1425219 ± 3% proc-vmstat.pgfault
37012 +16.6% 43157 ± 4% proc-vmstat.pgreuse
2468473 ± 42% -67.8% 794312 ±130% numa-meminfo.node0.FilePages
75120 ± 30% -35.4% 48496 ± 40% numa-meminfo.node0.KReclaimable
35040 ± 42% -66.3% 11825 ±112% numa-meminfo.node0.Mapped
75120 ± 30% -35.4% 48496 ± 40% numa-meminfo.node0.SReclaimable
227978 ± 10% -17.0% 189123 ± 10% numa-meminfo.node0.Slab
2412201 ± 43% -70.7% 705661 ±148% numa-meminfo.node0.Unevictable
856474 ±123% +192.9% 2508266 ± 40% numa-meminfo.node1.FilePages
25221 ± 4% -34.1% 16618 ± 13% numa-meminfo.node1.HugePages_Surp
25221 ± 4% -34.1% 16618 ± 13% numa-meminfo.node1.HugePages_Total
37917 ± 59% +72.7% 65467 ± 30% numa-meminfo.node1.KReclaimable
45044169 ± 5% +35.8% 61184692 ± 7% numa-meminfo.node1.MemFree
53983914 ± 4% -29.9% 37843391 ± 12% numa-meminfo.node1.MemUsed
37917 ± 59% +72.7% 65467 ± 30% numa-meminfo.node1.SReclaimable
153538 ± 16% +26.2% 193736 ± 10% numa-meminfo.node1.Slab
655409 ±161% +260.4% 2361959 ± 44% numa-meminfo.node1.Unevictable
1482 ± 9% -17.5% 1223 ± 9% sched_debug.cfs_rq:/.runnable_avg.max
661.67 ± 14% -93.0% 46.09 ± 15% sched_debug.cfs_rq:/.util_est.avg
1286 ± 12% -61.4% 496.42 ± 37% sched_debug.cfs_rq:/.util_est.max
123.89 ± 48% -57.2% 53.08 ± 29% sched_debug.cfs_rq:/.util_est.stddev
125242 ± 11% +35.5% 169710 ± 10% sched_debug.cpu.clock.avg
125264 ± 11% +35.5% 169723 ± 10% sched_debug.cpu.clock.max
125213 ± 11% +35.5% 169693 ± 10% sched_debug.cpu.clock.min
124816 ± 11% +35.6% 169267 ± 10% sched_debug.cpu.clock_task.avg
125011 ± 11% +35.6% 169465 ± 10% sched_debug.cpu.clock_task.max
115620 ± 12% +37.8% 159344 ± 10% sched_debug.cpu.clock_task.min
2909 ± 14% +172.9% 7941 ± 10% sched_debug.cpu.nr_switches.avg
715.68 ± 18% +470.7% 4084 ± 23% sched_debug.cpu.nr_switches.min
125215 ± 11% +35.5% 169695 ± 10% sched_debug.cpu_clk
123982 ± 11% +35.9% 168463 ± 10% sched_debug.ktime
126127 ± 11% +35.3% 170626 ± 10% sched_debug.sched_clk
15.81 ± 2% +357.5% 72.34 ± 5% perf-stat.i.MPKI
1.46e+10 ± 2% -32.9% 9.801e+09 ± 4% perf-stat.i.branch-instructions
0.10 ± 3% +0.5 0.65 ± 5% perf-stat.i.branch-miss-rate%
10768595 -27.8% 7778807 ± 3% perf-stat.i.branch-misses
96.93 -19.0 77.95 perf-stat.i.cache-miss-rate%
8.054e+08 ± 2% -33.0% 5.398e+08 ± 4% perf-stat.i.cache-misses
8.26e+08 ± 2% -29.1% 5.855e+08 ± 4% perf-stat.i.cache-references
2668 ± 4% +159.7% 6928 ± 3% perf-stat.i.context-switches
5.07 +42.6% 7.24 ± 12% perf-stat.i.cpi
2.809e+11 ± 2% -44.1% 1.571e+11 ± 3% perf-stat.i.cpu-cycles
213.40 ± 2% +41.5% 301.92 ± 5% perf-stat.i.cpu-migrations
360.56 -9.5% 326.39 ± 5% perf-stat.i.cycles-between-cache-misses
6.256e+10 ± 2% -32.6% 4.218e+10 ± 4% perf-stat.i.instructions
0.24 +39.6% 0.33 ± 3% perf-stat.i.ipc
5779 ± 2% -18.1% 4735 ± 2% perf-stat.i.minor-faults
5780 ± 2% -18.1% 4737 ± 2% perf-stat.i.page-faults
12.99 -1.8% 12.75 perf-stat.overall.MPKI
97.43 -5.1 92.33 perf-stat.overall.cache-miss-rate%
4.52 -17.5% 3.72 perf-stat.overall.cpi
347.63 -16.0% 291.93 perf-stat.overall.cycles-between-cache-misses
0.22 +21.3% 0.27 perf-stat.overall.ipc
10915 -3.4% 10545 perf-stat.overall.path-length
1.433e+10 ± 2% -31.5% 9.821e+09 ± 4% perf-stat.ps.branch-instructions
10358936 ± 2% -25.2% 7745475 ± 4% perf-stat.ps.branch-misses
7.973e+08 ± 2% -32.4% 5.389e+08 ± 4% perf-stat.ps.cache-misses
8.183e+08 ± 2% -28.7% 5.838e+08 ± 4% perf-stat.ps.cache-references
2648 ± 4% +157.5% 6819 ± 3% perf-stat.ps.context-switches
2.771e+11 ± 2% -43.3% 1.572e+11 ± 3% perf-stat.ps.cpu-cycles
211.28 ± 2% +41.6% 299.23 ± 5% perf-stat.ps.cpu-migrations
6.139e+10 ± 2% -31.2% 4.226e+10 ± 4% perf-stat.ps.instructions
5815 ± 2% -19.4% 4686 ± 2% perf-stat.ps.minor-faults
5816 ± 2% -19.4% 4687 ± 2% perf-stat.ps.page-faults
1.265e+13 -3.4% 1.222e+13 perf-stat.total.instructions
60.25 ± 15% -13.0 47.20 ± 55% perf-profile.calltrace.cycles-pp.do_rw_once
47.47 ± 14% -8.3 39.13 ± 57% perf-profile.calltrace.cycles-pp.lrand48_r@plt
2.17 ±130% -1.5 0.65 ±159% perf-profile.calltrace.cycles-pp.__mutex_lock.hugetlb_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
1.57 ±127% -1.0 0.59 ±160% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.hugetlb_fault.handle_mm_fault.do_user_addr_fault
0.56 ±146% -0.6 0.00 perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.hugetlb_fault.handle_mm_fault.do_user_addr_fault
1.30 ± 48% -0.4 0.88 ± 71% perf-profile.calltrace.cycles-pp.lrand48_r
2.11 ± 14% -0.1 1.99 ± 49% perf-profile.calltrace.cycles-pp.nrand48_r
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.ast_mode_config_helper_atomic_commit_tail.commit_tail.drm_atomic_helper_commit.drm_atomic_commit.drm_atomic_helper_dirtyfb
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.ast_primary_plane_helper_atomic_update.drm_atomic_helper_commit_planes.drm_atomic_helper_commit_tail_rpm.ast_mode_config_helper_atomic_commit_tail.commit_tail
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.commit_tail.drm_atomic_helper_commit.drm_atomic_commit.drm_atomic_helper_dirtyfb.drm_fbdev_generic_helper_fb_dirty
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.drm_atomic_helper_commit_planes.drm_atomic_helper_commit_tail_rpm.ast_mode_config_helper_atomic_commit_tail.commit_tail.drm_atomic_helper_commit
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.drm_atomic_helper_commit_tail_rpm.ast_mode_config_helper_atomic_commit_tail.commit_tail.drm_atomic_helper_commit.drm_atomic_commit
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.drm_fb_memcpy.ast_primary_plane_helper_atomic_update.drm_atomic_helper_commit_planes.drm_atomic_helper_commit_tail_rpm.ast_mode_config_helper_atomic_commit_tail
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.alloc_hugetlb_folio.hugetlb_wp.hugetlb_fault.handle_mm_fault
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.drm_atomic_commit.drm_atomic_helper_dirtyfb.drm_fbdev_generic_helper_fb_dirty.drm_fb_helper_damage_work.process_one_work
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.drm_atomic_helper_commit.drm_atomic_commit.drm_atomic_helper_dirtyfb.drm_fbdev_generic_helper_fb_dirty.drm_fb_helper_damage_work
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.drm_atomic_helper_dirtyfb.drm_fbdev_generic_helper_fb_dirty.drm_fb_helper_damage_work.process_one_work.worker_thread
0.00 +0.1 0.08 ±223% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.alloc_hugetlb_folio.hugetlb_wp.hugetlb_fault
0.00 +0.1 0.09 ±223% perf-profile.calltrace.cycles-pp.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +0.1 0.09 ±223% perf-profile.calltrace.cycles-pp.drm_fbdev_generic_helper_fb_dirty.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread
0.00 +0.1 0.09 ±223% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.copy_mc_enhanced_fast_string
0.00 +0.1 0.09 ±223% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.copy_mc_enhanced_fast_string.copy_subpage
0.00 +0.1 0.09 ±223% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 +0.1 0.09 ±223% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 +0.1 0.10 ±223% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +0.1 0.10 ±223% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork.ret_from_fork_asm
0.00 +0.1 0.10 ±223% perf-profile.calltrace.cycles-pp.ret_from_fork.ret_from_fork_asm
0.00 +0.1 0.10 ±223% perf-profile.calltrace.cycles-pp.ret_from_fork_asm
0.00 +0.1 0.10 ±223% perf-profile.calltrace.cycles-pp.prep_new_hugetlb_folio.alloc_surplus_hugetlb_folio.alloc_hugetlb_folio.hugetlb_wp.hugetlb_fault
0.00 +0.1 0.10 ±223% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.copy_mc_enhanced_fast_string.copy_subpage.copy_user_large_folio
0.00 +0.1 0.11 ±223% perf-profile.calltrace.cycles-pp.update_process_times.tick_nohz_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.00 +0.2 0.17 ±223% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.copy_mc_enhanced_fast_string.copy_subpage.copy_user_large_folio.hugetlb_wp
0.00 +0.2 0.23 ±145% perf-profile.calltrace.cycles-pp.tick_nohz_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
0.00 +0.2 0.24 ±144% perf-profile.calltrace.cycles-pp.prep_compound_page.get_page_from_freelist.__alloc_pages_noprof.__folio_alloc_noprof.alloc_buddy_hugetlb_folio
0.00 +0.2 0.25 ±144% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +0.3 0.25 ±142% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter
0.00 +0.3 0.26 ±144% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_noprof.__folio_alloc_noprof.alloc_buddy_hugetlb_folio.__alloc_fresh_hugetlb_folio
0.00 +0.3 0.26 ±144% perf-profile.calltrace.cycles-pp.__alloc_pages_noprof.__folio_alloc_noprof.alloc_buddy_hugetlb_folio.__alloc_fresh_hugetlb_folio.alloc_surplus_hugetlb_folio
0.00 +0.3 0.28 ±144% perf-profile.calltrace.cycles-pp.__folio_alloc_noprof.alloc_buddy_hugetlb_folio.__alloc_fresh_hugetlb_folio.alloc_surplus_hugetlb_folio.alloc_hugetlb_folio
0.00 +0.3 0.28 ±144% perf-profile.calltrace.cycles-pp.alloc_buddy_hugetlb_folio.__alloc_fresh_hugetlb_folio.alloc_surplus_hugetlb_folio.alloc_hugetlb_folio.hugetlb_wp
0.00 +0.3 0.28 ±144% perf-profile.calltrace.cycles-pp.__alloc_fresh_hugetlb_folio.alloc_surplus_hugetlb_folio.alloc_hugetlb_folio.hugetlb_wp.hugetlb_fault
0.00 +0.5 0.46 ±144% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt
0.00 +0.5 0.48 ±144% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter
0.00 +0.6 0.57 ±144% perf-profile.calltrace.cycles-pp.alloc_surplus_hugetlb_folio.alloc_hugetlb_folio.hugetlb_wp.hugetlb_fault.handle_mm_fault
0.00 +0.7 0.72 ±144% perf-profile.calltrace.cycles-pp.alloc_hugetlb_folio.hugetlb_wp.hugetlb_fault.handle_mm_fault.do_user_addr_fault
0.00 +0.9 0.90 ±143% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter.cpuidle_enter_state
0.00 +1.1 1.14 ±142% perf-profile.calltrace.cycles-pp.acpi_safe_halt.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
0.00 +2.1 2.06 ±143% perf-profile.calltrace.cycles-pp.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
0.00 +2.1 2.09 ±143% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
0.00 +2.1 2.10 ±143% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
0.00 +2.2 2.23 ±143% perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.common_startup_64
0.00 +2.3 2.30 ±143% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.common_startup_64
0.00 +2.3 2.30 ±143% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.common_startup_64
0.00 +2.3 2.30 ±143% perf-profile.calltrace.cycles-pp.start_secondary.common_startup_64
0.00 +2.4 2.35 ±142% perf-profile.calltrace.cycles-pp.common_startup_64
0.00 +2.7 2.71 ±143% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter
12.15 ±106% +14.7 26.84 ±129% perf-profile.calltrace.cycles-pp.do_access
10.20 ±128% +14.7 24.91 ±142% perf-profile.calltrace.cycles-pp.hugetlb_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
10.20 ±128% +14.7 24.93 ±141% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
10.22 ±128% +14.7 24.95 ±142% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.do_access
10.21 ±128% +14.7 24.95 ±142% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
10.23 ±128% +14.8 25.05 ±141% perf-profile.calltrace.cycles-pp.asm_exc_page_fault.do_access
7.77 ±127% +15.5 23.22 ±141% perf-profile.calltrace.cycles-pp.copy_mc_enhanced_fast_string.copy_subpage.copy_user_large_folio.hugetlb_wp.hugetlb_fault
7.83 ±127% +15.5 23.34 ±141% perf-profile.calltrace.cycles-pp.copy_subpage.copy_user_large_folio.hugetlb_wp.hugetlb_fault.handle_mm_fault
7.84 ±127% +15.6 23.40 ±141% perf-profile.calltrace.cycles-pp.copy_user_large_folio.hugetlb_wp.hugetlb_fault.handle_mm_fault.do_user_addr_fault
8.00 ±127% +16.2 24.20 ±141% perf-profile.calltrace.cycles-pp.hugetlb_wp.hugetlb_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
84.24 ± 14% -17.2 67.02 ± 55% perf-profile.children.cycles-pp.do_rw_once
24.51 ± 14% -4.4 20.11 ± 57% perf-profile.children.cycles-pp.lrand48_r@plt
2.17 ±130% -1.5 0.65 ±159% perf-profile.children.cycles-pp.__mutex_lock
1.57 ±127% -1.0 0.59 ±160% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.59 ±136% -0.6 0.04 ±152% perf-profile.children.cycles-pp.osq_lock
1.01 ± 19% -0.2 0.77 ± 47% perf-profile.children.cycles-pp.lrand48_r
2.81 ± 14% -0.1 2.71 ± 45% perf-profile.children.cycles-pp.nrand48_r
0.10 ± 57% -0.1 0.03 ±100% perf-profile.children.cycles-pp.main
0.10 ± 57% -0.1 0.03 ±100% perf-profile.children.cycles-pp.run_builtin
0.08 ± 92% -0.1 0.02 ±141% perf-profile.children.cycles-pp.__cmd_record
0.08 ± 92% -0.1 0.02 ±141% perf-profile.children.cycles-pp.cmd_record
0.06 ±112% -0.1 0.00 perf-profile.children.cycles-pp.perf_mmap__push
0.06 ±112% -0.1 0.00 perf-profile.children.cycles-pp.record__mmap_read_evlist
0.05 ±113% -0.1 0.00 perf-profile.children.cycles-pp.record__pushfn
0.05 ±111% -0.0 0.00 perf-profile.children.cycles-pp.writen
0.05 ±110% -0.0 0.00 perf-profile.children.cycles-pp.shmem_file_write_iter
0.04 ±110% -0.0 0.00 perf-profile.children.cycles-pp.generic_perform_write
0.01 ±223% -0.0 0.00 perf-profile.children.cycles-pp.copy_page_from_iter_atomic
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.__rmqueue_pcplist
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.io_serial_out
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.prepare_task_switch
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.seq_read_iter
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.update_curr
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.irqentry_enter
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.delay_tsc
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.nohz_balancer_kick
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.copy_mc_to_kernel
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.ksys_read
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.vfs_read
0.06 ± 17% +0.0 0.08 ± 36% perf-profile.children.cycles-pp.task_tick_fair
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.__sysvec_irq_work
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp._printk
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.irq_work_run
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.irq_work_single
0.00 +0.0 0.01 ±223% perf-profile.children.cycles-pp.sysvec_irq_work
0.00 +0.0 0.02 ±223% perf-profile.children.cycles-pp.irq_work_run_list
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.__handle_mm_fault
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.dequeue_entity
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.native_apic_msr_eoi
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.sched_ttwu_pending
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.schedule_preempt_disabled
0.00 +0.0 0.02 ±144% perf-profile.children.cycles-pp.rcu_all_qs
0.00 +0.0 0.02 ±144% perf-profile.children.cycles-pp.rcu_pending
0.00 +0.0 0.02 ±144% perf-profile.children.cycles-pp.read
0.00 +0.0 0.02 ±141% perf-profile.children.cycles-pp.update_irq_load_avg
0.00 +0.0 0.02 ±141% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.___perf_sw_event
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.__flush_smp_call_function_queue
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.dequeue_task_fair
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.enqueue_entity
0.00 +0.0 0.02 ±146% perf-profile.children.cycles-pp.rcu_report_qs_rdp
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.read_tsc
0.00 +0.0 0.02 ±142% perf-profile.children.cycles-pp.rmqueue
0.00 +0.0 0.02 ±141% perf-profile.children.cycles-pp.wait_for_xmitr
0.00 +0.0 0.02 ±141% perf-profile.children.cycles-pp.idle_cpu
0.00 +0.0 0.03 ±141% perf-profile.children.cycles-pp.enqueue_task_fair
0.00 +0.0 0.03 ±143% perf-profile.children.cycles-pp.lapic_next_deadline
0.00 +0.0 0.03 ±143% perf-profile.children.cycles-pp.note_gp_changes
0.00 +0.0 0.03 ±147% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.0 0.03 ±144% perf-profile.children.cycles-pp.sched_clock
0.00 +0.0 0.03 ±141% perf-profile.children.cycles-pp.activate_task
0.00 +0.0 0.03 ±142% perf-profile.children.cycles-pp.native_sched_clock
0.00 +0.0 0.03 ±142% perf-profile.children.cycles-pp.irqtime_account_irq
0.00 +0.0 0.03 ±142% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.00 +0.0 0.03 ±142% perf-profile.children.cycles-pp.sched_clock_cpu
0.00 +0.0 0.03 ±142% perf-profile.children.cycles-pp.update_rq_clock_task
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp.complete
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp.tick_nohz_next_event
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.00 +0.0 0.04 ±142% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +0.0 0.04 ±144% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.00 +0.0 0.04 ±142% perf-profile.children.cycles-pp.schedule_idle
0.06 ± 9% +0.0 0.10 ± 79% perf-profile.children.cycles-pp.tmigr_requires_handle_remote
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp.rcu_do_batch
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.04 ± 45% +0.0 0.09 ± 78% perf-profile.children.cycles-pp.get_jiffies_update
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.00 +0.0 0.04 ±141% perf-profile.children.cycles-pp._raw_spin_lock
0.00 +0.0 0.04 ±152% perf-profile.children.cycles-pp.sched_balance_newidle
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.native_irq_return_iret
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.try_to_wake_up
0.04 ±101% +0.0 0.09 ± 78% perf-profile.children.cycles-pp.free_unref_page
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.clear_page_erms
0.00 +0.0 0.05 ±151% perf-profile.children.cycles-pp.pick_next_task_fair
0.06 ± 77% +0.0 0.10 ± 76% perf-profile.children.cycles-pp.exit_mm
0.00 +0.0 0.05 ±145% perf-profile.children.cycles-pp.__cond_resched
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.__get_user_pages
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.__mm_populate
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.clear_huge_page
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.hugetlb_no_page
0.00 +0.0 0.05 ±141% perf-profile.children.cycles-pp.populate_vma_page_range
0.00 +0.1 0.05 ±141% perf-profile.children.cycles-pp.__mmap
0.06 ± 77% +0.1 0.11 ± 76% perf-profile.children.cycles-pp.__mmput
0.06 ± 77% +0.1 0.11 ± 76% perf-profile.children.cycles-pp.__x64_sys_exit_group
0.06 ± 77% +0.1 0.11 ± 76% perf-profile.children.cycles-pp.do_group_exit
0.06 ± 77% +0.1 0.11 ± 76% perf-profile.children.cycles-pp.exit_mmap
0.00 +0.1 0.05 ±142% perf-profile.children.cycles-pp.rest_init
0.00 +0.1 0.05 ±142% perf-profile.children.cycles-pp.start_kernel
0.00 +0.1 0.05 ±142% perf-profile.children.cycles-pp.x86_64_start_kernel
0.00 +0.1 0.05 ±142% perf-profile.children.cycles-pp.x86_64_start_reservations
0.04 ±102% +0.1 0.10 ± 77% perf-profile.children.cycles-pp.tlb_finish_mmu
0.06 ± 77% +0.1 0.11 ± 75% perf-profile.children.cycles-pp.do_exit
0.00 +0.1 0.05 ±143% perf-profile.children.cycles-pp.update_load_avg
0.04 ±102% +0.1 0.10 ± 77% perf-profile.children.cycles-pp.__tlb_batch_free_encoded_pages
0.04 ±102% +0.1 0.10 ± 77% perf-profile.children.cycles-pp.folios_put_refs
0.04 ±102% +0.1 0.10 ± 77% perf-profile.children.cycles-pp.free_pages_and_swap_cache
0.01 ±223% +0.1 0.06 ±149% perf-profile.children.cycles-pp.task_work_run
0.01 ±223% +0.1 0.06 ±148% perf-profile.children.cycles-pp.task_mm_cid_work
0.00 +0.1 0.06 ±141% perf-profile.children.cycles-pp.ksys_mmap_pgoff
0.00 +0.1 0.06 ±141% perf-profile.children.cycles-pp.__update_blocked_fair
0.00 +0.1 0.06 ±146% perf-profile.children.cycles-pp.update_sg_lb_stats
0.02 ±144% +0.1 0.09 ±145% perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
0.00 +0.1 0.07 ±118% perf-profile.children.cycles-pp.vm_mmap_pgoff
0.16 ± 35% +0.1 0.23 ± 79% perf-profile.children.cycles-pp.ksys_write
0.16 ± 34% +0.1 0.23 ± 79% perf-profile.children.cycles-pp.vfs_write
0.16 ± 35% +0.1 0.23 ± 80% perf-profile.children.cycles-pp.write
0.00 +0.1 0.08 ±145% perf-profile.children.cycles-pp.sched_balance_find_src_group
0.00 +0.1 0.08 ±145% perf-profile.children.cycles-pp.update_sd_lb_stats
0.00 +0.1 0.08 ±148% perf-profile.children.cycles-pp.schedule_timeout
0.00 +0.1 0.09 ±146% perf-profile.children.cycles-pp.__wait_for_common
0.00 +0.1 0.09 ±132% perf-profile.children.cycles-pp._nohz_idle_balance
0.00 +0.1 0.09 ±145% perf-profile.children.cycles-pp.tick_irq_enter
0.00 +0.1 0.09 ±145% perf-profile.children.cycles-pp.wait_for_completion_state
0.00 +0.1 0.09 ±146% perf-profile.children.cycles-pp.__wait_rcu_gp
0.00 +0.1 0.09 ±142% perf-profile.children.cycles-pp.sched_balance_update_blocked_averages
0.00 +0.1 0.09 ±141% perf-profile.children.cycles-pp.rcu_core
0.00 +0.1 0.10 ±145% perf-profile.children.cycles-pp.irq_enter_rcu
0.00 +0.1 0.10 ±143% perf-profile.children.cycles-pp.menu_select
0.00 +0.1 0.10 ±145% perf-profile.children.cycles-pp.hugetlb_vmemmap_optimize_folio
0.13 ± 15% +0.1 0.23 ± 68% perf-profile.children.cycles-pp.sched_tick
0.00 +0.1 0.10 ±141% perf-profile.children.cycles-pp.sched_balance_domains
0.00 +0.1 0.10 ±134% perf-profile.children.cycles-pp.sysvec_call_function_single
0.00 +0.1 0.11 ±146% perf-profile.children.cycles-pp.schedule
0.00 +0.1 0.11 ±143% perf-profile.children.cycles-pp.sched_balance_rq
0.05 ± 76% +0.1 0.18 ± 76% perf-profile.children.cycles-pp.io_serial_in
0.12 ±125% +0.1 0.24 ±144% perf-profile.children.cycles-pp.prep_compound_page
0.08 ± 57% +0.1 0.21 ± 83% perf-profile.children.cycles-pp.devkmsg_emit
0.08 ± 57% +0.1 0.21 ± 83% perf-profile.children.cycles-pp.devkmsg_write
0.07 ± 57% +0.1 0.20 ± 70% perf-profile.children.cycles-pp.wait_for_lsr
0.09 ± 37% +0.1 0.22 ± 72% perf-profile.children.cycles-pp.serial8250_console_write
0.00 +0.1 0.14 ±117% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.13 ±124% +0.1 0.27 ±144% perf-profile.children.cycles-pp.__alloc_pages_noprof
0.13 ±124% +0.1 0.26 ±144% perf-profile.children.cycles-pp.get_page_from_freelist
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.console_flush_all
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.console_unlock
0.10 ± 38% +0.1 0.24 ± 72% perf-profile.children.cycles-pp.vprintk_emit
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.ast_mode_config_helper_atomic_commit_tail
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.ast_primary_plane_helper_atomic_update
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.commit_tail
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.drm_atomic_helper_commit_planes
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.drm_atomic_helper_commit_tail_rpm
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.drm_fb_memcpy
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.children.cycles-pp.memcpy_toio
0.13 ±125% +0.1 0.28 ±144% perf-profile.children.cycles-pp.__alloc_fresh_hugetlb_folio
0.13 ±124% +0.1 0.28 ±144% perf-profile.children.cycles-pp.__folio_alloc_noprof
0.10 ± 38% +0.1 0.24 ± 74% perf-profile.children.cycles-pp.drm_atomic_commit
0.10 ± 38% +0.1 0.24 ± 74% perf-profile.children.cycles-pp.drm_atomic_helper_commit
0.10 ± 38% +0.1 0.24 ± 74% perf-profile.children.cycles-pp.drm_atomic_helper_dirtyfb
0.00 +0.1 0.15 ±144% perf-profile.children.cycles-pp.__schedule
0.13 ±124% +0.1 0.28 ±144% perf-profile.children.cycles-pp.alloc_buddy_hugetlb_folio
0.10 ± 36% +0.2 0.25 ± 73% perf-profile.children.cycles-pp.drm_fb_helper_damage_work
0.10 ± 36% +0.2 0.25 ± 73% perf-profile.children.cycles-pp.drm_fbdev_generic_helper_fb_dirty
0.11 ± 36% +0.2 0.26 ± 73% perf-profile.children.cycles-pp.process_one_work
0.11 ± 36% +0.2 0.27 ± 72% perf-profile.children.cycles-pp.worker_thread
0.09 ± 12% +0.2 0.25 ± 89% perf-profile.children.cycles-pp.clockevents_program_event
0.12 ± 35% +0.2 0.29 ± 70% perf-profile.children.cycles-pp.kthread
0.12 ± 35% +0.2 0.29 ± 70% perf-profile.children.cycles-pp.ret_from_fork
0.12 ± 35% +0.2 0.29 ± 70% perf-profile.children.cycles-pp.ret_from_fork_asm
0.00 +0.2 0.18 ±143% perf-profile.children.cycles-pp.prep_new_hugetlb_folio
0.00 +0.2 0.18 ±145% perf-profile.children.cycles-pp.synchronize_rcu_normal
0.24 ± 10% +0.2 0.45 ± 69% perf-profile.children.cycles-pp.update_process_times
0.29 ± 33% +0.2 0.53 ± 55% perf-profile.children.cycles-pp.do_syscall_64
0.29 ± 33% +0.2 0.53 ± 55% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.08 ± 14% +0.3 0.34 ±106% perf-profile.children.cycles-pp.ktime_get
0.27 ± 9% +0.3 0.54 ± 71% perf-profile.children.cycles-pp.tick_nohz_handler
0.28 ± 9% +0.3 0.56 ± 72% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +0.3 0.34 ±144% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.00 +0.3 0.34 ±144% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.03 ±100% +0.4 0.39 ±119% perf-profile.children.cycles-pp.irq_exit_rcu
0.13 ±125% +0.4 0.58 ±140% perf-profile.children.cycles-pp.alloc_surplus_hugetlb_folio
0.39 ± 7% +0.5 0.87 ± 79% perf-profile.children.cycles-pp.hrtimer_interrupt
0.40 ± 7% +0.5 0.90 ± 79% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
0.14 ±126% +0.6 0.73 ±141% perf-profile.children.cycles-pp.alloc_hugetlb_folio
0.43 ± 7% +0.9 1.38 ± 96% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
0.59 ± 15% +1.9 2.48 ±108% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.02 ±141% +2.2 2.20 ±134% perf-profile.children.cycles-pp.acpi_safe_halt
0.02 ±141% +2.2 2.20 ±134% perf-profile.children.cycles-pp.acpi_idle_enter
0.02 ±141% +2.2 2.24 ±134% perf-profile.children.cycles-pp.cpuidle_enter_state
0.02 ±141% +2.2 2.24 ±134% perf-profile.children.cycles-pp.cpuidle_enter
0.02 ±142% +2.4 2.38 ±134% perf-profile.children.cycles-pp.cpuidle_idle_call
0.02 ±141% +2.4 2.39 ±134% perf-profile.children.cycles-pp.start_secondary
0.03 ±102% +2.4 2.46 ±133% perf-profile.children.cycles-pp.do_idle
0.03 ±102% +2.4 2.46 ±133% perf-profile.children.cycles-pp.common_startup_64
0.03 ±102% +2.4 2.46 ±133% perf-profile.children.cycles-pp.cpu_startup_entry
12.44 ±103% +14.7 27.14 ±127% perf-profile.children.cycles-pp.do_access
10.22 ±128% +14.8 25.04 ±141% perf-profile.children.cycles-pp.do_user_addr_fault
10.22 ±128% +14.8 25.04 ±141% perf-profile.children.cycles-pp.exc_page_fault
10.20 ±128% +14.8 25.04 ±141% perf-profile.children.cycles-pp.hugetlb_fault
10.22 ±128% +14.9 25.08 ±141% perf-profile.children.cycles-pp.handle_mm_fault
10.24 ±128% +14.9 25.15 ±141% perf-profile.children.cycles-pp.asm_exc_page_fault
7.82 ±127% +15.6 23.38 ±141% perf-profile.children.cycles-pp.copy_mc_enhanced_fast_string
7.83 ±127% +15.6 23.42 ±141% perf-profile.children.cycles-pp.copy_subpage
7.84 ±127% +15.6 23.48 ±141% perf-profile.children.cycles-pp.copy_user_large_folio
8.00 ±127% +16.3 24.27 ±141% perf-profile.children.cycles-pp.hugetlb_wp
83.41 ± 14% -17.2 66.25 ± 55% perf-profile.self.cycles-pp.do_rw_once
1.56 ±127% -1.0 0.59 ±160% perf-profile.self.cycles-pp.mutex_spin_on_owner
0.59 ±136% -0.6 0.04 ±152% perf-profile.self.cycles-pp.osq_lock
0.72 ± 25% -0.2 0.49 ± 53% perf-profile.self.cycles-pp.lrand48_r@plt
1.92 ± 14% -0.2 1.72 ± 47% perf-profile.self.cycles-pp.do_access
2.53 ± 14% -0.1 2.44 ± 45% perf-profile.self.cycles-pp.nrand48_r
0.30 ± 15% -0.0 0.28 ± 50% perf-profile.self.cycles-pp.lrand48_r
0.01 ±223% -0.0 0.00 perf-profile.self.cycles-pp.copy_page_from_iter_atomic
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.io_serial_out
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.nohz_balancer_kick
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.note_gp_changes
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.rcu_all_qs
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.rcu_pending
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.delay_tsc
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.0 0.01 ±223% perf-profile.self.cycles-pp.update_rq_clock_task
0.00 +0.0 0.02 ±141% perf-profile.self.cycles-pp.___perf_sw_event
0.00 +0.0 0.02 ±141% perf-profile.self.cycles-pp.irqtime_account_irq
0.00 +0.0 0.02 ±142% perf-profile.self.cycles-pp.__schedule
0.00 +0.0 0.02 ±142% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.00 +0.0 0.02 ±142% perf-profile.self.cycles-pp.native_apic_msr_eoi
0.00 +0.0 0.02 ±142% perf-profile.self.cycles-pp.update_irq_load_avg
0.00 +0.0 0.02 ±141% perf-profile.self.cycles-pp.copy_user_large_folio
0.00 +0.0 0.02 ±146% perf-profile.self.cycles-pp.idle_cpu
0.00 +0.0 0.02 ±142% perf-profile.self.cycles-pp.read_tsc
0.00 +0.0 0.02 ±143% perf-profile.self.cycles-pp.hugetlb_wp
0.00 +0.0 0.02 ±141% perf-profile.self.cycles-pp.tick_nohz_next_event
0.00 +0.0 0.02 ±141% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.00 +0.0 0.03 ±143% perf-profile.self.cycles-pp.lapic_next_deadline
0.00 +0.0 0.03 ±150% perf-profile.self.cycles-pp.__cond_resched
0.00 +0.0 0.03 ±141% perf-profile.self.cycles-pp.native_sched_clock
0.00 +0.0 0.03 ±141% perf-profile.self.cycles-pp.sched_balance_domains
0.00 +0.0 0.03 ±144% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.00 +0.0 0.03 ±144% perf-profile.self.cycles-pp.tick_nohz_handler
0.00 +0.0 0.03 ±146% perf-profile.self.cycles-pp.update_load_avg
0.00 +0.0 0.04 ±143% perf-profile.self.cycles-pp.copy_subpage
0.00 +0.0 0.04 ±141% perf-profile.self.cycles-pp.__update_blocked_fair
0.00 +0.0 0.04 ±147% perf-profile.self.cycles-pp.menu_select
0.00 +0.0 0.04 ±144% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.00 +0.0 0.04 ±141% perf-profile.self.cycles-pp._raw_spin_lock
0.04 ±101% +0.0 0.08 ± 77% perf-profile.self.cycles-pp.free_unref_page
0.04 ± 45% +0.0 0.09 ± 78% perf-profile.self.cycles-pp.get_jiffies_update
0.00 +0.0 0.04 ±141% perf-profile.self.cycles-pp.clear_page_erms
0.00 +0.0 0.05 ±141% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.0 0.05 ±148% perf-profile.self.cycles-pp.update_sg_lb_stats
0.01 ±223% +0.1 0.06 ±149% perf-profile.self.cycles-pp.task_mm_cid_work
0.05 ± 76% +0.1 0.17 ± 75% perf-profile.self.cycles-pp.io_serial_in
0.11 ±124% +0.1 0.24 ±144% perf-profile.self.cycles-pp.prep_compound_page
0.10 ± 38% +0.1 0.24 ± 73% perf-profile.self.cycles-pp.memcpy_toio
0.08 ± 14% +0.2 0.32 ±105% perf-profile.self.cycles-pp.ktime_get
0.00 +0.3 0.34 ±144% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.00 +1.1 1.07 ±138% perf-profile.self.cycles-pp.acpi_safe_halt
7.77 ±127% +15.5 23.22 ±141% perf-profile.self.cycles-pp.copy_mc_enhanced_fast_string



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


--
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests/wiki