Re: [LKP] [rcu] 276c410448: will-it-scale.per_thread_ops -12.3% regression

From: Xing Zhengjun
Date: Tue Aug 18 2020 - 03:23:02 EST

Next message: David Hildenbrand: "Re: [PATCH] mm/page_reporting: the "page" must not be the list head"
Previous message: Nicholas Piggin: "Re: [PATCH 1/2] lockdep: improve current->(hard|soft)irqs_enabled synchronisation with actual irq state"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

On 6/17/2020 12:28 AM, Paul E. McKenney wrote:

On Tue, Jun 16, 2020 at 10:02:24AM +0800, Xing Zhengjun wrote:

Hi Paul,

Do you have time to take a look at this? Thanks.

I do not see how this change could affect anything that isn't directly
using RCU Tasks Trace. Yes, there is some addition to process creation,
but that isn't what is showing the increased overhead.

I see that the instruction count increased. Is it possible that this
is due to changes in offsets within the task_struct structure?

Thanx, Paul

How about this regression? I test the latest v5.9-rc1, the regression is still exsited.

=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/debug-setup/nr_task/mode/test/cpufreq_governor/ucode:

lkp-knm01/will-it-scale/debian-x86_64-20191114.cgz/x86_64-rhel-7.6/gcc-9/test2/100%/thread/page_fault3/performance/0x11

commit:
b0afa0f056676ffe0a7213818f09d2460adbcc16
276c410448dbca357a2bc3539acfe04862e5f172
v5.9-rc1

b0afa0f056676ffe 276c410448dbca357a2bc3539ac v5.9-rc1
---------------- --------------------------- ---------------------------
%stddev %change %stddev %change %stddev
\ | \ | \
1417 -13.2% 1230 ± 2% -16.6% 1182 will-it-scale.per_thread_ops
408456 -13.2% 354391 ± 2% -16.6% 340519 will-it-scale.workload

On 6/15/2020 4:57 PM, kernel test robot wrote:

Greeting,

FYI, we noticed a -12.3% regression of will-it-scale.per_thread_ops due to commit:

commit: 276c410448dbca357a2bc3539acfe04862e5f172 ("rcu-tasks: Split ->trc_reader_need_end")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master

in testcase: will-it-scale
on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory
with following parameters:

nr_task: 100%
mode: thread
test: page_fault3
cpufreq_governor: performance
ucode: 0x11

test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale

If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen@xxxxxxxxx>

Details are as below:
-------------------------------------------------------------------------------------------------->

To reproduce:

git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-7.6/thread/100%/debian-x86_64-20191114.cgz/lkp-knm01/page_fault3/will-it-scale/0x11

commit:
b0afa0f056 ("rcu-tasks: Provide boot parameter to delay IPIs until late in grace period")
276c410448 ("rcu-tasks: Split ->trc_reader_need_end")

b0afa0f056676ffe 276c410448dbca357a2bc3539ac
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
2:4 -50% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:4 28% 1:4 perf-profile.calltrace.cycles-pp.error_entry
0:4 0% 0:4 perf-profile.children.cycles-pp.error_exit
1:4 7% 2:4 perf-profile.children.cycles-pp.error_entry
0:4 4% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
1414 -12.3% 1241 ± 2% will-it-scale.per_thread_ops
463.32 +1.7% 470.99 will-it-scale.time.elapsed_time
463.32 +1.7% 470.99 will-it-scale.time.elapsed_time.max
407566 -12.3% 357573 ± 2% will-it-scale.workload
48.51 -1.5% 47.77 boot-time.boot
7.203e+10 +20.0% 8.64e+10 ± 2% cpuidle.C1.time
2.162e+08 ± 2% +27.7% 2.761e+08 ± 2% cpuidle.C1.usage
60.50 +12.2 72.74 ± 2% mpstat.cpu.all.idle%
39.17 -12.2 26.97 ± 6% mpstat.cpu.all.sys%
2334 ± 12% +18.8% 2772 ± 5% slabinfo.khugepaged_mm_slot.active_objs
2334 ± 12% +18.8% 2772 ± 5% slabinfo.khugepaged_mm_slot.num_objs
60.25 +20.3% 72.50 ± 2% vmstat.cpu.id
92.75 ± 3% -21.6% 72.75 ± 5% vmstat.procs.r
223709 +41.8% 317250 ± 3% vmstat.system.cs
641687 ± 3% +8.0% 693245 ± 2% proc-vmstat.nr_inactive_anon
641688 ± 3% +8.0% 693245 ± 2% proc-vmstat.nr_zone_inactive_anon
166782 -3.7% 160632 proc-vmstat.numa_hint_faults
166782 -3.7% 160632 proc-vmstat.numa_hint_faults_local
984.25 -14.2% 844.75 ± 2% proc-vmstat.numa_huge_pte_updates
710979 -11.2% 631134 proc-vmstat.numa_pte_updates
1.967e+08 -10.9% 1.752e+08 proc-vmstat.pgfault
58.18 +3.4% 60.17 perf-stat.i.MPKI
1.173e+09 +10.5% 1.296e+09 perf-stat.i.branch-instructions
6.74 -0.1 6.68 perf-stat.i.branch-miss-rate%
72495831 +10.7% 80219684 perf-stat.i.branch-misses
14.68 -0.6 14.06 perf-stat.i.cache-miss-rate%
43014696 +10.5% 47551690 perf-stat.i.cache-misses
2.936e+08 +15.6% 3.393e+08 perf-stat.i.cache-references
227441 +42.0% 323034 ± 3% perf-stat.i.context-switches
37.22 -29.0% 26.44 ± 5% perf-stat.i.cpi
1.828e+11 -22.3% 1.421e+11 ± 3% perf-stat.i.cpu-cycles
513.71 +13.6% 583.63 perf-stat.i.cpu-migrations
4303 -27.8% 3107 ± 5% perf-stat.i.cycles-between-cache-misses
1.78 -0.0 1.74 perf-stat.i.iTLB-load-miss-rate%
90757979 +9.1% 98982336 perf-stat.i.iTLB-load-misses
5.518e+09 +10.1% 6.076e+09 perf-stat.i.iTLB-loads
5.501e+09 +10.3% 6.065e+09 perf-stat.i.instructions
59.50 +2.4% 60.91 perf-stat.i.instructions-per-iTLB-miss
0.03 +48.9% 0.05 ± 3% perf-stat.i.ipc
0.61 -22.2% 0.47 ± 3% perf-stat.i.metric.GHz
0.85 ± 2% +6.3% 0.90 ± 3% perf-stat.i.metric.K/sec
23.19 +10.3% 25.58 perf-stat.i.metric.M/sec
398027 -13.3% 345187 ± 2% perf-stat.i.minor-faults
398027 -13.3% 345187 ± 2% perf-stat.i.page-faults
51.63 +4.7% 54.06 perf-stat.overall.MPKI
14.82 -0.6 14.26 perf-stat.overall.cache-miss-rate%
32.82 -28.9% 23.34 ± 4% perf-stat.overall.cpi
4290 -29.4% 3029 ± 5% perf-stat.overall.cycles-between-cache-misses
0.03 +40.9% 0.04 ± 4% perf-stat.overall.ipc
6447068 +28.0% 8254132 ± 3% perf-stat.overall.path-length
1.214e+09 +10.5% 1.341e+09 perf-stat.ps.branch-instructions
72454767 +10.7% 80188768 perf-stat.ps.branch-misses
43379426 +11.2% 48228470 perf-stat.ps.cache-misses
2.927e+08 +15.5% 3.382e+08 ± 2% perf-stat.ps.cache-references
223136 +42.0% 316818 ± 3% perf-stat.ps.context-switches
1.861e+11 -21.6% 1.459e+11 ± 3% perf-stat.ps.cpu-cycles
498.80 +14.0% 568.54 perf-stat.ps.cpu-migrations
90216145 +8.9% 98279965 perf-stat.ps.iTLB-load-misses
5.688e+09 +10.2% 6.267e+09 perf-stat.ps.iTLB-loads
5.67e+09 +10.3% 6.256e+09 perf-stat.ps.instructions
404137 -13.0% 351604 ± 2% perf-stat.ps.minor-faults
404137 -13.0% 351604 ± 2% perf-stat.ps.page-faults
2.627e+12 +12.2% 2.949e+12 perf-stat.total.instructions
84210 -25.9% 62375 ± 5% sched_debug.cfs_rq:/.exec_clock.avg
91870 ± 3% -23.3% 70486 ± 5% sched_debug.cfs_rq:/.exec_clock.max
79683 -23.1% 61285 ± 6% sched_debug.cfs_rq:/.exec_clock.min
2299 ± 7% +36.5% 3139 ± 12% sched_debug.cfs_rq:/.load.avg
216559 +81.8% 393746 ± 14% sched_debug.cfs_rq:/.load.max
16561 ± 3% +64.0% 27165 ± 14% sched_debug.cfs_rq:/.load.stddev
2.32 ± 11% -19.6% 1.87 ± 14% sched_debug.cfs_rq:/.load_avg.avg
18373664 ± 3% -19.7% 14762699 ± 8% sched_debug.cfs_rq:/.min_vruntime.avg
18652687 ± 3% -19.9% 14948853 ± 8% sched_debug.cfs_rq:/.min_vruntime.max
17259651 ± 3% -20.6% 13706324 ± 9% sched_debug.cfs_rq:/.min_vruntime.min
0.09 ± 4% -30.2% 0.06 ± 8% sched_debug.cfs_rq:/.nr_running.avg
0.27 ± 2% -14.3% 0.24 ± 5% sched_debug.cfs_rq:/.nr_running.stddev
18.07 ± 2% -31.0% 12.47 ± 5% sched_debug.cfs_rq:/.nr_spread_over.avg
1.97 ± 34% -49.2% 1.00 ± 57% sched_debug.cfs_rq:/.nr_spread_over.min
258.66 ± 6% -38.4% 159.22 ± 5% sched_debug.cfs_rq:/.runnable_avg.avg
231.14 -13.6% 199.77 ± 7% sched_debug.cfs_rq:/.runnable_avg.stddev
302282 ± 40% -44.4% 168177 ± 29% sched_debug.cfs_rq:/.spread0.avg
568464 ± 36% -39.3% 344858 ± 16% sched_debug.cfs_rq:/.spread0.max
252.26 ± 6% -38.7% 154.72 ± 5% sched_debug.cfs_rq:/.util_avg.avg
217.63 -15.4% 184.13 ± 6% sched_debug.cfs_rq:/.util_avg.stddev
18.44 ± 12% -50.3% 9.17 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.avg
575.84 ± 17% -22.2% 447.81 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.max
67.91 ± 9% -35.4% 43.85 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.stddev
417156 ± 7% -15.2% 353896 ± 5% sched_debug.cpu.avg_idle.stddev
273.72 ± 3% -11.3% 242.79 ± 4% sched_debug.cpu.clock.stddev
273.72 ± 3% -11.3% 242.79 ± 4% sched_debug.cpu.clock_task.stddev
426.78 ± 3% -27.6% 309.10 ± 12% sched_debug.cpu.curr->pid.avg
1282 ± 2% -12.4% 1123 ± 6% sched_debug.cpu.curr->pid.stddev
351857 ± 3% -16.4% 294246 ± 4% sched_debug.cpu.max_idle_balance_cost.stddev
0.00 -11.8% 0.00 ± 3% sched_debug.cpu.next_balance.stddev
0.09 ± 3% -32.0% 0.06 ± 12% sched_debug.cpu.nr_running.avg
0.28 -14.6% 0.24 ± 7% sched_debug.cpu.nr_running.stddev
163725 +37.4% 225040 ± 4% sched_debug.cpu.nr_switches.avg
174783 +35.4% 236604 ± 4% sched_debug.cpu.nr_switches.max
151538 +36.4% 206743 ± 4% sched_debug.cpu.nr_switches.min
2143 ± 4% +28.5% 2753 ± 4% sched_debug.cpu.nr_switches.stddev
160974 +38.1% 222280 ± 4% sched_debug.cpu.sched_count.avg
170145 +36.7% 232581 ± 4% sched_debug.cpu.sched_count.max
148944 +37.6% 204888 ± 4% sched_debug.cpu.sched_count.min
1847 ± 8% +38.7% 2563 ± 6% sched_debug.cpu.sched_count.stddev
80136 +38.3% 110820 ± 4% sched_debug.cpu.sched_goidle.avg
84559 +36.9% 115782 ± 4% sched_debug.cpu.sched_goidle.max
74091 +37.8% 102072 ± 4% sched_debug.cpu.sched_goidle.min
891.35 ± 6% +41.4% 1260 ± 6% sched_debug.cpu.sched_goidle.stddev
80346 +38.2% 111003 ± 4% sched_debug.cpu.ttwu_count.avg
114308 ± 2% +42.7% 163080 ± 6% sched_debug.cpu.ttwu_count.max
62759 ± 3% +38.4% 86881 ± 2% sched_debug.cpu.ttwu_count.min
8223 ± 7% +53.5% 12623 ± 13% sched_debug.cpu.ttwu_count.stddev
2.35 ± 10% -0.7 1.65 ± 14% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.94 ± 15% -0.5 0.44 ± 58% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.page_fault
0.90 ± 15% -0.5 0.42 ± 58% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.page_fault
1.38 ± 4% -0.4 0.94 ± 12% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.81 ± 4% +0.1 0.91 ± 4% perf-profile.calltrace.cycles-pp.file_update_time.fault_dirty_shared_page.do_fault.__handle_mm_fault.handle_mm_fault
1.35 ± 6% +0.2 1.51 ± 3% perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault
1.16 ± 7% +0.2 1.33 ± 5% perf-profile.calltrace.cycles-pp.unlock_page.fault_dirty_shared_page.do_fault.__handle_mm_fault.handle_mm_fault
1.29 ± 8% +0.2 1.46 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_set_pte.finish_fault.do_fault.__handle_mm_fault
1.76 ± 7% +0.3 2.04 ± 5% perf-profile.calltrace.cycles-pp.page_add_file_rmap.alloc_set_pte.finish_fault.do_fault.__handle_mm_fault
2.13 ± 5% +0.3 2.41 ± 4% perf-profile.calltrace.cycles-pp.fault_dirty_shared_page.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
2.46 ± 8% +0.4 2.81 ± 7% perf-profile.calltrace.cycles-pp.up_read.do_user_addr_fault.page_fault
2.86 ± 6% +0.4 3.21 ± 4% perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault.do_fault
3.12 ± 6% +0.4 3.52 ± 4% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_fault.__do_fault.do_fault.__handle_mm_fault
3.27 ± 6% +0.4 3.67 ± 4% perf-profile.calltrace.cycles-pp.shmem_fault.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault
3.33 ± 6% +0.4 3.75 ± 4% perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
0.13 ±173% +0.4 0.55 ± 8% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
3.39 ± 7% +0.5 3.89 ± 5% perf-profile.calltrace.cycles-pp.alloc_set_pte.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault
3.44 ± 7% +0.5 3.94 ± 5% perf-profile.calltrace.cycles-pp.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
8.99 ± 6% +1.2 10.20 ± 4% perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.page_fault
12.23 ± 6% +1.6 13.84 ± 5% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.page_fault
12.68 ± 6% +1.7 14.38 ± 5% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.page_fault
45.14 ± 9% +6.1 51.25 ± 6% perf-profile.calltrace.cycles-pp.down_read_trylock.do_user_addr_fault.page_fault
66.96 ± 7% +7.4 74.37 ± 4% perf-profile.calltrace.cycles-pp.do_user_addr_fault.page_fault
69.19 ± 7% +7.7 76.89 ± 4% perf-profile.calltrace.cycles-pp.page_fault
17.74 ± 8% -3.3 14.46 ± 20% perf-profile.children.cycles-pp.apic_timer_interrupt
17.02 ± 8% -3.1 13.89 ± 20% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
2.97 ± 8% -0.7 2.25 ± 12% perf-profile.children.cycles-pp.irq_exit
1.88 ± 11% -0.5 1.41 ± 11% perf-profile.children.cycles-pp.__softirqentry_text_start
1.02 ± 14% -0.4 0.59 ± 15% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
1.75 ± 12% -0.4 1.35 ± 14% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.92 ± 12% -0.2 0.68 ± 17% perf-profile.children.cycles-pp.ktime_get
0.32 ± 20% -0.2 0.13 ± 30% perf-profile.children.cycles-pp.munmap
0.32 ± 22% -0.2 0.14 ± 27% perf-profile.children.cycles-pp.__x64_sys_munmap
0.32 ± 22% -0.2 0.14 ± 28% perf-profile.children.cycles-pp.__vm_munmap
0.29 ± 21% -0.2 0.13 ± 23% perf-profile.children.cycles-pp.__do_munmap
0.28 ± 21% -0.2 0.12 ± 25% perf-profile.children.cycles-pp.unmap_region
0.28 ± 22% -0.2 0.13 ± 23% perf-profile.children.cycles-pp.unmap_vmas
0.28 ± 21% -0.2 0.13 ± 23% perf-profile.children.cycles-pp.unmap_page_range
0.48 ± 6% -0.1 0.34 ± 15% perf-profile.children.cycles-pp.rebalance_domains
0.56 ± 12% -0.1 0.43 ± 16% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.44 ± 11% -0.1 0.33 ± 25% perf-profile.children.cycles-pp.clockevents_program_event
0.31 ± 14% -0.1 0.21 ± 16% perf-profile.children.cycles-pp.run_rebalance_domains
0.34 ± 9% -0.1 0.25 ± 16% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.28 ± 14% -0.1 0.21 ± 22% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.12 ± 21% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.smp_call_function_many_cond
0.12 ± 21% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.on_each_cpu_cond_mask
0.12 ± 21% -0.1 0.05 ± 60% perf-profile.children.cycles-pp.flush_tlb_mm_range
0.19 ± 16% -0.1 0.12 ± 25% perf-profile.children.cycles-pp.irq_work_tick
0.31 ± 10% -0.1 0.24 ± 21% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.17 ± 13% -0.0 0.12 ± 15% perf-profile.children.cycles-pp.rcu_idle_exit
0.12 ± 12% -0.0 0.08 ± 30% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.14 ± 8% -0.0 0.10 ± 12% perf-profile.children.cycles-pp.raise_softirq
0.09 ± 7% +0.0 0.11 ± 4% perf-profile.children.cycles-pp._cond_resched
0.06 +0.0 0.08 ± 11% perf-profile.children.cycles-pp.lock_page_memcg
0.15 ± 7% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.__mod_memcg_state
0.07 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.perf_swevent_event
0.18 ± 7% +0.0 0.21 ± 4% perf-profile.children.cycles-pp.current_time
0.23 ± 3% +0.0 0.26 ± 4% perf-profile.children.cycles-pp.xas_load
0.14 ± 9% +0.0 0.18 ± 8% perf-profile.children.cycles-pp.__count_memcg_events
0.46 ± 5% +0.1 0.51 ± 4% perf-profile.children.cycles-pp.__mod_lruvec_state
0.42 ± 5% +0.1 0.48 ± 7% perf-profile.children.cycles-pp.__mark_inode_dirty
0.55 ± 5% +0.1 0.61 ± 3% perf-profile.children.cycles-pp.___perf_sw_event
0.47 ± 4% +0.1 0.55 ± 8% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.42 ± 9% +0.1 0.50 ± 8% perf-profile.children.cycles-pp.__might_sleep
0.81 ± 5% +0.1 0.92 ± 4% perf-profile.children.cycles-pp.file_update_time
1.36 ± 6% +0.2 1.52 ± 3% perf-profile.children.cycles-pp.find_get_entry
1.17 ± 7% +0.2 1.34 ± 5% perf-profile.children.cycles-pp.unlock_page
1.77 ± 7% +0.3 2.05 ± 5% perf-profile.children.cycles-pp.page_add_file_rmap
2.14 ± 5% +0.3 2.42 ± 4% perf-profile.children.cycles-pp.fault_dirty_shared_page
2.51 ± 8% +0.4 2.86 ± 7% perf-profile.children.cycles-pp.up_read
2.90 ± 6% +0.4 3.26 ± 4% perf-profile.children.cycles-pp.find_lock_entry
3.12 ± 6% +0.4 3.52 ± 4% perf-profile.children.cycles-pp.shmem_getpage_gfp
3.27 ± 6% +0.4 3.68 ± 4% perf-profile.children.cycles-pp.shmem_fault
3.33 ± 6% +0.4 3.75 ± 3% perf-profile.children.cycles-pp.__do_fault
3.45 ± 7% +0.5 3.95 ± 5% perf-profile.children.cycles-pp.finish_fault
3.42 ± 7% +0.5 3.92 ± 5% perf-profile.children.cycles-pp.alloc_set_pte
9.02 ± 6% +1.2 10.23 ± 4% perf-profile.children.cycles-pp.do_fault
12.26 ± 6% +1.6 13.88 ± 5% perf-profile.children.cycles-pp.__handle_mm_fault
12.72 ± 6% +1.7 14.43 ± 5% perf-profile.children.cycles-pp.handle_mm_fault
45.27 ± 9% +6.1 51.39 ± 6% perf-profile.children.cycles-pp.down_read_trylock
67.33 ± 7% +7.5 74.81 ± 4% perf-profile.children.cycles-pp.do_user_addr_fault
69.24 ± 7% +7.7 76.95 ± 4% perf-profile.children.cycles-pp.page_fault
1.02 ± 14% -0.4 0.59 ± 15% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.74 ± 13% -0.2 0.55 ± 18% perf-profile.self.cycles-pp.ktime_get
0.28 ± 10% -0.1 0.21 ± 17% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.28 ± 13% -0.1 0.20 ± 21% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.19 ± 16% -0.1 0.12 ± 25% perf-profile.self.cycles-pp.irq_work_tick
0.26 ± 7% -0.1 0.21 ± 12% perf-profile.self.cycles-pp.__softirqentry_text_start
0.20 ± 15% -0.0 0.16 ± 11% perf-profile.self.cycles-pp.__run_timers
0.14 ± 7% -0.0 0.10 ± 12% perf-profile.self.cycles-pp.raise_softirq
0.13 ± 9% -0.0 0.10 ± 15% perf-profile.self.cycles-pp.tick_sched_timer
0.07 ± 10% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.clockevents_program_event
0.09 ± 5% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.apic_timer_interrupt
0.05 ± 8% +0.0 0.07 ± 12% perf-profile.self.cycles-pp.lock_page_memcg
0.11 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.file_update_time
0.10 ± 7% +0.0 0.12 ± 7% perf-profile.self.cycles-pp.___might_sleep
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.perf_swevent_event
0.18 ± 8% +0.0 0.20 ± 6% perf-profile.self.cycles-pp.__mod_lruvec_state
0.13 ± 9% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__mod_memcg_state
0.24 ± 6% +0.0 0.27 ± 6% perf-profile.self.cycles-pp.handle_mm_fault
0.41 ± 4% +0.0 0.44 ± 3% perf-profile.self.cycles-pp.___perf_sw_event
0.14 ± 9% +0.0 0.17 ± 6% perf-profile.self.cycles-pp.__count_memcg_events
0.21 ± 6% +0.0 0.25 ± 4% perf-profile.self.cycles-pp.shmem_getpage_gfp
0.23 ± 10% +0.1 0.29 ± 13% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.02 ± 6% +0.1 1.13 ± 6% perf-profile.self.cycles-pp.find_get_entry
0.86 ± 4% +0.1 1.00 ± 6% perf-profile.self.cycles-pp.do_user_addr_fault
1.10 ± 6% +0.2 1.26 ± 7% perf-profile.self.cycles-pp.unlock_page
1.26 ± 7% +0.2 1.44 ± 8% perf-profile.self.cycles-pp.find_lock_entry
1.20 ± 6% +0.2 1.38 ± 8% perf-profile.self.cycles-pp.page_add_file_rmap
2.35 ± 7% +0.3 2.69 ± 8% perf-profile.self.cycles-pp.up_read
2.97 ± 6% +0.4 3.35 ± 8% perf-profile.self.cycles-pp.__handle_mm_fault
42.09 ± 8% +5.7 47.79 ± 8% perf-profile.self.cycles-pp.down_read_trylock
406.00 ± 37% +1859.5% 7955 ±151% interrupts.32:IR-PCI-MSI.2097155-edge.eth0-TxRx-2
3009113 -4.3% 2880393 ± 2% interrupts.CAL:Function_call_interrupts
1445 ± 50% +93.0% 2788 ± 9% interrupts.CPU0.NMI:Non-maskable_interrupts
1445 ± 50% +93.0% 2788 ± 9% interrupts.CPU0.PMI:Performance_monitoring_interrupts
939.50 ± 16% +23.2% 1157 ± 5% interrupts.CPU100.RES:Rescheduling_interrupts
1223 ± 11% +43.3% 1753 ± 23% interrupts.CPU103.NMI:Non-maskable_interrupts
1223 ± 11% +43.3% 1753 ± 23% interrupts.CPU103.PMI:Performance_monitoring_interrupts
1163 ± 6% +24.5% 1448 ± 6% interrupts.CPU104.RES:Rescheduling_interrupts
1062 ± 15% +40.5% 1493 ± 5% interrupts.CPU105.RES:Rescheduling_interrupts
1490 ± 28% +70.1% 2536 ± 20% interrupts.CPU106.NMI:Non-maskable_interrupts
1490 ± 28% +70.1% 2536 ± 20% interrupts.CPU106.PMI:Performance_monitoring_interrupts
1186 ± 3% +26.4% 1499 ± 11% interrupts.CPU106.RES:Rescheduling_interrupts
1186 ± 5% +36.5% 1618 ± 9% interrupts.CPU107.RES:Rescheduling_interrupts
1484 ± 29% +98.1% 2941 ± 9% interrupts.CPU108.NMI:Non-maskable_interrupts
1484 ± 29% +98.1% 2941 ± 9% interrupts.CPU108.PMI:Performance_monitoring_interrupts
1087 ± 11% +35.2% 1470 ± 11% interrupts.CPU108.RES:Rescheduling_interrupts
905.00 ± 14% +26.9% 1148 ± 8% interrupts.CPU109.RES:Rescheduling_interrupts
1534 ± 35% +91.6% 2939 ± 9% interrupts.CPU110.NMI:Non-maskable_interrupts
1534 ± 35% +91.6% 2939 ± 9% interrupts.CPU110.PMI:Performance_monitoring_interrupts
1222 ± 11% +54.3% 1885 ± 44% interrupts.CPU111.NMI:Non-maskable_interrupts
1222 ± 11% +54.3% 1885 ± 44% interrupts.CPU111.PMI:Performance_monitoring_interrupts
1066 +27.7% 1360 ± 5% interrupts.CPU111.RES:Rescheduling_interrupts
1214 ± 12% +51.1% 1833 ± 35% interrupts.CPU112.NMI:Non-maskable_interrupts
1214 ± 12% +51.1% 1833 ± 35% interrupts.CPU112.PMI:Performance_monitoring_interrupts
1206 ± 12% +30.8% 1577 ± 9% interrupts.CPU116.RES:Rescheduling_interrupts
1102 ± 10% +46.7% 1616 ± 11% interrupts.CPU117.RES:Rescheduling_interrupts
1211 ± 3% +35.2% 1638 ± 15% interrupts.CPU118.RES:Rescheduling_interrupts
1217 ± 11% +115.4% 2623 ± 29% interrupts.CPU119.NMI:Non-maskable_interrupts
1217 ± 11% +115.4% 2623 ± 29% interrupts.CPU119.PMI:Performance_monitoring_interrupts
406.00 ± 37% +1859.5% 7955 ±151% interrupts.CPU12.32:IR-PCI-MSI.2097155-edge.eth0-TxRx-2
1125 ± 12% +27.3% 1432 ± 10% interrupts.CPU12.NMI:Non-maskable_interrupts
1125 ± 12% +27.3% 1432 ± 10% interrupts.CPU12.PMI:Performance_monitoring_interrupts
1173 ± 12% +55.5% 1823 ± 35% interrupts.CPU120.NMI:Non-maskable_interrupts
1173 ± 12% +55.5% 1823 ± 35% interrupts.CPU120.PMI:Performance_monitoring_interrupts
1112 ± 5% +40.2% 1559 ± 6% interrupts.CPU121.RES:Rescheduling_interrupts
1227 ± 11% +50.5% 1846 ± 34% interrupts.CPU122.NMI:Non-maskable_interrupts
1227 ± 11% +50.5% 1846 ± 34% interrupts.CPU122.PMI:Performance_monitoring_interrupts
1036 ± 11% +36.6% 1416 ± 4% interrupts.CPU122.RES:Rescheduling_interrupts
1164 ± 22% +40.8% 1639 ± 16% interrupts.CPU123.RES:Rescheduling_interrupts
1419 ± 13% +20.7% 1712 ± 9% interrupts.CPU124.RES:Rescheduling_interrupts
1209 ± 11% +21.5% 1469 ± 9% interrupts.CPU126.NMI:Non-maskable_interrupts
1209 ± 11% +21.5% 1469 ± 9% interrupts.CPU126.PMI:Performance_monitoring_interrupts
1266 ± 16% +34.9% 1708 ± 13% interrupts.CPU126.RES:Rescheduling_interrupts
1207 ± 24% +36.5% 1648 ± 11% interrupts.CPU127.RES:Rescheduling_interrupts
1298 ± 12% +30.8% 1698 interrupts.CPU128.RES:Rescheduling_interrupts
1354 ± 7% +33.5% 1808 ± 9% interrupts.CPU129.RES:Rescheduling_interrupts
1046 ± 7% +42.3% 1488 ± 17% interrupts.CPU130.RES:Rescheduling_interrupts
1068 ± 6% +45.9% 1558 ± 13% interrupts.CPU131.RES:Rescheduling_interrupts
1200 ± 2% +41.7% 1701 ± 14% interrupts.CPU132.RES:Rescheduling_interrupts
1191 ± 11% +85.4% 2208 ± 39% interrupts.CPU133.NMI:Non-maskable_interrupts
1191 ± 11% +85.4% 2208 ± 39% interrupts.CPU133.PMI:Performance_monitoring_interrupts
1327 ± 9% +13.8% 1510 ± 4% interrupts.CPU134.RES:Rescheduling_interrupts
1203 ± 12% +52.8% 1837 ± 34% interrupts.CPU136.NMI:Non-maskable_interrupts
1203 ± 12% +52.8% 1837 ± 34% interrupts.CPU136.PMI:Performance_monitoring_interrupts
976.75 ± 8% +19.0% 1162 ± 8% interrupts.CPU136.RES:Rescheduling_interrupts
1438 ± 34% +75.9% 2530 ± 27% interrupts.CPU137.NMI:Non-maskable_interrupts
1438 ± 34% +75.9% 2530 ± 27% interrupts.CPU137.PMI:Performance_monitoring_interrupts
950.75 ± 5% +33.1% 1265 ± 14% interrupts.CPU139.RES:Rescheduling_interrupts
1054 ± 6% +26.9% 1338 ± 8% interrupts.CPU140.RES:Rescheduling_interrupts
10703 ± 3% -8.0% 9849 ± 4% interrupts.CPU140.TLB:TLB_shootdowns
1509 ± 29% +71.5% 2589 ± 27% interrupts.CPU141.NMI:Non-maskable_interrupts
1509 ± 29% +71.5% 2589 ± 27% interrupts.CPU141.PMI:Performance_monitoring_interrupts
1334 ± 7% +14.9% 1533 ± 8% interrupts.CPU141.RES:Rescheduling_interrupts
1505 ± 36% +71.7% 2585 ± 27% interrupts.CPU142.NMI:Non-maskable_interrupts
1505 ± 36% +71.7% 2585 ± 27% interrupts.CPU142.PMI:Performance_monitoring_interrupts
1206 ± 7% +32.3% 1596 ± 13% interrupts.CPU142.RES:Rescheduling_interrupts
1218 ± 11% +55.0% 1888 ± 44% interrupts.CPU143.NMI:Non-maskable_interrupts
1218 ± 11% +55.0% 1888 ± 44% interrupts.CPU143.PMI:Performance_monitoring_interrupts
1883 ± 5% +37.7% 2594 ± 12% interrupts.CPU143.RES:Rescheduling_interrupts
1211 ± 11% +51.1% 1831 ± 35% interrupts.CPU144.NMI:Non-maskable_interrupts
1211 ± 11% +51.1% 1831 ± 35% interrupts.CPU144.PMI:Performance_monitoring_interrupts
1266 ± 15% +43.3% 1815 ± 7% interrupts.CPU144.RES:Rescheduling_interrupts
1226 ± 11% +109.7% 2572 ± 27% interrupts.CPU145.NMI:Non-maskable_interrupts
1226 ± 11% +109.7% 2572 ± 27% interrupts.CPU145.PMI:Performance_monitoring_interrupts
1370 ± 27% +54.3% 2114 ± 35% interrupts.CPU15.NMI:Non-maskable_interrupts
1370 ± 27% +54.3% 2114 ± 35% interrupts.CPU15.PMI:Performance_monitoring_interrupts
685.25 ± 6% +33.2% 913.00 ± 9% interrupts.CPU15.RES:Rescheduling_interrupts
1197 ± 11% +84.2% 2206 ± 39% interrupts.CPU150.NMI:Non-maskable_interrupts
1197 ± 11% +84.2% 2206 ± 39% interrupts.CPU150.PMI:Performance_monitoring_interrupts
1097 ± 9% +33.0% 1459 ± 13% interrupts.CPU152.RES:Rescheduling_interrupts
1263 ± 7% +31.8% 1665 ± 8% interrupts.CPU154.RES:Rescheduling_interrupts
1215 ± 12% +49.4% 1815 ± 33% interrupts.CPU155.NMI:Non-maskable_interrupts
1215 ± 12% +49.4% 1815 ± 33% interrupts.CPU155.PMI:Performance_monitoring_interrupts
1222 ± 5% +29.1% 1578 ± 9% interrupts.CPU155.RES:Rescheduling_interrupts
1065 ± 9% +30.1% 1386 ± 13% interrupts.CPU156.RES:Rescheduling_interrupts
1017 ± 13% +23.8% 1259 ± 7% interrupts.CPU157.RES:Rescheduling_interrupts
1055 ± 11% +28.5% 1356 ± 11% interrupts.CPU158.RES:Rescheduling_interrupts
1016 ± 9% +39.7% 1420 ± 13% interrupts.CPU159.RES:Rescheduling_interrupts
1084 ± 2% +24.3% 1347 ± 13% interrupts.CPU161.RES:Rescheduling_interrupts
918.75 ± 13% +20.4% 1106 ± 11% interrupts.CPU162.RES:Rescheduling_interrupts
10725 -8.9% 9774 ± 2% interrupts.CPU162.TLB:TLB_shootdowns
959.75 ± 9% +24.8% 1197 ± 11% interrupts.CPU163.RES:Rescheduling_interrupts
1177 ± 8% +36.8% 1610 ± 15% interrupts.CPU167.RES:Rescheduling_interrupts
1211 ± 12% +84.4% 2233 ± 39% interrupts.CPU168.NMI:Non-maskable_interrupts
1211 ± 12% +84.4% 2233 ± 39% interrupts.CPU168.PMI:Performance_monitoring_interrupts
1220 ± 12% +22.2% 1491 ± 8% interrupts.CPU169.RES:Rescheduling_interrupts
711.00 ± 6% +33.3% 948.00 ± 13% interrupts.CPU17.RES:Rescheduling_interrupts
1254 ± 8% +32.6% 1663 ± 18% interrupts.CPU170.RES:Rescheduling_interrupts
1149 ± 10% +46.0% 1677 ± 11% interrupts.CPU171.RES:Rescheduling_interrupts
1578 ± 49% +41.6% 2234 ± 40% interrupts.CPU173.NMI:Non-maskable_interrupts
1578 ± 49% +41.6% 2234 ± 40% interrupts.CPU173.PMI:Performance_monitoring_interrupts
1242 ± 9% +17.3% 1456 ± 9% interrupts.CPU174.NMI:Non-maskable_interrupts
1242 ± 9% +17.3% 1456 ± 9% interrupts.CPU174.PMI:Performance_monitoring_interrupts
1008 ± 7% +26.7% 1278 interrupts.CPU176.RES:Rescheduling_interrupts
1015 ± 4% +33.9% 1360 ± 8% interrupts.CPU177.RES:Rescheduling_interrupts
929.50 ± 13% +27.4% 1183 ± 6% interrupts.CPU178.RES:Rescheduling_interrupts
1051 ± 8% +20.7% 1268 interrupts.CPU179.RES:Rescheduling_interrupts
1149 ± 13% +87.3% 2153 ± 34% interrupts.CPU18.NMI:Non-maskable_interrupts
1149 ± 13% +87.3% 2153 ± 34% interrupts.CPU18.PMI:Performance_monitoring_interrupts
832.75 ± 4% +23.5% 1028 interrupts.CPU18.RES:Rescheduling_interrupts
1215 ± 11% +21.9% 1481 ± 9% interrupts.CPU180.NMI:Non-maskable_interrupts
1215 ± 11% +21.9% 1481 ± 9% interrupts.CPU180.PMI:Performance_monitoring_interrupts
1050 ± 15% +39.3% 1463 ± 6% interrupts.CPU181.RES:Rescheduling_interrupts
1093 ± 5% +28.7% 1407 ± 11% interrupts.CPU182.RES:Rescheduling_interrupts
1082 ± 5% +27.6% 1381 ± 3% interrupts.CPU183.RES:Rescheduling_interrupts
990.50 ± 10% +28.1% 1269 ± 8% interrupts.CPU184.RES:Rescheduling_interrupts
964.00 ± 13% +28.2% 1235 ± 8% interrupts.CPU186.RES:Rescheduling_interrupts
1498 ± 29% +68.5% 2524 ± 19% interrupts.CPU187.NMI:Non-maskable_interrupts
1498 ± 29% +68.5% 2524 ± 19% interrupts.CPU187.PMI:Performance_monitoring_interrupts
1084 ± 11% +35.9% 1473 ± 9% interrupts.CPU188.RES:Rescheduling_interrupts
1537 ± 34% +68.0% 2582 ± 26% interrupts.CPU190.NMI:Non-maskable_interrupts
1537 ± 34% +68.0% 2582 ± 26% interrupts.CPU190.PMI:Performance_monitoring_interrupts
1247 ± 2% +32.7% 1655 ± 5% interrupts.CPU190.RES:Rescheduling_interrupts
1292 ± 11% +26.0% 1628 ± 6% interrupts.CPU191.RES:Rescheduling_interrupts
1223 ± 13% +50.2% 1837 ± 33% interrupts.CPU192.NMI:Non-maskable_interrupts
1223 ± 13% +50.2% 1837 ± 33% interrupts.CPU192.PMI:Performance_monitoring_interrupts
1263 ± 8% +30.8% 1651 ± 8% interrupts.CPU193.RES:Rescheduling_interrupts
1369 ± 8% +25.9% 1724 ± 13% interrupts.CPU196.RES:Rescheduling_interrupts
1127 ± 9% +27.5% 1437 ± 6% interrupts.CPU197.RES:Rescheduling_interrupts
1134 ± 10% +25.8% 1427 ± 19% interrupts.CPU198.RES:Rescheduling_interrupts
1205 ± 12% +47.0% 1772 ± 24% interrupts.CPU199.NMI:Non-maskable_interrupts
1205 ± 12% +47.0% 1772 ± 24% interrupts.CPU199.PMI:Performance_monitoring_interrupts
1160 ± 12% +117.2% 2520 ± 25% interrupts.CPU2.NMI:Non-maskable_interrupts
1160 ± 12% +117.2% 2520 ± 25% interrupts.CPU2.PMI:Performance_monitoring_interrupts
1408 ± 27% +77.7% 2502 ± 27% interrupts.CPU20.NMI:Non-maskable_interrupts
1408 ± 27% +77.7% 2502 ± 27% interrupts.CPU20.PMI:Performance_monitoring_interrupts
1077 ± 13% +28.2% 1381 ± 9% interrupts.CPU202.RES:Rescheduling_interrupts
1512 ± 36% +41.9% 2147 ± 26% interrupts.CPU203.NMI:Non-maskable_interrupts
1512 ± 36% +41.9% 2147 ± 26% interrupts.CPU203.PMI:Performance_monitoring_interrupts
1052 ± 5% +35.0% 1420 ± 20% interrupts.CPU203.RES:Rescheduling_interrupts
1001 ± 3% +41.0% 1411 ± 19% interrupts.CPU204.RES:Rescheduling_interrupts
1140 ± 4% +31.4% 1498 ± 7% interrupts.CPU206.RES:Rescheduling_interrupts
1288 ± 5% +27.6% 1643 ± 3% interrupts.CPU208.RES:Rescheduling_interrupts
1131 ± 13% +60.9% 1821 ± 44% interrupts.CPU21.NMI:Non-maskable_interrupts
1131 ± 13% +60.9% 1821 ± 44% interrupts.CPU21.PMI:Performance_monitoring_interrupts
1126 ± 2% +29.1% 1454 ± 13% interrupts.CPU210.RES:Rescheduling_interrupts
10556 ± 3% -8.9% 9618 ± 2% interrupts.CPU210.TLB:TLB_shootdowns
1042 ± 12% +42.8% 1489 ± 9% interrupts.CPU211.RES:Rescheduling_interrupts
1156 ± 10% +18.5% 1371 ± 9% interrupts.CPU212.RES:Rescheduling_interrupts
1336 ± 4% +13.8% 1520 ± 5% interrupts.CPU213.RES:Rescheduling_interrupts
1201 ± 5% +23.0% 1477 ± 8% interrupts.CPU214.RES:Rescheduling_interrupts
1622 ± 6% +36.7% 2219 ± 17% interrupts.CPU215.RES:Rescheduling_interrupts
1178 ± 16% +30.5% 1538 ± 6% interrupts.CPU216.RES:Rescheduling_interrupts
1006 ± 13% +48.5% 1494 ± 7% interrupts.CPU217.RES:Rescheduling_interrupts
1603 ± 48% +40.3% 2248 ± 38% interrupts.CPU218.NMI:Non-maskable_interrupts
1603 ± 48% +40.3% 2248 ± 38% interrupts.CPU218.PMI:Performance_monitoring_interrupts
1235 ± 9% +36.4% 1684 ± 6% interrupts.CPU218.RES:Rescheduling_interrupts
1219 ± 13% +29.3% 1576 ± 8% interrupts.CPU219.RES:Rescheduling_interrupts
1153 ± 12% +145.2% 2828 ± 10% interrupts.CPU22.NMI:Non-maskable_interrupts
1153 ± 12% +145.2% 2828 ± 10% interrupts.CPU22.PMI:Performance_monitoring_interrupts
849.50 ± 4% +25.5% 1066 ± 6% interrupts.CPU22.RES:Rescheduling_interrupts
1209 ± 12% +84.1% 2226 ± 40% interrupts.CPU220.NMI:Non-maskable_interrupts
1209 ± 12% +84.1% 2226 ± 40% interrupts.CPU220.PMI:Performance_monitoring_interrupts
1037 ± 10% +14.3% 1186 ± 3% interrupts.CPU220.RES:Rescheduling_interrupts
1092 ± 8% +31.8% 1440 ± 14% interrupts.CPU221.RES:Rescheduling_interrupts
1112 ± 13% +28.8% 1433 ± 9% interrupts.CPU222.RES:Rescheduling_interrupts
1220 ± 9% +32.8% 1620 ± 7% interrupts.CPU223.RES:Rescheduling_interrupts
1515 ± 34% +42.5% 2159 ± 28% interrupts.CPU226.NMI:Non-maskable_interrupts
1515 ± 34% +42.5% 2159 ± 28% interrupts.CPU226.PMI:Performance_monitoring_interrupts
1083 ± 8% +33.0% 1441 ± 13% interrupts.CPU226.RES:Rescheduling_interrupts
956.50 ± 11% +23.7% 1183 ± 8% interrupts.CPU227.RES:Rescheduling_interrupts
1180 ± 3% +38.2% 1631 ± 18% interrupts.CPU228.RES:Rescheduling_interrupts
1223 ± 11% +20.1% 1468 ± 9% interrupts.CPU229.NMI:Non-maskable_interrupts
1223 ± 11% +20.1% 1468 ± 9% interrupts.CPU229.PMI:Performance_monitoring_interrupts
1149 ± 12% +58.3% 1819 ± 44% interrupts.CPU23.NMI:Non-maskable_interrupts
1149 ± 12% +58.3% 1819 ± 44% interrupts.CPU23.PMI:Performance_monitoring_interrupts
726.75 ± 4% +32.6% 963.50 ± 6% interrupts.CPU23.RES:Rescheduling_interrupts
1013 ± 7% +35.2% 1370 ± 14% interrupts.CPU230.RES:Rescheduling_interrupts
1004 ± 5% +29.5% 1300 ± 8% interrupts.CPU231.RES:Rescheduling_interrupts
1213 ± 13% +141.5% 2929 ± 9% interrupts.CPU233.NMI:Non-maskable_interrupts
1213 ± 13% +141.5% 2929 ± 9% interrupts.CPU233.PMI:Performance_monitoring_interrupts
1013 ± 9% +22.5% 1241 ± 8% interrupts.CPU233.RES:Rescheduling_interrupts
1177 ± 13% +80.2% 2121 ± 29% interrupts.CPU234.NMI:Non-maskable_interrupts
1177 ± 13% +80.2% 2121 ± 29% interrupts.CPU234.PMI:Performance_monitoring_interrupts
1515 ± 35% +68.0% 2545 ± 26% interrupts.CPU237.NMI:Non-maskable_interrupts
1515 ± 35% +68.0% 2545 ± 26% interrupts.CPU237.PMI:Performance_monitoring_interrupts
1770 ± 29% +64.4% 2910 ± 10% interrupts.CPU238.NMI:Non-maskable_interrupts
1770 ± 29% +64.4% 2910 ± 10% interrupts.CPU238.PMI:Performance_monitoring_interrupts
1000 ± 10% +23.4% 1233 ± 3% interrupts.CPU238.RES:Rescheduling_interrupts
1178 ± 6% +23.5% 1456 ± 8% interrupts.CPU239.RES:Rescheduling_interrupts
1151 ± 14% +115.7% 2483 ± 27% interrupts.CPU24.NMI:Non-maskable_interrupts
1151 ± 14% +115.7% 2483 ± 27% interrupts.CPU24.PMI:Performance_monitoring_interrupts
823.00 ± 9% +51.7% 1248 ± 19% interrupts.CPU24.RES:Rescheduling_interrupts
1217 ± 15% +22.9% 1496 ± 8% interrupts.CPU240.RES:Rescheduling_interrupts
1014 ± 4% +54.4% 1565 ± 20% interrupts.CPU242.RES:Rescheduling_interrupts
10616 ± 3% -8.3% 9731 interrupts.CPU242.TLB:TLB_shootdowns
1043 ± 11% +36.3% 1422 ± 16% interrupts.CPU243.RES:Rescheduling_interrupts
1215 ± 11% +83.3% 2227 ± 40% interrupts.CPU247.NMI:Non-maskable_interrupts
1215 ± 11% +83.3% 2227 ± 40% interrupts.CPU247.PMI:Performance_monitoring_interrupts
1499 ± 34% +68.8% 2531 ± 20% interrupts.CPU248.NMI:Non-maskable_interrupts
1499 ± 34% +68.8% 2531 ± 20% interrupts.CPU248.PMI:Performance_monitoring_interrupts
1034 ± 5% +28.3% 1327 ± 15% interrupts.CPU248.RES:Rescheduling_interrupts
1103 ± 14% +25.1% 1380 ± 8% interrupts.CPU249.RES:Rescheduling_interrupts
1143 ± 13% +49.8% 1712 ± 24% interrupts.CPU25.NMI:Non-maskable_interrupts
1143 ± 13% +49.8% 1712 ± 24% interrupts.CPU25.PMI:Performance_monitoring_interrupts
749.50 ± 9% +24.9% 936.25 ± 4% interrupts.CPU25.RES:Rescheduling_interrupts
10842 ± 2% -8.8% 9885 ± 2% interrupts.CPU25.TLB:TLB_shootdowns
1099 ± 5% +18.0% 1297 ± 3% interrupts.CPU251.RES:Rescheduling_interrupts
993.25 ± 11% +23.1% 1223 ± 5% interrupts.CPU252.RES:Rescheduling_interrupts
1017 ± 12% +34.7% 1369 ± 11% interrupts.CPU253.RES:Rescheduling_interrupts
1532 ± 49% +44.3% 2211 ± 39% interrupts.CPU254.NMI:Non-maskable_interrupts
1532 ± 49% +44.3% 2211 ± 39% interrupts.CPU254.PMI:Performance_monitoring_interrupts
979.50 ± 10% +29.8% 1271 ± 10% interrupts.CPU254.RES:Rescheduling_interrupts
928.50 ± 8% +43.7% 1334 ± 17% interrupts.CPU256.RES:Rescheduling_interrupts
1049 ± 12% +23.9% 1300 ± 8% interrupts.CPU257.RES:Rescheduling_interrupts
1183 ± 4% +12.5% 1331 ± 10% interrupts.CPU258.RES:Rescheduling_interrupts
796.50 ± 6% +38.3% 1101 ± 23% interrupts.CPU26.RES:Rescheduling_interrupts
1087 ± 8% +28.4% 1396 ± 6% interrupts.CPU260.RES:Rescheduling_interrupts
1081 ± 11% +40.3% 1517 ± 6% interrupts.CPU261.RES:Rescheduling_interrupts
1553 ± 48% +43.8% 2233 ± 39% interrupts.CPU262.NMI:Non-maskable_interrupts
1553 ± 48% +43.8% 2233 ± 39% interrupts.CPU262.PMI:Performance_monitoring_interrupts
1270 ± 13% +29.0% 1638 ± 10% interrupts.CPU262.RES:Rescheduling_interrupts
1170 ± 13% +57.6% 1844 ± 44% interrupts.CPU264.NMI:Non-maskable_interrupts
1170 ± 13% +57.6% 1844 ± 44% interrupts.CPU264.PMI:Performance_monitoring_interrupts
899.00 ± 10% +38.8% 1247 ± 14% interrupts.CPU264.RES:Rescheduling_interrupts
912.25 ± 11% +18.3% 1079 ± 7% interrupts.CPU267.RES:Rescheduling_interrupts
703.25 ± 9% +48.5% 1044 ± 21% interrupts.CPU27.RES:Rescheduling_interrupts
1198 ± 12% +82.4% 2185 ± 40% interrupts.CPU273.NMI:Non-maskable_interrupts
1198 ± 12% +82.4% 2185 ± 40% interrupts.CPU273.PMI:Performance_monitoring_interrupts
847.50 ± 10% +44.9% 1228 ± 18% interrupts.CPU273.RES:Rescheduling_interrupts
900.50 ± 19% +34.2% 1208 ± 17% interrupts.CPU274.RES:Rescheduling_interrupts
1175 ± 13% +82.5% 2145 ± 36% interrupts.CPU275.NMI:Non-maskable_interrupts
1175 ± 13% +82.5% 2145 ± 36% interrupts.CPU275.PMI:Performance_monitoring_interrupts
800.50 ± 8% +35.5% 1084 ± 14% interrupts.CPU275.RES:Rescheduling_interrupts
803.00 ± 7% +55.0% 1244 ± 20% interrupts.CPU276.RES:Rescheduling_interrupts
888.50 ± 11% +40.6% 1249 ± 9% interrupts.CPU277.RES:Rescheduling_interrupts
10916 -10.1% 9813 ± 2% interrupts.CPU277.TLB:TLB_shootdowns
1035 ± 2% +23.6% 1280 ± 5% interrupts.CPU278.RES:Rescheduling_interrupts
926.75 ± 8% +37.3% 1272 ± 16% interrupts.CPU279.RES:Rescheduling_interrupts
753.25 ± 21% +42.8% 1076 ± 8% interrupts.CPU282.RES:Rescheduling_interrupts
1183 ± 12% +55.6% 1841 ± 44% interrupts.CPU283.NMI:Non-maskable_interrupts
1183 ± 12% +55.6% 1841 ± 44% interrupts.CPU283.PMI:Performance_monitoring_interrupts
1187 ± 11% +112.7% 2525 ± 27% interrupts.CPU284.NMI:Non-maskable_interrupts
1187 ± 11% +112.7% 2525 ± 27% interrupts.CPU284.PMI:Performance_monitoring_interrupts
2063 ± 28% +38.7% 2863 ± 9% interrupts.CPU285.NMI:Non-maskable_interrupts
2063 ± 28% +38.7% 2863 ± 9% interrupts.CPU285.PMI:Performance_monitoring_interrupts
854.25 ± 3% +27.0% 1084 ± 5% interrupts.CPU286.RES:Rescheduling_interrupts
729.50 ± 11% +33.3% 972.75 ± 5% interrupts.CPU287.RES:Rescheduling_interrupts
1473 ± 50% +72.6% 2542 ± 30% interrupts.CPU29.NMI:Non-maskable_interrupts
1473 ± 50% +72.6% 2542 ± 30% interrupts.CPU29.PMI:Performance_monitoring_interrupts
1133 ± 13% +92.6% 2183 ± 39% interrupts.CPU3.NMI:Non-maskable_interrupts
1133 ± 13% +92.6% 2183 ± 39% interrupts.CPU3.PMI:Performance_monitoring_interrupts
853.00 ± 5% +19.3% 1017 ± 4% interrupts.CPU3.RES:Rescheduling_interrupts
865.00 ± 5% +27.6% 1103 ± 9% interrupts.CPU30.RES:Rescheduling_interrupts
750.50 ± 10% +20.9% 907.25 ± 12% interrupts.CPU31.RES:Rescheduling_interrupts
1140 ± 13% +93.0% 2201 ± 40% interrupts.CPU32.NMI:Non-maskable_interrupts
1140 ± 13% +93.0% 2201 ± 40% interrupts.CPU32.PMI:Performance_monitoring_interrupts
800.50 ± 10% +17.9% 944.00 ± 4% interrupts.CPU32.RES:Rescheduling_interrupts
836.50 ± 5% +18.9% 994.50 ± 4% interrupts.CPU34.RES:Rescheduling_interrupts
797.00 ± 4% +21.9% 971.75 ± 6% interrupts.CPU35.RES:Rescheduling_interrupts
754.00 ± 4% +21.2% 914.00 ± 5% interrupts.CPU36.RES:Rescheduling_interrupts
616.25 ± 8% +44.8% 892.25 ± 15% interrupts.CPU37.RES:Rescheduling_interrupts
791.25 ± 6% +32.6% 1049 ± 16% interrupts.CPU38.RES:Rescheduling_interrupts
686.75 ± 5% +34.9% 926.50 ± 14% interrupts.CPU39.RES:Rescheduling_interrupts
878.50 ± 6% +31.6% 1156 ± 16% interrupts.CPU4.RES:Rescheduling_interrupts
1180 ± 12% +85.2% 2185 ± 34% interrupts.CPU42.NMI:Non-maskable_interrupts
1180 ± 12% +85.2% 2185 ± 34% interrupts.CPU42.PMI:Performance_monitoring_interrupts
980.75 ± 11% +39.5% 1367 ± 14% interrupts.CPU45.RES:Rescheduling_interrupts
1103 ± 14% +22.1% 1347 ± 6% interrupts.CPU46.RES:Rescheduling_interrupts
925.00 ± 26% +42.2% 1315 ± 10% interrupts.CPU47.RES:Rescheduling_interrupts
960.25 ± 15% +41.2% 1356 ± 12% interrupts.CPU48.RES:Rescheduling_interrupts
921.75 ± 8% +23.2% 1135 ± 11% interrupts.CPU49.RES:Rescheduling_interrupts
1067 ± 15% +25.3% 1337 ± 10% interrupts.CPU50.RES:Rescheduling_interrupts
1076 ± 7% +49.1% 1605 ± 17% interrupts.CPU56.RES:Rescheduling_interrupts
10449 ± 2% -7.7% 9646 ± 3% interrupts.CPU56.TLB:TLB_shootdowns
913.75 ± 13% +40.9% 1287 ± 13% interrupts.CPU58.RES:Rescheduling_interrupts
767.50 ± 8% +54.1% 1182 ± 14% interrupts.CPU59.RES:Rescheduling_interrupts
1374 ± 27% +79.9% 2473 ± 26% interrupts.CPU6.NMI:Non-maskable_interrupts
1374 ± 27% +79.9% 2473 ± 26% interrupts.CPU6.PMI:Performance_monitoring_interrupts
825.00 ± 11% +38.8% 1145 ± 18% interrupts.CPU6.RES:Rescheduling_interrupts
1016 ± 21% +32.2% 1343 ± 12% interrupts.CPU60.RES:Rescheduling_interrupts
802.50 ± 12% +52.6% 1225 ± 16% interrupts.CPU61.RES:Rescheduling_interrupts
895.50 ± 8% +21.4% 1087 ± 2% interrupts.CPU62.RES:Rescheduling_interrupts
973.25 ± 22% +41.4% 1376 ± 6% interrupts.CPU66.RES:Rescheduling_interrupts
854.75 ± 10% +33.8% 1143 ± 13% interrupts.CPU67.RES:Rescheduling_interrupts
771.25 ± 12% +40.2% 1081 ± 13% interrupts.CPU69.RES:Rescheduling_interrupts
621.50 ± 7% +45.4% 903.50 ± 12% interrupts.CPU7.RES:Rescheduling_interrupts
1169 ± 7% +24.5% 1455 ± 5% interrupts.CPU70.RES:Rescheduling_interrupts
10547 ± 2% -8.5% 9654 interrupts.CPU70.TLB:TLB_shootdowns
1574 ± 12% +34.4% 2115 ± 11% interrupts.CPU71.RES:Rescheduling_interrupts
1456 ± 29% +49.9% 2183 ± 35% interrupts.CPU72.NMI:Non-maskable_interrupts
1456 ± 29% +49.9% 2183 ± 35% interrupts.CPU72.PMI:Performance_monitoring_interrupts
1183 ± 12% +25.6% 1485 ± 8% interrupts.CPU72.RES:Rescheduling_interrupts
1514 ± 33% +41.4% 2142 ± 27% interrupts.CPU73.NMI:Non-maskable_interrupts
1514 ± 33% +41.4% 2142 ± 27% interrupts.CPU73.PMI:Performance_monitoring_interrupts
986.75 ± 21% +56.7% 1546 ± 14% interrupts.CPU73.RES:Rescheduling_interrupts
1001 ± 4% +35.5% 1356 ± 7% interrupts.CPU76.RES:Rescheduling_interrupts
1004 ± 10% +22.4% 1229 ± 11% interrupts.CPU77.RES:Rescheduling_interrupts
897.25 ± 9% +34.5% 1206 ± 19% interrupts.CPU78.RES:Rescheduling_interrupts
785.75 ± 11% +25.6% 987.00 ± 4% interrupts.CPU8.RES:Rescheduling_interrupts
943.75 ± 9% +29.1% 1218 ± 12% interrupts.CPU81.RES:Rescheduling_interrupts
991.75 ± 2% +37.9% 1367 ± 17% interrupts.CPU82.RES:Rescheduling_interrupts
1177 ± 12% +58.9% 1870 ± 44% interrupts.CPU83.NMI:Non-maskable_interrupts
1177 ± 12% +58.9% 1870 ± 44% interrupts.CPU83.PMI:Performance_monitoring_interrupts
1170 ± 15% +17.1% 1370 ± 6% interrupts.CPU83.RES:Rescheduling_interrupts
1499 ± 30% +45.9% 2188 ± 34% interrupts.CPU86.NMI:Non-maskable_interrupts
1499 ± 30% +45.9% 2188 ± 34% interrupts.CPU86.PMI:Performance_monitoring_interrupts
1193 ± 10% +109.8% 2502 ± 20% interrupts.CPU87.NMI:Non-maskable_interrupts
1193 ± 10% +109.8% 2502 ± 20% interrupts.CPU87.PMI:Performance_monitoring_interrupts
1145 ± 14% +31.2% 1502 ± 7% interrupts.CPU87.RES:Rescheduling_interrupts
1177 ± 6% +21.1% 1426 ± 8% interrupts.CPU88.RES:Rescheduling_interrupts
1140 ± 14% +91.1% 2179 ± 40% interrupts.CPU9.NMI:Non-maskable_interrupts
1140 ± 14% +91.1% 2179 ± 40% interrupts.CPU9.PMI:Performance_monitoring_interrupts
676.75 ± 10% +41.2% 955.25 ± 11% interrupts.CPU9.RES:Rescheduling_interrupts
1195 ± 11% +56.7% 1872 ± 43% interrupts.CPU90.NMI:Non-maskable_interrupts
1195 ± 11% +56.7% 1872 ± 43% interrupts.CPU90.PMI:Performance_monitoring_interrupts
2083 ± 27% +40.0% 2917 ± 10% interrupts.CPU95.NMI:Non-maskable_interrupts
2083 ± 27% +40.0% 2917 ± 10% interrupts.CPU95.PMI:Performance_monitoring_interrupts
1110 ± 6% +14.4% 1270 ± 11% interrupts.CPU95.RES:Rescheduling_interrupts
1110 ± 6% +41.0% 1566 ± 18% interrupts.CPU98.RES:Rescheduling_interrupts
984.75 ± 9% +58.2% 1557 ± 19% interrupts.CPU99.RES:Rescheduling_interrupts
310787 ± 6% +23.6% 384165 ± 4% interrupts.RES:Rescheduling_interrupts
33134 ± 2% +14.7% 38003 ± 6% softirqs.CPU0.SCHED
27079 ± 2% +17.4% 31779 ± 3% softirqs.CPU1.SCHED
162495 +8.8% 176829 ± 4% softirqs.CPU1.TIMER
26465 +19.2% 31556 ± 3% softirqs.CPU10.SCHED
25261 ± 3% +16.4% 29411 ± 3% softirqs.CPU100.SCHED
25450 +18.5% 30153 ± 4% softirqs.CPU101.SCHED
25169 ± 2% +19.3% 30020 ± 3% softirqs.CPU102.SCHED
24805 ± 3% +20.5% 29893 ± 3% softirqs.CPU103.SCHED
25132 ± 3% +18.9% 29875 ± 3% softirqs.CPU104.SCHED
177301 ± 2% +11.3% 197274 ± 4% softirqs.CPU104.TIMER
24869 ± 3% +18.8% 29537 ± 2% softirqs.CPU105.SCHED
25032 ± 2% +17.7% 29462 ± 3% softirqs.CPU106.SCHED
24317 +22.3% 29729 ± 3% softirqs.CPU107.SCHED
25241 ± 3% +18.5% 29917 ± 2% softirqs.CPU108.SCHED
25571 ± 2% +17.6% 30075 ± 3% softirqs.CPU109.SCHED
25910 +17.9% 30551 ± 3% softirqs.CPU11.SCHED
24927 ± 2% +18.5% 29538 ± 4% softirqs.CPU110.SCHED
25019 ± 2% +19.2% 29833 ± 4% softirqs.CPU111.SCHED
25067 ± 2% +18.7% 29743 ± 4% softirqs.CPU112.SCHED
25105 ± 2% +19.1% 29892 ± 2% softirqs.CPU113.SCHED
25603 ± 2% +16.2% 29753 ± 4% softirqs.CPU114.SCHED
25517 ± 2% +17.9% 30096 ± 3% softirqs.CPU115.SCHED
176346 ± 5% +11.4% 196390 ± 4% softirqs.CPU115.TIMER
24988 ± 2% +17.3% 29299 ± 4% softirqs.CPU116.SCHED
24362 +22.1% 29748 ± 2% softirqs.CPU117.SCHED
25420 ± 2% +18.4% 30101 ± 3% softirqs.CPU118.SCHED
25202 +17.2% 29531 ± 3% softirqs.CPU119.SCHED
246.00 ± 32% +5886.8% 14727 ±166% softirqs.CPU12.NET_RX
25808 ± 2% +19.6% 30866 ± 4% softirqs.CPU12.SCHED
161592 ± 4% +26.1% 203759 ± 17% softirqs.CPU12.TIMER
25550 +16.3% 29721 ± 3% softirqs.CPU120.SCHED
172644 ± 4% +13.1% 195269 ± 4% softirqs.CPU120.TIMER
24062 ± 5% +24.3% 29898 ± 3% softirqs.CPU121.SCHED
173612 ± 4% +12.4% 195124 ± 3% softirqs.CPU121.TIMER
24774 ± 3% +20.1% 29742 ± 2% softirqs.CPU122.SCHED
25233 ± 2% +18.4% 29878 ± 2% softirqs.CPU123.SCHED
25038 ± 2% +18.0% 29548 ± 4% softirqs.CPU124.SCHED
24756 +19.1% 29485 ± 3% softirqs.CPU125.SCHED
25079 +19.2% 29903 ± 3% softirqs.CPU126.SCHED
25110 +17.9% 29598 ± 3% softirqs.CPU127.SCHED
24869 ± 3% +19.6% 29754 ± 3% softirqs.CPU128.SCHED
25255 ± 2% +17.6% 29710 ± 3% softirqs.CPU129.SCHED
26257 +22.8% 32254 ± 3% softirqs.CPU13.SCHED
25274 ± 2% +19.3% 30153 ± 2% softirqs.CPU130.SCHED
25219 ± 2% +15.4% 29103 ± 2% softirqs.CPU131.SCHED
25034 ± 2% +19.3% 29869 ± 2% softirqs.CPU132.SCHED
25448 +17.1% 29792 softirqs.CPU133.SCHED
25064 +17.5% 29450 ± 4% softirqs.CPU134.SCHED
25561 ± 2% +16.4% 29742 ± 4% softirqs.CPU135.SCHED
25620 +17.3% 30041 ± 3% softirqs.CPU136.SCHED
174761 ± 6% +11.1% 194097 ± 7% softirqs.CPU136.TIMER
26235 ± 2% +14.8% 30124 ± 2% softirqs.CPU137.SCHED
169540 ± 4% +13.3% 192089 ± 3% softirqs.CPU137.TIMER
25194 +18.3% 29808 ± 3% softirqs.CPU138.SCHED
25038 ± 4% +19.7% 29982 ± 4% softirqs.CPU139.SCHED
26136 ± 2% +20.5% 31494 ± 2% softirqs.CPU14.SCHED
25185 +20.2% 30269 ± 3% softirqs.CPU140.SCHED
25032 +20.2% 30098 ± 2% softirqs.CPU141.SCHED
25247 ± 2% +16.9% 29514 softirqs.CPU142.SCHED
24775 +12.9% 27962 ± 6% softirqs.CPU143.SCHED
25196 +19.1% 30016 ± 3% softirqs.CPU144.SCHED
24907 ± 2% +18.4% 29495 ± 3% softirqs.CPU145.SCHED
25254 +16.3% 29359 ± 4% softirqs.CPU146.SCHED
25123 +19.8% 30089 ± 3% softirqs.CPU147.SCHED
25311 ± 6% +17.6% 29757 ± 5% softirqs.CPU148.SCHED
25020 ± 2% +20.4% 30121 ± 2% softirqs.CPU149.SCHED
26013 +19.5% 31094 ± 2% softirqs.CPU15.SCHED
25040 +19.1% 29828 ± 4% softirqs.CPU150.SCHED
25358 +20.1% 30458 ± 2% softirqs.CPU151.SCHED
175966 ± 6% +11.6% 196369 ± 4% softirqs.CPU151.TIMER
24847 ± 2% +20.7% 30003 ± 2% softirqs.CPU152.SCHED
24860 ± 4% +19.9% 29811 ± 3% softirqs.CPU153.SCHED
25102 ± 3% +18.0% 29611 ± 3% softirqs.CPU154.SCHED
24819 +20.0% 29792 ± 3% softirqs.CPU155.SCHED
25414 ± 2% +17.3% 29808 softirqs.CPU156.SCHED
176417 ± 5% +15.6% 203967 ± 5% softirqs.CPU156.TIMER
25556 +16.1% 29663 ± 4% softirqs.CPU157.SCHED
25241 ± 2% +19.9% 30256 ± 3% softirqs.CPU158.SCHED
25462 +17.9% 30017 ± 2% softirqs.CPU159.SCHED
25909 +18.5% 30694 ± 3% softirqs.CPU16.SCHED
25139 +18.1% 29684 ± 4% softirqs.CPU160.SCHED
25431 +17.2% 29812 ± 4% softirqs.CPU161.SCHED
25712 +18.6% 30483 ± 5% softirqs.CPU162.SCHED
172304 ± 4% +13.1% 194925 ± 4% softirqs.CPU162.TIMER
25736 +16.7% 30040 ± 3% softirqs.CPU163.SCHED
169697 ± 6% +16.0% 196768 ± 7% softirqs.CPU163.TIMER
25196 ± 2% +17.4% 29591 ± 2% softirqs.CPU164.SCHED
24976 +19.1% 29753 ± 2% softirqs.CPU165.SCHED
25153 ± 2% +18.0% 29682 ± 2% softirqs.CPU166.SCHED
24977 +19.7% 29886 ± 2% softirqs.CPU167.SCHED
24784 ± 3% +18.9% 29457 ± 3% softirqs.CPU168.SCHED
25266 ± 2% +17.1% 29596 ± 4% softirqs.CPU169.SCHED
25886 ± 2% +19.3% 30876 ± 3% softirqs.CPU17.SCHED
24920 +17.6% 29295 ± 3% softirqs.CPU170.SCHED
24993 +18.7% 29660 ± 3% softirqs.CPU171.SCHED
25422 +17.1% 29763 ± 2% softirqs.CPU172.SCHED
25491 ± 2% +17.7% 29994 ± 3% softirqs.CPU173.SCHED
25264 ± 2% +16.8% 29518 ± 6% softirqs.CPU174.SCHED
25266 ± 2% +17.9% 29791 ± 2% softirqs.CPU175.SCHED
25231 ± 2% +17.9% 29754 ± 3% softirqs.CPU176.SCHED
183212 ± 2% +10.0% 201572 ± 2% softirqs.CPU176.TIMER
25273 ± 2% +18.3% 29899 ± 3% softirqs.CPU177.SCHED
25155 +19.8% 30145 ± 2% softirqs.CPU178.SCHED
25499 ± 2% +16.0% 29576 ± 5% softirqs.CPU179.SCHED
26339 +16.3% 30634 ± 2% softirqs.CPU18.SCHED
24757 ± 4% +19.2% 29500 ± 2% softirqs.CPU180.SCHED
25192 ± 3% +14.7% 28898 ± 5% softirqs.CPU181.SCHED
25166 ± 2% +19.2% 29999 ± 2% softirqs.CPU182.SCHED
25259 ± 2% +18.4% 29910 ± 4% softirqs.CPU183.SCHED
25247 ± 2% +16.9% 29519 ± 4% softirqs.CPU184.SCHED
25415 ± 2% +16.9% 29715 ± 2% softirqs.CPU185.SCHED
180421 ± 5% +11.4% 200946 ± 3% softirqs.CPU185.TIMER
24973 ± 3% +16.3% 29053 softirqs.CPU186.SCHED
25525 ± 2% +16.1% 29625 ± 2% softirqs.CPU187.SCHED
25461 +18.2% 30088 ± 2% softirqs.CPU188.SCHED
24833 +20.5% 29936 ± 2% softirqs.CPU189.SCHED
25894 +17.1% 30332 ± 4% softirqs.CPU19.SCHED
162878 ± 4% +18.0% 192168 ± 14% softirqs.CPU19.TIMER
25062 +18.4% 29663 ± 2% softirqs.CPU190.SCHED
24867 +18.3% 29425 ± 3% softirqs.CPU191.SCHED
24926 +18.8% 29620 ± 2% softirqs.CPU192.SCHED
183126 ± 5% +11.9% 204971 ± 2% softirqs.CPU192.TIMER
24864 ± 2% +16.2% 28893 ± 4% softirqs.CPU193.SCHED
25242 +17.7% 29702 ± 2% softirqs.CPU194.SCHED
25230 ± 2% +17.4% 29626 ± 3% softirqs.CPU195.SCHED
24981 ± 2% +18.8% 29680 ± 2% softirqs.CPU196.SCHED
25020 +17.3% 29348 ± 6% softirqs.CPU197.SCHED
25272 +18.5% 29942 ± 3% softirqs.CPU198.SCHED
25221 ± 2% +18.8% 29968 ± 3% softirqs.CPU199.SCHED
182100 ± 4% +8.3% 197211 ± 3% softirqs.CPU199.TIMER
26451 +18.1% 31251 ± 3% softirqs.CPU2.SCHED
26194 +18.4% 31019 ± 2% softirqs.CPU20.SCHED
25645 ± 2% +17.6% 30168 ± 3% softirqs.CPU200.SCHED
25337 +20.0% 30393 ± 3% softirqs.CPU201.SCHED
25160 +19.0% 29945 ± 2% softirqs.CPU202.SCHED
25322 ± 2% +18.3% 29944 ± 3% softirqs.CPU203.SCHED
25076 +20.2% 30130 ± 3% softirqs.CPU204.SCHED
25542 +19.2% 30455 ± 2% softirqs.CPU205.SCHED
25245 ± 2% +16.7% 29455 ± 2% softirqs.CPU206.SCHED
25317 ± 2% +17.5% 29743 ± 3% softirqs.CPU207.SCHED
25283 ± 2% +18.5% 29958 ± 4% softirqs.CPU208.SCHED
25533 +12.9% 28839 ± 6% softirqs.CPU209.SCHED
176766 ± 3% +13.1% 199978 ± 2% softirqs.CPU209.TIMER
26093 +18.6% 30954 ± 3% softirqs.CPU21.SCHED
25426 ± 2% +17.8% 29963 ± 3% softirqs.CPU210.SCHED
25363 ± 2% +17.5% 29794 softirqs.CPU211.SCHED
25056 ± 2% +18.3% 29644 ± 5% softirqs.CPU212.SCHED
24915 ± 2% +18.8% 29602 ± 3% softirqs.CPU213.SCHED
25269 ± 2% +19.9% 30296 ± 2% softirqs.CPU214.SCHED
24759 ± 2% +16.4% 28808 ± 5% softirqs.CPU215.SCHED
25090 +19.8% 30061 ± 2% softirqs.CPU216.SCHED
24887 ± 2% +17.2% 29156 softirqs.CPU217.SCHED
25021 +17.2% 29336 ± 4% softirqs.CPU218.SCHED
25320 ± 2% +17.7% 29806 ± 2% softirqs.CPU219.SCHED
25672 ± 2% +20.9% 31048 softirqs.CPU22.SCHED
25182 ± 2% +18.8% 29919 ± 3% softirqs.CPU220.SCHED
25152 ± 2% +20.3% 30248 ± 4% softirqs.CPU221.SCHED
24777 +19.1% 29504 ± 5% softirqs.CPU222.SCHED
25122 ± 3% +19.6% 30041 ± 2% softirqs.CPU223.SCHED
25079 ± 2% +19.4% 29954 ± 2% softirqs.CPU224.SCHED
25236 ± 2% +18.8% 29969 ± 2% softirqs.CPU225.SCHED
25105 ± 3% +19.0% 29876 ± 2% softirqs.CPU226.SCHED
25609 +15.6% 29613 ± 4% softirqs.CPU227.SCHED
180136 ± 8% +11.0% 200040 ± 5% softirqs.CPU227.TIMER
25435 +15.9% 29476 ± 2% softirqs.CPU228.SCHED
175813 ± 3% +16.7% 205108 ± 5% softirqs.CPU228.TIMER
25142 ± 2% +14.1% 28699 ± 5% softirqs.CPU229.SCHED
25831 +19.2% 30787 ± 2% softirqs.CPU23.SCHED
25460 ± 2% +18.8% 30242 ± 3% softirqs.CPU230.SCHED
25200 ± 3% +20.1% 30259 ± 2% softirqs.CPU231.SCHED
168374 ± 3% +8.7% 183098 ± 3% softirqs.CPU231.TIMER
25379 ± 2% +17.1% 29711 ± 2% softirqs.CPU232.SCHED
25524 ± 2% +18.5% 30246 ± 3% softirqs.CPU233.SCHED
25686 ± 2% +17.5% 30170 ± 3% softirqs.CPU234.SCHED
170330 ± 4% +11.3% 189542 ± 5% softirqs.CPU234.TIMER
25635 ± 2% +14.7% 29410 ± 4% softirqs.CPU235.SCHED
176292 ± 7% +15.9% 204389 ± 6% softirqs.CPU235.TIMER
25549 ± 2% +16.3% 29718 ± 2% softirqs.CPU236.SCHED
178538 ± 4% +9.2% 194880 ± 4% softirqs.CPU236.TIMER
25386 ± 2% +18.4% 30055 ± 2% softirqs.CPU237.SCHED
25191 ± 2% +17.9% 29707 softirqs.CPU238.SCHED
25186 ± 3% +20.3% 30293 softirqs.CPU239.SCHED
25877 +19.0% 30799 ± 3% softirqs.CPU24.SCHED
25506 +17.5% 29967 ± 3% softirqs.CPU240.SCHED
24964 ± 2% +21.1% 30222 ± 3% softirqs.CPU241.SCHED
25258 +17.7% 29719 ± 2% softirqs.CPU242.SCHED
25162 +18.2% 29740 ± 4% softirqs.CPU243.SCHED
25808 +17.3% 30285 ± 3% softirqs.CPU244.SCHED
25679 +17.4% 30150 ± 3% softirqs.CPU245.SCHED
175664 ± 3% +8.3% 190327 ± 4% softirqs.CPU245.TIMER
25134 ± 2% +19.7% 30079 ± 4% softirqs.CPU246.SCHED
24942 +19.9% 29913 ± 3% softirqs.CPU247.SCHED
25395 ± 2% +17.8% 29906 ± 2% softirqs.CPU248.SCHED
180993 ± 3% +10.8% 200584 ± 4% softirqs.CPU248.TIMER
25491 ± 2% +18.0% 30075 ± 4% softirqs.CPU249.SCHED
26099 +17.2% 30595 ± 3% softirqs.CPU25.SCHED
25332 +18.7% 30060 ± 2% softirqs.CPU250.SCHED
25471 ± 2% +17.4% 29892 ± 3% softirqs.CPU251.SCHED
180242 ± 4% +9.8% 197819 ± 4% softirqs.CPU251.TIMER
25406 ± 2% +16.9% 29694 ± 3% softirqs.CPU252.SCHED
25317 ± 3% +18.2% 29922 ± 3% softirqs.CPU253.SCHED
25103 ± 4% +19.9% 30106 ± 3% softirqs.CPU254.SCHED
25231 ± 2% +19.8% 30227 ± 3% softirqs.CPU255.SCHED
25509 ± 2% +18.2% 30161 ± 3% softirqs.CPU256.SCHED
25559 ± 3% +16.9% 29888 ± 3% softirqs.CPU257.SCHED
25277 ± 2% +16.8% 29523 ± 2% softirqs.CPU258.SCHED
24695 ± 5% +20.4% 29721 ± 2% softirqs.CPU259.SCHED
182550 ± 5% +10.5% 201781 ± 3% softirqs.CPU259.TIMER
25905 +19.5% 30970 ± 2% softirqs.CPU26.SCHED
164306 ± 3% +7.6% 176738 ± 5% softirqs.CPU26.TIMER
24829 ± 2% +20.8% 29990 ± 2% softirqs.CPU260.SCHED
25156 +19.1% 29971 ± 2% softirqs.CPU261.SCHED
25098 ± 3% +17.6% 29515 ± 4% softirqs.CPU262.SCHED
180807 ± 5% +9.4% 197856 ± 3% softirqs.CPU262.TIMER
25053 ± 2% +18.2% 29613 ± 2% softirqs.CPU263.SCHED
25505 +18.9% 30336 ± 3% softirqs.CPU264.SCHED
169958 ± 5% +11.8% 189979 ± 4% softirqs.CPU264.TIMER
25011 ± 3% +18.5% 29640 ± 4% softirqs.CPU265.SCHED
169719 ± 4% +22.2% 207453 ± 8% softirqs.CPU265.TIMER
25489 ± 2% +18.6% 30231 ± 3% softirqs.CPU266.SCHED
25727 +18.8% 30554 ± 2% softirqs.CPU267.SCHED
25423 +18.1% 30020 ± 2% softirqs.CPU268.SCHED
25451 ± 2% +19.0% 30292 ± 4% softirqs.CPU269.SCHED
26042 +18.5% 30852 ± 3% softirqs.CPU27.SCHED
163812 ± 3% +8.6% 177825 ± 5% softirqs.CPU27.TIMER
25649 ± 2% +18.3% 30337 ± 3% softirqs.CPU270.SCHED
25318 +19.3% 30212 ± 3% softirqs.CPU271.SCHED
25592 ± 2% +19.6% 30603 ± 3% softirqs.CPU272.SCHED
25440 ± 2% +20.0% 30520 ± 3% softirqs.CPU273.SCHED
26007 +18.2% 30741 ± 2% softirqs.CPU274.SCHED
25661 +18.7% 30454 ± 3% softirqs.CPU275.SCHED
25227 +21.0% 30536 ± 2% softirqs.CPU276.SCHED
25923 +17.9% 30560 ± 3% softirqs.CPU277.SCHED
25973 +14.6% 29757 ± 5% softirqs.CPU278.SCHED
25905 ± 2% +16.2% 30089 ± 3% softirqs.CPU279.SCHED
26091 +18.3% 30875 ± 3% softirqs.CPU28.SCHED
25736 ± 2% +17.4% 30217 ± 4% softirqs.CPU280.SCHED
25964 +13.5% 29482 ± 6% softirqs.CPU281.SCHED
170413 ± 4% +11.8% 190550 ± 4% softirqs.CPU281.TIMER
25669 +18.8% 30484 ± 3% softirqs.CPU282.SCHED
25462 ± 2% +18.6% 30208 softirqs.CPU283.SCHED
174059 ± 6% +10.6% 192446 ± 5% softirqs.CPU283.TIMER
25578 +18.4% 30287 ± 3% softirqs.CPU284.SCHED
25703 +19.1% 30617 ± 3% softirqs.CPU285.SCHED
25775 ± 2% +16.0% 29891 ± 2% softirqs.CPU286.SCHED
25175 ± 2% +16.0% 29204 ± 4% softirqs.CPU287.SCHED
26076 +17.7% 30684 ± 3% softirqs.CPU29.SCHED
26116 +18.8% 31032 ± 2% softirqs.CPU3.SCHED
26043 +18.2% 30789 ± 3% softirqs.CPU30.SCHED
25884 +18.5% 30681 ± 2% softirqs.CPU31.SCHED
167289 ± 2% +6.3% 177832 ± 6% softirqs.CPU31.TIMER
26095 +17.1% 30563 ± 3% softirqs.CPU32.SCHED
161186 ± 2% +10.6% 178192 ± 4% softirqs.CPU32.TIMER
26124 +18.2% 30887 ± 3% softirqs.CPU33.SCHED
25966 +18.0% 30651 ± 2% softirqs.CPU34.SCHED
167402 ± 4% +6.6% 178425 ± 4% softirqs.CPU34.TIMER
25944 +18.0% 30622 ± 3% softirqs.CPU35.SCHED
26167 +17.9% 30861 ± 2% softirqs.CPU36.SCHED
25900 +20.7% 31271 ± 3% softirqs.CPU37.SCHED
25475 ± 3% +21.1% 30843 ± 3% softirqs.CPU38.SCHED
25642 ± 2% +19.4% 30627 ± 3% softirqs.CPU39.SCHED
25494 ± 2% +20.7% 30774 ± 2% softirqs.CPU4.SCHED
25610 +18.1% 30236 ± 4% softirqs.CPU40.SCHED
26064 ± 3% +17.2% 30546 ± 3% softirqs.CPU41.SCHED
25739 ± 2% +15.2% 29643 ± 4% softirqs.CPU42.SCHED
25730 ± 2% +18.5% 30493 ± 3% softirqs.CPU43.SCHED
175037 ± 6% +10.6% 193664 ± 4% softirqs.CPU43.TIMER
25729 +18.4% 30470 ± 3% softirqs.CPU44.SCHED
25114 ± 2% +21.3% 30475 ± 2% softirqs.CPU45.SCHED
25415 ± 3% +20.1% 30511 ± 2% softirqs.CPU46.SCHED
25558 +17.4% 29994 softirqs.CPU47.SCHED
25624 +16.7% 29897 ± 4% softirqs.CPU48.SCHED
167429 ± 5% +13.0% 189268 ± 5% softirqs.CPU48.TIMER
25871 +17.3% 30344 ± 3% softirqs.CPU49.SCHED
167694 ± 3% +12.5% 188683 ± 4% softirqs.CPU49.TIMER
25681 +20.0% 30819 ± 3% softirqs.CPU5.SCHED
25661 +17.8% 30220 softirqs.CPU50.SCHED
25857 +17.6% 30408 ± 3% softirqs.CPU51.SCHED
25943 +17.7% 30544 ± 3% softirqs.CPU52.SCHED
25398 ± 2% +19.6% 30387 ± 3% softirqs.CPU53.SCHED
25599 ± 2% +18.9% 30428 ± 3% softirqs.CPU54.SCHED
25454 ± 2% +20.5% 30663 ± 3% softirqs.CPU55.SCHED
25603 ± 2% +18.6% 30374 ± 3% softirqs.CPU56.SCHED
25665 +18.7% 30453 ± 3% softirqs.CPU57.SCHED
25853 +18.9% 30740 ± 2% softirqs.CPU58.SCHED
25916 +17.5% 30454 ± 3% softirqs.CPU59.SCHED
26202 +16.7% 30570 ± 3% softirqs.CPU6.SCHED
25549 ± 2% +20.5% 30778 ± 2% softirqs.CPU60.SCHED
25854 +18.5% 30626 ± 2% softirqs.CPU61.SCHED
25516 ± 2% +17.1% 29871 ± 4% softirqs.CPU62.SCHED
25833 +17.2% 30284 ± 3% softirqs.CPU63.SCHED
25510 ± 3% +19.2% 30420 ± 3% softirqs.CPU64.SCHED
26177 +16.5% 30487 ± 3% softirqs.CPU65.SCHED
166747 ± 3% +11.5% 185900 ± 3% softirqs.CPU65.TIMER
25637 ± 2% +19.0% 30503 ± 3% softirqs.CPU66.SCHED
25644 ± 2% +15.4% 29588 softirqs.CPU67.SCHED
25796 +18.6% 30585 ± 3% softirqs.CPU68.SCHED
25503 +20.2% 30654 ± 3% softirqs.CPU69.SCHED
25912 +16.4% 30171 ± 4% softirqs.CPU7.SCHED
25994 ± 6% +16.2% 30203 softirqs.CPU70.SCHED
25255 +17.9% 29766 ± 3% softirqs.CPU71.SCHED
25057 +19.1% 29854 ± 3% softirqs.CPU72.SCHED
24925 ± 2% +18.7% 29588 ± 2% softirqs.CPU73.SCHED
25774 +16.1% 29929 ± 3% softirqs.CPU74.SCHED
177035 ± 2% +7.9% 190942 ± 4% softirqs.CPU74.TIMER
25433 +19.2% 30327 ± 3% softirqs.CPU75.SCHED
25274 ± 2% +15.5% 29184 ± 3% softirqs.CPU76.SCHED
25297 +17.7% 29765 ± 4% softirqs.CPU77.SCHED
25557 ± 2% +18.2% 30203 ± 3% softirqs.CPU78.SCHED
25604 ± 2% +17.3% 30034 ± 3% softirqs.CPU79.SCHED
175758 ± 6% +9.8% 193033 ± 3% softirqs.CPU79.TIMER
26086 +18.4% 30878 ± 2% softirqs.CPU8.SCHED
25297 +18.6% 30013 ± 3% softirqs.CPU80.SCHED
25450 +17.8% 29987 ± 2% softirqs.CPU81.SCHED
25125 ± 3% +17.0% 29404 ± 3% softirqs.CPU82.SCHED
24840 ± 2% +18.7% 29490 ± 6% softirqs.CPU83.SCHED
25920 +14.9% 29770 ± 2% softirqs.CPU84.SCHED
168708 ± 5% +18.4% 199703 ± 7% softirqs.CPU84.TIMER
24980 ± 3% +19.5% 29850 ± 3% softirqs.CPU85.SCHED
25338 +18.6% 30042 ± 2% softirqs.CPU86.SCHED
25404 ± 2% +18.6% 30142 ± 2% softirqs.CPU87.SCHED
177099 ± 3% +9.0% 193072 softirqs.CPU87.TIMER
24855 ± 2% +20.7% 30000 ± 3% softirqs.CPU88.SCHED
25532 ± 2% +17.2% 29916 ± 3% softirqs.CPU89.SCHED
26321 ± 2% +14.7% 30186 ± 4% softirqs.CPU9.SCHED
25622 ± 2% +17.4% 30077 ± 3% softirqs.CPU90.SCHED
177491 ± 4% +10.9% 196822 ± 4% softirqs.CPU90.TIMER
25638 ± 2% +14.0% 29228 ± 5% softirqs.CPU91.SCHED
175040 ± 5% +16.7% 204221 ± 6% softirqs.CPU91.TIMER
25387 ± 2% +18.0% 29968 ± 2% softirqs.CPU92.SCHED
25316 ± 2% +19.5% 30262 ± 2% softirqs.CPU93.SCHED
25125 ± 2% +19.6% 30051 softirqs.CPU94.SCHED
25303 ± 2% +18.1% 29875 ± 2% softirqs.CPU95.SCHED
25481 +18.3% 30133 ± 3% softirqs.CPU96.SCHED
25533 +18.1% 30146 ± 3% softirqs.CPU97.SCHED
24892 ± 3% +20.4% 29982 ± 3% softirqs.CPU98.SCHED
24611 +20.3% 29607 ± 3% softirqs.CPU99.SCHED
7325587 +18.2% 8660780 ± 3% softirqs.SCHED

will-it-scale.per_thread_ops
1500 +--------------------------------------------------------------------+
1450 |+. +. .+ +++. +. .+++. +. .++. + |
| + ++ + ++ + ++ + + .++.+ |
1400 |-+ : + + |
1350 |-+ : : OO |
1300 |-+ + O |
1250 |-+ OO O OO OO O|
| O OO O O OO OO O |
1200 |-+ O O OO OO OO O |
1150 |-+ O |
1100 |-+ O O O O |
1050 |O+O O O O O |
| O O O O |
1000 |-+ O O |
950 +--------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample

Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.

Thanks,
Rong Chen

_______________________________________________
LKP mailing list -- lkp@xxxxxxxxxxxx
To unsubscribe send an email to lkp-leave@xxxxxxxxxxxx

--
Zhengjun Xing

--
Zhengjun Xing

Next message: David Hildenbrand: "Re: [PATCH] mm/page_reporting: the "page" must not be the list head"
Previous message: Nicholas Piggin: "Re: [PATCH 1/2] lockdep: improve current->(hard|soft)irqs_enabled synchronisation with actual irq state"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]