Re: [x86/mm/pat] 8d04a5f97a: phoronix-test-suite.glmark2.0.score -23.7% regression

From: Mariusz Ceier
Date: Sat Nov 30 2019 - 15:23:56 EST

I can also confirm this - just bisected framebuffer rendering
performance regression on amdgpu and
8d04a5f97a5fa9d7afdf46eda3a5ceaa973a1bcc is the first bad commit
(leading to drop from around 260-300fps to about 60fps in CS:GO on
Fury X).

PS. Sorry for duplicate email (sending plain text only now, hopefully).

On Wed, 27 Nov 2019 at 00:56, kernel test robot <rong.a.chen@xxxxxxxxx> wrote:
>
> Greeting,
>
> FYI, we noticed a -23.7% regression of phoronix-test-suite.glmark2.0.score due to commit:
>
>
> commit: 8d04a5f97a5fa9d7afdf46eda3a5ceaa973a1bcc ("x86/mm/pat: Convert the PAT tree to a generic interval tree")
> https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
>
> in testcase: phoronix-test-suite
> on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
> with following parameters:
>
> need_x: true
> test: glmark2-1.1.0
> cpufreq_governor: performance
> ucode: 0x500002b
>
> test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added.
> test-url: http://www.phoronix-test-suite.com/
>
> In addition to that, the commit also has significant impact on the following tests:
>
> +------------------+-----------------------------------------------------------------------------+
> | testcase: change | phoronix-test-suite: phoronix-test-suite.gtkperf.0.seconds 26.8% regression |
> | test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory |
> | test parameters | cpufreq_governor=performance |
> | | need_x=true |
> | | test=gtkperf-1.2.1 |
> | | ucode=0x500002b |
> +------------------+-----------------------------------------------------------------------------+
>
>
> If you fix the issue, kindly add following tag
> Reported-by: kernel test robot <rong.a.chen@xxxxxxxxx>
>
>
> Details are as below:
> -------------------------------------------------------------------------------------------------->
>
>
> To reproduce:
>
> git clone https://github.com/intel/lkp-tests.git
> cd lkp-tests
> bin/lkp install job.yaml # job file is attached in this email
> bin/lkp run job.yaml
>
> =========================================================================================
> compiler/cpufreq_governor/kconfig/need_x/rootfs/tbox_group/test/testcase/ucode:
> gcc-7/performance/x86_64-rhel-7.6/true/debian-x86_64-phoronix/lkp-csl-2sp8/glmark2-1.1.0/phoronix-test-suite/0x500002b
>
> commit:
> 9f4813b531 (" Linux 5.4-rc8")
> 8d04a5f97a ("x86/mm/pat: Convert the PAT tree to a generic interval tree")
>
> 9f4813b531a0b8cc 8d04a5f97a5fa9d7afdf46eda3a
> ---------------- ---------------------------
> fail:runs %reproduction fail:runs
> | | |
> 1:4 -25% :4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
> 2:4 -50% :4 dmesg.WARNING:stack_recursion
> %stddev %change %stddev
> \ | \
> 290.50 -23.7% 221.75 Â 4% phoronix-test-suite.glmark2.0.score
> 210.25 -24.1% 159.50 Â 4% phoronix-test-suite.glmark2.1.score
> 35084 -19.8% 28122 Â 3% vmstat.system.cs
> 16157 +1.6% 16415 proc-vmstat.nr_kernel_stack
> 17551 +2.0% 17909 proc-vmstat.nr_slab_reclaimable
> 46846 +2.4% 47962 proc-vmstat.nr_slab_unreclaimable
> 156401 Â 15% -19.5% 125917 Â 11% proc-vmstat.numa_hint_faults_local
> 2091859 -2.4% 2041250 Â 2% proc-vmstat.pgfault
> 72.57 Â 2% -10.0 62.61 Â 19% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
> 1.25 Â 8% -0.5 0.79 Â 58% perf-profile.calltrace.cycles-pp.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
> 1.04 Â 10% -0.4 0.66 Â 58% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
> 72.70 Â 2% -9.9 62.81 Â 19% perf-profile.children.cycles-pp.intel_idle
> 1.28 Â 8% -0.3 0.94 Â 30% perf-profile.children.cycles-pp.irq_enter
> 1.08 Â 9% -0.3 0.78 Â 28% perf-profile.children.cycles-pp.tick_irq_enter
> 0.47 Â 14% -0.2 0.32 Â 39% perf-profile.children.cycles-pp.rcu_sched_clock_irq
> 0.48 Â 4% -0.1 0.37 Â 32% perf-profile.children.cycles-pp.futex_wait_queue_me
> 0.16 Â 11% -0.1 0.06 Â 63% perf-profile.children.cycles-pp.perf_event_task_tick
> 0.20 Â 5% -0.1 0.10 Â 62% perf-profile.children.cycles-pp.rb_next
> 0.11 Â 15% -0.1 0.03 Â100% perf-profile.children.cycles-pp.switch_mm_irqs_off
> 0.18 Â 7% -0.1 0.10 Â 61% perf-profile.children.cycles-pp.update_ts_time_stats
> 72.59 Â 2% -9.8 62.77 Â 19% perf-profile.self.cycles-pp.intel_idle
> 0.16 Â 14% -0.1 0.06 Â 63% perf-profile.self.cycles-pp.perf_event_task_tick
> 0.18 Â 6% -0.1 0.10 Â 65% perf-profile.self.cycles-pp.rb_next
> 26427524 -30.2% 18439861 Â 11% perf-stat.i.branch-misses
> 1.264e+08 -32.7% 85112641 Â 15% perf-stat.i.cache-references
> 35249 -19.8% 28261 Â 3% perf-stat.i.context-switches
> 1663983 Â 10% -47.0% 881904 Â 41% perf-stat.i.dTLB-load-misses
> 2.55e+09 Â 3% -29.5% 1.799e+09 Â 13% perf-stat.i.dTLB-loads
> 1.123e+09 Â 2% -6.9% 1.046e+09 Â 3% perf-stat.i.dTLB-stores
> 1.112e+10 -15.7% 9.376e+09 Â 4% perf-stat.i.instructions
> 6700 -21.1% 5289 Â 7% perf-stat.i.instructions-per-iTLB-miss
> 92755 Â 4% -5.2% 87901 perf-stat.i.node-loads
> 6929 -20.3% 5525 Â 7% perf-stat.overall.instructions-per-iTLB-miss
> 26388462 -30.2% 18414499 Â 11% perf-stat.ps.branch-misses
> 1.262e+08 -32.7% 84986397 Â 15% perf-stat.ps.cache-references
> 35191 -19.8% 28218 Â 3% perf-stat.ps.context-switches
> 1661390 Â 10% -47.0% 880613 Â 41% perf-stat.ps.dTLB-load-misses
> 2.546e+09 Â 3% -29.4% 1.796e+09 Â 13% perf-stat.ps.dTLB-loads
> 1.122e+09 Â 2% -6.8% 1.045e+09 Â 3% perf-stat.ps.dTLB-stores
> 1.111e+10 -15.7% 9.362e+09 Â 4% perf-stat.ps.instructions
> 92587 Â 4% -5.2% 87778 perf-stat.ps.node-loads
> 7.805e+12 -16.3% 6.535e+12 Â 4% perf-stat.total.instructions
> 421893 Â 13% -33.5% 280495 Â 17% numa-meminfo.node0.Active
> 301962 Â 18% -24.7% 227271 Â 3% numa-meminfo.node0.Active(anon)
> 119930 -55.6% 53224 Â 75% numa-meminfo.node0.Active(file)
> 289371 Â 19% -23.6% 220986 Â 3% numa-meminfo.node0.AnonPages
> 1599232 -46.1% 861252 Â 63% numa-meminfo.node0.FilePages
> 1467294 -45.5% 800320 Â 63% numa-meminfo.node0.Inactive
> 406871 -60.9% 159255 Â 92% numa-meminfo.node0.Inactive(file)
> 10042 Â 2% -14.2% 8615 Â 12% numa-meminfo.node0.KernelStack
> 109027 -67.1% 35838 Â 78% numa-meminfo.node0.Mapped
> 2488468 Â 2% -36.4% 1582090 Â 41% numa-meminfo.node0.MemUsed
> 4081 Â 3% -53.1% 1913 Â 56% numa-meminfo.node0.PageTables
> 169752 Â 3% -15.8% 143010 Â 19% numa-meminfo.node0.Slab
> 183294 Â 31% +78.6% 327336 Â 16% numa-meminfo.node1.Active
> 176459 Â 32% +44.1% 254351 Â 4% numa-meminfo.node1.Active(anon)
> 6834 Â 11% +967.9% 72984 Â 57% numa-meminfo.node1.Active(file)
> 171600 Â 33% +42.0% 243637 Â 2% numa-meminfo.node1.AnonPages
> 18539 Â 5% +3986.1% 757532 Â 72% numa-meminfo.node1.FilePages
> 6284 Â 14% +10623.2% 673848 Â 75% numa-meminfo.node1.Inactive
> 3812 Â 13% +6513.3% 252099 Â 58% numa-meminfo.node1.Inactive(file)
> 4526 Â 18% +1622.5% 77962 Â 35% numa-meminfo.node1.Mapped
> 477729 Â 11% +190.4% 1387370 Â 48% numa-meminfo.node1.MemUsed
> 704.00 Â 20% +307.6% 2869 Â 37% numa-meminfo.node1.PageTables
> 75486 Â 18% -24.7% 56818 Â 3% numa-vmstat.node0.nr_active_anon
> 29985 -55.6% 13304 Â 75% numa-vmstat.node0.nr_active_file
> 72338 Â 19% -23.6% 55246 Â 3% numa-vmstat.node0.nr_anon_pages
> 399807 -46.1% 215312 Â 63% numa-vmstat.node0.nr_file_pages
> 101715 -60.9% 39814 Â 92% numa-vmstat.node0.nr_inactive_file
> 10043 Â 2% -14.2% 8614 Â 12% numa-vmstat.node0.nr_kernel_stack
> 27254 -67.1% 8959 Â 78% numa-vmstat.node0.nr_mapped
> 1019 Â 3% -53.2% 477.50 Â 56% numa-vmstat.node0.nr_page_table_pages
> 75486 Â 18% -24.7% 56818 Â 3% numa-vmstat.node0.nr_zone_active_anon
> 29985 -55.6% 13304 Â 75% numa-vmstat.node0.nr_zone_active_file
> 101715 -60.9% 39814 Â 92% numa-vmstat.node0.nr_zone_inactive_file
> 1483935 Â 6% -18.2% 1214502 Â 21% numa-vmstat.node0.numa_local
> 44115 Â 32% +44.2% 63599 Â 4% numa-vmstat.node1.nr_active_anon
> 1708 Â 11% +968.1% 18243 Â 57% numa-vmstat.node1.nr_active_file
> 42900 Â 33% +42.0% 60922 Â 2% numa-vmstat.node1.nr_anon_pages
> 4635 Â 5% +3985.9% 189382 Â 72% numa-vmstat.node1.nr_file_pages
> 952.75 Â 13% +6515.2% 63026 Â 58% numa-vmstat.node1.nr_inactive_file
> 1131 Â 18% +1623.5% 19492 Â 35% numa-vmstat.node1.nr_mapped
> 176.00 Â 20% +307.4% 717.00 Â 37% numa-vmstat.node1.nr_page_table_pages
> 44115 Â 32% +44.2% 63599 Â 4% numa-vmstat.node1.nr_zone_active_anon
> 1708 Â 11% +968.1% 18243 Â 57% numa-vmstat.node1.nr_zone_active_file
> 952.75 Â 13% +6515.2% 63026 Â 58% numa-vmstat.node1.nr_zone_inactive_file
> 1546 Â 3% +34.6% 2081 Â 6% slabinfo.UNIX.active_objs
> 1546 Â 3% +34.6% 2081 Â 6% slabinfo.UNIX.num_objs
> 2089 Â 4% +11.9% 2337 Â 7% slabinfo.dmaengine-unmap-16.active_objs
> 2089 Â 4% +11.9% 2337 Â 7% slabinfo.dmaengine-unmap-16.num_objs
> 21286 Â 4% +10.5% 23516 Â 5% slabinfo.filp.active_objs
> 21594 Â 4% +10.8% 23932 Â 4% slabinfo.filp.num_objs
> 3632 Â 7% +15.4% 4190 Â 7% slabinfo.mnt_cache.active_objs
> 3632 Â 7% +15.4% 4190 Â 7% slabinfo.mnt_cache.num_objs
> 3343 Â 4% +23.1% 4116 Â 7% slabinfo.numa_policy.active_objs
> 3343 Â 4% +23.1% 4116 Â 7% slabinfo.numa_policy.num_objs
> 5711 Â 3% +10.0% 6282 Â 4% slabinfo.ovl_inode.active_objs
> 5711 Â 3% +10.0% 6282 Â 4% slabinfo.ovl_inode.num_objs
> 2143 Â 4% +15.8% 2481 Â 7% slabinfo.pool_workqueue.active_objs
> 2143 Â 4% +15.8% 2481 Â 7% slabinfo.pool_workqueue.num_objs
> 2309 Â 8% +14.7% 2648 Â 6% slabinfo.skbuff_ext_cache.active_objs
> 2309 Â 8% +14.7% 2648 Â 6% slabinfo.skbuff_ext_cache.num_objs
> 2785 Â 3% +21.8% 3390 Â 4% slabinfo.sock_inode_cache.active_objs
> 2785 Â 3% +21.8% 3390 Â 4% slabinfo.sock_inode_cache.num_objs
> 1300 Â 3% +15.3% 1500 Â 8% slabinfo.task_group.active_objs
> 1300 Â 3% +15.3% 1500 Â 8% slabinfo.task_group.num_objs
> 471.00 Â 12% -33.1% 315.25 Â 31% slabinfo.xfrm_state.active_objs
> 471.00 Â 12% -33.1% 315.25 Â 31% slabinfo.xfrm_state.num_objs
> 15189 Â 4% -16.9% 12626 Â 4% sched_debug.cfs_rq:/.exec_clock.avg
> 54802 Â 5% -20.8% 43426 Â 7% sched_debug.cfs_rq:/.load.avg
> 59.91 Â 51% -38.0% 37.16 Â 5% sched_debug.cfs_rq:/.load_avg.avg
> 2493 Â112% -68.5% 784.19 Â 3% sched_debug.cfs_rq:/.load_avg.max
> 320.29 Â 88% -55.3% 143.18 Â 2% sched_debug.cfs_rq:/.load_avg.stddev
> 68001 Â 4% -12.7% 59359 Â 3% sched_debug.cfs_rq:/.min_vruntime.avg
> 67912 -18.0% 55681 Â 8% sched_debug.cfs_rq:/.min_vruntime.stddev
> 0.11 Â 5% -26.6% 0.08 Â 7% sched_debug.cfs_rq:/.nr_running.avg
> 0.30 Â 2% -11.0% 0.27 Â 3% sched_debug.cfs_rq:/.nr_running.stddev
> 28.47 Â 6% -16.1% 23.89 Â 6% sched_debug.cfs_rq:/.runnable_load_avg.avg
> 754.35 Â 4% -8.9% 687.54 Â 6% sched_debug.cfs_rq:/.runnable_load_avg.max
> 127.97 Â 4% -10.0% 115.24 Â 6% sched_debug.cfs_rq:/.runnable_load_avg.stddev
> 54698 Â 5% -20.6% 43419 Â 7% sched_debug.cfs_rq:/.runnable_weight.avg
> 44849 Â 15% -52.5% 21314 Â 60% sched_debug.cfs_rq:/.spread0.avg
> 67914 -18.0% 55682 Â 8% sched_debug.cfs_rq:/.spread0.stddev
> 110.05 Â 2% -20.3% 87.72 Â 2% sched_debug.cfs_rq:/.util_avg.avg
> 22.41 Â 9% -27.7% 16.21 Â 10% sched_debug.cfs_rq:/.util_est_enqueued.avg
> 0.05 Â 4% -10.7% 0.05 Â 4% sched_debug.cpu.nr_running.avg
> 134130 -20.1% 107139 Â 3% sched_debug.cpu.nr_switches.avg
> 764365 Â 4% -25.1% 572854 Â 5% sched_debug.cpu.nr_switches.max
> 212569 Â 2% -22.1% 165622 Â 8% sched_debug.cpu.nr_switches.stddev
> 131734 -20.5% 104682 Â 3% sched_debug.cpu.sched_count.avg
> 760935 Â 5% -25.2% 569239 Â 5% sched_debug.cpu.sched_count.max
> 212271 Â 2% -22.0% 165483 Â 8% sched_debug.cpu.sched_count.stddev
> 65857 -20.5% 52334 Â 3% sched_debug.cpu.sched_goidle.avg
> 380419 Â 5% -25.2% 284602 Â 5% sched_debug.cpu.sched_goidle.max
> 106128 Â 2% -22.0% 82735 Â 8% sched_debug.cpu.sched_goidle.stddev
> 65779 -20.6% 52253 Â 3% sched_debug.cpu.ttwu_count.avg
> 164575 Â 4% -15.1% 139787 Â 12% sched_debug.cpu.ttwu_count.stddev
> 925.77 +14.7% 1061 Â 4% sched_debug.cpu.ttwu_local.avg
> 95.00 Â 81% -96.3% 3.50 Â 91% interrupts.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
> 81.00 Â150% -100.0% 0.00 interrupts.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
> 0.00 +4.9e+105% 4915 Â172% interrupts.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
> 71.75 Â167% -99.7% 0.25 Â173% interrupts.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
> 1278 Â 29% +1192.4% 16520 Â127% interrupts.CPU1.RES:Rescheduling_interrupts
> 410.50 Â 26% -94.5% 22.50 Â173% interrupts.CPU10.TLB:TLB_shootdowns
> 95.00 Â 81% -97.4% 2.50 Â128% interrupts.CPU12.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
> 218.50 Â 82% -91.5% 18.50 Â173% interrupts.CPU12.TLB:TLB_shootdowns
> 1142 -64.1% 409.75 Â 92% interrupts.CPU13.NMI:Non-maskable_interrupts
> 1142 -64.1% 409.75 Â 92% interrupts.CPU13.PMI:Performance_monitoring_interrupts
> 11287 Â167% -98.6% 154.00 Â163% interrupts.CPU13.RES:Rescheduling_interrupts
> 1141 Â 2% -49.4% 578.00 Â 72% interrupts.CPU15.NMI:Non-maskable_interrupts
> 1141 Â 2% -49.4% 578.00 Â 72% interrupts.CPU15.PMI:Performance_monitoring_interrupts
> 1124 Â 2% -67.4% 366.75 Â115% interrupts.CPU16.NMI:Non-maskable_interrupts
> 1124 Â 2% -67.4% 366.75 Â115% interrupts.CPU16.PMI:Performance_monitoring_interrupts
> 315.50 Â 62% -69.3% 96.75 Â173% interrupts.CPU17.TLB:TLB_shootdowns
> 137.25 Â 63% -96.5% 4.75 Â161% interrupts.CPU18.TLB:TLB_shootdowns
> 160.00 Â170% -99.5% 0.75 Â110% interrupts.CPU2.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
> 506.25 Â 30% -77.4% 114.50 Â 84% interrupts.CPU2.TLB:TLB_shootdowns
> 241.25 Â 78% -99.1% 2.25 Â173% interrupts.CPU21.TLB:TLB_shootdowns
> 295.00 Â 56% -79.1% 61.75 Â169% interrupts.CPU22.TLB:TLB_shootdowns
> 723.25 Â 63% -84.0% 116.00 Â167% interrupts.CPU23.RES:Rescheduling_interrupts
> 24258 Â 60% -96.5% 848.00 Â 5% interrupts.CPU24.RES:Rescheduling_interrupts
> 254.75 Â 27% +109.6% 534.00 Â 54% interrupts.CPU24.TLB:TLB_shootdowns
> 124.25 Â 75% +178.5% 346.00 Â 32% interrupts.CPU25.TLB:TLB_shootdowns
> 70.00 Â173% +362.9% 324.00 Â 89% interrupts.CPU27.TLB:TLB_shootdowns
> 41.75 Â 84% +1.9e+05% 77527 Â171% interrupts.CPU28.RES:Rescheduling_interrupts
> 1088 Â 22% +12337.9% 135324 Â 82% interrupts.CPU3.RES:Rescheduling_interrupts
> 546.00 Â 39% -87.0% 71.25 Â 68% interrupts.CPU4.TLB:TLB_shootdowns
> 26.25 Â 65% +2721.0% 740.50 Â 82% interrupts.CPU43.RES:Rescheduling_interrupts
> 4.50 Â104% +8927.8% 406.25 Â 92% interrupts.CPU47.TLB:TLB_shootdowns
> 1154 Â172% -99.9% 1.50 Â137% interrupts.CPU48.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
> 435.50 Â 70% -98.5% 6.75 Â 92% interrupts.CPU48.RES:Rescheduling_interrupts
> 504.50 Â 62% -99.8% 1.25 Â131% interrupts.CPU49.RES:Rescheduling_interrupts
> 180.25 Â 72% -100.0% 0.00 interrupts.CPU49.TLB:TLB_shootdowns
> 1605 Â 69% -79.6% 327.75 Â 70% interrupts.CPU5.NMI:Non-maskable_interrupts
> 1605 Â 69% -79.6% 327.75 Â 70% interrupts.CPU5.PMI:Performance_monitoring_interrupts
> 527.00 Â 8% -96.6% 17.75 Â173% interrupts.CPU5.TLB:TLB_shootdowns
> 1248 Â 44% -77.9% 276.25 Â 84% interrupts.CPU53.NMI:Non-maskable_interrupts
> 1248 Â 44% -77.9% 276.25 Â 84% interrupts.CPU53.PMI:Performance_monitoring_interrupts
> 613.00 Â100% -99.5% 3.25 Â 88% interrupts.CPU54.RES:Rescheduling_interrupts
> 165.50 Â 98% -96.5% 5.75 Â173% interrupts.CPU54.TLB:TLB_shootdowns
> 577.75 Â111% -99.7% 1.75 Â116% interrupts.CPU55.RES:Rescheduling_interrupts
> 668.25 Â 76% -46.1% 360.50 Â123% interrupts.CPU56.NMI:Non-maskable_interrupts
> 668.25 Â 76% -46.1% 360.50 Â123% interrupts.CPU56.PMI:Performance_monitoring_interrupts
> 390.50 Â111% -87.8% 47.75 Â168% interrupts.CPU56.RES:Rescheduling_interrupts
> 134.50 Â 64% -74.2% 34.75 Â173% interrupts.CPU56.TLB:TLB_shootdowns
> 356.50 Â 96% -94.5% 19.50 Â 73% interrupts.CPU59.RES:Rescheduling_interrupts
> 77.25 Â 57% -99.0% 0.75 Â173% interrupts.CPU59.TLB:TLB_shootdowns
> 1004 Â 24% -62.6% 376.25 Â106% interrupts.CPU61.NMI:Non-maskable_interrupts
> 1004 Â 24% -62.6% 376.25 Â106% interrupts.CPU61.PMI:Performance_monitoring_interrupts
> 1181 Â 34% -96.8% 38.25 Â143% interrupts.CPU61.RES:Rescheduling_interrupts
> 379.00 Â 65% -97.8% 8.50 Â173% interrupts.CPU61.TLB:TLB_shootdowns
> 2301 Â140% -99.7% 6.50 Â 86% interrupts.CPU62.RES:Rescheduling_interrupts
> 95.75 Â 59% -92.4% 7.25 Â173% interrupts.CPU62.TLB:TLB_shootdowns
> 433.75 Â 83% -98.4% 6.75 Â139% interrupts.CPU63.RES:Rescheduling_interrupts
> 103.00 Â 56% -92.5% 7.75 Â173% interrupts.CPU63.TLB:TLB_shootdowns
> 994.50 Â 23% -62.2% 376.25 Â113% interrupts.CPU64.NMI:Non-maskable_interrupts
> 994.50 Â 23% -62.2% 376.25 Â113% interrupts.CPU64.PMI:Performance_monitoring_interrupts
> 512.75 Â 65% -98.2% 9.25 Â137% interrupts.CPU64.RES:Rescheduling_interrupts
> 151.00 Â 61% -99.7% 0.50 Â173% interrupts.CPU64.TLB:TLB_shootdowns
> 1008 Â 44% -94.9% 51.50 Â100% interrupts.CPU67.RES:Rescheduling_interrupts
> 242.25 Â 79% -96.0% 9.75 Â155% interrupts.CPU67.TLB:TLB_shootdowns
> 779.50 Â 75% -98.8% 9.50 Â126% interrupts.CPU68.RES:Rescheduling_interrupts
> 1059 Â 43% -93.1% 73.25 Â109% interrupts.CPU69.RES:Rescheduling_interrupts
> 246.00 Â104% -93.1% 17.00 Â173% interrupts.CPU69.TLB:TLB_shootdowns
> 1054 Â152% -98.1% 20.00 Â161% interrupts.CPU7.RES:Rescheduling_interrupts
> 66.00 Â 66% -90.9% 6.00 Â173% interrupts.CPU7.TLB:TLB_shootdowns
> 1056 Â 24% -94.3% 59.75 Â125% interrupts.CPU70.RES:Rescheduling_interrupts
> 224.75 Â 69% -89.5% 23.50 Â163% interrupts.CPU70.TLB:TLB_shootdowns
> 0.00 +1.1e+104% 107.00 Â 93% interrupts.CPU72.TLB:TLB_shootdowns
> 9.00 Â137% +3747.2% 346.25 Â 96% interrupts.CPU73.RES:Rescheduling_interrupts
> 0.00 +2.3e+104% 230.00 Â133% interrupts.CPU74.TLB:TLB_shootdowns
> 0.00 +1.6e+104% 165.00 Â 51% interrupts.CPU75.TLB:TLB_shootdowns
> 537.75 Â 26% -90.2% 52.50 Â113% interrupts.CPU8.TLB:TLB_shootdowns
> 0.00 +9.8e+103% 97.50 Â 67% interrupts.CPU83.TLB:TLB_shootdowns
> 0.00 +2e+104% 198.00 Â 49% interrupts.CPU85.TLB:TLB_shootdowns
> 13.25 Â 59% +809.4% 120.50 Â 75% interrupts.CPU88.RES:Rescheduling_interrupts
> 5593 Â 51% -93.2% 380.50 Â160% interrupts.CPU9.RES:Rescheduling_interrupts
> 0.75 Â 57% +31033.3% 233.50 Â 89% interrupts.CPU93.RES:Rescheduling_interrupts
> 0.50 Â100% +47100.0% 236.00 Â115% interrupts.CPU94.RES:Rescheduling_interrupts
> 16.25 Â169% +3118.5% 523.00 Â 78% interrupts.CPU95.RES:Rescheduling_interrupts
> 2.00 Â173% +8037.5% 162.75 Â 67% interrupts.CPU95.TLB:TLB_shootdowns
> 49869 Â 7% +94.1% 96790 Â 11% softirqs.CPU0.RCU
> 51718 Â 6% +67.2% 86459 Â 11% softirqs.CPU1.RCU
> 51281 Â 5% +92.7% 98810 Â 7% softirqs.CPU10.RCU
> 49686 Â 12% +95.1% 96913 Â 11% softirqs.CPU11.RCU
> 51222 Â 6% +95.4% 100111 Â 11% softirqs.CPU12.RCU
> 50980 Â 6% +99.1% 101505 Â 6% softirqs.CPU13.RCU
> 51046 Â 7% +98.3% 101207 Â 6% softirqs.CPU14.RCU
> 45578 Â 21% +116.5% 98669 Â 8% softirqs.CPU15.RCU
> 44168 Â 7% +99.2% 87963 Â 11% softirqs.CPU16.RCU
> 41610 Â 9% +119.4% 91301 Â 13% softirqs.CPU17.RCU
> 43759 Â 8% +110.7% 92217 Â 11% softirqs.CPU18.RCU
> 42902 Â 8% +109.1% 89698 Â 10% softirqs.CPU19.RCU
> 52217 Â 5% +94.3% 101454 Â 5% softirqs.CPU2.RCU
> 42704 Â 5% +114.8% 91744 Â 10% softirqs.CPU20.RCU
> 44910 Â 7% +102.1% 90783 Â 10% softirqs.CPU22.RCU
> 44991 Â 7% +104.7% 92096 Â 11% softirqs.CPU23.RCU
> 47098 Â 12% +92.3% 90567 Â 9% softirqs.CPU24.RCU
> 106586 Â 6% -11.9% 93907 Â 3% softirqs.CPU24.SCHED
> 42456 Â 12% +99.8% 84830 Â 8% softirqs.CPU25.RCU
> 47709 Â 6% +82.9% 87250 Â 10% softirqs.CPU26.RCU
> 50970 Â 13% +73.4% 88408 Â 12% softirqs.CPU27.RCU
> 51241 Â 13% +67.2% 85676 Â 15% softirqs.CPU28.RCU
> 50293 Â 13% +80.0% 90528 Â 10% softirqs.CPU29.RCU
> 53868 Â 4% +84.6% 99454 Â 10% softirqs.CPU3.RCU
> 44947 Â 14% +98.9% 89421 Â 8% softirqs.CPU31.RCU
> 54210 Â 19% +86.6% 101147 Â 5% softirqs.CPU32.RCU
> 58728 Â 15% +70.0% 99864 Â 9% softirqs.CPU33.RCU
> 55716 Â 18% +87.2% 104278 Â 5% softirqs.CPU34.RCU
> 58583 Â 15% +77.6% 104065 Â 5% softirqs.CPU35.RCU
> 58080 Â 14% +82.0% 105718 Â 5% softirqs.CPU36.RCU
> 50595 Â 12% +95.7% 99025 Â 4% softirqs.CPU37.RCU
> 53939 Â 13% +82.0% 98153 Â 4% softirqs.CPU38.RCU
> 53424 Â 14% +90.6% 101817 Â 6% softirqs.CPU39.RCU
> 52327 Â 5% +96.8% 102971 Â 4% softirqs.CPU4.RCU
> 54501 Â 14% +87.8% 102330 Â 7% softirqs.CPU40.RCU
> 53036 Â 35% +92.4% 102050 Â 4% softirqs.CPU41.RCU
> 60492 Â 14% +69.9% 102761 Â 2% softirqs.CPU42.RCU
> 57222 Â 15% +69.7% 97101 Â 5% softirqs.CPU43.RCU
> 58535 Â 14% +76.2% 103127 Â 5% softirqs.CPU44.RCU
> 57025 Â 14% +76.3% 100515 Â 6% softirqs.CPU45.RCU
> 60244 Â 17% +63.4% 98447 Â 7% softirqs.CPU46.RCU
> 57985 Â 14% +68.9% 97910 Â 12% softirqs.CPU47.RCU
> 49462 Â 6% +95.9% 96879 Â 11% softirqs.CPU48.RCU
> 49436 Â 4% +92.7% 95249 Â 12% softirqs.CPU49.RCU
> 52413 Â 5% +88.8% 98965 Â 11% softirqs.CPU5.RCU
> 51032 Â 6% +104.5% 104382 Â 7% softirqs.CPU50.RCU
> 45684 Â 30% +117.7% 99464 Â 15% softirqs.CPU51.RCU
> 51919 Â 5% +103.2% 105507 Â 6% softirqs.CPU52.RCU
> 52420 Â 4% +95.6% 102530 Â 12% softirqs.CPU53.RCU
> 49538 Â 9% +112.3% 105146 Â 7% softirqs.CPU54.RCU
> 49883 Â 7% +103.9% 101712 Â 9% softirqs.CPU55.RCU
> 49604 Â 6% +95.9% 97166 Â 9% softirqs.CPU56.RCU
> 51798 Â 4% +98.5% 102805 Â 6% softirqs.CPU57.RCU
> 49777 Â 8% +99.7% 99405 Â 7% softirqs.CPU58.RCU
> 49338 Â 14% +105.1% 101169 Â 11% softirqs.CPU59.RCU
> 49653 Â 10% +106.2% 102399 Â 6% softirqs.CPU6.RCU
> 51134 Â 6% +98.8% 101668 Â 11% softirqs.CPU60.RCU
> 50488 Â 7% +102.4% 102180 Â 7% softirqs.CPU61.RCU
> 50078 Â 6% +102.7% 101522 Â 6% softirqs.CPU62.RCU
> 51026 Â 5% +99.6% 101832 Â 8% softirqs.CPU63.RCU
> 42895 Â 7% +107.0% 88783 Â 13% softirqs.CPU64.RCU
> 42387 Â 11% +113.3% 90430 Â 11% softirqs.CPU65.RCU
> 43746 Â 8% +108.8% 91341 Â 12% softirqs.CPU66.RCU
> 40324 Â 12% +121.3% 89240 Â 11% softirqs.CPU67.RCU
> 41900 Â 6% +114.6% 89917 Â 11% softirqs.CPU68.RCU
> 44157 Â 7% +104.3% 90228 Â 11% softirqs.CPU69.RCU
> 50551 Â 9% +97.0% 99596 Â 8% softirqs.CPU7.RCU
> 44094 Â 7% +107.9% 91683 Â 13% softirqs.CPU70.RCU
> 44086 Â 7% +106.8% 91179 Â 11% softirqs.CPU71.RCU
> 46488 Â 15% +90.2% 88422 Â 8% softirqs.CPU72.RCU
> 42653 Â 12% +99.2% 84953 Â 9% softirqs.CPU73.RCU
> 48559 Â 12% +76.5% 85713 Â 12% softirqs.CPU74.RCU
> 51770 Â 16% +73.0% 89572 Â 9% softirqs.CPU75.RCU
> 50182 Â 14% +72.4% 86513 Â 14% softirqs.CPU76.RCU
> 50446 Â 14% +77.7% 89651 Â 10% softirqs.CPU77.RCU
> 49119 Â 13% +84.9% 90818 Â 8% softirqs.CPU78.RCU
> 45781 Â 15% +93.5% 88595 Â 8% softirqs.CPU79.RCU
> 50229 Â 6% +96.4% 98632 Â 7% softirqs.CPU8.RCU
> 45155 Â 36% +128.7% 103272 Â 5% softirqs.CPU80.RCU
> 58487 Â 14% +77.0% 103508 Â 6% softirqs.CPU81.RCU
> 55666 Â 18% +87.0% 104094 Â 5% softirqs.CPU82.RCU
> 58506 Â 14% +77.7% 103963 Â 5% softirqs.CPU83.RCU
> 58416 Â 14% +80.3% 105297 Â 6% softirqs.CPU84.RCU
> 51291 Â 12% +95.8% 100447 Â 4% softirqs.CPU85.RCU
> 54557 Â 13% +82.1% 99356 Â 4% softirqs.CPU86.RCU
> 54147 Â 13% +89.8% 102754 Â 6% softirqs.CPU87.RCU
> 55853 Â 14% +82.1% 101688 Â 6% softirqs.CPU88.RCU
> 59176 Â 16% +70.8% 101077 Â 5% softirqs.CPU89.RCU
> 52291 Â 6% +93.8% 101344 Â 5% softirqs.CPU9.RCU
> 60854 Â 15% +69.0% 102864 Â 2% softirqs.CPU90.RCU
> 57902 Â 12% +70.1% 98501 Â 4% softirqs.CPU91.RCU
> 59683 Â 15% +73.3% 103419 Â 5% softirqs.CPU92.RCU
> 57459 Â 14% +78.5% 102584 Â 6% softirqs.CPU93.RCU
> 59398 Â 13% +63.2% 96927 Â 8% softirqs.CPU94.RCU
> 56576 Â 15% +76.2% 99664 Â 11% softirqs.CPU95.RCU
> 5123 Â 16% +168.1% 13739 Â 7% softirqs.NET_RX
> 4882876 Â 10% +90.1% 9282598 Â 6% softirqs.RCU
>
>
>
> phoronix-test-suite.glmark2.0.score
>
> 300 +-+-------------------------------------------------------------------+
> | : +. +..+ +. +..+. +. + |
> 250 +-+: |
> O : O O O O O O O O O O O O O O
> | :O O O O O O O O O O |
> 200 +-+ |
> | : |
> 150 +-+ |
> |: |
> 100 +-+ |
> |: |
> |: |
> 50 +-+ |
> | |
> 0 +-+-------------------------------------------------------------------+
>
>
> phoronix-test-suite.glmark2.1.score
>
> 250 +-+-------------------------------------------------------------------+
> | |
> | +..+..+..+..+..+.+..+..+.. .+..+..+..+..+..+..+..+.+..+ |
> 200 +-+: +. |
> | : O O O
> O :O O O O O O O O O O O O O O O O O O O O O |
> 150 +-+ |
> | : |
> 100 +-+ |
> |: |
> |: |
> 50 +-+ |
> |: |
> | |
> 0 +-+-------------------------------------------------------------------+
>
>
> [*] bisect-good sample
> [O] bisect-bad sample
>
> ***************************************************************************************************
> lkp-csl-2sp8: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
> =========================================================================================
> compiler/cpufreq_governor/kconfig/need_x/rootfs/tbox_group/test/testcase/ucode:
> gcc-7/performance/x86_64-rhel-7.6/true/debian-x86_64-phoronix/lkp-csl-2sp8/gtkperf-1.2.1/phoronix-test-suite/0x500002b
>
> commit:
> 9f4813b531 (" Linux 5.4-rc8")
> 8d04a5f97a ("x86/mm/pat: Convert the PAT tree to a generic interval tree")
>
> 9f4813b531a0b8cc 8d04a5f97a5fa9d7afdf46eda3a
> ---------------- ---------------------------
> %stddev %change %stddev
> \ | \
> 10.34 +26.8% 13.11 Â 5% phoronix-test-suite.gtkperf.0.seconds
> 62.29 +13.3% 70.56 Â 2% phoronix-test-suite.time.elapsed_time
> 62.29 +13.3% 70.56 Â 2% phoronix-test-suite.time.elapsed_time.max
> 46875 -12.5% 41002 Â 3% meminfo.max_used_kB
> 29.85 +39.6% 41.68 Â 22% boot-time.boot
> 2433 +48.7% 3617 Â 25% boot-time.idle
> 1628 -11.4% 1442 Â 4% vmstat.io.bi
> 9046 -11.6% 7993 Â 2% vmstat.system.cs
> 1.954e+09 Â 69% +226.7% 6.384e+09 Â 6% cpuidle.C1E.time
> 6278082 Â 33% +94.4% 12207082 Â 16% cpuidle.C1E.usage
> 3.958e+09 Â 32% -93.8% 2.444e+08 Â 10% cpuidle.C6.time
> 5684464 -95.4% 262692 Â 13% cpuidle.C6.usage
> 8.34 Â100% -8.3 0.00 perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
> 8.34 Â100% -8.3 0.00 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
> 8.34 Â100% -8.3 0.00 perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
> 5.28 Â100% -3.2 2.08 Â173% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.get_signal.do_signal
> 5.28 Â100% -3.2 2.08 Â173% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.get_signal
> 8.34 Â100% -8.3 0.00 perf-profile.children.cycles-pp.do_sys_open
> 8.34 Â100% -8.3 0.00 perf-profile.children.cycles-pp.do_filp_open
> 8.34 Â100% -8.3 0.00 perf-profile.children.cycles-pp.path_openat
> 5.28 Â100% -3.2 2.08 Â173% perf-profile.children.cycles-pp.mmput
> 5.28 Â100% -3.2 2.08 Â173% perf-profile.children.cycles-pp.exit_mmap
> 17.00 Â 13% +230.9% 56.25 Â 29% sched_debug.cfs_rq:/.runnable_load_avg.max
> 3.87 Â 17% +73.5% 6.71 Â 22% sched_debug.cfs_rq:/.runnable_load_avg.stddev
> 25.25 Â 12% -22.4% 19.58 Â 20% sched_debug.cfs_rq:/.util_est_enqueued.avg
> 34397 +44.4% 49658 Â 29% sched_debug.cpu.clock.avg
> 34402 +44.4% 49663 Â 29% sched_debug.cpu.clock.max
> 34391 +44.4% 49654 Â 29% sched_debug.cpu.clock.min
> 34397 +44.4% 49658 Â 29% sched_debug.cpu.clock_task.avg
> 34402 +44.4% 49663 Â 29% sched_debug.cpu.clock_task.max
> 34391 +44.4% 49654 Â 29% sched_debug.cpu.clock_task.min
> 9.74 Â 5% -11.5% 8.62 Â 4% sched_debug.cpu.nr_uninterruptible.stddev
> 34393 +44.4% 49654 Â 29% sched_debug.cpu_clk
> 31537 +48.4% 46795 Â 31% sched_debug.ktime
> 34725 +44.0% 49988 Â 29% sched_debug.sched_clk
> 96262 +2.1% 98322 proc-vmstat.nr_active_anon
> 29673 +1.4% 30100 proc-vmstat.nr_active_file
> 94407 +2.3% 96570 proc-vmstat.nr_anon_pages
> 1082 +1.5% 1099 proc-vmstat.nr_page_table_pages
> 96262 +2.1% 98322 proc-vmstat.nr_zone_active_anon
> 29673 +1.4% 30100 proc-vmstat.nr_zone_active_file
> 7664 Â 27% +172.9% 20912 Â 38% proc-vmstat.numa_hint_faults
> 7507 Â 27% +124.1% 16824 Â 38% proc-vmstat.numa_hint_faults_local
> 328182 +5.9% 347387 Â 4% proc-vmstat.numa_hit
> 309363 +6.2% 328630 Â 4% proc-vmstat.numa_local
> 39400 Â 35% +90.3% 74971 Â 42% proc-vmstat.numa_pte_updates
> 370297 +7.5% 398082 Â 4% proc-vmstat.pgalloc_normal
> 278665 +12.0% 312075 Â 4% proc-vmstat.pgfault
> 269968 Â 2% +10.9% 299343 Â 5% proc-vmstat.pgfree
> 16.26 Â 53% -51.0% 7.96 Â 2% perf-stat.i.MPKI
> 8.359e+08 Â 2% -12.0% 7.355e+08 Â 5% perf-stat.i.branch-instructions
> 3.78 Â 21% -1.0 2.76 Â 9% perf-stat.i.branch-miss-rate%
> 30272546 Â 11% -25.3% 22600376 Â 15% perf-stat.i.branch-misses
> 1870084 Â 6% -59.7% 752958 Â 15% perf-stat.i.cache-misses
> 47650854 Â 37% -46.3% 25593693 Â 2% perf-stat.i.cache-references
> 9360 -12.3% 8208 Â 2% perf-stat.i.context-switches
> 6.312e+09 Â 6% -15.0% 5.364e+09 Â 2% perf-stat.i.cpu-cycles
> 3783 Â 9% +176.2% 10448 Â 18% perf-stat.i.cycles-between-cache-misses
> 0.16 Â 40% -0.1 0.01 Â 16% perf-stat.i.dTLB-load-miss-rate%
> 921731 Â 27% -87.9% 111653 Â 10% perf-stat.i.dTLB-load-misses
> 0.05 Â 32% -0.0 0.01 Â 21% perf-stat.i.dTLB-store-miss-rate%
> 157895 Â 26% -82.3% 28003 Â 22% perf-stat.i.dTLB-store-misses
> 41.55 Â 4% -3.5 38.06 perf-stat.i.iTLB-load-miss-rate%
> 3.826e+09 Â 2% -11.9% 3.372e+09 Â 6% perf-stat.i.instructions
> 9.33 -13.3% 8.09 Â 3% perf-stat.i.major-faults
> 12.54 Â 38% -39.3% 7.61 Â 5% perf-stat.overall.MPKI
> 3.63 Â 13% -0.6 3.06 Â 10% perf-stat.overall.branch-miss-rate%
> 4.51 Â 35% -1.6 2.94 Â 14% perf-stat.overall.cache-miss-rate%
> 3391 Â 10% +113.9% 7255 Â 12% perf-stat.overall.cycles-between-cache-misses
> 0.10 Â 33% -0.1 0.01 Â 14% perf-stat.overall.dTLB-load-miss-rate%
> 0.04 Â 26% -0.0 0.01 Â 23% perf-stat.overall.dTLB-store-miss-rate%
> 8.23e+08 Â 2% -11.9% 7.253e+08 Â 5% perf-stat.ps.branch-instructions
> 29792047 Â 11% -25.2% 22290398 Â 15% perf-stat.ps.branch-misses
> 1841339 Â 6% -59.6% 743171 Â 15% perf-stat.ps.cache-misses
> 46876977 Â 37% -46.2% 25232671 Â 2% perf-stat.ps.cache-references
> 9205 -12.1% 8091 Â 2% perf-stat.ps.context-switches
> 6.211e+09 Â 6% -14.8% 5.289e+09 Â 2% perf-stat.ps.cpu-cycles
> 907015 Â 27% -87.9% 110123 Â 10% perf-stat.ps.dTLB-load-misses
> 155379 Â 26% -82.2% 27623 Â 22% perf-stat.ps.dTLB-store-misses
> 3.766e+09 Â 2% -11.7% 3.325e+09 Â 6% perf-stat.ps.instructions
> 9.21 -13.4% 7.98 Â 3% perf-stat.ps.major-faults
> 16348 Â 5% +33.4% 21802 Â 5% softirqs.CPU0.SCHED
> 11186 Â 15% +37.7% 15406 Â 16% softirqs.CPU1.SCHED
> 9914 Â 8% +48.9% 14762 Â 30% softirqs.CPU10.SCHED
> 9645 Â 2% +21.1% 11681 Â 4% softirqs.CPU11.SCHED
> 9779 Â 3% +17.1% 11450 Â 7% softirqs.CPU13.SCHED
> 9805 Â 3% +12.6% 11040 Â 6% softirqs.CPU14.SCHED
> 9658 Â 2% +25.3% 12104 Â 10% softirqs.CPU15.SCHED
> 31797 Â 7% +23.0% 39108 Â 14% softirqs.CPU16.TIMER
> 9330 Â 6% +29.9% 12116 Â 4% softirqs.CPU17.SCHED
> 31554 Â 10% +16.1% 36648 Â 6% softirqs.CPU17.TIMER
> 9493 Â 4% +21.9% 11574 Â 6% softirqs.CPU18.SCHED
> 9700 Â 2% +61.1% 15631 Â 47% softirqs.CPU19.SCHED
> 10097 Â 4% +20.7% 12186 softirqs.CPU2.SCHED
> 9731 Â 2% +18.3% 11516 Â 3% softirqs.CPU20.SCHED
> 9664 Â 3% +18.1% 11413 Â 4% softirqs.CPU21.SCHED
> 9810 Â 3% +12.3% 11013 Â 6% softirqs.CPU22.SCHED
> 9509 Â 3% +20.0% 11407 Â 4% softirqs.CPU23.SCHED
> 9355 Â 9% +23.8% 11581 Â 8% softirqs.CPU26.SCHED
> 34990 +24.1% 43413 Â 6% softirqs.CPU26.TIMER
> 9577 Â 8% +20.8% 11569 Â 4% softirqs.CPU27.SCHED
> 9920 Â 2% +15.5% 11462 Â 6% softirqs.CPU28.SCHED
> 10084 +13.1% 11409 Â 4% softirqs.CPU29.SCHED
> 30741 Â 10% +27.7% 39262 Â 8% softirqs.CPU3.TIMER
> 9843 +18.7% 11688 Â 6% softirqs.CPU30.SCHED
> 8609 Â 21% +33.6% 11503 Â 4% softirqs.CPU32.SCHED
> 9714 Â 2% +22.8% 11927 Â 7% softirqs.CPU33.SCHED
> 9695 +18.1% 11445 Â 5% softirqs.CPU34.SCHED
> 8242 Â 30% +39.4% 11488 Â 6% softirqs.CPU35.SCHED
> 8035 Â 30% +40.4% 11280 Â 5% softirqs.CPU37.SCHED
> 9880 +17.7% 11627 Â 6% softirqs.CPU46.SCHED
> 8892 Â 9% +26.4% 11243 Â 8% softirqs.CPU47.SCHED
> 9244 Â 7% +16.8% 10799 Â 3% softirqs.CPU49.SCHED
> 9617 +18.4% 11389 Â 3% softirqs.CPU50.SCHED
> 31719 Â 7% +12.5% 35691 Â 5% softirqs.CPU50.TIMER
> 9366 Â 5% +16.5% 10911 Â 3% softirqs.CPU51.SCHED
> 9929 Â 3% +22.9% 12207 Â 7% softirqs.CPU53.SCHED
> 8616 Â 13% +41.5% 12194 Â 10% softirqs.CPU54.SCHED
> 9500 Â 3% +15.4% 10962 softirqs.CPU55.SCHED
> 32014 Â 9% +20.3% 38529 Â 15% softirqs.CPU56.TIMER
> 9732 Â 6% +16.2% 11310 Â 4% softirqs.CPU59.SCHED
> 9628 Â 2% +21.5% 11699 Â 10% softirqs.CPU60.SCHED
> 10026 Â 5% +10.9% 11124 Â 6% softirqs.CPU62.SCHED
> 9585 +14.5% 10972 Â 8% softirqs.CPU63.SCHED
> 9541 Â 3% +21.4% 11586 Â 16% softirqs.CPU64.SCHED
> 9035 Â 10% +17.1% 10577 Â 7% softirqs.CPU65.SCHED
> 9483 Â 2% +20.2% 11401 Â 5% softirqs.CPU66.SCHED
> 9026 Â 12% +23.4% 11134 Â 4% softirqs.CPU68.SCHED
> 9482 Â 2% +13.8% 10787 Â 5% softirqs.CPU69.SCHED
> 9658 Â 2% +20.4% 11624 Â 4% softirqs.CPU7.SCHED
> 9764 Â 3% +11.0% 10836 Â 5% softirqs.CPU70.SCHED
> 9316 Â 11% +18.8% 11072 Â 12% softirqs.CPU74.SCHED
> 9963 +12.3% 11189 Â 6% softirqs.CPU75.SCHED
> 10017 +14.1% 11425 Â 7% softirqs.CPU76.SCHED
> 9788 +18.4% 11588 Â 5% softirqs.CPU77.SCHED
> 9968 +16.3% 11591 Â 7% softirqs.CPU78.SCHED
> 9911 Â 2% +16.6% 11555 Â 5% softirqs.CPU79.SCHED
> 9408 Â 2% +19.7% 11258 Â 7% softirqs.CPU80.SCHED
> 10027 Â 4% +11.3% 11164 Â 5% softirqs.CPU81.SCHED
> 9638 Â 3% +14.3% 11019 Â 7% softirqs.CPU82.SCHED
> 9551 Â 2% +15.0% 10981 Â 8% softirqs.CPU83.SCHED
> 9583 Â 4% +18.8% 11389 Â 6% softirqs.CPU84.SCHED
> 8173 Â 29% +34.4% 10989 Â 7% softirqs.CPU86.SCHED
> 9936 Â 4% +14.8% 11410 Â 6% softirqs.CPU9.SCHED
> 8179 Â 30% +37.6% 11257 Â 10% softirqs.CPU91.SCHED
> 8077 Â 30% +39.1% 11233 Â 8% softirqs.CPU95.SCHED
> 919351 Â 7% +19.9% 1102697 Â 4% softirqs.SCHED
> 3193255 Â 2% +11.6% 3563915 Â 6% softirqs.TIMER
> 33.00 Â147% -100.0% 0.00 interrupts.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
> 127.00 +15.4% 146.50 Â 3% interrupts.9:IO-APIC.9-fasteoi.acpi
> 124159 Â 3% +16.5% 144587 Â 3% interrupts.CPU0.LOC:Local_timer_interrupts
> 127.00 +15.4% 146.50 Â 3% interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
> 123924 Â 3% +16.7% 144656 Â 2% interrupts.CPU1.LOC:Local_timer_interrupts
> 123637 Â 3% +16.2% 143635 Â 4% interrupts.CPU10.LOC:Local_timer_interrupts
> 123785 Â 3% +15.3% 142755 Â 3% interrupts.CPU11.LOC:Local_timer_interrupts
> 123691 Â 3% +16.3% 143829 Â 3% interrupts.CPU12.LOC:Local_timer_interrupts
> 123545 Â 3% +15.7% 142970 Â 3% interrupts.CPU13.LOC:Local_timer_interrupts
> 123726 Â 3% +16.2% 143718 Â 3% interrupts.CPU14.LOC:Local_timer_interrupts
> 123727 Â 3% +15.2% 142493 Â 2% interrupts.CPU15.LOC:Local_timer_interrupts
> 123761 Â 3% +16.7% 144390 Â 3% interrupts.CPU16.LOC:Local_timer_interrupts
> 123749 Â 3% +16.9% 144632 Â 3% interrupts.CPU17.LOC:Local_timer_interrupts
> 123660 Â 3% +16.9% 144533 Â 3% interrupts.CPU18.LOC:Local_timer_interrupts
> 123976 Â 3% +17.0% 145106 Â 3% interrupts.CPU19.LOC:Local_timer_interrupts
> 123983 Â 3% +16.8% 144764 Â 3% interrupts.CPU2.LOC:Local_timer_interrupts
> 123783 Â 3% +16.7% 144400 Â 3% interrupts.CPU20.LOC:Local_timer_interrupts
> 123924 Â 3% +16.5% 144405 Â 3% interrupts.CPU21.LOC:Local_timer_interrupts
> 124054 Â 3% +15.9% 143768 Â 3% interrupts.CPU22.LOC:Local_timer_interrupts
> 124085 Â 3% +15.7% 143543 Â 3% interrupts.CPU23.LOC:Local_timer_interrupts
> 110004 Â 22% +30.5% 143553 Â 4% interrupts.CPU24.LOC:Local_timer_interrupts
> 110068 Â 22% +29.7% 142727 Â 3% interrupts.CPU25.LOC:Local_timer_interrupts
> 110942 Â 22% +29.6% 143774 Â 2% interrupts.CPU26.LOC:Local_timer_interrupts
> 111894 Â 22% +28.3% 143555 Â 4% interrupts.CPU27.LOC:Local_timer_interrupts
> 111050 Â 22% +29.3% 143625 Â 4% interrupts.CPU28.LOC:Local_timer_interrupts
> 111805 Â 22% +27.5% 142570 Â 3% interrupts.CPU29.LOC:Local_timer_interrupts
> 122901 Â 3% +17.6% 144537 Â 3% interrupts.CPU3.LOC:Local_timer_interrupts
> 111025 Â 22% +29.5% 143752 Â 4% interrupts.CPU30.LOC:Local_timer_interrupts
> 110372 Â 21% +29.3% 142764 Â 3% interrupts.CPU31.LOC:Local_timer_interrupts
> 110041 Â 22% +30.2% 143294 Â 3% interrupts.CPU32.LOC:Local_timer_interrupts
> 110289 Â 21% +29.4% 142737 Â 3% interrupts.CPU33.LOC:Local_timer_interrupts
> 0.75 Â110% +4200.0% 32.25 Â143% interrupts.CPU33.RES:Rescheduling_interrupts
> 111042 Â 22% +28.7% 142872 Â 4% interrupts.CPU34.LOC:Local_timer_interrupts
> 110820 Â 22% +29.6% 143676 Â 4% interrupts.CPU35.LOC:Local_timer_interrupts
> 110849 Â 22% +29.9% 143999 Â 4% interrupts.CPU36.LOC:Local_timer_interrupts
> 110376 Â 22% +30.4% 143915 Â 3% interrupts.CPU37.LOC:Local_timer_interrupts
> 111593 Â 22% +29.0% 143915 Â 4% interrupts.CPU38.LOC:Local_timer_interrupts
> 111949 Â 22% +27.1% 142241 Â 4% interrupts.CPU39.LOC:Local_timer_interrupts
> 124261 Â 3% +15.7% 143828 Â 3% interrupts.CPU4.LOC:Local_timer_interrupts
> 111554 Â 22% +27.5% 142286 Â 4% interrupts.CPU40.LOC:Local_timer_interrupts
> 110802 Â 22% +29.1% 143047 Â 4% interrupts.CPU41.LOC:Local_timer_interrupts
> 111642 Â 22% +29.4% 144476 Â 4% interrupts.CPU42.LOC:Local_timer_interrupts
> 110980 Â 22% +29.3% 143450 Â 4% interrupts.CPU43.LOC:Local_timer_interrupts
> 111595 Â 22% +27.4% 142158 Â 4% interrupts.CPU44.LOC:Local_timer_interrupts
> 110926 Â 22% +28.8% 142914 Â 4% interrupts.CPU45.LOC:Local_timer_interrupts
> 111788 Â 22% +28.5% 143694 Â 4% interrupts.CPU46.LOC:Local_timer_interrupts
> 110789 Â 22% +29.2% 143182 Â 4% interrupts.CPU47.LOC:Local_timer_interrupts
> 123853 Â 3% +16.0% 143633 Â 3% interrupts.CPU48.LOC:Local_timer_interrupts
> 123954 Â 3% +16.1% 143915 Â 3% interrupts.CPU49.LOC:Local_timer_interrupts
> 125940 Â 5% +14.2% 143844 Â 2% interrupts.CPU5.LOC:Local_timer_interrupts
> 122996 Â 3% +16.9% 143771 Â 3% interrupts.CPU50.LOC:Local_timer_interrupts
> 123469 Â 3% +16.3% 143600 Â 3% interrupts.CPU51.LOC:Local_timer_interrupts
> 122963 Â 2% +16.8% 143584 Â 3% interrupts.CPU52.LOC:Local_timer_interrupts
> 123920 Â 3% +16.7% 144558 Â 3% interrupts.CPU53.LOC:Local_timer_interrupts
> 123791 Â 3% +16.7% 144460 Â 3% interrupts.CPU54.LOC:Local_timer_interrupts
> 123877 Â 3% +16.6% 144392 Â 3% interrupts.CPU55.LOC:Local_timer_interrupts
> 123809 Â 3% +16.4% 144159 Â 3% interrupts.CPU56.LOC:Local_timer_interrupts
> 123506 Â 3% +16.6% 144033 Â 3% interrupts.CPU57.LOC:Local_timer_interrupts
> 123672 Â 3% +17.7% 145596 Â 4% interrupts.CPU58.LOC:Local_timer_interrupts
> 123454 Â 3% +16.8% 144178 Â 3% interrupts.CPU59.LOC:Local_timer_interrupts
> 123108 Â 4% +17.5% 144649 Â 3% interrupts.CPU6.LOC:Local_timer_interrupts
> 123692 Â 3% +16.1% 143634 Â 3% interrupts.CPU60.LOC:Local_timer_interrupts
> 123855 Â 3% +15.5% 143073 Â 3% interrupts.CPU61.LOC:Local_timer_interrupts
> 123714 Â 3% +16.2% 143797 Â 3% interrupts.CPU62.LOC:Local_timer_interrupts
> 123863 Â 3% +16.0% 143707 Â 3% interrupts.CPU63.LOC:Local_timer_interrupts
> 123875 Â 3% +15.9% 143543 Â 3% interrupts.CPU64.LOC:Local_timer_interrupts
> 124440 Â 2% +16.8% 145383 Â 2% interrupts.CPU65.LOC:Local_timer_interrupts
> 124284 Â 2% +15.9% 144070 Â 3% interrupts.CPU66.LOC:Local_timer_interrupts
> 123799 Â 3% +15.8% 143331 Â 3% interrupts.CPU67.LOC:Local_timer_interrupts
> 123400 Â 3% +17.0% 144332 Â 3% interrupts.CPU68.LOC:Local_timer_interrupts
> 125156 Â 4% +14.5% 143289 Â 3% interrupts.CPU69.LOC:Local_timer_interrupts
> 124195 Â 3% +16.3% 144402 Â 3% interrupts.CPU7.LOC:Local_timer_interrupts
> 123791 Â 3% +16.0% 143551 Â 3% interrupts.CPU70.LOC:Local_timer_interrupts
> 123826 Â 3% +15.7% 143277 Â 3% interrupts.CPU71.LOC:Local_timer_interrupts
> 110101 Â 22% +29.0% 141983 Â 4% interrupts.CPU72.LOC:Local_timer_interrupts
> 110774 Â 22% +28.3% 142100 Â 4% interrupts.CPU73.LOC:Local_timer_interrupts
> 111785 Â 22% +27.6% 142623 Â 3% interrupts.CPU74.LOC:Local_timer_interrupts
> 111709 Â 22% +29.2% 144354 Â 3% interrupts.CPU75.LOC:Local_timer_interrupts
> 111739 Â 22% +28.9% 143992 Â 3% interrupts.CPU76.LOC:Local_timer_interrupts
> 111017 Â 22% +29.7% 143954 Â 3% interrupts.CPU77.LOC:Local_timer_interrupts
> 111625 Â 22% +28.7% 143651 Â 3% interrupts.CPU78.LOC:Local_timer_interrupts
> 110970 Â 22% +29.5% 143695 Â 4% interrupts.CPU79.LOC:Local_timer_interrupts
> 122666 Â 4% +18.0% 144790 Â 3% interrupts.CPU8.LOC:Local_timer_interrupts
> 109397 Â 21% +32.0% 144381 Â 3% interrupts.CPU80.LOC:Local_timer_interrupts
> 111101 Â 22% +29.2% 143593 Â 3% interrupts.CPU81.LOC:Local_timer_interrupts
> 110996 Â 22% +28.0% 142033 Â 4% interrupts.CPU82.LOC:Local_timer_interrupts
> 110733 Â 22% +28.4% 142147 Â 4% interrupts.CPU83.LOC:Local_timer_interrupts
> 110217 Â 22% +30.5% 143787 Â 4% interrupts.CPU84.LOC:Local_timer_interrupts
> 109986 Â 22% +31.0% 144082 Â 3% interrupts.CPU85.LOC:Local_timer_interrupts
> 110129 Â 22% +30.2% 143365 Â 3% interrupts.CPU86.LOC:Local_timer_interrupts
> 110749 Â 22% +28.8% 142696 Â 4% interrupts.CPU87.LOC:Local_timer_interrupts
> 110778 Â 22% +29.8% 143804 Â 4% interrupts.CPU88.LOC:Local_timer_interrupts
> 111348 Â 22% +28.5% 143096 Â 4% interrupts.CPU89.LOC:Local_timer_interrupts
> 123749 Â 3% +16.1% 143677 Â 3% interrupts.CPU9.LOC:Local_timer_interrupts
> 110728 Â 22% +29.0% 142841 Â 4% interrupts.CPU90.LOC:Local_timer_interrupts
> 110097 Â 22% +30.1% 143207 Â 4% interrupts.CPU91.LOC:Local_timer_interrupts
> 111533 Â 22% +28.3% 143083 Â 4% interrupts.CPU92.LOC:Local_timer_interrupts
> 110777 Â 22% +29.0% 142893 Â 4% interrupts.CPU93.LOC:Local_timer_interrupts
> 109394 Â 21% +31.1% 143427 Â 4% interrupts.CPU94.LOC:Local_timer_interrupts
> 110000 Â 22% +30.0% 143027 Â 4% interrupts.CPU95.LOC:Local_timer_interrupts
> 11264859 Â 12% +22.4% 13788804 Â 3% interrupts.LOC:Local_timer_interrupts
>
>
>
>
>
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
>
>
> Thanks,
> Rong Chen
>