May 2019 - LKP - Ml01.01.Org

[sched/fair] 07cf623c04: hackbench.throughput -70.5% regression

by kernel test robot

Greeting, FYI, we noticed a -70.5% regression of hackbench.throughput due to commit: commit: 07cf623c04048316ec3c273fd0cebe478f1caa65 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") git://linux-arm.org/linux-de.git upstream/rem_rq_load in testcase: hackbench on test machine: 192 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 496G memory with following parameters: nr_threads: 1600% mode: process ipc: pipe cpufreq_governor: performance ucode: 0xb00002e test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler. test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc... In addition to that, the commit also has significant impact on the following tests: +------------------+------------------------------------------------------------------------+ | testcase: change | netperf: netperf.Throughput_Mbps 71.4% improvement | | test machine | 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 8G memory | | test parameters | cluster=cs-localhost | | | cpufreq_governor=performance | | | ip=ipv4 | | | nr_threads=200% | | | runtime=900s | | | test=TCP_STREAM | | | ucode=0x7000017 | +------------------+------------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput 20.7% improvement | | test machine | 192 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 496G memory | | test parameters | cpufreq_governor=performance | | | ipc=pipe | | | mode=process | | | nr_threads=50% | | | ucode=0xb00002e | +------------------+------------------------------------------------------------------------+ | testcase: change | vm-scalability: vm-scalability.median 24.6% improvement | | test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory | | test parameters | cpufreq_governor=performance | | | runtime=300s | | | test=small-allocs-mt | | | ucode=0xb00002e | +------------------+------------------------------------------------------------------------+ | testcase: change | netperf: netperf.Throughput_Mbps 73.3% improvement | | test machine | 8 threads Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G memory | | test parameters | cluster=cs-localhost | | | cpufreq_governor=performance | | | ip=ipv4 | | | nr_threads=200% | | | runtime=900s | | | test=TCP_STREAM | | | ucode=0x25 | +------------------+------------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput 98.7% improvement | | test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory | | test parameters | cpufreq_governor=performance | | | ipc=pipe | | | mode=process | | | nr_threads=50% | | | ucode=0xb00002e | +------------------+------------------------------------------------------------------------+ | testcase: change | fsmark: fsmark.files_per_sec 22.1% improvement | | test machine | 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory | | test parameters | cpufreq_governor=performance | | | disk=1SSD | | | filesize=8K | | | fs=xfs | | | iterations=8 | | | nr_directories=16d | | | nr_files_per_directory=256fpd | | | nr_threads=32 | | | sync_method=fsyncBeforeClose | | | test_size=50G | | | ucode=0x3d | +------------------+------------------------------------------------------------------------+ | testcase: change | vm-scalability: vm-scalability.median 19.5% improvement | | test machine | 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory | | test parameters | cpufreq_governor=performance | | | runtime=300s | | | size=8T | | | test=anon-w-seq-hugetlb | +------------------+------------------------------------------------------------------------+ | testcase: change | aim7: aim7.jobs-per-min 69.7% improvement | | test machine | 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory | | test parameters | cpufreq_governor=performance | | | disk=1BRD_48G | | | fs=xfs | | | load=3000 | | | test=disk_wrt | +------------------+------------------------------------------------------------------------+ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/process/1600%/debian-x86_64-2018-04-03.cgz/lkp-bdw-ex1/hackbench/0xb00002e commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- %stddev %change %stddev \ | \ 735898 ± 2% -70.5% 216982 ± 13% hackbench.throughput 689.04 ± 6% +65.9% 1143 ± 8% hackbench.time.elapsed_time 689.04 ± 6% +65.9% 1143 ± 8% hackbench.time.elapsed_time.max 8.115e+08 ± 19% -74.3% 2.085e+08 ± 11% hackbench.time.involuntary_context_switches 24019994 ± 8% -80.2% 4748364 hackbench.time.minor_page_faults 87861 ± 7% +75.4% 154094 ± 6% hackbench.time.system_time 4313 ± 9% -80.1% 856.52 ± 3% hackbench.time.user_time 1.5e+09 ± 13% -67.5% 4.881e+08 ± 5% hackbench.time.voluntary_context_switches 1.267e+09 ± 9% -81.8% 2.304e+08 hackbench.workload 0.01 ± 51% +0.1 0.11 ± 3% mpstat.cpu.all.soft% 3.23 ± 7% -2.8 0.39 ± 7% mpstat.cpu.all.usr% 1.467e+08 ± 18% +531.5% 9.261e+08 ± 20% cpuidle.C1.time 5005909 ± 39% +782.1% 44155851 ± 13% cpuidle.C1.usage 4540245 ± 50% +117.2% 9860150 ± 13% cpuidle.POLL.time 1275028 ± 44% +172.8% 3478748 ± 21% cpuidle.POLL.usage 1826 ± 2% +3.6% 1891 turbostat.Avg_MHz 5004757 ± 39% +782.3% 44154736 ± 13% turbostat.C1 0.11 ± 21% +0.3 0.42 ± 14% turbostat.C1% 6.28 ± 25% -57.2% 2.69 ± 18% turbostat.Pkg%pc2 66.00 ± 2% +7.6% 71.00 vmstat.cpu.sy 1492292 ± 2% +31.1% 1956362 vmstat.memory.cache 7852 ± 10% -50.4% 3893 ± 7% vmstat.procs.r 3394490 ± 9% -80.4% 666124 ± 8% vmstat.system.cs 554445 ± 3% -31.7% 378496 vmstat.system.in 48614185 ± 46% -82.9% 8311794 ± 20% numa-numastat.node0.local_node 48629712 ± 46% -82.8% 8342882 ± 20% numa-numastat.node0.numa_hit 49409522 ± 69% -83.0% 8412147 ± 26% numa-numastat.node1.local_node 49432821 ± 69% -83.0% 8424630 ± 26% numa-numastat.node1.numa_hit 35845642 ± 20% -68.0% 11485301 ± 34% numa-numastat.node2.local_node 35868942 ± 20% -67.9% 11504009 ± 34% numa-numastat.node2.numa_hit 77888783 ± 45% -87.4% 9830105 ± 39% numa-numastat.node3.local_node 77919865 ± 45% -87.3% 9861185 ± 39% numa-numastat.node3.numa_hit 4524321 ± 2% +11.0% 5024051 ± 5% meminfo.Active 4523772 ± 2% +11.1% 5023723 ± 5% meminfo.Active(anon) 2.587e+08 +10.8% 2.866e+08 meminfo.Committed_AS 32652 ± 2% +38.2% 45110 ± 4% meminfo.Inactive 32171 ± 2% +38.8% 44664 ± 4% meminfo.Inactive(anon) 308877 ± 3% +134.3% 723694 meminfo.KReclaimable 308877 ± 3% +134.3% 723694 meminfo.SReclaimable 3161707 +14.3% 3613409 meminfo.Slab 37892 ± 6% -43.7% 21351 ± 10% meminfo.max_used_kB 1131168 ± 2% +11.0% 1255914 ± 5% proc-vmstat.nr_active_anon 8054 ± 2% +38.7% 11170 ± 4% proc-vmstat.nr_inactive_anon 0.00 +4.2e+104% 416.00 ± 10% proc-vmstat.nr_isolated_anon 1757796 +9.2% 1918886 proc-vmstat.nr_kernel_stack 77179 ± 3% +134.4% 180923 proc-vmstat.nr_slab_reclaimable 1131168 ± 2% +11.0% 1255914 ± 5% proc-vmstat.nr_zone_active_anon 8054 ± 2% +38.7% 11170 ± 4% proc-vmstat.nr_zone_inactive_anon 1619 ± 91% +24483.4% 398189 ± 3% proc-vmstat.numa_hint_faults 610.25 ±106% +12797.1% 78704 ± 4% proc-vmstat.numa_hint_faults_local 2.118e+08 ± 10% -82.0% 38153929 ± 2% proc-vmstat.numa_hit 2.117e+08 ± 10% -82.0% 38060544 ± 2% proc-vmstat.numa_local 1865 ± 86% +16842.5% 316062 ± 4% proc-vmstat.numa_pages_migrated 24793 ± 90% +1702.9% 446996 ± 2% proc-vmstat.numa_pte_updates 2.151e+08 ± 10% -81.9% 39000234 proc-vmstat.pgalloc_normal 25773843 ± 8% -68.7% 8056495 ± 3% proc-vmstat.pgfault 2.148e+08 ± 10% -81.9% 38785725 proc-vmstat.pgfree 1865 ± 86% +16842.5% 316062 ± 4% proc-vmstat.pgmigrate_success 20588 ± 5% -85.6% 2956 ± 58% numa-meminfo.node0.Inactive 20487 ± 6% -86.8% 2706 ± 61% numa-meminfo.node0.Inactive(anon) 11613 ± 8% -54.3% 5306 ± 6% numa-meminfo.node0.Mapped 254761 +46.2% 372434 ± 18% numa-meminfo.node1.FilePages 34896 ± 62% +1319.1% 495210 ± 23% numa-meminfo.node1.KReclaimable 34896 ± 62% +1319.1% 495210 ± 23% numa-meminfo.node1.SReclaimable 7756 ± 30% +1510.5% 124920 ± 54% numa-meminfo.node1.Shmem 4356 ± 38% +253.9% 15418 ± 72% numa-meminfo.node2.Inactive 4355 ± 38% +254.0% 15416 ± 72% numa-meminfo.node2.Inactive(anon) 2292667 ± 65% -89.7% 236622 ± 56% numa-meminfo.node3.Active 2292180 ± 65% -89.7% 236615 ± 56% numa-meminfo.node3.Active(anon) 2290479 ± 65% -90.8% 211236 ± 61% numa-meminfo.node3.AnonPages 2402 ± 40% +700.2% 19223 ± 37% numa-meminfo.node3.Inactive 2079 ± 38% +824.7% 19223 ± 37% numa-meminfo.node3.Inactive(anon) 917500 ± 67% -93.7% 57559 ±155% numa-meminfo.node3.KernelStack 9073609 ± 63% -86.9% 1190399 ± 63% numa-meminfo.node3.MemUsed 2328393 ± 65% -94.3% 132153 ±168% numa-meminfo.node3.PageTables 1450078 ± 64% -90.3% 140915 ± 91% numa-meminfo.node3.SUnreclaim 2857 ± 30% +676.5% 22185 ± 39% numa-meminfo.node3.Shmem 1523094 ± 63% -88.9% 169351 ± 79% numa-meminfo.node3.Slab 5113 ± 6% -86.8% 676.75 ± 61% numa-vmstat.node0.nr_inactive_anon 0.00 +1.4e+104% 136.25 ±116% numa-vmstat.node0.nr_isolated_anon 2891 ± 7% -53.9% 1333 ± 6% numa-vmstat.node0.nr_mapped 5113 ± 6% -86.8% 676.75 ± 61% numa-vmstat.node0.nr_zone_inactive_anon 22770632 ± 60% -89.9% 2293701 ± 66% numa-vmstat.node0.numa_hit 22753664 ± 60% -90.3% 2210511 ± 69% numa-vmstat.node0.numa_local 16968 ± 89% +390.2% 83189 ± 35% numa-vmstat.node0.numa_other 63692 +46.2% 93119 ± 18% numa-vmstat.node1.nr_file_pages 0.00 +1e+104% 101.50 ±166% numa-vmstat.node1.nr_isolated_anon 1941 ± 30% +1509.1% 31241 ± 54% numa-vmstat.node1.nr_shmem 8720 ± 62% +1320.3% 123852 ± 23% numa-vmstat.node1.nr_slab_reclaimable 23308854 ± 64% -89.8% 2383479 ± 64% numa-vmstat.node1.numa_hit 23202683 ± 64% -90.0% 2321696 ± 64% numa-vmstat.node1.numa_local 1101 ± 38% +249.9% 3854 ± 72% numa-vmstat.node2.nr_inactive_anon 0.00 +1.5e+104% 146.75 ± 99% numa-vmstat.node2.nr_isolated_anon 1101 ± 38% +249.9% 3854 ± 72% numa-vmstat.node2.nr_zone_inactive_anon 15470132 ± 21% -84.0% 2468173 ± 46% numa-vmstat.node2.numa_hit 15364362 ± 22% -84.5% 2383735 ± 47% numa-vmstat.node2.numa_local 572287 ± 65% -89.7% 59146 ± 56% numa-vmstat.node3.nr_active_anon 571878 ± 65% -90.8% 52793 ± 61% numa-vmstat.node3.nr_anon_pages 325.75 ± 91% -100.0% 0.00 numa-vmstat.node3.nr_dirtied 522.25 ± 38% +819.9% 4804 ± 37% numa-vmstat.node3.nr_inactive_anon 916112 ± 67% -93.7% 57565 ±155% numa-vmstat.node3.nr_kernel_stack 581094 ± 66% -94.3% 33041 ±168% numa-vmstat.node3.nr_page_table_pages 717.25 ± 30% +673.0% 5544 ± 39% numa-vmstat.node3.nr_shmem 361795 ± 64% -90.3% 35236 ± 91% numa-vmstat.node3.nr_slab_unreclaimable 323.00 ± 91% -100.0% 0.00 numa-vmstat.node3.nr_written 572288 ± 65% -89.7% 59146 ± 56% numa-vmstat.node3.nr_zone_active_anon 522.25 ± 38% +819.9% 4804 ± 37% numa-vmstat.node3.nr_zone_inactive_anon 37728123 ± 45% -95.7% 1603449 ± 49% numa-vmstat.node3.numa_hit 37614784 ± 45% -96.0% 1490393 ± 53% numa-vmstat.node3.numa_local 12.02 ±103% -12.0 0.00 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.57 ±103% -11.6 0.00 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.86 ±107% -9.7 0.15 ±173% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 9.56 ±101% -9.4 0.16 ±173% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.16 ±101% -9.0 0.16 ±173% perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 8.80 ±106% -8.8 0.00 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 8.60 ±107% -8.6 0.00 perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 8.55 ±107% -8.6 0.00 perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 4.65 ±100% -4.7 0.00 perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 4.55 ±108% -4.6 0.00 perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 4.29 ±100% -4.3 0.00 perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 4.19 ±109% -4.2 0.00 perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read 4.12 ±109% -4.1 0.00 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read 0.28 ±100% +0.6 0.83 ± 13% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.osq_lock 0.32 ±100% +0.6 0.91 ± 12% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.osq_lock.__mutex_lock 0.38 ±100% +0.6 0.96 ± 12% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.osq_lock.__mutex_lock.pipe_wait 0.40 ±100% +0.6 1.00 ± 12% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.osq_lock.__mutex_lock.pipe_wait.pipe_write 0.00 +0.7 0.69 ± 17% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 0.00 +4.0 3.96 ± 50% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.load_balance.pick_next_task_fair.__schedule 0.00 +4.0 3.97 ± 49% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.load_balance.pick_next_task_fair.__schedule.schedule 0.14 ±173% +5.6 5.72 ± 48% perf-profile.calltrace.cycles-pp.load_balance.pick_next_task_fair.__schedule.schedule.pipe_wait 0.14 ±173% +5.7 5.86 ± 48% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_write 0.56 ± 60% +6.0 6.56 ± 44% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_write.new_sync_write.vfs_write 0.56 ± 60% +6.0 6.55 ± 44% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_write.new_sync_write 5.00 ± 95% -4.8 0.24 ± 16% perf-profile.children.cycles-pp.select_task_rq_fair 2.55 ±111% -2.4 0.11 ± 19% perf-profile.children.cycles-pp.ttwu_do_activate 1.23 ± 91% -1.1 0.09 ± 36% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.59 ± 86% -0.5 0.06 ± 11% perf-profile.children.cycles-pp.update_rq_clock 0.15 ± 65% +0.2 0.30 ± 26% perf-profile.children.cycles-pp.__mutex_unlock_slowpath 0.09 ± 81% +0.2 0.26 ± 34% perf-profile.children.cycles-pp.wake_up_q 0.38 ± 24% +0.2 0.56 ± 17% perf-profile.children.cycles-pp.prepare_to_wait 0.14 ± 88% +0.2 0.33 ± 24% perf-profile.children.cycles-pp.rebalance_domains 0.04 ±173% +0.3 0.35 ± 39% perf-profile.children.cycles-pp.migrate_task_rq_fair 0.26 ± 31% +0.4 0.62 ± 16% perf-profile.children.cycles-pp.task_tick_fair 0.06 ±100% +0.4 0.44 ± 41% perf-profile.children.cycles-pp.schedule_preempt_disabled 0.46 ± 39% +0.4 0.84 ± 14% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.7 0.66 ± 50% perf-profile.children.cycles-pp.attach_task 2.05 ±103% +4.1 6.10 ± 38% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 1.50 ± 56% +4.3 5.76 ± 36% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.32 ± 77% +6.1 6.44 ± 47% perf-profile.children.cycles-pp.load_balance 0.65 ± 89% -0.6 0.07 ± 39% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.49 ± 86% -0.4 0.05 ± 8% perf-profile.self.cycles-pp.update_rq_clock 0.28 ± 93% -0.2 0.09 ± 23% perf-profile.self.cycles-pp._raw_spin_lock 0.04 ±100% +0.2 0.23 ± 21% perf-profile.self.cycles-pp.task_tick_fair 2.04 ±103% +4.1 6.10 ± 38% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 9.40 ± 26% -73.4% 2.50 ± 15% perf-stat.i.MPKI 0.82 ± 48% -0.5 0.27 ± 10% perf-stat.i.branch-miss-rate% 1.245e+08 ± 21% -54.5% 56701748 ± 8% perf-stat.i.branch-misses 15.30 ± 10% +4.7 20.04 ± 11% perf-stat.i.cache-miss-rate% 3.639e+08 ± 9% -43.2% 2.066e+08 ± 12% perf-stat.i.cache-references 1934781 ± 28% -67.0% 637529 ± 11% perf-stat.i.context-switches 2.20 ± 3% -8.7% 2.01 perf-stat.i.cpi 3.391e+11 ± 2% +6.9% 3.624e+11 perf-stat.i.cpu-cycles 100735 ± 15% +143.7% 245542 ± 6% perf-stat.i.cpu-migrations 0.23 ± 17% -0.2 0.05 ± 9% perf-stat.i.dTLB-load-miss-rate% 86693419 ± 19% -77.3% 19700185 ± 11% perf-stat.i.dTLB-load-misses 0.16 ± 5% -0.0 0.13 ± 6% perf-stat.i.dTLB-store-miss-rate% 5897751 ± 18% -65.7% 2023467 ± 10% perf-stat.i.dTLB-store-misses 7.683e+09 ± 26% -67.7% 2.479e+09 ± 9% perf-stat.i.dTLB-stores 51.94 ± 4% +10.2 62.11 ± 7% perf-stat.i.iTLB-load-miss-rate% 32942717 ± 28% -75.3% 8137995 ± 11% perf-stat.i.iTLB-load-misses 18252735 ± 23% -68.7% 5710201 ± 12% perf-stat.i.iTLB-loads 117745 ± 8% +19.4% 140621 ± 7% perf-stat.i.instructions-per-iTLB-miss 39880 ± 9% -82.7% 6907 ± 5% perf-stat.i.minor-faults 392334 -2.1% 384257 perf-stat.i.msec 89.47 +5.7 95.19 perf-stat.i.node-load-miss-rate% 2771890 ± 30% -50.3% 1376778 ± 28% perf-stat.i.node-loads 44.74 ± 2% +21.6 66.37 perf-stat.i.node-store-miss-rate% 3724446 ± 6% +36.0% 5064528 ± 3% perf-stat.i.node-store-misses 4931569 ± 13% -52.8% 2327594 ± 2% perf-stat.i.node-stores 40575 ± 8% -83.0% 6908 ± 5% perf-stat.i.page-faults 2.39 ± 6% -54.2% 1.10 ± 13% perf-stat.overall.MPKI 0.54 ± 7% -0.4 0.16 ± 7% perf-stat.overall.branch-miss-rate% 8.80 ± 5% +7.1 15.88 ± 6% perf-stat.overall.cache-miss-rate% 1.69 +12.0% 1.89 perf-stat.overall.cpi 8090 ± 9% +38.1% 11176 ± 18% perf-stat.overall.cycles-between-cache-misses 0.23 ± 12% -0.2 0.03 ± 9% perf-stat.overall.dTLB-load-miss-rate% 0.06 ± 11% +0.0 0.08 ± 2% perf-stat.overall.dTLB-store-miss-rate% 66.92 ± 2% -8.1 58.83 perf-stat.overall.iTLB-load-miss-rate% 3357 ± 8% +569.0% 22462 ± 6% perf-stat.overall.instructions-per-iTLB-miss 0.59 -10.7% 0.53 perf-stat.overall.ipc 79.89 ± 4% +12.9 92.83 ± 2% perf-stat.overall.node-load-miss-rate% 41.17 ± 2% +27.4 68.55 perf-stat.overall.node-store-miss-rate% 112718 ± 8% +740.5% 947374 ± 7% perf-stat.overall.path-length 3.922e+10 ± 2% -7.1% 3.645e+10 perf-stat.ps.branch-instructions 2.13e+08 ± 6% -72.9% 57717833 ± 8% perf-stat.ps.branch-misses 43381702 ± 9% -23.0% 33388480 ± 17% perf-stat.ps.cache-misses 4.925e+08 ± 6% -57.5% 2.094e+08 ± 12% perf-stat.ps.cache-references 3350914 ± 10% -80.1% 667033 ± 8% perf-stat.ps.context-switches 3.481e+11 ± 2% +3.9% 3.615e+11 perf-stat.ps.cpu-cycles 115208 ± 11% +116.0% 248847 ± 6% perf-stat.ps.cpu-migrations 1.476e+08 ± 12% -86.3% 20154051 ± 10% perf-stat.ps.dTLB-load-misses 6.352e+10 ± 2% -7.0% 5.905e+10 perf-stat.ps.dTLB-loads 8496234 ± 12% -75.7% 2067344 ± 8% perf-stat.ps.dTLB-store-misses 1.457e+10 ± 7% -82.3% 2.572e+09 ± 7% perf-stat.ps.dTLB-stores 61844376 ± 8% -86.2% 8557800 ± 8% perf-stat.ps.iTLB-load-misses 30637986 ± 11% -80.4% 5993899 ± 9% perf-stat.ps.iTLB-loads 2.062e+11 ± 2% -7.3% 1.912e+11 perf-stat.ps.instructions 37082 ± 7% -81.2% 6968 ± 5% perf-stat.ps.minor-faults 5093784 ± 25% -71.2% 1465337 ± 28% perf-stat.ps.node-loads 6762056 ± 6% -65.3% 2343088 ± 2% perf-stat.ps.node-stores 37041 ± 7% -81.2% 6970 ± 5% perf-stat.ps.page-faults 1.421e+14 ± 7% +53.6% 2.183e+14 ± 7% perf-stat.total.instructions 85105 ± 76% +490.2% 502299 ± 15% sched_debug.cfs_rq:/.MIN_vruntime.avg 12099064 ± 70% +363.3% 56050430 ± 37% sched_debug.cfs_rq:/.MIN_vruntime.max 996553 ± 73% +385.5% 4838492 ± 23% sched_debug.cfs_rq:/.MIN_vruntime.stddev 9.55 ± 19% +221.9% 30.74 ± 15% sched_debug.cfs_rq:/.load_avg.avg 288.59 ± 16% +1025.4% 3247 ± 21% sched_debug.cfs_rq:/.load_avg.max 36.18 ± 16% +629.5% 263.94 ± 18% sched_debug.cfs_rq:/.load_avg.stddev 85105 ± 76% +490.2% 502299 ± 15% sched_debug.cfs_rq:/.max_vruntime.avg 12099064 ± 70% +363.3% 56050430 ± 37% sched_debug.cfs_rq:/.max_vruntime.max 996553 ± 73% +385.5% 4838492 ± 23% sched_debug.cfs_rq:/.max_vruntime.stddev 53164577 ± 10% +257.9% 1.903e+08 ± 9% sched_debug.cfs_rq:/.min_vruntime.avg 68436306 ± 12% +357.0% 3.128e+08 ± 9% sched_debug.cfs_rq:/.min_vruntime.max 34725312 ± 5% +340.5% 1.529e+08 ± 9% sched_debug.cfs_rq:/.min_vruntime.min 10902982 ± 27% +435.0% 58333938 ± 11% sched_debug.cfs_rq:/.min_vruntime.stddev 0.38 ± 7% +69.7% 0.64 ± 5% sched_debug.cfs_rq:/.nr_running.avg 3.23 ± 7% +722.5% 26.53 ± 18% sched_debug.cfs_rq:/.runnable_load_avg.avg 165.48 ± 11% +1826.7% 3188 ± 22% sched_debug.cfs_rq:/.runnable_load_avg.max 16.24 ± 8% +1464.0% 253.95 ± 19% sched_debug.cfs_rq:/.runnable_load_avg.stddev 1518659 ±366% +1681.1% 27049232 ± 13% sched_debug.cfs_rq:/.spread0.avg 16424984 ± 18% +806.7% 1.489e+08 ± 11% sched_debug.cfs_rq:/.spread0.max 10803161 ± 28% +438.8% 58202386 ± 11% sched_debug.cfs_rq:/.spread0.stddev 447.65 ± 5% +25.7% 562.89 ± 5% sched_debug.cfs_rq:/.util_avg.avg 1408 ± 4% +584.2% 9639 ± 12% sched_debug.cfs_rq:/.util_avg.max 10.88 ± 95% -85.3% 1.60 ±169% sched_debug.cfs_rq:/.util_avg.min 325.27 ± 10% +178.6% 906.23 ± 9% sched_debug.cfs_rq:/.util_avg.stddev 318.61 ± 31% +84.5% 587.96 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.avg 6547 ± 27% +602.1% 45969 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.max 863.51 ± 30% +340.8% 3806 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.stddev 799007 ± 12% +899.6% 7986829 ± 4% sched_debug.cpu.avg_idle.avg 2018492 ± 19% +830.0% 18771549 ± 2% sched_debug.cpu.avg_idle.max 100426 ± 28% +392.0% 494096 ± 18% sched_debug.cpu.avg_idle.min 402154 ± 23% +970.3% 4304181 ± 4% sched_debug.cpu.avg_idle.stddev 369699 ± 6% +63.2% 603279 ± 9% sched_debug.cpu.clock.avg 372372 ± 6% +62.8% 606108 ± 9% sched_debug.cpu.clock.max 365919 ± 6% +63.9% 599805 ± 9% sched_debug.cpu.clock.min 369699 ± 6% +63.2% 603279 ± 9% sched_debug.cpu.clock_task.avg 372372 ± 6% +62.8% 606108 ± 9% sched_debug.cpu.clock_task.max 365919 ± 6% +63.9% 599805 ± 9% sched_debug.cpu.clock_task.min 48588 ± 14% +35.8% 65992 ± 4% sched_debug.cpu.curr->pid.avg 158280 ± 4% -17.6% 130496 sched_debug.cpu.curr->pid.max 54049 ± 11% -24.3% 40911 sched_debug.cpu.curr->pid.stddev 4942 ± 13% +29.8% 6414 ± 5% sched_debug.cpu.load.avg 630059 ± 13% +1296.0% 8795465 ± 3% sched_debug.cpu.max_idle_balance_cost.avg 1171022 ± 21% +910.0% 11827131 ± 4% sched_debug.cpu.max_idle_balance_cost.max 500000 +1063.1% 5815581 ± 4% sched_debug.cpu.max_idle_balance_cost.min 148238 ± 48% +704.2% 1192074 ± 2% sched_debug.cpu.max_idle_balance_cost.stddev 7.84 ± 36% +152.2% 19.77 ± 17% sched_debug.cpu.nr_running.avg 98.70 ± 25% +1669.9% 1746 ± 18% sched_debug.cpu.nr_running.max 17.32 ± 31% +744.0% 146.16 ± 18% sched_debug.cpu.nr_running.stddev 5428402 ± 11% -85.8% 772678 ± 13% sched_debug.cpu.nr_switches.avg 8367541 ± 13% -87.7% 1027305 ± 11% sched_debug.cpu.nr_switches.max 1520870 ± 9% -73.5% 402748 ± 14% sched_debug.cpu.nr_switches.min 2235226 ± 20% -93.6% 143699 ± 7% sched_debug.cpu.nr_switches.stddev 85.65 ± 7% +65.4% 141.71 sched_debug.cpu.nr_uninterruptible.avg 1979 ± 20% +303.5% 7987 ± 16% sched_debug.cpu.nr_uninterruptible.max -2978 +370.0% -13996 sched_debug.cpu.nr_uninterruptible.min 921.58 ± 20% +358.5% 4225 ± 17% sched_debug.cpu.nr_uninterruptible.stddev 362076 ± 6% +65.6% 599650 ± 9% sched_debug.cpu_clk 357309 ± 6% +66.5% 594880 ± 9% sched_debug.ktime 3.02 +10.9% 3.35 sched_debug.rt_rq:/.rt_runtime.stddev 367493 ± 6% +63.8% 601939 ± 8% sched_debug.sched_clk 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 24763 ± 25% -17.6% 20398 ± 17% slabinfo.Acpi-Namespace.active_objs 24763 ± 25% -17.6% 20398 ± 17% slabinfo.Acpi-Namespace.num_objs 388134 ± 3% +109.2% 812118 slabinfo.Acpi-Parse.active_objs 5511 ± 3% +132.7% 12826 slabinfo.Acpi-Parse.active_slabs 402363 ± 3% +132.7% 936386 slabinfo.Acpi-Parse.num_objs 5511 ± 3% +132.7% 12826 slabinfo.Acpi-Parse.num_slabs 323.00 ± 9% +45.0% 468.25 ± 13% slabinfo.biovec-128.active_objs 323.00 ± 9% +45.0% 468.25 ± 13% slabinfo.biovec-128.num_objs 349292 ± 2% +136.2% 825175 slabinfo.dentry.active_objs 8689 ± 2% +160.2% 22610 slabinfo.dentry.active_slabs 364980 ± 2% +160.2% 949666 slabinfo.dentry.num_objs 8689 ± 2% +160.2% 22610 slabinfo.dentry.num_slabs 1255 ± 9% +34.6% 1689 ± 12% slabinfo.dmaengine-unmap-16.active_objs 1255 ± 9% +34.6% 1689 ± 12% slabinfo.dmaengine-unmap-16.num_objs 169454 ± 3% -23.3% 129971 slabinfo.files_cache.active_objs 3714 ± 3% -23.8% 2829 slabinfo.files_cache.active_slabs 170895 ± 3% -23.8% 130155 slabinfo.files_cache.num_objs 3714 ± 3% -23.8% 2829 slabinfo.files_cache.num_slabs 203851 ± 2% -19.5% 164057 slabinfo.filp.active_objs 3206 ± 2% -19.9% 2567 slabinfo.filp.active_slabs 205230 ± 2% -19.9% 164348 slabinfo.filp.num_objs 3206 ± 2% -19.9% 2567 slabinfo.filp.num_slabs 191482 ± 2% -27.8% 138160 slabinfo.inode_cache.active_objs 3490 ± 2% -27.9% 2516 slabinfo.inode_cache.active_slabs 192020 ± 2% -27.9% 138402 slabinfo.inode_cache.num_objs 3490 ± 2% -27.9% 2516 slabinfo.inode_cache.num_slabs 1163 ± 9% +29.2% 1503 ± 11% slabinfo.kernfs_iattrs_cache.active_objs 1163 ± 9% +29.2% 1503 ± 11% slabinfo.kernfs_iattrs_cache.num_objs 157085 ± 4% -55.5% 69976 slabinfo.kmalloc-192.active_objs 3747 ± 4% -55.5% 1667 slabinfo.kmalloc-192.active_slabs 157400 ± 4% -55.5% 70040 slabinfo.kmalloc-192.num_objs 3747 ± 4% -55.5% 1667 slabinfo.kmalloc-192.num_slabs 82471 ± 2% -16.4% 68952 slabinfo.kmalloc-1k.active_objs 2597 ± 2% -16.8% 2160 slabinfo.kmalloc-1k.active_slabs 83122 ± 2% -16.8% 69140 slabinfo.kmalloc-1k.num_objs 2597 ± 2% -16.8% 2160 slabinfo.kmalloc-1k.num_slabs 18742 +44.9% 27156 ± 2% slabinfo.kmalloc-256.active_objs 293.25 +45.5% 426.75 ± 2% slabinfo.kmalloc-256.active_slabs 18768 +45.6% 27330 ± 2% slabinfo.kmalloc-256.num_objs 293.25 +45.5% 426.75 ± 2% slabinfo.kmalloc-256.num_slabs 561114 ± 4% -45.6% 305013 slabinfo.kmalloc-32.active_objs 4399 ± 4% -45.8% 2385 slabinfo.kmalloc-32.active_slabs 563202 ± 4% -45.8% 305367 slabinfo.kmalloc-32.num_objs 4399 ± 4% -45.8% 2385 slabinfo.kmalloc-32.num_slabs 311945 ± 3% -41.0% 184010 slabinfo.kmalloc-64.active_objs 4888 ± 3% -41.1% 2877 slabinfo.kmalloc-64.active_slabs 312889 ± 3% -41.1% 184161 slabinfo.kmalloc-64.num_objs 4888 ± 3% -41.1% 2877 slabinfo.kmalloc-64.num_slabs 887.00 ± 3% +18.0% 1047 ± 2% slabinfo.kmem_cache_node.active_objs 1040 ± 2% +15.4% 1200 ± 2% slabinfo.kmem_cache_node.num_objs 455120 ± 5% -61.3% 176294 slabinfo.lsm_file_cache.active_objs 1778 ± 5% -61.3% 688.00 slabinfo.lsm_file_cache.active_slabs 455326 ± 5% -61.3% 176294 slabinfo.lsm_file_cache.num_objs 1778 ± 5% -61.3% 688.00 slabinfo.lsm_file_cache.num_slabs 461.25 ± 7% +63.9% 756.00 ± 15% slabinfo.nfs_commit_data.active_objs 461.25 ± 7% +63.9% 756.00 ± 15% slabinfo.nfs_commit_data.num_objs 323.75 ± 10% +71.2% 554.25 ± 12% slabinfo.nfs_read_data.active_objs 323.75 ± 10% +71.2% 554.25 ± 12% slabinfo.nfs_read_data.num_objs 2548 ± 6% +16.3% 2963 ± 8% slabinfo.pool_workqueue.active_objs 2643 ± 6% +15.1% 3041 ± 7% slabinfo.pool_workqueue.num_objs 130692 ± 9% +415.3% 673456 slabinfo.proc_inode_cache.active_objs 3386 ± 11% +308.7% 13839 slabinfo.proc_inode_cache.active_slabs 165952 ± 11% +308.7% 678178 slabinfo.proc_inode_cache.num_objs 3386 ± 11% +308.7% 13839 slabinfo.proc_inode_cache.num_slabs 1197 ± 10% +35.7% 1624 ± 14% slabinfo.skbuff_ext_cache.active_objs 1197 ± 10% +35.7% 1624 ± 14% slabinfo.skbuff_ext_cache.num_objs 1385 ± 4% +42.8% 1979 ± 12% slabinfo.skbuff_fclone_cache.active_objs 1385 ± 4% +42.8% 1979 ± 12% slabinfo.skbuff_fclone_cache.num_objs 81560 +64.9% 134499 ± 5% softirqs.CPU0.SCHED 251872 ± 5% +44.2% 363298 ± 7% softirqs.CPU0.TIMER 79248 ± 2% +66.9% 132263 ± 6% softirqs.CPU1.SCHED 247294 ± 4% +42.5% 352312 ± 7% softirqs.CPU1.TIMER 78494 ± 3% +66.9% 131034 ± 7% softirqs.CPU10.SCHED 245009 ± 4% +43.9% 352465 ± 8% softirqs.CPU10.TIMER 78577 ± 3% +66.0% 130439 ± 7% softirqs.CPU100.SCHED 243613 ± 4% +46.3% 356452 ± 7% softirqs.CPU100.TIMER 78423 ± 3% +66.9% 130874 ± 7% softirqs.CPU101.SCHED 244079 ± 4% +46.0% 356472 ± 7% softirqs.CPU101.TIMER 78109 ± 2% +67.4% 130780 ± 7% softirqs.CPU102.SCHED 243499 ± 3% +46.0% 355603 ± 8% softirqs.CPU102.TIMER 78009 ± 3% +68.1% 131171 ± 6% softirqs.CPU103.SCHED 242288 ± 4% +46.3% 354377 ± 7% softirqs.CPU103.TIMER 77915 ± 3% +67.8% 130713 ± 7% softirqs.CPU104.SCHED 242596 ± 4% +46.2% 354572 ± 7% softirqs.CPU104.TIMER 78129 ± 3% +68.3% 131463 ± 7% softirqs.CPU105.SCHED 244717 ± 4% +45.5% 356029 ± 7% softirqs.CPU105.TIMER 77741 ± 2% +68.7% 131142 ± 7% softirqs.CPU106.SCHED 243228 ± 4% +45.8% 354669 ± 7% softirqs.CPU106.TIMER 78298 ± 3% +67.2% 130900 ± 6% softirqs.CPU107.SCHED 242182 ± 4% +45.9% 353442 ± 7% softirqs.CPU107.TIMER 78026 ± 2% +67.1% 130405 ± 7% softirqs.CPU108.SCHED 244159 ± 4% +46.1% 356819 ± 8% softirqs.CPU108.TIMER 78505 ± 3% +66.0% 130295 ± 7% softirqs.CPU109.SCHED 255603 ± 8% +39.4% 356348 ± 7% softirqs.CPU109.TIMER 78284 ± 3% +67.4% 131077 ± 6% softirqs.CPU11.SCHED 243794 ± 4% +44.9% 353267 ± 7% softirqs.CPU11.TIMER 78287 ± 3% +67.3% 130965 ± 7% softirqs.CPU110.SCHED 245705 ± 4% +44.6% 355231 ± 7% softirqs.CPU110.TIMER 78182 ± 3% +67.0% 130571 ± 7% softirqs.CPU111.SCHED 246630 ± 4% +44.4% 356223 ± 7% softirqs.CPU111.TIMER 77815 ± 2% +67.6% 130409 ± 7% softirqs.CPU112.SCHED 251120 ± 4% +42.8% 358620 ± 7% softirqs.CPU112.TIMER 78258 ± 3% +67.7% 131265 ± 7% softirqs.CPU113.SCHED 248536 ± 5% +44.6% 359356 ± 7% softirqs.CPU113.TIMER 77762 ± 3% +67.5% 130266 ± 7% softirqs.CPU114.SCHED 243681 ± 4% +45.6% 354709 ± 8% softirqs.CPU114.TIMER 77995 ± 2% +67.3% 130454 ± 7% softirqs.CPU115.SCHED 243167 ± 4% +45.6% 353990 ± 8% softirqs.CPU115.TIMER 78049 ± 3% +67.3% 130582 ± 7% softirqs.CPU116.SCHED 242293 ± 4% +46.6% 355307 ± 8% softirqs.CPU116.TIMER 78085 ± 3% +66.9% 130295 ± 7% softirqs.CPU117.SCHED 246207 ± 4% +43.0% 352060 ± 10% softirqs.CPU117.TIMER 77698 ± 3% +67.9% 130481 ± 7% softirqs.CPU118.SCHED 245813 ± 3% +45.0% 356344 ± 8% softirqs.CPU118.TIMER 77852 ± 3% +67.7% 130591 ± 6% softirqs.CPU119.SCHED 245443 ± 4% +45.6% 357310 ± 8% softirqs.CPU119.TIMER 78757 ± 3% +66.1% 130825 ± 7% softirqs.CPU12.SCHED 245008 ± 4% +45.1% 355428 ± 8% softirqs.CPU12.TIMER 77336 ± 4% +69.2% 130890 ± 6% softirqs.CPU120.SCHED 246261 ± 5% +49.2% 367358 ± 6% softirqs.CPU120.TIMER 77657 ± 4% +68.6% 130897 ± 7% softirqs.CPU121.SCHED 243338 ± 4% +50.0% 364993 ± 6% softirqs.CPU121.TIMER 77463 ± 3% +69.5% 131276 ± 7% softirqs.CPU122.SCHED 242899 ± 4% +49.0% 361958 ± 5% softirqs.CPU122.TIMER 77741 ± 3% +69.3% 131622 ± 7% softirqs.CPU123.SCHED 242489 ± 4% +48.8% 360869 ± 6% softirqs.CPU123.TIMER 77720 ± 4% +68.8% 131192 ± 7% softirqs.CPU124.SCHED 243792 ± 4% +49.4% 364321 ± 6% softirqs.CPU124.TIMER 77999 ± 4% +68.2% 131211 ± 7% softirqs.CPU125.SCHED 243034 ± 4% +49.8% 364106 ± 6% softirqs.CPU125.TIMER 77689 ± 3% +68.8% 131145 ± 7% softirqs.CPU126.SCHED 244750 ± 4% +48.1% 362561 ± 6% softirqs.CPU126.TIMER 77810 ± 3% +68.0% 130701 ± 7% softirqs.CPU127.SCHED 244304 ± 4% +48.9% 363760 ± 5% softirqs.CPU127.TIMER 77831 ± 4% +68.3% 131017 ± 6% softirqs.CPU128.SCHED 245834 ± 4% +47.5% 362597 ± 5% softirqs.CPU128.TIMER 77822 ± 3% +68.4% 131074 ± 7% softirqs.CPU129.SCHED 245681 ± 4% +47.5% 362289 ± 6% softirqs.CPU129.TIMER 78014 ± 3% +67.7% 130811 ± 7% softirqs.CPU13.SCHED 245193 ± 4% +44.8% 355044 ± 8% softirqs.CPU13.TIMER 77847 ± 4% +68.7% 131308 ± 7% softirqs.CPU130.SCHED 245965 ± 4% +47.4% 362672 ± 6% softirqs.CPU130.TIMER 77938 ± 4% +68.0% 130965 ± 7% softirqs.CPU131.SCHED 243388 ± 4% +47.8% 359754 ± 5% softirqs.CPU131.TIMER 77840 ± 3% +67.6% 130483 ± 7% softirqs.CPU132.SCHED 245504 ± 4% +47.5% 362099 ± 6% softirqs.CPU132.TIMER 78100 ± 4% +67.6% 130877 ± 7% softirqs.CPU133.SCHED 246400 ± 4% +47.4% 363275 ± 6% softirqs.CPU133.TIMER 77543 ± 3% +69.4% 131335 ± 7% softirqs.CPU134.SCHED 245013 ± 3% +47.6% 361575 ± 6% softirqs.CPU134.TIMER 77352 ± 3% +69.8% 131320 ± 7% softirqs.CPU135.SCHED 247352 ± 4% +55.2% 383885 ± 10% softirqs.CPU135.TIMER 77474 ± 3% +69.0% 130928 ± 7% softirqs.CPU136.SCHED 248874 ± 4% +47.2% 366354 ± 6% softirqs.CPU136.TIMER 77513 ± 3% +68.7% 130730 ± 7% softirqs.CPU137.SCHED 245600 ± 4% +48.2% 364036 ± 6% softirqs.CPU137.TIMER 77761 ± 3% +68.6% 131083 ± 7% softirqs.CPU138.SCHED 243447 ± 4% +68.8% 411046 ± 21% softirqs.CPU138.TIMER 77188 ± 4% +69.3% 130704 ± 7% softirqs.CPU139.SCHED 242608 ± 4% +48.9% 361235 ± 5% softirqs.CPU139.TIMER 78370 ± 3% +66.7% 130619 ± 7% softirqs.CPU14.SCHED 247370 ± 4% +42.9% 353519 ± 8% softirqs.CPU14.TIMER 77617 ± 3% +68.2% 130533 ± 7% softirqs.CPU140.SCHED 243441 ± 4% +49.2% 363125 ± 6% softirqs.CPU140.TIMER 77460 ± 4% +68.8% 130751 ± 7% softirqs.CPU141.SCHED 245658 ± 4% +49.0% 366115 ± 6% softirqs.CPU141.TIMER 77705 ± 4% +67.9% 130454 ± 7% softirqs.CPU142.SCHED 248147 ± 4% +46.5% 363514 ± 6% softirqs.CPU142.TIMER 77787 ± 4% +68.0% 130701 ± 7% softirqs.CPU143.SCHED 246328 ± 4% +47.9% 364290 ± 6% softirqs.CPU143.TIMER 73943 ± 4% +54.6% 114345 ± 21% softirqs.CPU144.SCHED 247331 ± 5% +47.8% 365584 ± 7% softirqs.CPU144.TIMER 73720 ± 4% +53.7% 113343 ± 22% softirqs.CPU145.SCHED 246405 ± 4% +46.0% 359773 ± 8% softirqs.CPU145.TIMER 74066 ± 4% +53.5% 113725 ± 21% softirqs.CPU146.SCHED 247832 ± 5% +44.4% 357950 ± 7% softirqs.CPU146.TIMER 73316 ± 5% +55.4% 113954 ± 20% softirqs.CPU147.SCHED 242776 ± 4% +47.8% 358876 ± 7% softirqs.CPU147.TIMER 73539 ± 4% +55.3% 114209 ± 21% softirqs.CPU148.SCHED 244726 ± 5% +46.8% 359270 ± 8% softirqs.CPU148.TIMER 73893 ± 4% +53.8% 113682 ± 21% softirqs.CPU149.SCHED 243135 ± 4% +47.9% 359660 ± 8% softirqs.CPU149.TIMER 78121 ± 3% +67.6% 130938 ± 7% softirqs.CPU15.SCHED 247754 ± 4% +42.8% 353823 ± 7% softirqs.CPU15.TIMER 73808 ± 3% +54.2% 113798 ± 21% softirqs.CPU150.SCHED 243107 ± 3% +48.2% 360229 ± 8% softirqs.CPU150.TIMER 73782 ± 4% +55.2% 114521 ± 21% softirqs.CPU151.SCHED 242305 ± 4% +48.2% 359211 ± 7% softirqs.CPU151.TIMER 73628 ± 3% +54.8% 113944 ± 20% softirqs.CPU152.SCHED 243782 ± 5% +47.4% 359258 ± 7% softirqs.CPU152.TIMER 73473 ± 4% +55.4% 114181 ± 21% softirqs.CPU153.SCHED 241136 ± 5% +48.8% 358746 ± 7% softirqs.CPU153.TIMER 73621 ± 3% +54.3% 113593 ± 21% softirqs.CPU154.SCHED 247103 ± 4% +45.3% 359093 ± 8% softirqs.CPU154.TIMER 74369 ± 3% +52.8% 113604 ± 21% softirqs.CPU155.SCHED 269633 ± 16% +33.2% 359243 ± 8% softirqs.CPU155.TIMER 73545 ± 4% +55.4% 114265 ± 21% softirqs.CPU156.SCHED 242257 ± 5% +48.7% 360342 ± 8% softirqs.CPU156.TIMER 73827 ± 4% +54.8% 114297 ± 21% softirqs.CPU157.SCHED 241642 ± 4% +53.7% 371450 ± 7% softirqs.CPU157.TIMER 73886 ± 4% +53.9% 113746 ± 20% softirqs.CPU158.SCHED 243074 ± 5% +47.5% 358471 ± 7% softirqs.CPU158.TIMER 73796 ± 4% +54.6% 114082 ± 21% softirqs.CPU159.SCHED 247124 ± 4% +46.1% 360999 ± 8% softirqs.CPU159.TIMER 77805 ± 3% +68.6% 131213 ± 7% softirqs.CPU16.SCHED 250661 ± 5% +42.7% 357657 ± 7% softirqs.CPU16.TIMER 56924 ± 8% +13.9% 64846 ± 9% softirqs.CPU160.RCU 73509 ± 3% +54.6% 113667 ± 21% softirqs.CPU160.SCHED 248114 ± 5% +47.1% 365074 ± 8% softirqs.CPU160.TIMER 73922 ± 4% +53.1% 113209 ± 21% softirqs.CPU161.SCHED 248530 ± 5% +44.4% 358879 ± 7% softirqs.CPU161.TIMER 73752 ± 4% +54.5% 113955 ± 21% softirqs.CPU162.SCHED 241343 ± 4% +48.8% 359096 ± 8% softirqs.CPU162.TIMER 73442 ± 4% +54.8% 113716 ± 21% softirqs.CPU163.SCHED 242252 ± 4% +48.0% 358432 ± 8% softirqs.CPU163.TIMER 57703 ± 6% +11.4% 64264 ± 8% softirqs.CPU164.RCU 73199 ± 4% +54.6% 113140 ± 21% softirqs.CPU164.SCHED 242121 ± 5% +48.1% 358690 ± 8% softirqs.CPU164.TIMER 59271 ± 7% +14.3% 67743 ± 7% softirqs.CPU165.RCU 73329 ± 4% +55.4% 113980 ± 21% softirqs.CPU165.SCHED 245835 ± 4% +46.8% 360795 ± 8% softirqs.CPU165.TIMER 73644 ± 4% +54.6% 113835 ± 21% softirqs.CPU166.SCHED 244675 ± 4% +47.6% 361097 ± 8% softirqs.CPU166.TIMER 74098 ± 4% +52.6% 113097 ± 21% softirqs.CPU167.SCHED 276328 ± 23% +41.2% 390149 ± 12% softirqs.CPU167.TIMER 75284 ± 5% +48.8% 112012 ± 11% softirqs.CPU168.SCHED 243113 ± 6% +48.0% 359795 ± 4% softirqs.CPU168.TIMER 75205 ± 4% +48.5% 111689 ± 11% softirqs.CPU169.SCHED 238860 ± 5% +50.0% 358295 ± 5% softirqs.CPU169.TIMER 78002 ± 2% +67.7% 130774 ± 7% softirqs.CPU17.SCHED 250283 ± 5% +41.4% 353980 ± 7% softirqs.CPU17.TIMER 75416 ± 5% +48.0% 111582 ± 11% softirqs.CPU170.SCHED 238365 ± 4% +49.9% 357400 ± 5% softirqs.CPU170.TIMER 75332 ± 5% +47.5% 111091 ± 11% softirqs.CPU171.SCHED 238342 ± 4% +49.0% 355123 ± 5% softirqs.CPU171.TIMER 75421 ± 5% +47.7% 111375 ± 11% softirqs.CPU172.SCHED 239366 ± 5% +48.9% 356358 ± 5% softirqs.CPU172.TIMER 75353 ± 5% +48.1% 111597 ± 12% softirqs.CPU173.SCHED 238629 ± 4% +49.9% 357741 ± 5% softirqs.CPU173.TIMER 75855 ± 5% +47.3% 111745 ± 11% softirqs.CPU174.SCHED 244831 ± 2% +46.5% 358576 ± 4% softirqs.CPU174.TIMER 75625 ± 5% +47.0% 111160 ± 12% softirqs.CPU175.SCHED 241340 ± 5% +48.2% 357553 ± 4% softirqs.CPU175.TIMER 75429 ± 5% +47.7% 111445 ± 11% softirqs.CPU176.SCHED 242443 ± 5% +48.0% 358795 ± 4% softirqs.CPU176.TIMER 75561 ± 5% +46.7% 110858 ± 12% softirqs.CPU177.SCHED 240302 ± 6% +48.5% 356826 ± 5% softirqs.CPU177.TIMER 75836 ± 5% +46.9% 111433 ± 12% softirqs.CPU178.SCHED 240103 ± 6% +49.0% 357708 ± 4% softirqs.CPU178.TIMER 75266 ± 6% +47.8% 111253 ± 12% softirqs.CPU179.SCHED 239881 ± 5% +48.9% 357228 ± 4% softirqs.CPU179.TIMER 77985 ± 2% +68.2% 131167 ± 7% softirqs.CPU18.SCHED 245956 ± 4% +43.8% 353800 ± 8% softirqs.CPU18.TIMER 75180 ± 5% +48.2% 111435 ± 12% softirqs.CPU180.SCHED 240398 ± 5% +49.1% 358450 ± 5% softirqs.CPU180.TIMER 75063 ± 5% +47.8% 110936 ± 12% softirqs.CPU181.SCHED 238923 ± 5% +49.6% 357319 ± 5% softirqs.CPU181.TIMER 75312 ± 5% +48.4% 111739 ± 11% softirqs.CPU182.SCHED 239510 ± 4% +49.2% 357331 ± 5% softirqs.CPU182.TIMER 75763 ± 5% +47.4% 111685 ± 11% softirqs.CPU183.SCHED 243318 ± 5% +47.7% 359331 ± 5% softirqs.CPU183.TIMER 75294 ± 5% +48.6% 111875 ± 11% softirqs.CPU184.SCHED 245093 ± 5% +47.2% 360758 ± 4% softirqs.CPU184.TIMER 75579 ± 5% +48.2% 112024 ± 11% softirqs.CPU185.SCHED 242810 ± 5% +48.0% 359317 ± 4% softirqs.CPU185.TIMER 75392 ± 5% +47.8% 111415 ± 11% softirqs.CPU186.SCHED 238989 ± 5% +49.6% 357463 ± 5% softirqs.CPU186.TIMER 75458 ± 5% +47.8% 111534 ± 12% softirqs.CPU187.SCHED 238476 ± 5% +49.6% 356818 ± 4% softirqs.CPU187.TIMER 75718 ± 5% +47.0% 111339 ± 11% softirqs.CPU188.SCHED 258940 ± 13% +38.1% 357625 ± 4% softirqs.CPU188.TIMER 75330 ± 5% +47.8% 111334 ± 11% softirqs.CPU189.SCHED 242143 ± 4% +48.4% 359415 ± 5% softirqs.CPU189.TIMER 78157 ± 3% +67.9% 131251 ± 6% softirqs.CPU19.SCHED 245122 ± 4% +44.7% 354704 ± 7% softirqs.CPU19.TIMER 75189 ± 4% +47.8% 111150 ± 11% softirqs.CPU190.SCHED 244570 ± 4% +46.7% 358812 ± 5% softirqs.CPU190.TIMER 75188 ± 5% +47.6% 111006 ± 11% softirqs.CPU191.SCHED 242927 ± 5% +47.7% 358900 ± 4% softirqs.CPU191.TIMER 77901 ± 3% +67.8% 130724 ± 7% softirqs.CPU2.SCHED 245046 ± 4% +44.6% 354454 ± 7% softirqs.CPU2.TIMER 78051 ± 3% +67.3% 130592 ± 7% softirqs.CPU20.SCHED 244359 ± 5% +43.9% 351735 ± 7% softirqs.CPU20.TIMER 78046 ± 3% +68.4% 131408 ± 7% softirqs.CPU21.SCHED 247086 ± 4% +63.2% 403206 ± 13% softirqs.CPU21.TIMER 78046 ± 3% +67.6% 130822 ± 7% softirqs.CPU22.SCHED 247058 ± 4% +43.3% 354010 ± 7% softirqs.CPU22.TIMER 77741 ± 3% +68.9% 131308 ± 6% softirqs.CPU23.SCHED 247807 ± 5% +43.2% 354823 ± 8% softirqs.CPU23.TIMER 77943 ± 4% +66.7% 129950 ± 6% softirqs.CPU24.SCHED 247892 ± 4% +46.2% 362427 ± 6% softirqs.CPU24.TIMER 77993 ± 4% +67.0% 130243 ± 7% softirqs.CPU25.SCHED 245442 ± 4% +46.0% 358399 ± 5% softirqs.CPU25.TIMER 77674 ± 4% +69.7% 131791 ± 7% softirqs.CPU26.SCHED 244379 ± 4% +47.2% 359655 ± 6% softirqs.CPU26.TIMER 77733 ± 4% +68.3% 130839 ± 7% softirqs.CPU27.SCHED 243555 ± 4% +47.6% 359498 ± 6% softirqs.CPU27.TIMER 78030 ± 4% +67.8% 130967 ± 7% softirqs.CPU28.SCHED 245659 ± 4% +47.4% 362139 ± 6% softirqs.CPU28.TIMER 78272 ± 4% +68.0% 131489 ± 7% softirqs.CPU29.SCHED 244419 ± 4% +48.4% 362782 ± 6% softirqs.CPU29.TIMER 78503 ± 3% +67.0% 131085 ± 7% softirqs.CPU3.SCHED 243492 ± 4% +44.4% 351504 ± 7% softirqs.CPU3.TIMER 78652 ± 5% +67.0% 131360 ± 7% softirqs.CPU30.SCHED 245695 ± 4% +46.9% 361002 ± 6% softirqs.CPU30.TIMER 77824 ± 3% +69.9% 132256 ± 7% softirqs.CPU31.SCHED 246665 ± 4% +46.7% 361739 ± 6% softirqs.CPU31.TIMER 77764 ± 4% +69.1% 131501 ± 7% softirqs.CPU32.SCHED 247204 ± 4% +45.9% 360683 ± 5% softirqs.CPU32.TIMER 77741 ± 3% +68.3% 130856 ± 7% softirqs.CPU33.SCHED 247226 ± 4% +45.7% 360110 ± 6% softirqs.CPU33.TIMER 77846 ± 3% +69.4% 131836 ± 7% softirqs.CPU34.SCHED 246680 ± 4% +46.7% 361906 ± 6% softirqs.CPU34.TIMER 77657 ± 4% +68.6% 130948 ± 7% softirqs.CPU35.SCHED 244489 ± 4% +47.3% 360225 ± 6% softirqs.CPU35.TIMER 77832 ± 4% +68.3% 130970 ± 7% softirqs.CPU36.SCHED 246569 ± 4% +46.4% 360992 ± 6% softirqs.CPU36.TIMER 78042 ± 4% +68.6% 131543 ± 7% softirqs.CPU37.SCHED 246762 ± 4% +46.9% 362375 ± 6% softirqs.CPU37.TIMER 77542 ± 3% +69.0% 131016 ± 7% softirqs.CPU38.SCHED 245802 ± 3% +46.8% 360815 ± 6% softirqs.CPU38.TIMER 77286 ± 3% +69.6% 131054 ± 7% softirqs.CPU39.SCHED 246998 ± 4% +47.2% 363523 ± 5% softirqs.CPU39.TIMER 78108 ± 3% +67.7% 130950 ± 7% softirqs.CPU4.SCHED 245573 ± 4% +43.6% 352757 ± 7% softirqs.CPU4.TIMER 77753 ± 3% +68.8% 131213 ± 7% softirqs.CPU40.SCHED 249523 ± 4% +45.8% 363817 ± 6% softirqs.CPU40.TIMER 77626 ± 4% +68.5% 130807 ± 7% softirqs.CPU41.SCHED 247793 ± 4% +47.0% 364171 ± 6% softirqs.CPU41.TIMER 77817 ± 4% +68.2% 130900 ± 7% softirqs.CPU42.SCHED 245282 ± 4% +47.4% 361451 ± 6% softirqs.CPU42.TIMER 77718 ± 4% +69.9% 132015 ± 7% softirqs.CPU43.SCHED 243633 ± 4% +48.2% 360959 ± 5% softirqs.CPU43.TIMER 77780 ± 3% +69.1% 131494 ± 7% softirqs.CPU44.SCHED 245256 ± 4% +47.8% 362435 ± 6% softirqs.CPU44.TIMER 77398 ± 3% +70.6% 132069 ± 7% softirqs.CPU45.SCHED 246716 ± 4% +48.0% 365263 ± 6% softirqs.CPU45.TIMER 78181 ± 4% +68.0% 131383 ± 7% softirqs.CPU46.SCHED 249302 ± 4% +46.1% 364187 ± 6% softirqs.CPU46.TIMER 77824 ± 4% +69.2% 131691 ± 7% softirqs.CPU47.SCHED 248433 ± 4% +46.3% 363533 ± 6% softirqs.CPU47.TIMER 72698 ± 5% +55.0% 112665 ± 20% softirqs.CPU48.SCHED 247075 ± 7% +46.0% 360629 ± 7% softirqs.CPU48.TIMER 61934 ± 9% +15.6% 71595 ± 4% softirqs.CPU49.RCU 74017 ± 4% +53.7% 113758 ± 21% softirqs.CPU49.SCHED 246340 ± 5% +45.3% 357970 ± 7% softirqs.CPU49.TIMER 78325 ± 3% +67.0% 130843 ± 7% softirqs.CPU5.SCHED 245149 ± 4% +44.6% 354549 ± 7% softirqs.CPU5.TIMER 73917 ± 4% +54.7% 114337 ± 21% softirqs.CPU50.SCHED 244743 ± 5% +46.7% 358978 ± 7% softirqs.CPU50.TIMER 73820 ± 4% +54.6% 114090 ± 20% softirqs.CPU51.SCHED 244269 ± 4% +46.5% 357842 ± 7% softirqs.CPU51.TIMER 60754 ± 10% +13.6% 68995 ± 6% softirqs.CPU52.RCU 73706 ± 4% +55.5% 114595 ± 21% softirqs.CPU52.SCHED 244278 ± 5% +46.8% 358510 ± 7% softirqs.CPU52.TIMER 73896 ± 4% +54.8% 114364 ± 21% softirqs.CPU53.SCHED 243334 ± 4% +48.2% 360500 ± 7% softirqs.CPU53.TIMER 61552 ± 9% +15.1% 70875 ± 5% softirqs.CPU54.RCU 73777 ± 3% +55.3% 114588 ± 21% softirqs.CPU54.SCHED 244551 ± 3% +46.6% 358437 ± 7% softirqs.CPU54.TIMER 73787 ± 4% +54.7% 114168 ± 20% softirqs.CPU55.SCHED 242994 ± 4% +47.6% 358641 ± 7% softirqs.CPU55.TIMER 75522 ± 5% +50.9% 113959 ± 21% softirqs.CPU56.SCHED 245293 ± 5% +46.2% 358733 ± 7% softirqs.CPU56.TIMER 60494 ± 10% +11.3% 67356 ± 9% softirqs.CPU57.RCU 73720 ± 4% +54.7% 114027 ± 21% softirqs.CPU57.SCHED 242679 ± 5% +47.6% 358298 ± 7% softirqs.CPU57.TIMER 73730 ± 4% +54.7% 114067 ± 21% softirqs.CPU58.SCHED 243306 ± 5% +47.4% 358731 ± 7% softirqs.CPU58.TIMER 74007 ± 3% +53.6% 113663 ± 21% softirqs.CPU59.SCHED 244862 ± 4% +46.2% 358044 ± 7% softirqs.CPU59.TIMER 78407 ± 3% +67.7% 131453 ± 7% softirqs.CPU6.SCHED 244705 ± 3% +44.6% 353777 ± 7% softirqs.CPU6.TIMER 73974 ± 3% +53.9% 113857 ± 21% softirqs.CPU60.SCHED 243927 ± 5% +47.5% 359840 ± 8% softirqs.CPU60.TIMER 73517 ± 4% +55.9% 114648 ± 21% softirqs.CPU61.SCHED 243751 ± 4% +48.3% 361494 ± 7% softirqs.CPU61.TIMER 74119 ± 4% +53.9% 114076 ± 20% softirqs.CPU62.SCHED 244533 ± 4% +46.4% 358033 ± 7% softirqs.CPU62.TIMER 73890 ± 3% +54.9% 114451 ± 21% softirqs.CPU63.SCHED 247758 ± 4% +45.2% 359629 ± 7% softirqs.CPU63.TIMER 73939 ± 4% +54.8% 114422 ± 21% softirqs.CPU64.SCHED 250565 ± 5% +44.3% 361583 ± 7% softirqs.CPU64.TIMER 58770 ± 9% +14.0% 67011 ± 6% softirqs.CPU65.RCU 74588 ± 4% +53.2% 114267 ± 21% softirqs.CPU65.SCHED 249079 ± 5% +45.0% 361188 ± 8% softirqs.CPU65.TIMER 55840 ± 9% +16.6% 65116 ± 8% softirqs.CPU66.RCU 73733 ± 4% +54.9% 114203 ± 21% softirqs.CPU66.SCHED 243066 ± 5% +47.8% 359305 ± 7% softirqs.CPU66.TIMER 58059 ± 7% +12.1% 65098 ± 8% softirqs.CPU67.RCU 74079 ± 4% +54.7% 114572 ± 21% softirqs.CPU67.SCHED 244340 ± 4% +46.5% 357860 ± 7% softirqs.CPU67.TIMER 73838 ± 4% +54.4% 113974 ± 21% softirqs.CPU68.SCHED 243983 ± 5% +46.8% 358227 ± 7% softirqs.CPU68.TIMER 59726 ± 7% +13.4% 67711 ± 6% softirqs.CPU69.RCU 73918 ± 4% +54.5% 114184 ± 21% softirqs.CPU69.SCHED 248549 ± 5% +45.6% 361808 ± 8% softirqs.CPU69.TIMER 77982 ± 3% +69.0% 131769 ± 7% softirqs.CPU7.SCHED 244165 ± 4% +44.6% 353168 ± 7% softirqs.CPU7.TIMER 73684 ± 5% +54.6% 113945 ± 21% softirqs.CPU70.SCHED 248263 ± 4% +44.9% 359829 ± 7% softirqs.CPU70.TIMER 73774 ± 5% +55.1% 114433 ± 21% softirqs.CPU71.SCHED 249402 ± 6% +44.8% 361155 ± 7% softirqs.CPU71.TIMER 74515 ± 5% +49.5% 111367 ± 11% softirqs.CPU72.SCHED 242848 ± 6% +46.8% 356603 ± 5% softirqs.CPU72.TIMER 76137 ± 5% +46.2% 111347 ± 11% softirqs.CPU73.SCHED 239679 ± 5% +49.0% 357100 ± 5% softirqs.CPU73.TIMER 75379 ± 5% +48.3% 111798 ± 11% softirqs.CPU74.SCHED 239248 ± 4% +51.8% 363157 ± 6% softirqs.CPU74.TIMER 75712 ± 5% +47.9% 112000 ± 12% softirqs.CPU75.SCHED 239270 ± 5% +48.9% 356379 ± 5% softirqs.CPU75.TIMER 75625 ± 5% +47.6% 111606 ± 11% softirqs.CPU76.SCHED 240752 ± 5% +49.0% 358619 ± 5% softirqs.CPU76.TIMER 75752 ± 5% +47.1% 111400 ± 11% softirqs.CPU77.SCHED 240572 ± 5% +48.2% 356524 ± 5% softirqs.CPU77.TIMER 76147 ± 5% +46.5% 111543 ± 11% softirqs.CPU78.SCHED 266395 ± 13% +34.1% 357201 ± 5% softirqs.CPU78.TIMER 75523 ± 5% +47.7% 111566 ± 12% softirqs.CPU79.SCHED 241815 ± 5% +47.7% 357046 ± 4% softirqs.CPU79.TIMER 78000 ± 3% +68.1% 131138 ± 7% softirqs.CPU8.SCHED 243729 ± 5% +44.8% 352841 ± 7% softirqs.CPU8.TIMER 75896 ± 4% +47.2% 111724 ± 12% softirqs.CPU80.SCHED 243979 ± 5% +46.2% 356801 ± 4% softirqs.CPU80.TIMER 76090 ± 4% +46.4% 111359 ± 12% softirqs.CPU81.SCHED 241984 ± 6% +47.1% 355958 ± 5% softirqs.CPU81.TIMER 75610 ± 5% +47.3% 111399 ± 12% softirqs.CPU82.SCHED 240739 ± 5% +48.3% 357069 ± 5% softirqs.CPU82.TIMER 74942 ± 4% +48.4% 111237 ± 12% softirqs.CPU83.SCHED 241506 ± 4% +47.6% 356392 ± 5% softirqs.CPU83.TIMER 75752 ± 4% +46.8% 111238 ± 12% softirqs.CPU84.SCHED 241507 ± 5% +47.9% 357212 ± 5% softirqs.CPU84.TIMER 75528 ± 5% +48.4% 112051 ± 12% softirqs.CPU85.SCHED 240416 ± 5% +48.8% 357841 ± 5% softirqs.CPU85.TIMER 75146 ± 5% +48.4% 111510 ± 11% softirqs.CPU86.SCHED 240510 ± 4% +48.2% 356511 ± 5% softirqs.CPU86.TIMER 75628 ± 5% +48.3% 112144 ± 12% softirqs.CPU87.SCHED 243335 ± 5% +47.4% 358704 ± 5% softirqs.CPU87.TIMER 75702 ± 5% +47.4% 111573 ± 12% softirqs.CPU88.SCHED 246776 ± 5% +45.6% 359327 ± 5% softirqs.CPU88.TIMER 75804 ± 4% +47.5% 111829 ± 12% softirqs.CPU89.SCHED 243283 ± 4% +47.5% 358870 ± 5% softirqs.CPU89.TIMER 381.75 ± 37% +2446.7% 9722 ±151% softirqs.CPU9.NET_RX 78527 ± 3% +68.7% 132498 ± 9% softirqs.CPU9.SCHED 244005 ± 4% +72.1% 419964 ± 29% softirqs.CPU9.TIMER 75545 ± 5% +47.4% 111363 ± 11% softirqs.CPU90.SCHED 240258 ± 5% +48.7% 357191 ± 5% softirqs.CPU90.TIMER 75655 ± 5% +47.2% 111383 ± 12% softirqs.CPU91.SCHED 241133 ± 4% +47.9% 356618 ± 5% softirqs.CPU91.TIMER 75228 ± 4% +47.7% 111122 ± 12% softirqs.CPU92.SCHED 242237 ± 5% +47.2% 356567 ± 5% softirqs.CPU92.TIMER 75806 ± 5% +47.1% 111541 ± 12% softirqs.CPU93.SCHED 245121 ± 4% +46.5% 359078 ± 5% softirqs.CPU93.TIMER 75839 ± 5% +47.2% 111611 ± 11% softirqs.CPU94.SCHED 246117 ± 4% +45.3% 357703 ± 5% softirqs.CPU94.TIMER 75303 ± 4% +48.4% 111781 ± 12% softirqs.CPU95.SCHED 243322 ± 5% +47.5% 358924 ± 4% softirqs.CPU95.TIMER 78628 ± 3% +65.9% 130454 ± 6% softirqs.CPU96.SCHED 252738 ± 4% +40.9% 356176 ± 6% softirqs.CPU96.TIMER 78502 ± 2% +65.4% 129845 ± 7% softirqs.CPU97.SCHED 245796 ± 5% +44.5% 355113 ± 8% softirqs.CPU97.TIMER 77807 ± 3% +66.8% 129766 ± 7% softirqs.CPU98.SCHED 241848 ± 5% +45.0% 350708 ± 7% softirqs.CPU98.TIMER 78286 ± 3% +66.8% 130603 ± 7% softirqs.CPU99.SCHED 243368 ± 4% +45.1% 353088 ± 7% softirqs.CPU99.TIMER 17409 ± 5% +106.0% 35857 ± 42% softirqs.NET_RX 14654680 ± 3% +59.7% 23402701 ± 7% softirqs.SCHED 47035379 ± 4% +46.9% 69099061 ± 6% softirqs.TIMER 371.00 ± 5% +108.6% 773.75 ± 31% interrupts.131:PCI-MSI.1574913-edge.eth3-TxRx-1 363.75 ± 7% +536.6% 2315 ±127% interrupts.133:PCI-MSI.1574915-edge.eth3-TxRx-3 432.75 ± 16% +119.2% 948.75 ± 36% interrupts.135:PCI-MSI.1574917-edge.eth3-TxRx-5 353.00 ± 7% +66.4% 587.25 ± 6% interrupts.137:PCI-MSI.1574919-edge.eth3-TxRx-7 397.00 ± 9% +506.2% 2406 ±101% interrupts.138:PCI-MSI.1574920-edge.eth3-TxRx-8 623.25 ± 45% +2781.3% 17957 ±150% interrupts.139:PCI-MSI.1574921-edge.eth3-TxRx-9 354.25 ± 6% +74.1% 616.75 ± 10% interrupts.140:PCI-MSI.1574922-edge.eth3-TxRx-10 475.75 ± 41% +107.6% 987.50 ± 20% interrupts.143:PCI-MSI.1574925-edge.eth3-TxRx-13 338.00 ± 6% +66.1% 561.25 ± 8% interrupts.146:PCI-MSI.1574928-edge.eth3-TxRx-16 339.00 ± 5% +66.3% 563.75 ± 8% interrupts.147:PCI-MSI.1574929-edge.eth3-TxRx-17 336.00 ± 6% +91.7% 644.00 ± 26% interrupts.148:PCI-MSI.1574930-edge.eth3-TxRx-18 336.75 ± 6% +68.6% 567.75 ± 8% interrupts.149:PCI-MSI.1574931-edge.eth3-TxRx-19 337.25 ± 6% +67.1% 563.50 ± 7% interrupts.150:PCI-MSI.1574932-edge.eth3-TxRx-20 338.75 ± 6% +67.8% 568.50 ± 8% interrupts.151:PCI-MSI.1574933-edge.eth3-TxRx-21 336.00 ± 6% +68.1% 564.75 ± 9% interrupts.152:PCI-MSI.1574934-edge.eth3-TxRx-22 337.75 ± 6% +82.5% 616.25 ± 16% interrupts.153:PCI-MSI.1574935-edge.eth3-TxRx-23 341.25 ± 6% +64.0% 559.75 ± 8% interrupts.154:PCI-MSI.1574936-edge.eth3-TxRx-24 343.00 ± 7% +64.1% 562.75 ± 8% interrupts.155:PCI-MSI.1574937-edge.eth3-TxRx-25 336.50 ± 6% +66.6% 560.50 ± 8% interrupts.156:PCI-MSI.1574938-edge.eth3-TxRx-26 337.00 ± 6% +66.5% 561.25 ± 8% interrupts.157:PCI-MSI.1574939-edge.eth3-TxRx-27 336.75 ± 6% +66.1% 559.25 ± 8% interrupts.158:PCI-MSI.1574940-edge.eth3-TxRx-28 336.75 ± 6% +66.3% 560.00 ± 8% interrupts.159:PCI-MSI.1574941-edge.eth3-TxRx-29 336.00 ± 6% +66.6% 559.75 ± 8% interrupts.160:PCI-MSI.1574942-edge.eth3-TxRx-30 336.75 ± 6% +66.0% 559.00 ± 8% interrupts.161:PCI-MSI.1574943-edge.eth3-TxRx-31 337.75 ± 6% +65.7% 559.50 ± 8% interrupts.162:PCI-MSI.1574944-edge.eth3-TxRx-32 336.50 ± 6% +66.2% 559.25 ± 8% interrupts.163:PCI-MSI.1574945-edge.eth3-TxRx-33 337.75 ± 6% +72.5% 582.75 ± 10% interrupts.164:PCI-MSI.1574946-edge.eth3-TxRx-34 339.25 ± 6% +65.0% 559.75 ± 8% interrupts.165:PCI-MSI.1574947-edge.eth3-TxRx-35 338.75 ± 6% +65.9% 562.00 ± 7% interrupts.166:PCI-MSI.1574948-edge.eth3-TxRx-36 338.25 ± 6% +65.6% 560.00 ± 8% interrupts.167:PCI-MSI.1574949-edge.eth3-TxRx-37 336.50 ± 6% +66.5% 560.25 ± 8% interrupts.168:PCI-MSI.1574950-edge.eth3-TxRx-38 338.25 ± 6% +65.6% 560.25 ± 8% interrupts.169:PCI-MSI.1574951-edge.eth3-TxRx-39 338.25 ± 6% +65.8% 560.75 ± 8% interrupts.170:PCI-MSI.1574952-edge.eth3-TxRx-40 339.75 ± 7% +64.6% 559.25 ± 8% interrupts.171:PCI-MSI.1574953-edge.eth3-TxRx-41 372.50 ± 16% +50.5% 560.75 ± 8% interrupts.172:PCI-MSI.1574954-edge.eth3-TxRx-42 337.00 ± 6% +66.1% 559.75 ± 8% interrupts.173:PCI-MSI.1574955-edge.eth3-TxRx-43 341.75 ± 6% +63.6% 559.25 ± 8% interrupts.174:PCI-MSI.1574956-edge.eth3-TxRx-44 377.25 ± 18% +48.3% 559.50 ± 8% interrupts.176:PCI-MSI.1574958-edge.eth3-TxRx-46 336.50 ± 6% +66.3% 559.75 ± 8% interrupts.177:PCI-MSI.1574959-edge.eth3-TxRx-47 339.25 ± 6% +82.2% 618.00 ± 19% interrupts.178:PCI-MSI.1574960-edge.eth3-TxRx-48 336.50 ± 6% +67.8% 564.50 ± 8% interrupts.179:PCI-MSI.1574961-edge.eth3-TxRx-49 336.50 ± 6% +66.3% 559.50 ± 8% interrupts.180:PCI-MSI.1574962-edge.eth3-TxRx-50 336.25 ± 6% +66.3% 559.25 ± 8% interrupts.181:PCI-MSI.1574963-edge.eth3-TxRx-51 341.00 ± 6% +65.0% 562.50 ± 8% interrupts.182:PCI-MSI.1574964-edge.eth3-TxRx-52 338.75 ± 5% +66.0% 562.25 ± 8% interrupts.183:PCI-MSI.1574965-edge.eth3-TxRx-53 336.50 ± 6% +67.6% 564.00 ± 8% interrupts.184:PCI-MSI.1574966-edge.eth3-TxRx-54 336.50 ± 6% +66.7% 561.00 ± 8% interrupts.185:PCI-MSI.1574967-edge.eth3-TxRx-55 360.50 ± 11% +56.0% 562.25 ± 8% interrupts.186:PCI-MSI.1574968-edge.eth3-TxRx-56 336.50 ± 6% +66.9% 561.50 ± 7% interrupts.187:PCI-MSI.1574969-edge.eth3-TxRx-57 337.00 ± 6% +66.2% 560.00 ± 8% interrupts.188:PCI-MSI.1574970-edge.eth3-TxRx-58 336.75 ± 6% +66.5% 560.75 ± 8% interrupts.189:PCI-MSI.1574971-edge.eth3-TxRx-59 336.50 ± 6% +66.3% 559.75 ± 8% interrupts.190:PCI-MSI.1574972-edge.eth3-TxRx-60 336.25 ± 6% +66.4% 559.50 ± 8% interrupts.191:PCI-MSI.1574973-edge.eth3-TxRx-61 336.00 ± 6% +67.6% 563.00 ± 8% interrupts.192:PCI-MSI.1574974-edge.eth3-TxRx-62 1084415 ± 2% +87.7% 2035975 ± 9% interrupts.CAL:Function_call_interrupts 5674 ± 2% +79.4% 10178 ± 10% interrupts.CPU0.CAL:Function_call_interrupts 1339243 ± 9% +64.7% 2205626 ± 8% interrupts.CPU0.LOC:Local_timer_interrupts 956273 ± 34% -96.9% 29526 ± 24% interrupts.CPU0.RES:Rescheduling_interrupts 12.25 ± 24% +1581.6% 206.00 ± 46% interrupts.CPU0.TLB:TLB_shootdowns 371.00 ± 5% +108.6% 773.75 ± 31% interrupts.CPU1.131:PCI-MSI.1574913-edge.eth3-TxRx-1 5647 ± 2% +87.4% 10584 ± 9% interrupts.CPU1.CAL:Function_call_interrupts 1337359 ± 9% +64.7% 2202495 ± 8% interrupts.CPU1.LOC:Local_timer_interrupts 737858 ± 23% -95.5% 33112 ± 30% interrupts.CPU1.RES:Rescheduling_interrupts 15.75 ± 39% +793.7% 140.75 ± 45% interrupts.CPU1.TLB:TLB_shootdowns 354.25 ± 6% +74.1% 616.75 ± 10% interrupts.CPU10.140:PCI-MSI.1574922-edge.eth3-TxRx-10 5401 ± 3% +96.8% 10628 ± 9% interrupts.CPU10.CAL:Function_call_interrupts 1336653 ± 9% +64.7% 2201299 ± 8% interrupts.CPU10.LOC:Local_timer_interrupts 708938 ± 23% -97.2% 19525 ± 32% interrupts.CPU10.RES:Rescheduling_interrupts 16.25 ± 52% +376.9% 77.50 ± 37% interrupts.CPU10.TLB:TLB_shootdowns 5633 ± 3% +81.7% 10235 ± 11% interrupts.CPU100.CAL:Function_call_interrupts 1337590 ± 9% +64.6% 2201301 ± 8% interrupts.CPU100.LOC:Local_timer_interrupts 689007 ± 25% -97.0% 20368 ± 15% interrupts.CPU100.RES:Rescheduling_interrupts 13.00 ± 9% +600.0% 91.00 ± 36% interrupts.CPU100.TLB:TLB_shootdowns 5662 ± 3% +89.9% 10751 ± 7% interrupts.CPU101.CAL:Function_call_interrupts 1337477 ± 9% +64.7% 2202244 ± 8% interrupts.CPU101.LOC:Local_timer_interrupts 707657 ± 20% -96.5% 24748 ± 35% interrupts.CPU101.RES:Rescheduling_interrupts 10.25 ± 22% +709.8% 83.00 ± 42% interrupts.CPU101.TLB:TLB_shootdowns 5641 ± 3% +88.2% 10615 ± 9% interrupts.CPU102.CAL:Function_call_interrupts 1336519 ± 9% +64.8% 2202176 ± 8% interrupts.CPU102.LOC:Local_timer_interrupts 679814 ± 23% -96.9% 21380 ± 6% interrupts.CPU102.RES:Rescheduling_interrupts 11.75 ± 24% +591.5% 81.25 ± 47% interrupts.CPU102.TLB:TLB_shootdowns 5624 +89.3% 10644 ± 10% interrupts.CPU103.CAL:Function_call_interrupts 1337163 ± 9% +64.7% 2201928 ± 8% interrupts.CPU103.LOC:Local_timer_interrupts 703098 ± 26% -96.0% 28037 ± 43% interrupts.CPU103.RES:Rescheduling_interrupts 13.50 ± 21% +540.7% 86.50 ± 27% interrupts.CPU103.TLB:TLB_shootdowns 5606 ± 3% +91.9% 10757 ± 9% interrupts.CPU104.CAL:Function_call_interrupts 1336621 ± 9% +64.7% 2201690 ± 8% interrupts.CPU104.LOC:Local_timer_interrupts 667864 ± 23% -96.8% 21254 ± 26% interrupts.CPU104.RES:Rescheduling_interrupts 9.50 ± 31% +884.2% 93.50 ± 28% interrupts.CPU104.TLB:TLB_shootdowns 5518 ± 6% +91.9% 10590 ± 9% interrupts.CPU105.CAL:Function_call_interrupts 1350188 ± 8% +63.1% 2201982 ± 8% interrupts.CPU105.LOC:Local_timer_interrupts 720641 ± 21% -95.4% 32867 ± 48% interrupts.CPU105.RES:Rescheduling_interrupts 14.50 ± 14% +556.9% 95.25 ± 45% interrupts.CPU105.TLB:TLB_shootdowns 5666 ± 2% +87.8% 10642 ± 9% interrupts.CPU106.CAL:Function_call_interrupts 1336805 ± 9% +64.7% 2202035 ± 8% interrupts.CPU106.LOC:Local_timer_interrupts 674845 ± 21% -97.1% 19821 ± 29% interrupts.CPU106.RES:Rescheduling_interrupts 10.75 ± 40% +825.6% 99.50 ± 38% interrupts.CPU106.TLB:TLB_shootdowns 5680 ± 2% +85.9% 10557 ± 9% interrupts.CPU107.CAL:Function_call_interrupts 1336948 ± 9% +64.7% 2202238 ± 8% interrupts.CPU107.LOC:Local_timer_interrupts 717783 ± 23% -95.5% 32091 ± 41% interrupts.CPU107.RES:Rescheduling_interrupts 8.75 ± 39% +954.3% 92.25 ± 44% interrupts.CPU107.TLB:TLB_shootdowns 5683 ± 2% +86.9% 10622 ± 9% interrupts.CPU108.CAL:Function_call_interrupts 1336656 ± 9% +64.9% 2203613 ± 8% interrupts.CPU108.LOC:Local_timer_interrupts 730211 ± 24% -97.5% 17988 ± 6% interrupts.CPU108.RES:Rescheduling_interrupts 9.75 ± 22% +800.0% 87.75 ± 33% interrupts.CPU108.TLB:TLB_shootdowns 5497 ± 6% +93.0% 10611 ± 9% interrupts.CPU109.CAL:Function_call_interrupts 1351259 ± 8% +63.0% 2202164 ± 8% interrupts.CPU109.LOC:Local_timer_interrupts 732083 ± 24% -97.3% 20113 ± 11% interrupts.CPU109.RES:Rescheduling_interrupts 9.25 ± 14% +1018.9% 103.50 ± 52% interrupts.CPU109.TLB:TLB_shootdowns 5437 ± 3% +94.4% 10571 ± 10% interrupts.CPU11.CAL:Function_call_interrupts 1337527 ± 9% +64.7% 2202871 ± 8% interrupts.CPU11.LOC:Local_timer_interrupts 707362 ± 21% -97.3% 19191 ± 13% interrupts.CPU11.RES:Rescheduling_interrupts 14.75 ± 49% +406.8% 74.75 ± 42% interrupts.CPU11.TLB:TLB_shootdowns 5595 ± 3% +88.3% 10539 ± 9% interrupts.CPU110.CAL:Function_call_interrupts 1337218 ± 9% +64.7% 2202916 ± 8% interrupts.CPU110.LOC:Local_timer_interrupts 723696 ± 23% -96.6% 24462 ± 29% interrupts.CPU110.RES:Rescheduling_interrupts 10.50 ± 28% +931.0% 108.25 ± 48% interrupts.CPU110.TLB:TLB_shootdowns 5582 ± 3% +91.1% 10667 ± 9% interrupts.CPU111.CAL:Function_call_interrupts 1336615 ± 9% +64.7% 2201702 ± 8% interrupts.CPU111.LOC:Local_timer_interrupts 681341 ± 21% -97.6% 16503 ± 14% interrupts.CPU111.RES:Rescheduling_interrupts 10.00 ± 32% +1032.5% 113.25 ± 36% interrupts.CPU111.TLB:TLB_shootdowns 5453 ± 6% +95.7% 10673 ± 9% interrupts.CPU112.CAL:Function_call_interrupts 1349870 ± 8% +63.1% 2202148 ± 8% interrupts.CPU112.LOC:Local_timer_interrupts 687757 ± 23% -97.4% 17894 ± 24% interrupts.CPU112.RES:Rescheduling_interrupts 8.75 ± 14% +1705.7% 158.00 ± 47% interrupts.CPU112.TLB:TLB_shootdowns 5595 ± 3% +75.8% 9837 ± 8% interrupts.CPU113.CAL:Function_call_interrupts 1336607 ± 9% +64.9% 2203825 ± 8% interrupts.CPU113.LOC:Local_timer_interrupts 693461 ± 24% -95.7% 29768 ± 38% interrupts.CPU113.RES:Rescheduling_interrupts 10.75 ± 24% +1590.7% 181.75 ± 52% interrupts.CPU113.TLB:TLB_shootdowns 5586 ± 3% +89.7% 10595 ± 8% interrupts.CPU114.CAL:Function_call_interrupts 1336887 ± 9% +64.8% 2202815 ± 8% interrupts.CPU114.LOC:Local_timer_interrupts 700347 ± 25% -97.0% 21301 ± 44% interrupts.CPU114.RES:Rescheduling_interrupts 10.00 ± 38% +1527.5% 162.75 ± 47% interrupts.CPU114.TLB:TLB_shootdowns 5653 ± 2% +89.2% 10693 ± 9% interrupts.CPU115.CAL:Function_call_interrupts 1336031 ± 9% +64.8% 2202194 ± 8% interrupts.CPU115.LOC:Local_timer_interrupts 704469 ± 21% -97.1% 20411 ± 15% interrupts.CPU115.RES:Rescheduling_interrupts 13.25 ± 14% +1477.4% 209.00 ± 39% interrupts.CPU115.TLB:TLB_shootdowns 5632 ± 2% +82.5% 10280 ± 10% interrupts.CPU116.CAL:Function_call_interrupts 1335630 ± 9% +65.0% 2203792 ± 8% interrupts.CPU116.LOC:Local_timer_interrupts 722709 ± 24% -97.5% 17887 ± 15% interrupts.CPU116.RES:Rescheduling_interrupts 12.00 ± 22% +1860.4% 235.25 ± 59% interrupts.CPU116.TLB:TLB_shootdowns 5531 +91.3% 10582 ± 9% interrupts.CPU117.CAL:Function_call_interrupts 1336090 ± 9% +64.8% 2201800 ± 8% interrupts.CPU117.LOC:Local_timer_interrupts 668326 ± 25% -96.9% 20433 ± 14% interrupts.CPU117.RES:Rescheduling_interrupts 14.00 ± 13% +2782.1% 403.50 ± 50% interrupts.CPU117.TLB:TLB_shootdowns 5639 ± 2% +87.9% 10596 ± 9% interrupts.CPU118.CAL:Function_call_interrupts 1335273 ± 9% +64.8% 2200654 ± 8% interrupts.CPU118.LOC:Local_timer_interrupts 707837 ± 25% -97.2% 19977 ± 9% interrupts.CPU118.RES:Rescheduling_interrupts 10.00 ± 46% +6542.5% 664.25 ± 49% interrupts.CPU118.TLB:TLB_shootdowns 5590 ± 3% +82.9% 10228 ± 11% interrupts.CPU119.CAL:Function_call_interrupts 1335798 ± 9% +64.9% 2203338 ± 8% interrupts.CPU119.LOC:Local_timer_interrupts 709553 ± 28% -96.3% 25916 ± 44% interrupts.CPU119.RES:Rescheduling_interrupts 15.25 ± 17% +11609.8% 1785 ± 38% interrupts.CPU119.TLB:TLB_shootdowns 5591 ± 4% +89.3% 10586 ± 9% interrupts.CPU12.CAL:Function_call_interrupts 1336900 ± 9% +64.8% 2203014 ± 8% interrupts.CPU12.LOC:Local_timer_interrupts 730041 ± 25% -97.4% 18784 ± 6% interrupts.CPU12.RES:Rescheduling_interrupts 9.75 ± 35% +664.1% 74.50 ± 50% interrupts.CPU12.TLB:TLB_shootdowns 5648 ± 2% +88.5% 10646 ± 9% interrupts.CPU120.CAL:Function_call_interrupts 1339596 ± 9% +64.6% 2204777 ± 8% interrupts.CPU120.LOC:Local_timer_interrupts 649118 ± 32% -97.3% 17718 ± 11% interrupts.CPU120.RES:Rescheduling_interrupts 9.25 ± 46% +770.3% 80.50 ± 42% interrupts.CPU120.TLB:TLB_shootdowns 5654 ± 3% +88.6% 10663 ± 9% interrupts.CPU121.CAL:Function_call_interrupts 1336850 ± 9% +64.7% 2202003 ± 8% interrupts.CPU121.LOC:Local_timer_interrupts 659588 ± 32% -97.4% 17073 ± 19% interrupts.CPU121.RES:Rescheduling_interrupts 10.50 ± 36% +685.7% 82.50 ± 31% interrupts.CPU121.TLB:TLB_shootdowns 5717 ± 2% +87.7% 10729 ± 9% interrupts.CPU122.CAL:Function_call_interrupts 1337391 ± 9% +64.7% 2202632 ± 8% interrupts.CPU122.LOC:Local_timer_interrupts 659442 ± 34% -96.9% 20392 ± 29% interrupts.CPU122.RES:Rescheduling_interrupts 8.75 ± 20% +805.7% 79.25 ± 48% interrupts.CPU122.TLB:TLB_shootdowns 5708 ± 2% +87.5% 10703 ± 9% interrupts.CPU123.CAL:Function_call_interrupts 1337866 ± 9% +64.7% 2203757 ± 8% interrupts.CPU123.LOC:Local_timer_interrupts 619597 ± 31% -96.2% 23263 ± 26% interrupts.CPU123.RES:Rescheduling_interrupts 11.00 ± 34% +756.8% 94.25 ± 50% interrupts.CPU123.TLB:TLB_shootdowns 5682 ± 2% +88.5% 10711 ± 9% interrupts.CPU124.CAL:Function_call_interrupts 1338075 ± 9% +64.6% 2202688 ± 8% interrupts.CPU124.LOC:Local_timer_interrupts 624507 ± 29% -96.1% 24572 ± 37% interrupts.CPU124.RES:Rescheduling_interrupts 11.75 ± 40% +695.7% 93.50 ± 35% interrupts.CPU124.TLB:TLB_shootdowns 5681 +88.6% 10717 ± 9% interrupts.CPU125.CAL:Function_call_interrupts 1337537 ± 9% +64.8% 2203692 ± 8% interrupts.CPU125.LOC:Local_timer_interrupts 624748 ± 27% -96.6% 21339 ± 43% interrupts.CPU125.RES:Rescheduling_interrupts 11.75 ± 28% +727.7% 97.25 ± 49% interrupts.CPU125.TLB:TLB_shootdowns 5605 ± 3% +90.6% 10687 ± 9% interrupts.CPU126.CAL:Function_call_interrupts 1336953 ± 9% +64.8% 2203764 ± 8% interrupts.CPU126.LOC:Local_timer_interrupts 631463 ± 29% -96.8% 20200 ± 33% interrupts.CPU126.RES:Rescheduling_interrupts 9.75 ± 15% +782.1% 86.00 ± 39% interrupts.CPU126.TLB:TLB_shootdowns 5654 ± 3% +89.5% 10713 ± 9% interrupts.CPU127.CAL:Function_call_interrupts 1336539 ± 9% +64.8% 2202772 ± 8% interrupts.CPU127.LOC:Local_timer_interrupts 668278 ± 31% -97.4% 17090 ± 20% interrupts.CPU127.RES:Rescheduling_interrupts 11.00 ± 34% +670.5% 84.75 ± 40% interrupts.CPU127.TLB:TLB_shootdowns 5700 ± 2% +87.8% 10706 ± 9% interrupts.CPU128.CAL:Function_call_interrupts 1336901 ± 9% +64.8% 2202590 ± 8% interrupts.CPU128.LOC:Local_timer_interrupts 649687 ± 32% -96.9% 19878 ± 32% interrupts.CPU128.RES:Rescheduling_interrupts 13.75 ± 33% +592.7% 95.25 ± 59% interrupts.CPU128.TLB:TLB_shootdowns 5683 ± 3% +81.3% 10302 ± 11% interrupts.CPU129.CAL:Function_call_interrupts 1338193 ± 9% +64.6% 2203279 ± 8% interrupts.CPU129.LOC:Local_timer_interrupts 606637 ± 34% -97.4% 15906 ± 13% interrupts.CPU129.RES:Rescheduling_interrupts 13.75 ± 24% +514.5% 84.50 ± 40% interrupts.CPU129.TLB:TLB_shootdowns 475.75 ± 41% +107.6% 987.50 ± 20% interrupts.CPU13.143:PCI-MSI.1574925-edge.eth3-TxRx-13 5621 ± 3% +88.5% 10598 ± 9% interrupts.CPU13.CAL:Function_call_interrupts 1338157 ± 9% +64.6% 2202986 ± 8% interrupts.CPU13.LOC:Local_timer_interrupts 723210 ± 24% -97.2% 20517 ± 12% interrupts.CPU13.RES:Rescheduling_interrupts 12.50 ± 39% +520.0% 77.50 ± 33% interrupts.CPU13.TLB:TLB_shootdowns 5683 ± 2% +88.4% 10709 ± 9% interrupts.CPU130.CAL:Function_call_interrupts 1336929 ± 9% +64.8% 2203225 ± 8% interrupts.CPU130.LOC:Local_timer_interrupts 601381 ± 26% -97.0% 18168 ± 17% interrupts.CPU130.RES:Rescheduling_interrupts 10.75 ± 43% +869.8% 104.25 ± 56% interrupts.CPU130.TLB:TLB_shootdowns 5685 ± 2% +87.8% 10676 ± 10% interrupts.CPU131.CAL:Function_call_interrupts 1337061 ± 9% +64.7% 2202697 ± 8% interrupts.CPU131.LOC:Local_timer_interrupts 618621 ± 30% -96.6% 20952 ± 20% interrupts.CPU131.RES:Rescheduling_interrupts 9.00 ± 30% +1094.4% 107.50 ± 71% interrupts.CPU131.TLB:TLB_shootdowns 5670 ± 3% +88.2% 10673 ± 9% interrupts.CPU132.CAL:Function_call_interrupts 1336474 ± 9% +64.9% 2203424 ± 8% interrupts.CPU132.LOC:Local_timer_interrupts 623188 ± 27% -97.6% 14890 ± 13% interrupts.CPU132.RES:Rescheduling_interrupts 12.00 ± 30% +727.1% 99.25 ± 40% interrupts.CPU132.TLB:TLB_shootdowns 5667 ± 3% +89.5% 10741 ± 9% interrupts.CPU133.CAL:Function_call_interrupts 1337221 ± 9% +64.6% 2201613 ± 8% interrupts.CPU133.LOC:Local_timer_interrupts 585124 ± 33% -97.4% 15216 ± 13% interrupts.CPU133.RES:Rescheduling_interrupts 8.00 ± 45% +1168.8% 101.50 ± 35% interrupts.CPU133.TLB:TLB_shootdowns 5690 ± 3% +88.4% 10717 ± 9% interrupts.CPU134.CAL:Function_call_interrupts 1336931 ± 9% +64.8% 2203383 ± 8% interrupts.CPU134.LOC:Local_timer_interrupts 623267 ± 28% -96.6% 21377 ± 38% interrupts.CPU134.RES:Rescheduling_interrupts 13.00 ± 44% +913.5% 131.75 ± 50% interrupts.CPU134.TLB:TLB_shootdowns 5677 ± 3% +89.3% 10750 ± 9% interrupts.CPU135.CAL:Function_call_interrupts 1336777 ± 9% +64.8% 2203268 ± 8% interrupts.CPU135.LOC:Local_timer_interrupts 659089 ± 34% -97.4% 17314 ± 4% interrupts.CPU135.RES:Rescheduling_interrupts 11.00 ± 36% +1011.4% 122.25 ± 57% interrupts.CPU135.TLB:TLB_shootdowns 5671 ± 3% +90.1% 10781 ± 9% interrupts.CPU136.CAL:Function_call_interrupts 1337077 ± 9% +64.8% 2204095 ± 8% interrupts.CPU136.LOC:Local_timer_interrupts 659015 ± 32% -97.5% 16317 ± 17% interrupts.CPU136.RES:Rescheduling_interrupts 11.25 ± 19% +968.9% 120.25 ± 59% interrupts.CPU136.TLB:TLB_shootdowns 5662 ± 3% +90.2% 10768 ± 9% interrupts.CPU137.CAL:Function_call_interrupts 1337041 ± 9% +64.8% 2202909 ± 8% interrupts.CPU137.LOC:Local_timer_interrupts 609841 ± 30% -97.1% 17397 ± 16% interrupts.CPU137.RES:Rescheduling_interrupts 7.00 ± 41% +1996.4% 146.75 ± 69% interrupts.CPU137.TLB:TLB_shootdowns 5663 ± 3% +89.4% 10727 ± 9% interrupts.CPU138.CAL:Function_call_interrupts 1337025 ± 9% +64.6% 2201160 ± 8% interrupts.CPU138.LOC:Local_timer_interrupts 668683 ± 33% -97.5% 16409 ± 20% interrupts.CPU138.RES:Rescheduling_interrupts 10.00 ± 46% +1840.0% 194.00 ± 58% interrupts.CPU138.TLB:TLB_shootdowns 5700 ± 2% +87.2% 10670 ± 9% interrupts.CPU139.CAL:Function_call_interrupts 1342967 ± 8% +64.1% 2203939 ± 8% interrupts.CPU139.LOC:Local_timer_interrupts 658639 ± 30% -97.6% 15804 ± 23% interrupts.CPU139.RES:Rescheduling_interrupts 11.75 ± 43% +1557.4% 194.75 ± 54% interrupts.CPU139.TLB:TLB_shootdowns 5562 ± 4% +90.9% 10620 ± 9% interrupts.CPU14.CAL:Function_call_interrupts 1336278 ± 9% +64.8% 2202626 ± 8% interrupts.CPU14.LOC:Local_timer_interrupts 699903 ± 22% -97.3% 18692 ± 9% interrupts.CPU14.RES:Rescheduling_interrupts 5634 ± 2% +89.7% 10686 ± 9% interrupts.CPU140.CAL:Function_call_interrupts 1335391 ± 9% +65.0% 2203139 ± 8% interrupts.CPU140.LOC:Local_timer_interrupts 644124 ± 30% -97.7% 15074 ± 24% interrupts.CPU140.RES:Rescheduling_interrupts 7.75 ± 19% +3758.1% 299.00 ± 67% interrupts.CPU140.TLB:TLB_shootdowns 5660 ± 2% +88.2% 10653 ± 9% interrupts.CPU141.CAL:Function_call_interrupts 1336469 ± 9% +64.9% 2203203 ± 8% interrupts.CPU141.LOC:Local_timer_interrupts 638272 ± 32% -97.6% 15148 ± 6% interrupts.CPU141.RES:Rescheduling_interrupts 10.50 ± 43% +3200.0% 346.50 ± 63% interrupts.CPU141.TLB:TLB_shootdowns 5649 ± 3% +89.2% 10686 ± 9% interrupts.CPU142.CAL:Function_call_interrupts 1339006 ± 9% +64.5% 2202897 ± 8% interrupts.CPU142.LOC:Local_timer_interrupts 662319 ± 32% -97.4% 17378 ± 21% interrupts.CPU142.RES:Rescheduling_interrupts 8.50 ± 31% +7667.6% 660.25 ± 56% interrupts.CPU142.TLB:TLB_shootdowns 5651 ± 3% +89.4% 10703 ± 9% interrupts.CPU143.CAL:Function_call_interrupts 1336380 ± 9% +64.8% 2202606 ± 8% interrupts.CPU143.LOC:Local_timer_interrupts 650131 ± 31% -96.7% 21375 ± 18% interrupts.CPU143.RES:Rescheduling_interrupts 13.25 ± 46% +13549.1% 1808 ± 56% interrupts.CPU143.TLB:TLB_shootdowns 5699 ± 2% +87.1% 10662 ± 9% interrupts.CPU144.CAL:Function_call_interrupts 1337788 ± 9% +66.3% 2224917 ± 7% interrupts.CPU144.LOC:Local_timer_interrupts 647082 ± 10% -96.3% 23675 ± 13% interrupts.CPU144.RES:Rescheduling_interrupts 11.25 ± 45% +504.4% 68.00 ± 30% interrupts.CPU144.TLB:TLB_shootdowns 5714 ± 2% +86.1% 10634 ± 9% interrupts.CPU145.CAL:Function_call_interrupts 1335862 ± 9% +66.6% 2225857 ± 7% interrupts.CPU145.LOC:Local_timer_interrupts 675314 ± 7% -97.0% 19936 ± 17% interrupts.CPU145.RES:Rescheduling_interrupts 5517 ± 6% +92.3% 10609 ± 9% interrupts.CPU146.CAL:Function_call_interrupts 1348778 ± 8% +64.8% 2223237 ± 7% interrupts.CPU146.LOC:Local_timer_interrupts 652291 ± 6% -97.0% 19365 ± 12% interrupts.CPU146.RES:Rescheduling_interrupts 8.25 ± 34% +924.2% 84.50 ± 26% interrupts.CPU146.TLB:TLB_shootdowns 5708 ± 2% +81.3% 10351 ± 14% interrupts.CPU147.CAL:Function_call_interrupts 1336177 ± 9% +66.7% 2227670 ± 7% interrupts.CPU147.LOC:Local_timer_interrupts 668107 ± 10% -97.2% 19018 ± 18% interrupts.CPU147.RES:Rescheduling_interrupts 5649 ± 2% +88.1% 10625 ± 9% interrupts.CPU148.CAL:Function_call_interrupts 1335249 ± 9% +66.7% 2225833 ± 7% interrupts.CPU148.LOC:Local_timer_interrupts 675540 ± 3% -97.1% 19826 ± 25% interrupts.CPU148.RES:Rescheduling_interrupts 10.75 ± 35% +688.4% 84.75 ± 54% interrupts.CPU148.TLB:TLB_shootdowns 5687 ± 2% +81.6% 10324 ± 14% interrupts.CPU149.CAL:Function_call_interrupts 1335805 ± 9% +66.5% 2223973 ± 7% interrupts.CPU149.LOC:Local_timer_interrupts 684677 ± 7% -97.6% 16256 ± 8% interrupts.CPU149.RES:Rescheduling_interrupts 5.75 ± 72% +1195.7% 74.50 ± 23% interrupts.CPU149.TLB:TLB_shootdowns 5525 ± 5% +92.6% 10640 ± 9% interrupts.CPU15.CAL:Function_call_interrupts 1336688 ± 9% +64.7% 2200988 ± 8% interrupts.CPU15.LOC:Local_timer_interrupts 704484 ± 22% -96.5% 24646 ± 57% interrupts.CPU15.RES:Rescheduling_interrupts 5718 ± 2% +85.2% 10593 ± 9% interrupts.CPU150.CAL:Function_call_interrupts 1334989 ± 9% +66.8% 2226150 ± 7% interrupts.CPU150.LOC:Local_timer_interrupts 681028 ± 6% -97.5% 17306 ± 23% interrupts.CPU150.RES:Rescheduling_interrupts 5677 ± 2% +88.1% 10678 ± 9% interrupts.CPU151.CAL:Function_call_interrupts 1334972 ± 9% +66.7% 2226007 ± 7% interrupts.CPU151.LOC:Local_timer_interrupts 676282 ± 5% -97.5% 17098 ± 22% interrupts.CPU151.RES:Rescheduling_interrupts 7.25 ± 63% +1224.1% 96.00 ± 36% interrupts.CPU151.TLB:TLB_shootdowns 5750 ± 3% +86.0% 10695 ± 9% interrupts.CPU152.CAL:Function_call_interrupts 1335376 ± 9% +66.7% 2225544 ± 7% interrupts.CPU152.LOC:Local_timer_interrupts 650083 ± 14% -97.0% 19568 ± 12% interrupts.CPU152.RES:Rescheduling_interrupts 9.25 ± 46% +821.6% 85.25 ± 40% interrupts.CPU152.TLB:TLB_shootdowns 5727 ± 2% +85.9% 10648 ± 9% interrupts.CPU153.CAL:Function_call_interrupts 1335465 ± 9% +66.7% 2226869 ± 7% interrupts.CPU153.LOC:Local_timer_interrupts 674531 ± 6% -96.8% 21703 ± 37% interrupts.CPU153.RES:Rescheduling_interrupts 11.75 ± 44% +514.9% 72.25 ± 53% interrupts.CPU153.TLB:TLB_shootdowns 5498 ± 5% +93.5% 10638 ± 9% interrupts.CPU154.CAL:Function_call_interrupts 1350870 ± 8% +64.6% 2222919 ± 7% interrupts.CPU154.LOC:Local_timer_interrupts 660468 ± 7% -96.9% 20530 ± 17% interrupts.CPU154.RES:Rescheduling_interrupts 5.25 ± 56% +1395.2% 78.50 ± 57% interrupts.CPU154.TLB:TLB_shootdowns 5611 ± 3% +89.5% 10635 ± 9% interrupts.CPU155.CAL:Function_call_interrupts 1336411 ± 9% +66.4% 2223648 ± 7% interrupts.CPU155.LOC:Local_timer_interrupts 650931 ± 5% -97.0% 19736 ± 31% interrupts.CPU155.RES:Rescheduling_interrupts 10.50 ± 68% +840.5% 98.75 ± 49% interrupts.CPU155.TLB:TLB_shootdowns 5749 ± 2% +83.6% 10556 ± 9% interrupts.CPU156.CAL:Function_call_interrupts 1337118 ± 9% +66.5% 2226200 ± 7% interrupts.CPU156.LOC:Local_timer_interrupts 630431 ± 13% -96.2% 23790 ± 13% interrupts.CPU156.RES:Rescheduling_interrupts 8.25 ± 60% +848.5% 78.25 ± 50% interrupts.CPU156.TLB:TLB_shootdowns 5743 ± 2% +85.4% 10649 ± 9% interrupts.CPU157.CAL:Function_call_interrupts 1336259 ± 9% +66.5% 2225381 ± 7% interrupts.CPU157.LOC:Local_timer_interrupts 676910 ± 6% -97.2% 18706 ± 22% interrupts.CPU157.RES:Rescheduling_interrupts 8.50 ± 60% +902.9% 85.25 ± 62% interrupts.CPU157.TLB:TLB_shootdowns 5728 ± 2% +86.5% 10685 ± 9% interrupts.CPU158.CAL:Function_call_interrupts 1335660 ± 9% +66.6% 2224568 ± 7% interrupts.CPU158.LOC:Local_timer_interrupts 3972 ± 38% +56.9% 6233 ± 3% interrupts.CPU158.NMI:Non-maskable_interrupts 3972 ± 38% +56.9% 6233 ± 3% interrupts.CPU158.PMI:Performance_monitoring_interrupts 623360 ± 6% -97.4% 16354 ± 26% interrupts.CPU158.RES:Rescheduling_interrupts 12.25 ± 24% +608.2% 86.75 ± 53% interrupts.CPU158.TLB:TLB_shootdowns 5737 ± 3% +86.5% 10702 ± 9% interrupts.CPU159.CAL:Function_call_interrupts 1336068 ± 9% +66.6% 2225690 ± 7% interrupts.CPU159.LOC:Local_timer_interrupts 3360 ± 43% +86.5% 6266 ± 5% interrupts.CPU159.NMI:Non-maskable_interrupts 3360 ± 43% +86.5% 6266 ± 5% interrupts.CPU159.PMI:Performance_monitoring_interrupts 660967 ± 10% -97.7% 15332 ± 14% interrupts.CPU159.RES:Rescheduling_interrupts 7.75 ± 45% +1016.1% 86.50 ± 52% interrupts.CPU159.TLB:TLB_shootdowns 338.00 ± 6% +66.1% 561.25 ± 8% interrupts.CPU16.146:PCI-MSI.1574928-edge.eth3-TxRx-16 5668 ± 2% +86.3% 10560 ± 9% interrupts.CPU16.CAL:Function_call_interrupts 1338086 ± 9% +64.6% 2202242 ± 8% interrupts.CPU16.LOC:Local_timer_interrupts 666619 ± 23% -96.4% 24269 ± 44% interrupts.CPU16.RES:Rescheduling_interrupts 12.75 ± 31% +494.1% 75.75 ± 33% interrupts.CPU16.TLB:TLB_shootdowns 5629 ± 3% +90.2% 10705 ± 9% interrupts.CPU160.CAL:Function_call_interrupts 1334922 ± 9% +66.7% 2225170 ± 7% interrupts.CPU160.LOC:Local_timer_interrupts 3337 ± 43% +84.7% 6164 ± 4% interrupts.CPU160.NMI:Non-maskable_interrupts 3337 ± 43% +84.7% 6164 ± 4% interrupts.CPU160.PMI:Performance_monitoring_interrupts 633414 ± 8% -97.3% 17328 ± 12% interrupts.CPU160.RES:Rescheduling_interrupts 9.75 ± 57% +871.8% 94.75 ± 82% interrupts.CPU160.TLB:TLB_shootdowns 5709 ± 3% +86.3% 10636 ± 9% interrupts.CPU161.CAL:Function_call_interrupts 1336154 ± 9% +66.4% 2223675 ± 7% interrupts.CPU161.LOC:Local_timer_interrupts 653493 ± 9% -97.5% 16011 ± 12% interrupts.CPU161.RES:Rescheduling_interrupts 11.00 ± 64% +781.8% 97.00 ± 69% interrupts.CPU161.TLB:TLB_shootdowns 5689 ± 2% +87.7% 10680 ± 9% interrupts.CPU162.CAL:Function_call_interrupts 1335909 ± 9% +66.6% 2225599 ± 7% interrupts.CPU162.LOC:Local_timer_interrupts 3338 ± 44% +85.6% 6197 ± 4% interrupts.CPU162.NMI:Non-maskable_interrupts 3338 ± 44% +85.6% 6197 ± 4% interrupts.CPU162.PMI:Performance_monitoring_interrupts 654660 ± 11% -97.2% 18424 ± 22% interrupts.CPU162.RES:Rescheduling_interrupts 10.75 ± 67% +1174.4% 137.00 ± 96% interrupts.CPU162.TLB:TLB_shootdowns 5708 ± 2% +86.3% 10632 ± 9% interrupts.CPU163.CAL:Function_call_interrupts 1335563 ± 9% +66.8% 2227961 ± 7% interrupts.CPU163.LOC:Local_timer_interrupts 638756 ± 10% -97.1% 18631 ± 29% interrupts.CPU163.RES:Rescheduling_interrupts 11.50 ± 35% +1169.6% 146.00 ±100% interrupts.CPU163.TLB:TLB_shootdowns 5735 ± 2% +86.0% 10665 ± 9% interrupts.CPU164.CAL:Function_call_interrupts 1335392 ± 9% +66.5% 2222954 ± 7% interrupts.CPU164.LOC:Local_timer_interrupts 642959 ± 6% -97.4% 16493 ± 15% interrupts.CPU164.RES:Rescheduling_interrupts 10.00 ± 21% +1720.0% 182.00 ± 98% interrupts.CPU164.TLB:TLB_shootdowns 5693 ± 2% +86.5% 10620 ± 9% interrupts.CPU165.CAL:Function_call_interrupts 1334518 ± 9% +66.8% 2225475 ± 7% interrupts.CPU165.LOC:Local_timer_interrupts 699566 ± 6% -97.1% 20540 ± 29% interrupts.CPU165.RES:Rescheduling_interrupts 10.25 ± 62% +2219.5% 237.75 ± 97% interrupts.CPU165.TLB:TLB_shootdowns 5689 ± 2% +85.5% 10552 ± 9% interrupts.CPU166.CAL:Function_call_interrupts 1335476 ± 9% +66.7% 2226263 ± 7% interrupts.CPU166.LOC:Local_timer_interrupts 671206 ± 3% -97.3% 17981 ± 12% interrupts.CPU166.RES:Rescheduling_interrupts 10.25 ± 61% +4248.8% 445.75 ± 90% interrupts.CPU166.TLB:TLB_shootdowns 5678 ± 3% +87.7% 10658 ± 9% interrupts.CPU167.CAL:Function_call_interrupts 1335468 ± 9% +66.6% 2224566 ± 7% interrupts.CPU167.LOC:Local_timer_interrupts 647560 ± 16% -96.6% 21943 ± 25% interrupts.CPU167.RES:Rescheduling_interrupts 5.75 ± 25% +21639.1% 1250 ± 82% interrupts.CPU167.TLB:TLB_shootdowns 5689 ± 2% +87.7% 10677 ± 9% interrupts.CPU168.CAL:Function_call_interrupts 1336036 ± 9% +67.0% 2230560 ± 9% interrupts.CPU168.LOC:Local_timer_interrupts 508671 ± 28% -95.9% 20638 ± 30% interrupts.CPU168.RES:Rescheduling_interrupts 10.75 ± 27% +795.3% 96.25 ± 43% interrupts.CPU168.TLB:TLB_shootdowns 5659 ± 2% +83.4% 10377 ± 8% interrupts.CPU169.CAL:Function_call_interrupts 1335763 ± 9% +67.0% 2231333 ± 9% interrupts.CPU169.LOC:Local_timer_interrupts 536179 ± 28% -95.8% 22604 ± 42% interrupts.CPU169.RES:Rescheduling_interrupts 6.75 ± 88% +1370.4% 99.25 ± 42% interrupts.CPU169.TLB:TLB_shootdowns 339.00 ± 5% +66.3% 563.75 ± 8% interrupts.CPU17.147:PCI-MSI.1574929-edge.eth3-TxRx-17 5606 ± 3% +89.4% 10616 ± 9% interrupts.CPU17.CAL:Function_call_interrupts 1336521 ± 9% +64.7% 2201845 ± 8% interrupts.CPU17.LOC:Local_timer_interrupts 704375 ± 27% -97.2% 19506 ± 7% interrupts.CPU17.RES:Rescheduling_interrupts 13.75 ± 38% +545.5% 88.75 ± 46% interrupts.CPU17.TLB:TLB_shootdowns 5674 ± 2% +88.8% 10712 ± 10% interrupts.CPU170.CAL:Function_call_interrupts 1336262 ± 9% +66.9% 2230272 ± 9% interrupts.CPU170.LOC:Local_timer_interrupts 512869 ± 26% -96.1% 20053 ± 38% interrupts.CPU170.RES:Rescheduling_interrupts 5582 +91.3% 10679 ± 10% interrupts.CPU171.CAL:Function_call_interrupts 1336042 ± 9% +66.8% 2228301 ± 9% interrupts.CPU171.LOC:Local_timer_interrupts 524082 ± 26% -96.6% 17835 ± 20% interrupts.CPU171.RES:Rescheduling_interrupts 6.50 ± 35% +1338.5% 93.50 ± 23% interrupts.CPU171.TLB:TLB_shootdowns 5691 ± 2% +87.6% 10677 ± 10% interrupts.CPU172.CAL:Function_call_interrupts 1336433 ± 9% +66.6% 2226840 ± 9% interrupts.CPU172.LOC:Local_timer_interrupts 497709 ± 26% -96.6% 17057 ± 7% interrupts.CPU172.RES:Rescheduling_interrupts 10.50 ± 45% +778.6% 92.25 ± 26% interrupts.CPU172.TLB:TLB_shootdowns 5691 ± 2% +87.2% 10655 ± 9% interrupts.CPU173.CAL:Function_call_interrupts 1337124 ± 9% +66.7% 2229062 ± 9% interrupts.CPU173.LOC:Local_timer_interrupts 511640 ± 25% -96.3% 18954 ± 48% interrupts.CPU173.RES:Rescheduling_interrupts 11.50 ± 49% +615.2% 82.25 ± 17% interrupts.CPU173.TLB:TLB_shootdowns 5659 ± 2% +88.1% 10643 ± 10% interrupts.CPU174.CAL:Function_call_interrupts 1337489 ± 9% +66.7% 2229313 ± 9% interrupts.CPU174.LOC:Local_timer_interrupts 509073 ± 24% -96.3% 18862 ± 16% interrupts.CPU174.RES:Rescheduling_interrupts 11.25 ± 33% +713.3% 91.50 ± 33% interrupts.CPU174.TLB:TLB_shootdowns 5620 ± 2% +89.9% 10675 ± 9% interrupts.CPU175.CAL:Function_call_interrupts 1336923 ± 9% +66.6% 2226887 ± 9% interrupts.CPU175.LOC:Local_timer_interrupts 516156 ± 28% -95.2% 24766 ± 39% interrupts.CPU175.RES:Rescheduling_interrupts 9.75 ± 81% +735.9% 81.50 ± 32% interrupts.CPU175.TLB:TLB_shootdowns 5664 +81.0% 10251 ± 6% interrupts.CPU176.CAL:Function_call_interrupts 1336831 ± 9% +66.7% 2228796 ± 9% interrupts.CPU176.LOC:Local_timer_interrupts 498965 ± 23% -96.6% 17117 ± 14% interrupts.CPU176.RES:Rescheduling_interrupts 6.25 ± 60% +1388.0% 93.00 ± 28% interrupts.CPU176.TLB:TLB_shootdowns 5652 ± 2% +89.6% 10715 ± 9% interrupts.CPU177.CAL:Function_call_interrupts 1336450 ± 9% +66.7% 2227847 ± 9% interrupts.CPU177.LOC:Local_timer_interrupts 546177 ± 34% -96.4% 19831 ± 15% interrupts.CPU177.RES:Rescheduling_interrupts 7.25 ± 52% +1134.5% 89.50 ± 11% interrupts.CPU177.TLB:TLB_shootdowns 5671 +87.6% 10642 ± 10% interrupts.CPU178.CAL:Function_call_interrupts 1336617 ± 9% +66.5% 2225579 ± 9% interrupts.CPU178.LOC:Local_timer_interrupts 511801 ± 24% -95.4% 23573 ± 58% interrupts.CPU178.RES:Rescheduling_interrupts 8.50 ± 41% +888.2% 84.00 ± 25% interrupts.CPU178.TLB:TLB_shootdowns 5636 ± 2% +89.1% 10656 ± 10% interrupts.CPU179.CAL:Function_call_interrupts 1339746 ± 9% +66.3% 2228467 ± 9% interrupts.CPU179.LOC:Local_timer_interrupts 521712 ± 28% -96.5% 18222 ± 25% interrupts.CPU179.RES:Rescheduling_interrupts 9.00 ± 45% +950.0% 94.50 ± 34% interrupts.CPU179.TLB:TLB_shootdowns 336.00 ± 6% +91.7% 644.00 ± 26% interrupts.CPU18.148:PCI-MSI.1574930-edge.eth3-TxRx-18 5627 ± 2% +88.3% 10598 ± 10% interrupts.CPU18.CAL:Function_call_interrupts 1336878 ± 9% +64.7% 2202104 ± 8% interrupts.CPU18.LOC:Local_timer_interrupts 711780 ± 24% -96.4% 25643 ± 40% interrupts.CPU18.RES:Rescheduling_interrupts 15.50 ± 7% +422.6% 81.00 ± 32% interrupts.CPU18.TLB:TLB_shootdowns 5684 ± 2% +88.3% 10701 ± 9% interrupts.CPU180.CAL:Function_call_interrupts 1336339 ± 9% +66.9% 2230201 ± 9% interrupts.CPU180.LOC:Local_timer_interrupts 503037 ± 23% -96.0% 20201 ± 24% interrupts.CPU180.RES:Rescheduling_interrupts 10.00 ± 15% +1032.5% 113.25 ± 47% interrupts.CPU180.TLB:TLB_shootdowns 5697 ± 2% +88.7% 10751 ± 9% interrupts.CPU181.CAL:Function_call_interrupts 1336266 ± 9% +66.7% 2228070 ± 9% interrupts.CPU181.LOC:Local_timer_interrupts 515136 ± 28% -96.9% 15820 ± 19% interrupts.CPU181.RES:Rescheduling_interrupts 9.50 ± 54% +1118.4% 115.75 ± 27% interrupts.CPU181.TLB:TLB_shootdowns 5673 ± 2% +87.4% 10635 ± 9% interrupts.CPU182.CAL:Function_call_interrupts 1336520 ± 9% +66.8% 2228981 ± 9% interrupts.CPU182.LOC:Local_timer_interrupts 492679 ± 23% -95.7% 21298 ± 34% interrupts.CPU182.RES:Rescheduling_interrupts 8.25 ± 28% +1154.5% 103.50 ± 54% interrupts.CPU182.TLB:TLB_shootdowns 5584 +91.8% 10708 ± 9% interrupts.CPU183.CAL:Function_call_interrupts 1335927 ± 9% +67.0% 2230522 ± 9% interrupts.CPU183.LOC:Local_timer_interrupts 538292 ± 27% -96.5% 18588 ± 9% interrupts.CPU183.RES:Rescheduling_interrupts 6.25 ± 55% +1684.0% 111.50 ± 22% interrupts.CPU183.TLB:TLB_shootdowns 5666 ± 2% +90.0% 10764 ± 9% interrupts.CPU184.CAL:Function_call_interrupts 1336022 ± 9% +66.9% 2229988 ± 9% interrupts.CPU184.LOC:Local_timer_interrupts 525203 ± 26% -96.4% 18811 ± 16% interrupts.CPU184.RES:Rescheduling_interrupts 8.75 ± 75% +1340.0% 126.00 ± 23% interrupts.CPU184.TLB:TLB_shootdowns 5668 ± 2% +89.0% 10712 ± 9% interrupts.CPU185.CAL:Function_call_interrupts 1335633 ± 9% +66.9% 2229017 ± 9% interrupts.CPU185.LOC:Local_timer_interrupts 558324 ± 32% -96.3% 20797 ± 33% interrupts.CPU185.RES:Rescheduling_interrupts 8.50 ± 42% +1520.6% 137.75 ± 48% interrupts.CPU185.TLB:TLB_shootdowns 5661 +88.9% 10695 ± 9% interrupts.CPU186.CAL:Function_call_interrupts 1336090 ± 9% +67.0% 2231015 ± 9% interrupts.CPU186.LOC:Local_timer_interrupts 527927 ± 32% -96.4% 19155 ± 4% interrupts.CPU186.RES:Rescheduling_interrupts 11.50 ± 41% +1219.6% 151.75 ± 61% interrupts.CPU186.TLB:TLB_shootdowns 5609 ± 2% +90.2% 10670 ± 9% interrupts.CPU187.CAL:Function_call_interrupts 1336243 ± 9% +66.8% 2228425 ± 9% interrupts.CPU187.LOC:Local_timer_interrupts 528062 ± 28% -96.2% 19868 ± 32% interrupts.CPU187.RES:Rescheduling_interrupts 9.50 ± 50% +1942.1% 194.00 ± 41% interrupts.CPU187.TLB:TLB_shootdowns 5632 +90.0% 10704 ± 9% interrupts.CPU188.CAL:Function_call_interrupts 1337125 ± 9% +66.7% 2229046 ± 9% interrupts.CPU188.LOC:Local_timer_interrupts 510912 ± 26% -96.1% 19936 ± 32% interrupts.CPU188.RES:Rescheduling_interrupts 10.50 ± 31% +1871.4% 207.00 ± 45% interrupts.CPU188.TLB:TLB_shootdowns 5708 ± 2% +87.5% 10704 ± 10% interrupts.CPU189.CAL:Function_call_interrupts 1336074 ± 9% +66.9% 2230501 ± 9% interrupts.CPU189.LOC:Local_timer_interrupts 551988 ± 30% -97.0% 16432 ± 18% interrupts.CPU189.RES:Rescheduling_interrupts 13.50 ± 39% +2288.9% 322.50 ± 54% interrupts.CPU189.TLB:TLB_shootdowns 336.75 ± 6% +68.6% 567.75 ± 8% interrupts.CPU19.149:PCI-MSI.1574931-edge.eth3-TxRx-19 5649 ± 2% +87.9% 10614 ± 9% interrupts.CPU19.CAL:Function_call_interrupts 1336651 ± 9% +64.7% 2201031 ± 8% interrupts.CPU19.LOC:Local_timer_interrupts 713440 ± 18% -96.1% 27950 ± 65% interrupts.CPU19.RES:Rescheduling_interrupts 15.25 ± 26% +441.0% 82.50 ± 54% interrupts.CPU19.TLB:TLB_shootdowns 5605 ± 5% +90.9% 10700 ± 9% interrupts.CPU190.CAL:Function_call_interrupts 1336957 ± 9% +66.6% 2227750 ± 9% interrupts.CPU190.LOC:Local_timer_interrupts 517562 ± 30% -96.7% 17125 ± 19% interrupts.CPU190.RES:Rescheduling_interrupts 10.00 ± 44% +6002.5% 610.25 ± 41% interrupts.CPU190.TLB:TLB_shootdowns 5719 ± 2% +86.7% 10678 ± 10% interrupts.CPU191.CAL:Function_call_interrupts 1336507 ± 9% +66.7% 2227754 ± 9% interrupts.CPU191.LOC:Local_timer_interrupts 497581 ± 27% -96.4% 18123 ± 13% interrupts.CPU191.RES:Rescheduling_interrupts 7.50 ± 44% +21850.0% 1646 ± 48% interrupts.CPU191.TLB:TLB_shootdowns 5674 ± 2% +78.5% 10130 ± 10% interrupts.CPU2.CAL:Function_call_interrupts 1337333 ± 9% +64.7% 2202131 ± 8% interrupts.CPU2.LOC:Local_timer_interrupts 684406 ± 22% -96.3% 25531 ± 36% interrupts.CPU2.RES:Rescheduling_interrupts 15.25 ± 33% +782.0% 134.50 ± 39% interrupts.CPU2.TLB:TLB_shootdowns 337.25 ± 6% +67.1% 563.50 ± 7% interrupts.CPU20.150:PCI-MSI.1574932-edge.eth3-TxRx-20 5621 ± 2% +88.4% 10589 ± 9% interrupts.CPU20.CAL:Function_call_interrupts 1335760 ± 9% +64.8% 2201139 ± 8% interrupts.CPU20.LOC:Local_timer_interrupts 667495 ± 21% -97.0% 19906 ± 9% interrupts.CPU20.RES:Rescheduling_interrupts 11.00 ± 38% +722.7% 90.50 ± 40% interrupts.CPU20.TLB:TLB_shootdowns 338.75 ± 6% +67.8% 568.50 ± 8% interrupts.CPU21.151:PCI-MSI.1574933-edge.eth3-TxRx-21 5624 ± 3% +87.0% 10517 ± 9% interrupts.CPU21.CAL:Function_call_interrupts 1335646 ± 9% +64.9% 2202506 ± 8% interrupts.CPU21.LOC:Local_timer_interrupts 717994 ± 24% -96.7% 24033 ± 36% interrupts.CPU21.RES:Rescheduling_interrupts 336.00 ± 6% +68.1% 564.75 ± 9% interrupts.CPU22.152:PCI-MSI.1574934-edge.eth3-TxRx-22 5588 ± 2% +88.3% 10523 ± 8% interrupts.CPU22.CAL:Function_call_interrupts 1335325 ± 9% +64.9% 2201291 ± 8% interrupts.CPU22.LOC:Local_timer_interrupts 721457 ± 23% -97.6% 17618 ± 11% interrupts.CPU22.RES:Rescheduling_interrupts 337.75 ± 6% +82.5% 616.25 ± 16% interrupts.CPU23.153:PCI-MSI.1574935-edge.eth3-TxRx-23 5560 ± 3% +83.4% 10200 ± 10% interrupts.CPU23.CAL:Function_call_interrupts 1336615 ± 9% +64.7% 2201330 ± 8% interrupts.CPU23.LOC:Local_timer_interrupts 680834 ± 19% -96.5% 23537 ± 38% interrupts.CPU23.RES:Rescheduling_interrupts 13.25 ± 14% +541.5% 85.00 ± 31% interrupts.CPU23.TLB:TLB_shootdowns 341.25 ± 6% +64.0% 559.75 ± 8% interrupts.CPU24.154:PCI-MSI.1574936-edge.eth3-TxRx-24 5643 ± 2% +89.7% 10707 ± 9% interrupts.CPU24.CAL:Function_call_interrupts 1341312 ± 9% +64.5% 2206112 ± 8% interrupts.CPU24.LOC:Local_timer_interrupts 790319 ± 34% -97.1% 23144 ± 15% interrupts.CPU24.RES:Rescheduling_interrupts 12.00 ± 13% +1635.4% 208.25 ± 50% interrupts.CPU24.TLB:TLB_shootdowns 343.00 ± 7% +64.1% 562.75 ± 8% interrupts.CPU25.155:PCI-MSI.1574937-edge.eth3-TxRx-25 5729 ± 5% +86.5% 10683 ± 9% interrupts.CPU25.CAL:Function_call_interrupts 1338389 ± 9% +64.7% 2204049 ± 8% interrupts.CPU25.LOC:Local_timer_interrupts 629664 ± 32% -96.9% 19349 ± 15% interrupts.CPU25.RES:Rescheduling_interrupts 10.00 ± 18% +1370.0% 147.00 ± 51% interrupts.CPU25.TLB:TLB_shootdowns 336.50 ± 6% +66.6% 560.50 ± 8% interrupts.CPU26.156:PCI-MSI.1574938-edge.eth3-TxRx-26 5661 ± 2% +86.8% 10576 ± 9% interrupts.CPU26.CAL:Function_call_interrupts 1336248 ± 9% +64.9% 2203016 ± 8% interrupts.CPU26.LOC:Local_timer_interrupts 650031 ± 32% -96.4% 23166 ± 38% interrupts.CPU26.RES:Rescheduling_interrupts 10.50 ± 58% +1176.2% 134.00 ± 61% interrupts.CPU26.TLB:TLB_shootdowns 337.00 ± 6% +66.5% 561.25 ± 8% interrupts.CPU27.157:PCI-MSI.1574939-edge.eth3-TxRx-27 5511 ± 5% +93.6% 10670 ± 9% interrupts.CPU27.CAL:Function_call_interrupts 1338387 ± 9% +64.6% 2203551 ± 8% interrupts.CPU27.LOC:Local_timer_interrupts 664637 ± 36% -97.2% 18426 ± 22% interrupts.CPU27.RES:Rescheduling_interrupts 9.75 ± 55% +997.4% 107.00 ± 45% interrupts.CPU27.TLB:TLB_shootdowns 336.75 ± 6% +66.1% 559.25 ± 8% interrupts.CPU28.158:PCI-MSI.1574940-edge.eth3-TxRx-28 5728 ± 2% +87.6% 10744 ± 9% interrupts.CPU28.CAL:Function_call_interrupts 1338079 ± 9% +64.7% 2203198 ± 8% interrupts.CPU28.LOC:Local_timer_interrupts 647071 ± 28% -97.2% 18219 ± 20% interrupts.CPU28.RES:Rescheduling_interrupts 12.00 ± 29% +839.6% 112.75 ± 65% interrupts.CPU28.TLB:TLB_shootdowns 336.75 ± 6% +66.3% 560.00 ± 8% interrupts.CPU29.159:PCI-MSI.1574941-edge.eth3-TxRx-29 5673 ± 2% +88.5% 10696 ± 9% interrupts.CPU29.CAL:Function_call_interrupts 1337583 ± 9% +64.7% 2202713 ± 8% interrupts.CPU29.LOC:Local_timer_interrupts 655898 ± 32% -96.7% 21888 ± 55% interrupts.CPU29.RES:Rescheduling_interrupts 10.50 ± 36% +669.0% 80.75 ± 35% interrupts.CPU29.TLB:TLB_shootdowns 363.75 ± 7% +536.6% 2315 ±127% interrupts.CPU3.133:PCI-MSI.1574915-edge.eth3-TxRx-3 5648 ± 2% +87.5% 10592 ± 9% interrupts.CPU3.CAL:Function_call_interrupts 1335393 ± 9% +64.8% 2201240 ± 8% interrupts.CPU3.LOC:Local_timer_interrupts 697470 ± 18% -97.2% 19555 ± 11% interrupts.CPU3.RES:Rescheduling_interrupts 14.75 ± 30% +518.6% 91.25 ± 48% interrupts.CPU3.TLB:TLB_shootdowns 336.00 ± 6% +66.6% 559.75 ± 8% interrupts.CPU30.160:PCI-MSI.1574942-edge.eth3-TxRx-30 5658 ± 2% +83.7% 10395 ± 14% interrupts.CPU30.CAL:Function_call_interrupts 1337730 ± 9% +64.6% 2201321 ± 8% interrupts.CPU30.LOC:Local_timer_interrupts 668425 ± 32% -97.2% 19026 ± 31% interrupts.CPU30.RES:Rescheduling_interrupts 10.00 ± 20% +850.0% 95.00 ± 59% interrupts.CPU30.TLB:TLB_shootdowns 336.75 ± 6% +66.0% 559.00 ± 8% interrupts.CPU31.161:PCI-MSI.1574943-edge.eth3-TxRx-31 5652 ± 2% +89.5% 10713 ± 9% interrupts.CPU31.CAL:Function_call_interrupts 1337622 ± 9% +64.7% 2203361 ± 8% interrupts.CPU31.LOC:Local_timer_interrupts 646181 ± 29% -96.2% 24665 ± 21% interrupts.CPU31.RES:Rescheduling_interrupts 8.50 ± 29% +929.4% 87.50 ± 69% interrupts.CPU31.TLB:TLB_shootdowns 337.75 ± 6% +65.7% 559.50 ± 8% interrupts.CPU32.162:PCI-MSI.1574944-edge.eth3-TxRx-32 5609 ± 2% +90.8% 10700 ± 9% interrupts.CPU32.CAL:Function_call_interrupts 1337337 ± 9% +64.7% 2202882 ± 8% interrupts.CPU32.LOC:Local_timer_interrupts 643756 ± 31% -96.0% 25962 ± 39% interrupts.CPU32.RES:Rescheduling_interrupts 9.50 ± 45% +886.8% 93.75 ± 46% interrupts.CPU32.TLB:TLB_shootdowns 336.50 ± 6% +66.2% 559.25 ± 8% interrupts.CPU33.163:PCI-MSI.1574945-edge.eth3-TxRx-33 5671 ± 2% +88.4% 10683 ± 9% interrupts.CPU33.CAL:Function_call_interrupts 1338622 ± 9% +64.6% 2203897 ± 8% interrupts.CPU33.LOC:Local_timer_interrupts 663810 ± 31% -97.4% 17331 ± 7% interrupts.CPU33.RES:Rescheduling_interrupts 11.00 ± 6% +693.2% 87.25 ± 38% interrupts.CPU33.TLB:TLB_shootdowns 337.75 ± 6% +72.5% 582.75 ± 10% interrupts.CPU34.164:PCI-MSI.1574946-edge.eth3-TxRx-34 5640 ± 2% +87.3% 10564 ± 11% interrupts.CPU34.CAL:Function_call_interrupts 1337154 ± 9% +64.8% 2203835 ± 8% interrupts.CPU34.LOC:Local_timer_interrupts 614112 ± 26% -96.6% 21004 ± 5% interrupts.CPU34.RES:Rescheduling_interrupts 10.25 ± 36% +729.3% 85.00 ± 60% interrupts.CPU34.TLB:TLB_shootdowns 339.25 ± 6% +65.0% 559.75 ± 8% interrupts.CPU35.165:PCI-MSI.1574947-edge.eth3-TxRx-35 5614 ± 2% +86.1% 10448 ± 6% interrupts.CPU35.CAL:Function_call_interrupts 1337429 ± 9% +64.7% 2202409 ± 8% interrupts.CPU35.LOC:Local_timer_interrupts 632873 ± 27% -96.9% 19358 ± 20% interrupts.CPU35.RES:Rescheduling_interrupts 8.50 ± 31% +864.7% 82.00 ± 67% interrupts.CPU35.TLB:TLB_shootdowns 338.75 ± 6% +65.9% 562.00 ± 7% interrupts.CPU36.166:PCI-MSI.1574948-edge.eth3-TxRx-36 5643 ± 2% +89.7% 10707 ± 9% interrupts.CPU36.CAL:Function_call_interrupts 1337262 ± 9% +64.7% 2202605 ± 8% interrupts.CPU36.LOC:Local_timer_interrupts 639076 ± 36% -97.7% 14819 ± 8% interrupts.CPU36.RES:Rescheduling_interrupts 11.50 ± 39% +626.1% 83.50 ± 56% interrupts.CPU36.TLB:TLB_shootdowns 338.25 ± 6% +65.6% 560.00 ± 8% interrupts.CPU37.167:PCI-MSI.1574949-edge.eth3-TxRx-37 5663 ± 2% +89.4% 10724 ± 9% interrupts.CPU37.CAL:Function_call_interrupts 1337311 ± 9% +64.7% 2202522 ± 8% interrupts.CPU37.LOC:Local_timer_interrupts 632514 ± 31% -97.1% 18589 ± 21% interrupts.CPU37.RES:Rescheduling_interrupts 9.75 ± 37% +874.4% 95.00 ± 41% interrupts.CPU37.TLB:TLB_shootdowns 336.50 ± 6% +66.5% 560.25 ± 8% interrupts.CPU38.168:PCI-MSI.1574950-edge.eth3-TxRx-38 5639 ± 2% +89.5% 10684 ± 9% interrupts.CPU38.CAL:Function_call_interrupts 1337652 ± 9% +64.8% 2204763 ± 8% interrupts.CPU38.LOC:Local_timer_interrupts 623953 ± 29% -97.1% 17849 ± 19% interrupts.CPU38.RES:Rescheduling_interrupts 9.75 ± 30% +648.7% 73.00 ± 57% interrupts.CPU38.TLB:TLB_shootdowns 338.25 ± 6% +65.6% 560.25 ± 8% interrupts.CPU39.169:PCI-MSI.1574951-edge.eth3-TxRx-39 5682 ± 2% +88.2% 10692 ± 9% interrupts.CPU39.CAL:Function_call_interrupts 1336958 ± 9% +64.8% 2203255 ± 8% interrupts.CPU39.LOC:Local_timer_interrupts 660384 ± 32% -97.1% 19209 ± 24% interrupts.CPU39.RES:Rescheduling_interrupts 10.50 ± 21% +688.1% 82.75 ± 55% interrupts.CPU39.TLB:TLB_shootdowns 5562 ± 4% +88.6% 10489 ± 9% interrupts.CPU4.CAL:Function_call_interrupts 1337733 ± 9% +64.5% 2201218 ± 8% interrupts.CPU4.LOC:Local_timer_interrupts 684773 ± 21% -97.1% 19787 ± 7% interrupts.CPU4.RES:Rescheduling_interrupts 9.25 ± 11% +1105.4% 111.50 ± 40% interrupts.CPU4.TLB:TLB_shootdowns 338.25 ± 6% +65.8% 560.75 ± 8% interrupts.CPU40.170:PCI-MSI.1574952-edge.eth3-TxRx-40 5694 ± 2% +87.8% 10692 ± 9% interrupts.CPU40.CAL:Function_call_interrupts 1337645 ± 9% +64.4% 2199575 ± 8% interrupts.CPU40.LOC:Local_timer_interrupts 696669 ± 30% -97.2% 19799 ± 26% interrupts.CPU40.RES:Rescheduling_interrupts 339.75 ± 7% +64.6% 559.25 ± 8% interrupts.CPU41.171:PCI-MSI.1574953-edge.eth3-TxRx-41 5677 ± 2% +88.4% 10694 ± 9% interrupts.CPU41.CAL:Function_call_interrupts 1337254 ± 9% +64.6% 2201715 ± 8% interrupts.CPU41.LOC:Local_timer_interrupts 658640 ± 31% -97.7% 14966 ± 13% interrupts.CPU41.RES:Rescheduling_interrupts 10.00 ± 29% +670.0% 77.00 ± 60% interrupts.CPU41.TLB:TLB_shootdowns 372.50 ± 16% +50.5% 560.75 ± 8% interrupts.CPU42.172:PCI-MSI.1574954-edge.eth3-TxRx-42 5680 ± 2% +87.8% 10666 ± 9% interrupts.CPU42.CAL:Function_call_interrupts 1338366 ± 9% +64.7% 2203672 ± 8% interrupts.CPU42.LOC:Local_timer_interrupts 691206 ± 30% -97.9% 14844 ± 7% interrupts.CPU42.RES:Rescheduling_interrupts 11.00 ± 63% +645.5% 82.00 ± 58% interrupts.CPU42.TLB:TLB_shootdowns 337.00 ± 6% +66.1% 559.75 ± 8% interrupts.CPU43.173:PCI-MSI.1574955-edge.eth3-TxRx-43 5689 ± 2% +88.0% 10698 ± 9% interrupts.CPU43.CAL:Function_call_interrupts 1342829 ± 8% +64.1% 2203394 ± 8% interrupts.CPU43.LOC:Local_timer_interrupts 657377 ± 34% -96.9% 20430 ± 19% interrupts.CPU43.RES:Rescheduling_interrupts 9.50 ± 28% +594.7% 66.00 ± 44% interrupts.CPU43.TLB:TLB_shootdowns 341.75 ± 6% +63.6% 559.25 ± 8% interrupts.CPU44.174:PCI-MSI.1574956-edge.eth3-TxRx-44 5685 ± 2% +87.7% 10668 ± 9% interrupts.CPU44.CAL:Function_call_interrupts 1337425 ± 9% +64.8% 2203751 ± 8% interrupts.CPU44.LOC:Local_timer_interrupts 644717 ± 30% -97.1% 18806 ± 28% interrupts.CPU44.RES:Rescheduling_interrupts 5693 ± 2% +84.6% 10511 ± 7% interrupts.CPU45.CAL:Function_call_interrupts 1336493 ± 9% +65.0% 2204652 ± 8% interrupts.CPU45.LOC:Local_timer_interrupts 682038 ± 29% -96.8% 21531 ± 22% interrupts.CPU45.RES:Rescheduling_interrupts 12.25 ± 18% +459.2% 68.50 ± 50% interrupts.CPU45.TLB:TLB_shootdowns 377.25 ± 18% +48.3% 559.50 ± 8% interrupts.CPU46.176:PCI-MSI.1574958-edge.eth3-TxRx-46 5695 ± 2% +87.2% 10664 ± 9% interrupts.CPU46.CAL:Function_call_interrupts 1339463 ± 9% +64.4% 2202331 ± 8% interrupts.CPU46.LOC:Local_timer_interrupts 654896 ± 35% -97.2% 18230 ± 34% interrupts.CPU46.RES:Rescheduling_interrupts 13.25 ± 28% +449.1% 72.75 ± 42% interrupts.CPU46.TLB:TLB_shootdowns 336.50 ± 6% +66.3% 559.75 ± 8% interrupts.CPU47.177:PCI-MSI.1574959-edge.eth3-TxRx-47 5676 ± 2% +89.6% 10762 ± 10% interrupts.CPU47.CAL:Function_call_interrupts 1336629 ± 9% +64.8% 2202764 ± 8% interrupts.CPU47.LOC:Local_timer_interrupts 639234 ± 32% -96.7% 20809 ± 26% interrupts.CPU47.RES:Rescheduling_interrupts 10.25 ± 27% +636.6% 75.50 ± 49% interrupts.CPU47.TLB:TLB_shootdowns 339.25 ± 6% +82.2% 618.00 ± 19% interrupts.CPU48.178:PCI-MSI.1574960-edge.eth3-TxRx-48 5701 ± 2% +86.4% 10629 ± 9% interrupts.CPU48.CAL:Function_call_interrupts 1337988 ± 9% +66.4% 2226477 ± 7% interrupts.CPU48.LOC:Local_timer_interrupts 832935 ± 14% -97.7% 19066 ± 5% interrupts.CPU48.RES:Rescheduling_interrupts 8.50 ± 55% +1570.6% 142.00 ± 80% interrupts.CPU48.TLB:TLB_shootdowns 336.50 ± 6% +67.8% 564.50 ± 8% interrupts.CPU49.179:PCI-MSI.1574961-edge.eth3-TxRx-49 5706 ± 2% +85.9% 10608 ± 9% interrupts.CPU49.CAL:Function_call_interrupts 1335144 ± 9% +66.5% 2222889 ± 7% interrupts.CPU49.LOC:Local_timer_interrupts 656528 ± 10% -97.0% 19659 ± 6% interrupts.CPU49.RES:Rescheduling_interrupts 7.75 ± 16% +916.1% 78.75 ± 66% interrupts.CPU49.TLB:TLB_shootdowns 432.75 ± 16% +119.2% 948.75 ± 36% interrupts.CPU5.135:PCI-MSI.1574917-edge.eth3-TxRx-5 5614 ± 4% +88.9% 10603 ± 9% interrupts.CPU5.CAL:Function_call_interrupts 1338330 ± 9% +64.5% 2201812 ± 8% interrupts.CPU5.LOC:Local_timer_interrupts 722710 ± 21% -97.4% 18469 ± 10% interrupts.CPU5.RES:Rescheduling_interrupts 10.25 ± 28% +778.0% 90.00 ± 39% interrupts.CPU5.TLB:TLB_shootdowns 336.50 ± 6% +66.3% 559.50 ± 8% interrupts.CPU50.180:PCI-MSI.1574962-edge.eth3-TxRx-50 5668 ± 3% +87.8% 10647 ± 9% interrupts.CPU50.CAL:Function_call_interrupts 1336321 ± 9% +66.3% 2222644 ± 7% interrupts.CPU50.LOC:Local_timer_interrupts 669281 ± 5% -97.2% 18517 ± 18% interrupts.CPU50.RES:Rescheduling_interrupts 6.75 ± 64% +1225.9% 89.50 ± 55% interrupts.CPU50.TLB:TLB_shootdowns 336.25 ± 6% +66.3% 559.25 ± 8% interrupts.CPU51.181:PCI-MSI.1574963-edge.eth3-TxRx-51 5706 ± 2% +86.6% 10647 ± 9% interrupts.CPU51.CAL:Function_call_interrupts 1336081 ± 9% +66.4% 2222650 ± 7% interrupts.CPU51.LOC:Local_timer_interrupts 651523 ± 11% -96.9% 19979 ± 19% interrupts.CPU51.RES:Rescheduling_interrupts 5.50 ± 20% +1840.9% 106.75 ± 45% interrupts.CPU51.TLB:TLB_shootdowns 341.00 ± 6% +65.0% 562.50 ± 8% interrupts.CPU52.182:PCI-MSI.1574964-edge.eth3-TxRx-52 5648 ± 2% +88.4% 10644 ± 9% interrupts.CPU52.CAL:Function_call_interrupts 1334968 ± 9% +66.5% 2222405 ± 7% interrupts.CPU52.LOC:Local_timer_interrupts 661173 ± 15% -96.9% 20289 ± 17% interrupts.CPU52.RES:Rescheduling_interrupts 7.75 ± 48% +916.1% 78.75 ± 54% interrupts.CPU52.TLB:TLB_shootdowns 338.75 ± 5% +66.0% 562.25 ± 8% interrupts.CPU53.183:PCI-MSI.1574965-edge.eth3-TxRx-53 5673 ± 2% +75.1% 9936 ± 15% interrupts.CPU53.CAL:Function_call_interrupts 1335110 ± 9% +66.5% 2222968 ± 7% interrupts.CPU53.LOC:Local_timer_interrupts 674469 ± 8% -97.5% 16746 ± 16% interrupts.CPU53.RES:Rescheduling_interrupts 8.50 ± 44% +944.1% 88.75 ± 66% interrupts.CPU53.TLB:TLB_shootdowns 336.50 ± 6% +67.6% 564.00 ± 8% interrupts.CPU54.184:PCI-MSI.1574966-edge.eth3-TxRx-54 5660 ± 2% +87.9% 10634 ± 9% interrupts.CPU54.CAL:Function_call_interrupts 1334832 ± 9% +66.4% 2221576 ± 7% interrupts.CPU54.LOC:Local_timer_interrupts 668192 ± 8% -97.0% 19806 ± 23% interrupts.CPU54.RES:Rescheduling_interrupts 9.00 ± 42% +847.2% 85.25 ± 36% interrupts.CPU54.TLB:TLB_shootdowns 336.50 ± 6% +66.7% 561.00 ± 8% interrupts.CPU55.185:PCI-MSI.1574967-edge.eth3-TxRx-55 5625 ± 3% +89.4% 10656 ± 9% interrupts.CPU55.CAL:Function_call_interrupts 1334742 ± 9% +66.5% 2221734 ± 7% interrupts.CPU55.LOC:Local_timer_interrupts 690943 ± 8% -97.1% 19959 ± 9% interrupts.CPU55.RES:Rescheduling_interrupts 7.00 ± 36% +1210.7% 91.75 ± 46% interrupts.CPU55.TLB:TLB_shootdowns 360.50 ± 11% +56.0% 562.25 ± 8% interrupts.CPU56.186:PCI-MSI.1574968-edge.eth3-TxRx-56 5661 ± 3% +87.9% 10637 ± 9% interrupts.CPU56.CAL:Function_call_interrupts 1335099 ± 9% +66.4% 2222103 ± 7% interrupts.CPU56.LOC:Local_timer_interrupts 682549 ± 10% -97.1% 19619 ± 17% interrupts.CPU56.RES:Rescheduling_interrupts 9.25 ± 70% +745.9% 78.25 ± 36% interrupts.CPU56.TLB:TLB_shootdowns 336.50 ± 6% +66.9% 561.50 ± 7% interrupts.CPU57.187:PCI-MSI.1574969-edge.eth3-TxRx-57 5681 ± 3% +87.1% 10627 ± 9% interrupts.CPU57.CAL:Function_call_interrupts 1335334 ± 9% +66.5% 2223318 ± 7% interrupts.CPU57.LOC:Local_timer_interrupts 663269 ± 6% -97.2% 18408 ± 35% interrupts.CPU57.RES:Rescheduling_interrupts 9.25 ± 50% +867.6% 89.50 ± 19% interrupts.CPU57.TLB:TLB_shootdowns 337.00 ± 6% +66.2% 560.00 ± 8% interrupts.CPU58.188:PCI-MSI.1574970-edge.eth3-TxRx-58 5654 ± 2% +87.7% 10615 ± 9% interrupts.CPU58.CAL:Function_call_interrupts 1336562 ± 9% +66.2% 2221751 ± 7% interrupts.CPU58.LOC:Local_timer_interrupts 655577 ± 11% -96.7% 21891 ± 26% interrupts.CPU58.RES:Rescheduling_interrupts 5.75 ± 49% +1104.3% 69.25 ± 46% interrupts.CPU58.TLB:TLB_shootdowns 336.75 ± 6% +66.5% 560.75 ± 8% interrupts.CPU59.189:PCI-MSI.1574971-edge.eth3-TxRx-59 5670 ± 2% +87.9% 10651 ± 9% interrupts.CPU59.CAL:Function_call_interrupts 1335085 ± 9% +66.4% 2222089 ± 7% interrupts.CPU59.LOC:Local_timer_interrupts 644410 ± 14% -97.3% 17111 ± 22% interrupts.CPU59.RES:Rescheduling_interrupts 7.25 ± 81% +962.1% 77.00 ± 43% interrupts.CPU59.TLB:TLB_shootdowns 5570 ± 3% +90.7% 10620 ± 9% interrupts.CPU6.CAL:Function_call_interrupts 1336503 ± 9% +64.7% 2200759 ± 8% interrupts.CPU6.LOC:Local_timer_interrupts 726994 ± 25% -96.8% 22967 ± 27% interrupts.CPU6.RES:Rescheduling_interrupts 12.00 ± 43% +591.7% 83.00 ± 33% interrupts.CPU6.TLB:TLB_shootdowns 336.50 ± 6% +66.3% 559.75 ± 8% interrupts.CPU60.190:PCI-MSI.1574972-edge.eth3-TxRx-60 5613 ± 3% +89.6% 10643 ± 10% interrupts.CPU60.CAL:Function_call_interrupts 1335943 ± 9% +66.3% 2222278 ± 7% interrupts.CPU60.LOC:Local_timer_interrupts 655532 ± 15% -97.3% 17707 ± 8% interrupts.CPU60.RES:Rescheduling_interrupts 12.50 ± 28% +582.0% 85.25 ± 61% interrupts.CPU60.TLB:TLB_shootdowns 336.25 ± 6% +66.4% 559.50 ± 8% interrupts.CPU61.191:PCI-MSI.1574973-edge.eth3-TxRx-61 5710 ± 2% +85.8% 10609 ± 9% interrupts.CPU61.CAL:Function_call_interrupts 1335264 ± 9% +66.3% 2220608 ± 7% interrupts.CPU61.LOC:Local_timer_interrupts 677114 ± 9% -97.4% 17382 ± 12% interrupts.CPU61.RES:Rescheduling_interrupts 8.50 ± 39% +802.9% 76.75 ± 30% interrupts.CPU61.TLB:TLB_shootdowns 336.00 ± 6% +67.6% 563.00 ± 8% interrupts.CPU62.192:PCI-MSI.1574974-edge.eth3-TxRx-62 5715 ± 2% +86.6% 10666 ± 9% interrupts.CPU62.CAL:Function_call_interrupts 1334328 ± 9% +66.5% 2221181 ± 7% interrupts.CPU62.LOC:Local_timer_interrupts 667248 ± 6% -97.2% 18926 ± 40% interrupts.CPU62.RES:Rescheduling_interrupts 8.50 ± 21% +644.1% 63.25 ± 73% interrupts.CPU62.TLB:TLB_shootdowns 5646 ± 2% +88.8% 10657 ± 9% interrupts.CPU63.CAL:Function_call_interrupts 1334958 ± 9% +66.4% 2221901 ± 7% interrupts.CPU63.LOC:Local_timer_interrupts 677060 ± 9% -97.3% 18100 ± 18% interrupts.CPU63.RES:Rescheduling_interrupts 9.75 ± 73% +753.8% 83.25 ± 36% interrupts.CPU63.TLB:TLB_shootdowns 5660 ± 2% +82.2% 10313 ± 14% interrupts.CPU64.CAL:Function_call_interrupts 1335901 ± 9% +66.3% 2221761 ± 7% interrupts.CPU64.LOC:Local_timer_interrupts 659332 ± 7% -96.9% 20134 ± 10% interrupts.CPU64.RES:Rescheduling_interrupts 8.50 ± 55% +891.2% 84.25 ± 33% interrupts.CPU64.TLB:TLB_shootdowns 5651 ± 2% +81.2% 10241 ± 4% interrupts.CPU65.CAL:Function_call_interrupts 1335637 ± 9% +66.4% 2222095 ± 7% interrupts.CPU65.LOC:Local_timer_interrupts 685985 ± 10% -97.0% 20651 ± 12% interrupts.CPU65.RES:Rescheduling_interrupts 7.50 ± 81% +856.7% 71.75 ± 48% interrupts.CPU65.TLB:TLB_shootdowns 5649 ± 2% +89.1% 10682 ± 9% interrupts.CPU66.CAL:Function_call_interrupts 1335691 ± 9% +66.3% 2221863 ± 7% interrupts.CPU66.LOC:Local_timer_interrupts 660262 ± 12% -97.0% 19510 ± 17% interrupts.CPU66.RES:Rescheduling_interrupts 5660 ± 2% +88.2% 10653 ± 9% interrupts.CPU67.CAL:Function_call_interrupts 1334819 ± 9% +66.5% 2223089 ± 7% interrupts.CPU67.LOC:Local_timer_interrupts 652665 ± 12% -96.6% 22084 ± 22% interrupts.CPU67.RES:Rescheduling_interrupts 11.75 ± 43% +551.1% 76.50 ± 35% interrupts.CPU67.TLB:TLB_shootdowns 5629 ± 2% +87.1% 10535 ± 9% interrupts.CPU68.CAL:Function_call_interrupts 1335208 ± 9% +66.5% 2223119 ± 7% interrupts.CPU68.LOC:Local_timer_interrupts 656545 ± 10% -97.0% 19510 ± 21% interrupts.CPU68.RES:Rescheduling_interrupts 5652 ± 2% +89.4% 10705 ± 9% interrupts.CPU69.CAL:Function_call_interrupts 1335564 ± 9% +66.4% 2222959 ± 7% interrupts.CPU69.LOC:Local_timer_interrupts 670511 ± 12% -97.1% 19122 ± 37% interrupts.CPU69.RES:Rescheduling_interrupts 11.75 ± 7% +576.6% 79.50 ± 39% interrupts.CPU69.TLB:TLB_shootdowns 353.00 ± 7% +66.4% 587.25 ± 6% interrupts.CPU7.137:PCI-MSI.1574919-edge.eth3-TxRx-7 5471 ± 2% +93.2% 10568 ± 8% interrupts.CPU7.CAL:Function_call_interrupts 1337246 ± 9% +64.6% 2201051 ± 8% interrupts.CPU7.LOC:Local_timer_interrupts 719415 ± 22% -94.9% 36399 ± 43% interrupts.CPU7.RES:Rescheduling_interrupts 16.50 ± 35% +492.4% 97.75 ± 46% interrupts.CPU7.TLB:TLB_shootdowns 5650 ± 2% +82.8% 10331 ± 14% interrupts.CPU70.CAL:Function_call_interrupts 1335323 ± 9% +66.4% 2222239 ± 7% interrupts.CPU70.LOC:Local_timer_interrupts 680992 ± 7% -97.5% 16774 ± 11% interrupts.CPU70.RES:Rescheduling_interrupts 5597 ± 3% +89.3% 10594 ± 9% interrupts.CPU71.CAL:Function_call_interrupts 1334961 ± 9% +66.4% 2221418 ± 7% interrupts.CPU71.LOC:Local_timer_interrupts 662239 ± 9% -96.9% 20748 ± 33% interrupts.CPU71.RES:Rescheduling_interrupts 5.25 ± 57% +1247.6% 70.75 ± 49% interrupts.CPU71.TLB:TLB_shootdowns 5641 +79.8% 10143 ± 6% interrupts.CPU72.CAL:Function_call_interrupts 1336989 ± 9% +66.5% 2226102 ± 9% interrupts.CPU72.LOC:Local_timer_interrupts 586990 ± 35% -95.6% 26115 ± 30% interrupts.CPU72.RES:Rescheduling_interrupts 8.75 ± 26% +2062.9% 189.25 ± 40% interrupts.CPU72.TLB:TLB_shootdowns 5604 +90.0% 10647 ± 10% interrupts.CPU73.CAL:Function_call_interrupts 1335972 ± 9% +66.5% 2224519 ± 9% interrupts.CPU73.LOC:Local_timer_interrupts 509912 ± 28% -96.0% 20313 ± 17% interrupts.CPU73.RES:Rescheduling_interrupts 9.25 ± 45% +1659.5% 162.75 ± 30% interrupts.CPU73.TLB:TLB_shootdowns 5647 +87.7% 10599 ± 9% interrupts.CPU74.CAL:Function_call_interrupts 1335626 ± 9% +66.7% 2226048 ± 9% interrupts.CPU74.LOC:Local_timer_interrupts 543049 ± 30% -96.3% 20321 ± 8% interrupts.CPU74.RES:Rescheduling_interrupts 15.00 ± 67% +776.7% 131.50 ± 28% interrupts.CPU74.TLB:TLB_shootdowns 5620 ± 2% +90.5% 10707 ± 9% interrupts.CPU75.CAL:Function_call_interrupts 1336976 ± 9% +66.5% 2225914 ± 9% interrupts.CPU75.LOC:Local_timer_interrupts 528171 ± 26% -95.6% 23429 ± 45% interrupts.CPU75.RES:Rescheduling_interrupts 8.25 ± 69% +1084.8% 97.75 ± 27% interrupts.CPU75.TLB:TLB_shootdowns 5620 +83.2% 10297 ± 12% interrupts.CPU76.CAL:Function_call_interrupts 1336450 ± 9% +66.4% 2223334 ± 9% interrupts.CPU76.LOC:Local_timer_interrupts 522257 ± 29% -96.7% 17477 ± 23% interrupts.CPU76.RES:Rescheduling_interrupts 11.50 ± 39% +847.8% 109.00 ± 20% interrupts.CPU76.TLB:TLB_shootdowns 5625 ± 2% +92.1% 10804 ± 11% interrupts.CPU77.CAL:Function_call_interrupts 1336446 ± 9% +66.4% 2223386 ± 9% interrupts.CPU77.LOC:Local_timer_interrupts 530700 ± 26% -96.8% 17117 ± 14% interrupts.CPU77.RES:Rescheduling_interrupts 9.25 ± 46% +856.8% 88.50 ± 17% interrupts.CPU77.TLB:TLB_shootdowns 5535 ± 2% +92.8% 10672 ± 9% interrupts.CPU78.CAL:Function_call_interrupts 1336724 ± 9% +66.4% 2224726 ± 9% interrupts.CPU78.LOC:Local_timer_interrupts 521947 ± 26% -96.8% 16954 ± 19% interrupts.CPU78.RES:Rescheduling_interrupts 9.00 ± 45% +922.2% 92.00 ± 34% interrupts.CPU78.TLB:TLB_shootdowns 5647 +89.3% 10690 ± 9% interrupts.CPU79.CAL:Function_call_interrupts 1335967 ± 9% +66.5% 2223785 ± 9% interrupts.CPU79.LOC:Local_timer_interrupts 538704 ± 30% -96.6% 18362 ± 12% interrupts.CPU79.RES:Rescheduling_interrupts 8.00 ± 38% +931.2% 82.50 ± 17% interrupts.CPU79.TLB:TLB_shootdowns 397.00 ± 9% +506.2% 2406 ±101% interrupts.CPU8.138:PCI-MSI.1574920-edge.eth3-TxRx-8 5493 ± 2% +93.3% 10619 ± 9% interrupts.CPU8.CAL:Function_call_interrupts 1336712 ± 9% +64.7% 2202149 ± 8% interrupts.CPU8.LOC:Local_timer_interrupts 692057 ± 25% -96.4% 24727 ± 41% interrupts.CPU8.RES:Rescheduling_interrupts 16.25 ± 29% +440.0% 87.75 ± 26% interrupts.CPU8.TLB:TLB_shootdowns 5663 ± 2% +80.7% 10234 ± 10% interrupts.CPU80.CAL:Function_call_interrupts 1336216 ± 9% +66.4% 2222959 ± 9% interrupts.CPU80.LOC:Local_timer_interrupts 545620 ± 31% -95.8% 22763 ± 32% interrupts.CPU80.RES:Rescheduling_interrupts 5657 ± 2% +88.9% 10688 ± 9% interrupts.CPU81.CAL:Function_call_interrupts 1336349 ± 9% +66.5% 2224866 ± 9% interrupts.CPU81.LOC:Local_timer_interrupts 526819 ± 30% -96.6% 17695 ± 7% interrupts.CPU81.RES:Rescheduling_interrupts 9.00 ± 32% +1094.4% 107.50 ± 17% interrupts.CPU81.TLB:TLB_shootdowns 5611 +90.4% 10685 ± 9% interrupts.CPU82.CAL:Function_call_interrupts 1336218 ± 9% +66.4% 2223922 ± 9% interrupts.CPU82.LOC:Local_timer_interrupts 499863 ± 23% -96.8% 16009 ± 20% interrupts.CPU82.RES:Rescheduling_interrupts 11.50 ± 44% +706.5% 92.75 ± 32% interrupts.CPU82.TLB:TLB_shootdowns 5687 ± 2% +87.5% 10665 ± 10% interrupts.CPU83.CAL:Function_call_interrupts 1338523 ± 9% +66.2% 2225051 ± 9% interrupts.CPU83.LOC:Local_timer_interrupts 549174 ± 26% -96.7% 18013 ± 23% interrupts.CPU83.RES:Rescheduling_interrupts 5645 ± 2% +89.4% 10692 ± 9% interrupts.CPU84.CAL:Function_call_interrupts 1335343 ± 9% +66.4% 2222238 ± 9% interrupts.CPU84.LOC:Local_timer_interrupts 523159 ± 28% -96.1% 20408 ± 36% interrupts.CPU84.RES:Rescheduling_interrupts 6.25 ± 39% +1468.0% 98.00 ± 36% interrupts.CPU84.TLB:TLB_shootdowns 5683 ± 2% +88.5% 10712 ± 9% interrupts.CPU85.CAL:Function_call_interrupts 1336624 ± 9% +66.4% 2224261 ± 9% interrupts.CPU85.LOC:Local_timer_interrupts 535240 ± 30% -95.7% 23107 ± 25% interrupts.CPU85.RES:Rescheduling_interrupts 9.75 ± 37% +984.6% 105.75 ± 47% interrupts.CPU85.TLB:TLB_shootdowns 5678 +87.7% 10659 ± 10% interrupts.CPU86.CAL:Function_call_interrupts 1334667 ± 9% +66.6% 2223750 ± 9% interrupts.CPU86.LOC:Local_timer_interrupts 504987 ± 24% -96.5% 17766 ± 11% interrupts.CPU86.RES:Rescheduling_interrupts 9.50 ± 31% +789.5% 84.50 ± 24% interrupts.CPU86.TLB:TLB_shootdowns 5763 +78.3% 10277 ± 11% interrupts.CPU87.CAL:Function_call_interrupts 1335989 ± 9% +66.6% 2225599 ± 9% interrupts.CPU87.LOC:Local_timer_interrupts 529080 ± 27% -95.5% 23732 ± 53% interrupts.CPU87.RES:Rescheduling_interrupts 5648 ± 2% +89.7% 10716 ± 10% interrupts.CPU88.CAL:Function_call_interrupts 1335958 ± 9% +66.5% 2223996 ± 9% interrupts.CPU88.LOC:Local_timer_interrupts 524029 ± 26% -97.0% 15810 ± 16% interrupts.CPU88.RES:Rescheduling_interrupts 12.50 ± 52% +566.0% 83.25 ± 23% interrupts.CPU88.TLB:TLB_shootdowns 5536 ± 4% +92.3% 10645 ± 10% interrupts.CPU89.CAL:Function_call_interrupts 1335741 ± 9% +66.5% 2224606 ± 9% interrupts.CPU89.LOC:Local_timer_interrupts 551584 ± 31% -95.7% 23754 ± 42% interrupts.CPU89.RES:Rescheduling_interrupts 9.75 ± 38% +828.2% 90.50 ± 24% interrupts.CPU89.TLB:TLB_shootdowns 623.25 ± 45% +2781.3% 17957 ±150% interrupts.CPU9.139:PCI-MSI.1574921-edge.eth3-TxRx-9 5636 ± 2% +86.6% 10520 ± 10% interrupts.CPU9.CAL:Function_call_interrupts 1339534 ± 9% +64.4% 2201670 ± 8% interrupts.CPU9.LOC:Local_timer_interrupts 704904 ± 22% -96.6% 24266 ± 43% interrupts.CPU9.RES:Rescheduling_interrupts 10.25 ± 17% +807.3% 93.00 ± 30% interrupts.CPU9.TLB:TLB_shootdowns 5613 +90.2% 10674 ± 9% interrupts.CPU90.CAL:Function_call_interrupts 1336877 ± 9% +66.4% 2224635 ± 9% interrupts.CPU90.LOC:Local_timer_interrupts 535240 ± 25% -96.6% 18181 ± 15% interrupts.CPU90.RES:Rescheduling_interrupts 5745 ± 3% +85.6% 10665 ± 10% interrupts.CPU91.CAL:Function_call_interrupts 1336822 ± 9% +66.4% 2224231 ± 9% interrupts.CPU91.LOC:Local_timer_interrupts 528925 ± 30% -96.9% 16230 ± 14% interrupts.CPU91.RES:Rescheduling_interrupts 10.25 ± 27% +658.5% 77.75 ± 26% interrupts.CPU91.TLB:TLB_shootdowns 5641 +89.4% 10683 ± 10% interrupts.CPU92.CAL:Function_call_interrupts 1337346 ± 9% +66.1% 2221465 ± 9% interrupts.CPU92.LOC:Local_timer_interrupts 509215 ± 25% -95.8% 21345 ± 31% interrupts.CPU92.RES:Rescheduling_interrupts 11.00 ± 51% +638.6% 81.25 ± 34% interrupts.CPU92.TLB:TLB_shootdowns 5642 ± 2% +89.4% 10687 ± 9% interrupts.CPU93.CAL:Function_call_interrupts 1336600 ± 9% +66.4% 2223764 ± 9% interrupts.CPU93.LOC:Local_timer_interrupts 516609 ± 28% -95.7% 21975 ± 45% interrupts.CPU93.RES:Rescheduling_interrupts 13.25 ± 55% +428.3% 70.00 ± 28% interrupts.CPU93.TLB:TLB_shootdowns 5683 ± 3% +80.9% 10279 ± 11% interrupts.CPU94.CAL:Function_call_interrupts 1336658 ± 9% +66.4% 2224125 ± 9% interrupts.CPU94.LOC:Local_timer_interrupts 511912 ± 29% -96.4% 18298 ± 18% interrupts.CPU94.RES:Rescheduling_interrupts 7.75 ± 23% +967.7% 82.75 ± 44% interrupts.CPU94.TLB:TLB_shootdowns 5540 +89.7% 10508 ± 10% interrupts.CPU95.CAL:Function_call_interrupts 1336375 ± 9% +66.5% 2225055 ± 9% interrupts.CPU95.LOC:Local_timer_interrupts 517990 ± 25% -95.2% 24705 ± 29% interrupts.CPU95.RES:Rescheduling_interrupts 5681 ± 2% +85.6% 10543 ± 9% interrupts.CPU96.CAL:Function_call_interrupts 1339248 ± 9% +64.5% 2203541 ± 8% interrupts.CPU96.LOC:Local_timer_interrupts 719025 ± 24% -97.4% 18632 ± 15% interrupts.CPU96.RES:Rescheduling_interrupts 16.50 ± 12% +269.7% 61.00 ± 42% interrupts.CPU96.TLB:TLB_shootdowns 5652 ± 2% +80.6% 10208 ± 7% interrupts.CPU97.CAL:Function_call_interrupts 1337665 ± 9% +64.6% 2201481 ± 8% interrupts.CPU97.LOC:Local_timer_interrupts 699116 ± 26% -97.5% 17375 ± 15% interrupts.CPU97.RES:Rescheduling_interrupts 14.75 ± 24% +474.6% 84.75 ± 23% interrupts.CPU97.TLB:TLB_shootdowns 5682 ± 3% +86.7% 10609 ± 9% interrupts.CPU98.CAL:Function_call_interrupts 1336850 ± 9% +64.7% 2202241 ± 8% interrupts.CPU98.LOC:Local_timer_interrupts 711099 ± 19% -96.7% 23734 ± 42% interrupts.CPU98.RES:Rescheduling_interrupts 13.25 ± 26% +466.0% 75.00 ± 32% interrupts.CPU98.TLB:TLB_shootdowns 5696 ± 2% +86.4% 10619 ± 9% interrupts.CPU99.CAL:Function_call_interrupts 1337113 ± 9% +64.6% 2200509 ± 8% interrupts.CPU99.LOC:Local_timer_interrupts 714713 ± 22% -96.6% 24301 ± 50% interrupts.CPU99.RES:Rescheduling_interrupts 9.75 ± 33% +807.7% 88.50 ± 42% interrupts.CPU99.TLB:TLB_shootdowns 2.567e+08 ± 9% +65.6% 4.251e+08 ± 8% interrupts.LOC:Local_timer_interrupts 384.00 +50.0% 576.00 interrupts.MCP:Machine_check_polls 1.223e+08 ± 10% -96.8% 3869949 ± 8% interrupts.RES:Rescheduling_interrupts 1997 ± 13% +1301.3% 27995 ± 22% interrupts.TLB:TLB_shootdowns hackbench.throughput 800000 +-+----------------------------------------------------------------+ |.+.. .+..+. .. +.. .+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+.. .| 700000 +-+ + + + + | | | 600000 +-+ | | | 500000 +-+ | | | 400000 +-+ | | | 300000 +-+ O O | O O O O O O O O | 200000 +-O O O O O O O | | O O | 100000 +-+----------------------------------------------------------------+ hackbench.time.system_time 220000 +-+----------------------------------------------------------------+ | O | 200000 +-+ | 180000 +-+ | | | 160000 +-+ O O O O O O | O O O O O O O O | 140000 +-+ O O O O | | | 120000 +-+ | 100000 +-+ | | .+. .+.. .+.| 80000 +-+..+.+..+.+. +..+ +. .+.+..+.+..+.+..+.+..+.+.. .+..+.+. | | +. + | 60000 +-+----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-bdw-de1: 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 8G memory ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode: cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/200%/debian-x86_64-2019-05-14.cgz/900s/lkp-bdw-de1/TCP_STREAM/netperf/0x7000017 commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 2222 +71.4% 3808 netperf.Throughput_Mbps 71107 +71.4% 121875 netperf.Throughput_total_Mbps 511626 ± 79% +1.1e+05% 5.561e+08 netperf.time.involuntary_context_switches 553.25 +53.7% 850.50 netperf.time.percent_of_cpu_this_job_got 4779 +52.4% 7282 netperf.time.system_time 212.69 +84.1% 391.56 ± 2% netperf.time.user_time 4923187 -99.6% 18965 ± 25% netperf.time.voluntary_context_switches 4.883e+08 +71.4% 8.369e+08 netperf.workload 8169 ± 19% +108.1% 16998 ± 65% cpuidle.C1.usage 6775 ± 27% +67.7% 11359 ± 21% cpuidle.POLL.usage 97.00 -4.1% 93.00 vmstat.cpu.sy 12865 ± 6% +9483.7% 1232940 vmstat.system.cs 4208128 ± 10% -25.1% 3151360 ± 14% meminfo.DirectMap2M 1778107 -16.9% 1477288 meminfo.Memused 2170 -11.4% 1923 ± 2% meminfo.max_used_kB 6.56 +11.1 17.68 ± 2% mpstat.cpu.all.soft% 90.90 -15.1 75.76 mpstat.cpu.all.sys% 2.33 +4.0 6.35 mpstat.cpu.all.usr% 2494 -5.4% 2360 turbostat.Avg_MHz 7072 ± 25% +134.4% 16575 ± 63% turbostat.C1 0.10 ± 8% +661.5% 0.74 ± 2% turbostat.CPU%c1 43.97 +2.2% 44.93 turbostat.PkgWatt 6.43 -53.5% 2.99 ± 2% turbostat.RAMWatt 4546 -44.9% 2506 ± 4% slabinfo.kmalloc-1k.active_objs 4683 -45.0% 2574 ± 5% slabinfo.kmalloc-1k.num_objs 3566 ± 2% -25.6% 2652 ± 3% slabinfo.kmalloc-96.active_objs 3566 ± 2% -25.6% 2652 ± 3% slabinfo.kmalloc-96.num_objs 4373 -32.9% 2936 ± 18% slabinfo.skbuff_fclone_cache.active_objs 4433 -33.0% 2970 ± 17% slabinfo.skbuff_fclone_cache.num_objs 153279 +4.9% 160787 proc-vmstat.nr_dirty_background_threshold 306934 +4.9% 321969 proc-vmstat.nr_dirty_threshold 1569705 +4.8% 1644899 proc-vmstat.nr_free_pages 12138 -5.8% 11439 proc-vmstat.nr_slab_unreclaimable 2.448e+08 +14.3% 2.8e+08 proc-vmstat.numa_hit 2.448e+08 +14.3% 2.8e+08 proc-vmstat.numa_local 1.953e+09 +14.4% 2.235e+09 proc-vmstat.pgalloc_normal 996086 +1.4% 1010307 proc-vmstat.pgfault 1.953e+09 +14.4% 2.235e+09 proc-vmstat.pgfree 1645907 +1742.9% 30332750 softirqs.CPU0.NET_RX 1725542 +1649.6% 30190030 softirqs.CPU1.NET_RX 1723696 ± 2% +1665.7% 30435107 softirqs.CPU10.NET_RX 1759222 +1633.9% 30503925 softirqs.CPU11.NET_RX 1708263 +1685.0% 30492492 softirqs.CPU12.NET_RX 1775885 ± 3% +1625.5% 30642798 softirqs.CPU13.NET_RX 1734434 +1665.6% 30623503 softirqs.CPU14.NET_RX 1712477 +1676.9% 30428432 softirqs.CPU15.NET_RX 1737188 ± 2% +1645.1% 30315328 softirqs.CPU2.NET_RX 1730282 +1652.7% 30327295 softirqs.CPU3.NET_RX 1727291 +1655.2% 30317924 softirqs.CPU4.NET_RX 1771246 ± 2% +1608.7% 30265897 softirqs.CPU5.NET_RX 1746175 ± 2% +1648.1% 30525368 softirqs.CPU6.NET_RX 1815835 ± 8% +1575.5% 30423626 softirqs.CPU7.NET_RX 1675662 ± 2% +1720.4% 30503498 softirqs.CPU8.NET_RX 1723755 +1669.1% 30495570 softirqs.CPU9.NET_RX 27712869 +1656.7% 4.868e+08 softirqs.NET_RX 12074 ± 15% -87.9% 1464 ± 42% interrupts.CPU0.RES:Rescheduling_interrupts 12478 ± 7% -92.6% 923.00 ± 79% interrupts.CPU1.RES:Rescheduling_interrupts 11293 ± 18% -92.8% 808.25 ± 14% interrupts.CPU10.RES:Rescheduling_interrupts 15874 ± 14% -98.2% 293.50 ± 45% interrupts.CPU11.RES:Rescheduling_interrupts 11410 ± 12% -96.5% 403.50 ± 58% interrupts.CPU12.RES:Rescheduling_interrupts 13084 ± 8% -97.6% 317.75 ± 73% interrupts.CPU13.RES:Rescheduling_interrupts 11958 ± 4% -97.1% 345.50 ± 45% interrupts.CPU14.RES:Rescheduling_interrupts 10578 ± 12% -96.4% 380.50 ± 14% interrupts.CPU15.RES:Rescheduling_interrupts 13881 ± 15% -97.0% 422.25 ± 14% interrupts.CPU2.RES:Rescheduling_interrupts 10276 ± 11% -96.7% 335.25 ± 58% interrupts.CPU3.RES:Rescheduling_interrupts 13654 ± 6% -95.8% 571.25 ± 60% interrupts.CPU4.RES:Rescheduling_interrupts 8026 -71.8% 2261 ±147% interrupts.CPU5.CAL:Function_call_interrupts 13763 ± 7% -97.2% 391.50 ± 56% interrupts.CPU5.RES:Rescheduling_interrupts 12317 ± 6% -98.0% 249.50 ± 36% interrupts.CPU6.RES:Rescheduling_interrupts 16010 ± 7% -96.7% 520.50 ± 47% interrupts.CPU7.RES:Rescheduling_interrupts 13306 ± 13% -96.3% 488.00 ± 87% interrupts.CPU8.RES:Rescheduling_interrupts 13184 ± 8% -88.1% 1567 ±117% interrupts.CPU9.RES:Rescheduling_interrupts 205145 -95.4% 9481 ± 25% interrupts.RES:Rescheduling_interrupts 15033 ± 5% -13.8% 12958 ± 3% sched_debug.cfs_rq:/.load.stddev 210362 ± 7% -55.3% 94120 ± 14% sched_debug.cfs_rq:/.min_vruntime.stddev -312556 -60.2% -124549 sched_debug.cfs_rq:/.spread0.min 210321 ± 7% -55.3% 94106 ± 14% sched_debug.cfs_rq:/.spread0.stddev 1495 ± 7% -26.8% 1094 ± 3% sched_debug.cfs_rq:/.util_est_enqueued.max 242.23 ± 24% +39.9% 338.86 ± 8% sched_debug.cfs_rq:/.util_est_enqueued.min 336.61 ± 5% -42.3% 194.07 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.stddev 524056 ± 9% -31.7% 358027 ± 13% sched_debug.cpu.avg_idle.avg 330122 +17.2% 387044 ± 4% sched_debug.cpu.avg_idle.stddev 11.67 ± 13% -61.8% 4.46 ± 2% sched_debug.cpu.clock.stddev 11.67 ± 13% -61.8% 4.46 ± 2% sched_debug.cpu.clock_task.stddev 14841 ± 5% -13.1% 12892 ± 2% sched_debug.cpu.load.stddev 1.36 ± 5% +20.7% 1.64 ± 5% sched_debug.cpu.nr_running.min 375072 ± 8% +9081.9% 34438904 sched_debug.cpu.nr_switches.avg 580983 ± 33% +5897.8% 34846350 sched_debug.cpu.nr_switches.max 324037 +10387.3% 33982888 sched_debug.cpu.nr_switches.min 64665 ± 74% +271.7% 240347 ± 8% sched_debug.cpu.nr_switches.stddev 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 202.94 -50.0% 101.55 perf-stat.i.MPKI 6.205e+08 +370.5% 2.92e+09 perf-stat.i.branch-instructions 2.23 +0.4 2.61 perf-stat.i.branch-miss-rate% 13956226 +444.6% 76001354 perf-stat.i.branch-misses 6.344e+08 +133.6% 1.482e+09 perf-stat.i.cache-misses 6.344e+08 +133.6% 1.482e+09 perf-stat.i.cache-references 12852 ± 6% +9515.2% 1235744 perf-stat.i.context-switches 12.52 -79.5% 2.56 perf-stat.i.cpi 3.912e+10 -4.5% 3.736e+10 perf-stat.i.cpu-cycles 106.25 -10.5% 95.08 ± 2% perf-stat.i.cpu-migrations 61.80 -58.9% 25.43 perf-stat.i.cycles-between-cache-misses 0.13 +1.1 1.21 perf-stat.i.dTLB-load-miss-rate% 1924992 +3268.7% 64847952 perf-stat.i.dTLB-load-misses 1.487e+09 +256.1% 5.297e+09 perf-stat.i.dTLB-loads 0.08 ± 9% +0.3 0.36 ± 4% perf-stat.i.dTLB-store-miss-rate% 849173 ± 9% +1432.3% 13011969 ± 4% perf-stat.i.dTLB-store-misses 1.085e+09 +227.7% 3.554e+09 perf-stat.i.dTLB-stores 92.31 -27.0 65.27 perf-stat.i.iTLB-load-miss-rate% 967516 ± 5% +1210.5% 12679203 perf-stat.i.iTLB-load-misses 81381 ± 6% +8174.3% 6733745 perf-stat.i.iTLB-loads 3.137e+09 +364.9% 1.458e+10 perf-stat.i.instructions 3279 ± 4% -63.6% 1193 perf-stat.i.instructions-per-iTLB-miss 0.08 +379.1% 0.39 perf-stat.i.ipc 1068 +1.4% 1083 perf-stat.i.minor-faults 1068 +1.4% 1083 perf-stat.i.page-faults 202.27 -49.8% 101.64 perf-stat.overall.MPKI 2.25 +0.4 2.60 perf-stat.overall.branch-miss-rate% 12.47 -79.5% 2.56 perf-stat.overall.cpi 61.66 -59.1% 25.21 perf-stat.overall.cycles-between-cache-misses 0.13 +1.1 1.21 perf-stat.overall.dTLB-load-miss-rate% 0.08 ± 9% +0.3 0.36 ± 4% perf-stat.overall.dTLB-store-miss-rate% 92.23 -26.9 65.31 perf-stat.overall.iTLB-load-miss-rate% 3250 ± 4% -64.6% 1150 perf-stat.overall.instructions-per-iTLB-miss 0.08 +386.8% 0.39 perf-stat.overall.ipc 5788 +171.2% 15695 perf-stat.overall.path-length 6.198e+08 +370.5% 2.916e+09 perf-stat.ps.branch-instructions 13940624 +444.6% 75916760 perf-stat.ps.branch-misses 6.337e+08 +133.6% 1.48e+09 perf-stat.ps.cache-misses 6.337e+08 +133.6% 1.48e+09 perf-stat.ps.cache-references 12837 ± 6% +9515.2% 1234363 perf-stat.ps.context-switches 3.907e+10 -4.5% 3.732e+10 perf-stat.ps.cpu-cycles 106.14 -10.5% 94.98 ± 2% perf-stat.ps.cpu-migrations 1922844 +3268.7% 64775332 perf-stat.ps.dTLB-load-misses 1.486e+09 +256.1% 5.291e+09 perf-stat.ps.dTLB-loads 848224 ± 9% +1432.3% 12997348 ± 4% perf-stat.ps.dTLB-store-misses 1.083e+09 +227.7% 3.55e+09 perf-stat.ps.dTLB-stores 966436 ± 5% +1210.5% 12665011 perf-stat.ps.iTLB-load-misses 81290 ± 6% +8174.3% 6726216 perf-stat.ps.iTLB-loads 3.133e+09 +364.9% 1.457e+10 perf-stat.ps.instructions 1067 +1.4% 1082 perf-stat.ps.minor-faults 1067 +1.4% 1082 perf-stat.ps.page-faults 2.826e+12 +364.8% 1.314e+13 perf-stat.total.instructions 50.20 -37.1 13.14 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 50.12 -37.0 13.09 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 47.79 -36.7 11.09 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg 48.08 -36.5 11.55 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg 46.22 -35.4 10.79 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 64.17 -29.0 35.14 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64 64.22 -28.8 35.40 perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 64.54 -27.7 36.84 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 64.56 -27.5 37.04 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 21.99 -9.7 12.33 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 21.62 -9.6 12.00 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg 22.48 -9.5 12.98 perf-profile.calltrace.cycles-pp._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 97.95 -4.6 93.39 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 98.08 -4.3 93.74 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 2.08 ± 2% -1.0 1.12 ± 6% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg 1.94 ± 3% -1.0 0.97 ± 7% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked 2.29 ± 2% -0.8 1.45 ± 5% perf-profile.calltrace.cycles-pp.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 2.31 ± 2% -0.8 1.47 ± 5% perf-profile.calltrace.cycles-pp.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.85 ± 8% -0.3 0.53 ± 5% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv 1.19 ± 2% -0.3 0.87 ± 2% perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg 1.15 ± 8% -0.3 0.86 perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 6.74 -0.2 6.50 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg 1.24 ± 2% -0.2 1.04 ± 2% perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg 0.00 +0.5 0.51 ± 2% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked 0.00 +0.6 0.55 ± 4% perf-profile.calltrace.cycles-pp.native_write_msr 0.00 +0.6 0.55 ± 3% perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg 0.00 +0.6 0.56 perf-profile.calltrace.cycles-pp.load_new_mm_cr3.switch_mm_irqs_off.__schedule.schedule.schedule_timeout 0.00 +0.6 0.56 ± 4% perf-profile.calltrace.cycles-pp.__fget_light.sockfd_lookup_light.__sys_sendto.__x64_sys_sendto.do_syscall_64 0.00 +0.6 0.58 ± 5% perf-profile.calltrace.cycles-pp.__switch_to_asm 0.52 ± 3% +0.6 1.12 ± 2% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 0.00 +0.6 0.60 ± 5% perf-profile.calltrace.cycles-pp.__check_object_size.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +0.6 0.60 ± 3% perf-profile.calltrace.cycles-pp.tcp_current_mss.tcp_send_mss.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 6.85 +0.6 7.45 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg 0.00 +0.6 0.60 ± 6% perf-profile.calltrace.cycles-pp.selinux_socket_sock_rcv_skb.security_sock_rcv_skb.sk_filter_trim_cap.tcp_v4_rcv.ip_protocol_deliver_rcu 0.00 +0.6 0.61 ± 5% perf-profile.calltrace.cycles-pp.nf_hook_slow.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg 0.00 +0.6 0.61 perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common 0.00 +0.6 0.64 ± 3% perf-profile.calltrace.cycles-pp.sockfd_lookup_light.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.64 ± 5% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule 0.00 +0.7 0.66 ± 2% perf-profile.calltrace.cycles-pp.__fget_light.sockfd_lookup_light.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64 0.00 +0.7 0.68 ± 2% perf-profile.calltrace.cycles-pp.tcp_send_mss.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +0.7 0.71 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.00 +0.8 0.77 ± 2% perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack 0.00 +0.8 0.78 ± 2% perf-profile.calltrace.cycles-pp.sockfd_lookup_light.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.8 0.79 ± 4% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.00 +0.9 0.90 perf-profile.calltrace.cycles-pp.__alloc_skb.__tcp_send_ack.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 0.00 +0.9 0.90 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.wait_woken 0.00 +0.9 0.93 ± 6% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock 0.00 +1.0 1.04 perf-profile.calltrace.cycles-pp.__tcp_send_ack.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 0.59 ± 5% +1.1 1.65 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 0.00 +1.1 1.10 ± 2% perf-profile.calltrace.cycles-pp.__schedule.preempt_schedule_common._cond_resched.kmem_cache_alloc_node.__alloc_skb 0.00 +1.1 1.10 ± 20% perf-profile.calltrace.cycles-pp.security_sock_rcv_skb.sk_filter_trim_cap.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 0.00 +1.1 1.12 ± 2% perf-profile.calltrace.cycles-pp.preempt_schedule_common._cond_resched.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb 0.00 +1.1 1.13 ± 2% perf-profile.calltrace.cycles-pp._cond_resched.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked 0.00 +1.2 1.20 ± 2% perf-profile.calltrace.cycles-pp.__schedule.preempt_schedule_common._cond_resched.__release_sock.release_sock 0.00 +1.2 1.23 ± 2% perf-profile.calltrace.cycles-pp.preempt_schedule_common._cond_resched.__release_sock.release_sock.tcp_sendmsg 0.00 +1.2 1.25 ± 2% perf-profile.calltrace.cycles-pp._cond_resched.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg 0.00 +1.2 1.25 ± 5% perf-profile.calltrace.cycles-pp.__switch_to 0.00 +1.3 1.31 ± 3% perf-profile.calltrace.cycles-pp.sk_filter_trim_cap.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver 0.00 +1.3 1.32 ± 3% perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established 6.83 +1.4 8.18 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 0.00 +1.4 1.38 ± 3% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 0.14 ±173% +1.4 1.53 ± 3% perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv 0.00 +1.4 1.44 perf-profile.calltrace.cycles-pp.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output 1.11 ± 2% +1.6 2.70 ± 2% perf-profile.calltrace.cycles-pp.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 0.00 +1.6 1.62 ± 3% perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg 0.00 +1.6 1.64 ± 2% perf-profile.calltrace.cycles-pp.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit 0.00 +1.6 1.65 ± 2% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.schedule_timeout.wait_woken 1.14 ± 3% +1.8 2.92 perf-profile.calltrace.cycles-pp.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +2.0 1.96 ± 16% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 0.00 +2.3 2.27 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.3 2.31 ± 2% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.4 2.40 ± 2% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.5 2.50 ± 2% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock 0.00 +2.9 2.92 perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock 0.00 +3.1 3.08 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 0.00 +3.1 3.09 ± 7% perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb 5.91 +3.1 9.01 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 0.00 +3.1 3.15 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.wait_woken 0.00 +3.2 3.15 ± 2% perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock 1.97 +3.4 5.40 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv 0.78 ± 4% +4.1 4.88 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established 0.00 +4.3 4.35 ± 3% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked 0.00 +4.6 4.57 ± 3% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg 0.00 +5.0 5.04 ± 2% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 4.79 ± 2% +5.1 9.92 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 4.81 ± 2% +5.3 10.13 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver 0.00 +5.6 5.62 ± 2% perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +6.1 6.07 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock 0.00 +6.1 6.08 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock 0.00 +6.7 6.73 ± 2% perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established 0.00 +7.0 7.05 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv 0.00 +7.3 7.28 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv 0.00 +7.5 7.50 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg 0.00 +7.6 7.56 perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 0.00 +7.6 7.65 perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_woken.sk_wait_data 0.00 +7.7 7.67 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg 31.16 +7.8 38.95 perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 0.00 +7.8 7.82 perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg 0.00 +8.0 7.96 perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg 0.00 +8.3 8.30 perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 5.71 ± 2% +8.7 14.45 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv 5.79 ± 2% +9.1 14.87 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core 5.81 ± 2% +9.1 14.95 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog 5.85 ± 2% +9.3 15.15 perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action 0.00 +9.3 9.32 perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 0.00 +9.8 9.80 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked 6.03 ± 2% +9.9 15.98 perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start 6.20 ± 2% +10.4 16.58 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack 0.00 +10.8 10.84 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg 6.30 ± 2% +11.1 17.43 perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq 0.00 +11.5 11.47 perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.16 ±173% +11.6 11.80 perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 6.40 ± 2% +11.7 18.08 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip 0.65 ± 14% +11.8 12.43 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 0.68 ± 14% +11.9 12.57 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 6.49 ± 2% +12.0 18.51 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2 6.50 ± 2% +12.1 18.62 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output 6.57 ± 2% +12.5 19.05 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit 6.58 ± 2% +12.7 19.29 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb 0.42 ± 57% +13.5 13.93 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames 0.00 +17.0 16.97 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit 31.97 +19.4 51.37 perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64 32.25 +19.7 51.97 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 32.85 +20.2 53.09 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 32.92 +20.4 53.29 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 69.75 -46.7 23.05 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 50.17 -37.1 13.10 perf-profile.children.cycles-pp.__skb_datagram_iter 50.20 -37.1 13.14 perf-profile.children.cycles-pp.skb_copy_datagram_iter 47.80 -36.7 11.10 perf-profile.children.cycles-pp.copyout 48.11 -36.5 11.57 perf-profile.children.cycles-pp._copy_to_iter 64.18 -29.0 35.19 perf-profile.children.cycles-pp.tcp_recvmsg 64.22 -28.8 35.40 perf-profile.children.cycles-pp.inet_recvmsg 64.55 -27.7 36.86 perf-profile.children.cycles-pp.__sys_recvfrom 64.57 -27.5 37.06 perf-profile.children.cycles-pp.__x64_sys_recvfrom 22.01 -9.7 12.35 perf-profile.children.cycles-pp.copyin 22.49 -9.5 13.00 perf-profile.children.cycles-pp._copy_from_iter_full 98.17 -4.7 93.47 perf-profile.children.cycles-pp.do_syscall_64 98.31 -4.5 93.84 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 3.11 ± 4% -2.3 0.78 ± 7% perf-profile.children.cycles-pp.apic_timer_interrupt 3.34 ± 2% -1.9 1.48 ± 3% perf-profile.children.cycles-pp.skb_release_data 2.46 -1.7 0.78 ± 2% perf-profile.children.cycles-pp.__free_pages_ok 3.93 -1.7 2.27 perf-profile.children.cycles-pp.__kfree_skb 2.10 ± 2% -1.0 1.13 ± 6% perf-profile.children.cycles-pp.__alloc_pages_nodemask 1.96 ± 3% -1.0 0.98 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist 2.29 ± 2% -0.8 1.45 ± 6% perf-profile.children.cycles-pp.skb_page_frag_refill 2.31 ± 2% -0.8 1.48 ± 5% perf-profile.children.cycles-pp.sk_page_frag_refill 1.22 ± 4% -0.8 0.45 ± 5% perf-profile.children.cycles-pp.free_one_page 1.40 ± 8% -0.8 0.64 ± 9% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.95 ± 8% -0.7 0.23 ± 4% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.60 ± 4% -0.6 0.04 ± 58% perf-profile.children.cycles-pp.skb_clone 1.06 ± 6% -0.5 0.53 ± 10% perf-profile.children.cycles-pp.hrtimer_interrupt 0.62 -0.5 0.10 ± 15% perf-profile.children.cycles-pp.tcp_queue_rcv 0.87 ± 6% -0.5 0.41 ± 11% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.51 ± 2% -0.4 0.07 ± 6% perf-profile.children.cycles-pp.tcp_check_space 0.60 ± 7% -0.3 0.27 ± 13% perf-profile.children.cycles-pp.tick_sched_timer 0.55 ± 8% -0.3 0.24 ± 15% perf-profile.children.cycles-pp.tick_sched_handle 0.54 ± 8% -0.3 0.23 ± 13% perf-profile.children.cycles-pp.update_process_times 0.33 ± 5% -0.3 0.07 ± 12% perf-profile.children.cycles-pp.__put_compound_page 0.28 ± 12% -0.3 0.03 ±100% perf-profile.children.cycles-pp.irq_exit 0.33 ± 11% -0.2 0.14 ± 17% perf-profile.children.cycles-pp.scheduler_tick 1.24 ± 2% -0.2 1.05 ± 2% perf-profile.children.cycles-pp.simple_copy_to_iter 0.26 ± 12% -0.2 0.11 ± 16% perf-profile.children.cycles-pp.task_tick_fair 0.41 ± 4% -0.1 0.30 ± 5% perf-profile.children.cycles-pp.__skb_clone 0.11 ± 18% -0.1 0.05 ± 61% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.16 ± 14% -0.1 0.10 ± 37% perf-profile.children.cycles-pp.io_serial_in 0.09 ± 4% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.__mod_zone_page_state 1.56 -0.1 1.51 perf-profile.children.cycles-pp.__check_object_size 0.33 ± 3% -0.0 0.28 ± 6% perf-profile.children.cycles-pp.kmem_cache_free 0.14 ± 8% -0.0 0.09 ± 20% perf-profile.children.cycles-pp.prep_new_page 0.33 ± 5% -0.0 0.29 ± 4% perf-profile.children.cycles-pp.kfree 0.36 -0.0 0.34 perf-profile.children.cycles-pp.__list_del_entry_valid 0.22 ± 6% +0.0 0.26 ± 7% perf-profile.children.cycles-pp.skb_entail 0.10 ± 12% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.kfree_skbmem 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.netdev_pick_tx 0.00 +0.1 0.06 ± 15% perf-profile.children.cycles-pp.__netif_receive_skb 0.08 ± 6% +0.1 0.13 ± 3% perf-profile.children.cycles-pp.tcp_cleanup_rbuf 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.__x86_indirect_thunk_r9 0.04 ± 58% +0.1 0.10 ± 8% perf-profile.children.cycles-pp.check_stack_object 0.35 ± 3% +0.1 0.41 ± 7% perf-profile.children.cycles-pp.___might_sleep 0.06 ± 14% +0.1 0.12 ± 11% perf-profile.children.cycles-pp.rb_next 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.ip_queue_xmit 0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.tcp_push 0.00 +0.1 0.06 ± 17% perf-profile.children.cycles-pp.selinux_xfrm_sock_rcv_skb 0.12 ± 8% +0.1 0.18 ± 4% perf-profile.children.cycles-pp.ip_send_check 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.tcp_chrono_start 0.10 ± 15% +0.1 0.17 ± 6% perf-profile.children.cycles-pp.inet_sendmsg 0.03 ±100% +0.1 0.10 ± 13% perf-profile.children.cycles-pp.tcp_established_options 0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.tcp_chrono_stop 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.rb_insert_color_cached 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.rb_first 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.check_cfs_rq_runtime 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.tcp_rate_gen 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.tcp_recv_timestamp 0.04 ± 58% +0.1 0.12 ± 7% perf-profile.children.cycles-pp.tcp_stream_memory_free 0.07 ± 12% +0.1 0.15 ± 7% perf-profile.children.cycles-pp.__tcp_select_window 0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.jiffies_to_usecs 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.__copy_skb_header 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.tcp_send_delayed_ack 0.00 +0.1 0.09 ± 7% perf-profile.children.cycles-pp.resched_curr 0.09 ± 13% +0.1 0.18 ± 5% perf-profile.children.cycles-pp.rcu_all_qs 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.tcp_rate_check_app_limited 0.00 +0.1 0.09 ± 14% perf-profile.children.cycles-pp.__sock_wfree 0.00 +0.1 0.09 ± 15% perf-profile.children.cycles-pp.perf_exclude_event 0.00 +0.1 0.10 ± 5% perf-profile.children.cycles-pp.deactivate_task 0.00 +0.1 0.10 ± 4% perf-profile.children.cycles-pp.tcp_update_pacing_rate 0.00 +0.1 0.10 ± 11% perf-profile.children.cycles-pp.sock_put 0.06 ± 15% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.security_socket_recvmsg 0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.selinux_ipv4_postroute 0.00 +0.1 0.10 ± 14% perf-profile.children.cycles-pp.activate_task 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.netlbl_enabled 0.00 +0.1 0.11 ± 6% perf-profile.children.cycles-pp.tcp_rate_skb_sent 0.18 ± 10% +0.1 0.29 ± 6% perf-profile.children.cycles-pp.ksize 0.04 ± 57% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.__tcp_ack_snd_check 0.11 ± 4% +0.1 0.23 ± 12% perf-profile.children.cycles-pp.import_single_range 0.00 +0.1 0.11 ± 21% perf-profile.children.cycles-pp.tcp_v4_fill_cb 0.00 +0.1 0.12 ± 17% perf-profile.children.cycles-pp.cpumask_next 0.00 +0.1 0.12 ± 7% perf-profile.children.cycles-pp.bictcp_cong_avoid 0.00 +0.1 0.12 ± 5% perf-profile.children.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.12 ± 12% perf-profile.children.cycles-pp.__tcp_v4_send_check 0.00 +0.1 0.12 ± 3% perf-profile.children.cycles-pp.bictcp_acked 0.00 +0.1 0.12 ± 16% perf-profile.children.cycles-pp.skb_clone_tx_timestamp 0.00 +0.1 0.12 ± 4% perf-profile.children.cycles-pp.tcp_newly_delivered 0.00 +0.1 0.12 ± 14% perf-profile.children.cycles-pp.bictcp_cwnd_event 0.00 +0.1 0.13 ± 3% perf-profile.children.cycles-pp.eth_type_trans 0.12 ± 9% +0.1 0.24 ± 9% perf-profile.children.cycles-pp.tcp_add_backlog 0.15 ± 10% +0.1 0.28 ± 2% perf-profile.children.cycles-pp.security_socket_sendmsg 0.06 ± 17% +0.1 0.19 ± 4% perf-profile.children.cycles-pp.sock_recvmsg 0.01 ±173% +0.1 0.15 ± 10% perf-profile.children.cycles-pp.lock_timer_base 0.00 +0.1 0.14 ± 8% perf-profile.children.cycles-pp.add_wait_queue 0.01 ±173% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.__kfree_skb_flush 0.00 +0.1 0.14 ± 7% perf-profile.children.cycles-pp.woken_wake_function 0.00 +0.1 0.14 ± 5% perf-profile.children.cycles-pp.tcp_event_data_recv 0.00 +0.1 0.15 perf-profile.children.cycles-pp.tcp_v4_send_check 0.00 +0.2 0.15 ± 16% perf-profile.children.cycles-pp.selinux_netlbl_sock_rcv_skb 0.04 ± 58% +0.2 0.19 ± 11% perf-profile.children.cycles-pp.tcp_release_cb 0.00 +0.2 0.15 ± 3% perf-profile.children.cycles-pp.set_next_buddy 0.00 +0.2 0.16 ± 8% perf-profile.children.cycles-pp.__check_heap_object 0.01 ±173% +0.2 0.17 ± 9% perf-profile.children.cycles-pp.__list_add_valid 0.03 ±100% +0.2 0.19 perf-profile.children.cycles-pp.netif_skb_features 0.00 +0.2 0.16 ± 9% perf-profile.children.cycles-pp.tcp_update_skb_after_send 0.00 +0.2 0.17 ± 2% perf-profile.children.cycles-pp.tcp_rearm_rto 0.00 +0.2 0.17 ± 2% perf-profile.children.cycles-pp.tcp_wfree 0.00 +0.2 0.17 ± 6% perf-profile.children.cycles-pp.raw_local_deliver 0.00 +0.2 0.17 ± 7% perf-profile.children.cycles-pp.__usecs_to_jiffies 0.00 +0.2 0.17 ± 13% perf-profile.children.cycles-pp.__enqueue_entity 0.69 ± 6% +0.2 0.86 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.03 ±100% +0.2 0.20 ± 7% perf-profile.children.cycles-pp.selinux_ipv4_output 0.00 +0.2 0.17 ± 2% perf-profile.children.cycles-pp.remove_wait_queue 0.19 ± 3% +0.2 0.37 ± 6% perf-profile.children.cycles-pp.__might_fault 0.00 +0.2 0.18 ± 4% perf-profile.children.cycles-pp.clear_buddies 0.16 ± 7% +0.2 0.34 ± 2% perf-profile.children.cycles-pp.sock_has_perm 0.00 +0.2 0.19 ± 9% perf-profile.children.cycles-pp.find_next_bit 0.01 ±173% +0.2 0.21 ± 3% perf-profile.children.cycles-pp.kmalloc_slab 0.07 +0.2 0.27 ± 4% perf-profile.children.cycles-pp.ksoftirqd_running 0.00 +0.2 0.20 ± 4% perf-profile.children.cycles-pp.native_load_tls 0.00 +0.2 0.20 ± 7% perf-profile.children.cycles-pp.rb_erase_cached 0.17 ± 11% +0.2 0.38 ± 4% perf-profile.children.cycles-pp.tcp_rcv_space_adjust 0.00 +0.2 0.21 ± 11% perf-profile.children.cycles-pp.inet_ehashfn 0.00 +0.2 0.21 ± 8% perf-profile.children.cycles-pp.ip_rcv_finish_core 0.09 ± 9% +0.2 0.32 ± 4% perf-profile.children.cycles-pp.validate_xmit_skb 0.00 +0.2 0.23 ± 4% perf-profile.children.cycles-pp.account_entity_enqueue 0.13 ± 6% +0.2 0.36 ± 3% perf-profile.children.cycles-pp.__might_sleep 0.08 ± 11% +0.3 0.33 ± 2% perf-profile.children.cycles-pp.ip_finish_output 0.09 ± 13% +0.3 0.35 ± 6% perf-profile.children.cycles-pp.ip_rcv_core 0.08 ± 8% +0.3 0.35 ± 7% perf-profile.children.cycles-pp.ktime_get_with_offset 0.01 ±173% +0.3 0.29 ± 5% perf-profile.children.cycles-pp.tcp_ack_update_rtt 0.00 +0.3 0.28 ± 6% perf-profile.children.cycles-pp.cpumask_next_wrap 0.40 ± 4% +0.3 0.68 ± 3% perf-profile.children.cycles-pp.tcp_send_mss 0.01 ±173% +0.3 0.30 ± 6% perf-profile.children.cycles-pp.ip_rcv_finish 0.65 ± 5% +0.3 0.94 ± 2% perf-profile.children.cycles-pp._raw_spin_lock 0.39 ± 2% +0.3 0.68 ± 2% perf-profile.children.cycles-pp.tcp_current_mss 0.00 +0.3 0.31 ± 6% perf-profile.children.cycles-pp.__calc_delta 0.00 +0.3 0.31 ± 6% perf-profile.children.cycles-pp.cpuacct_charge 0.08 +0.3 0.40 ± 5% perf-profile.children.cycles-pp.selinux_parse_skb 0.00 +0.3 0.32 ± 2% perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.01 ±173% +0.3 0.34 ± 6% perf-profile.children.cycles-pp.update_min_vruntime 0.23 ± 6% +0.3 0.57 perf-profile.children.cycles-pp.ipv4_mtu 0.10 ± 8% +0.3 0.45 ± 3% perf-profile.children.cycles-pp.skb_release_head_state 0.00 +0.4 0.35 ± 6% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.11 ± 10% +0.4 0.47 ± 4% perf-profile.children.cycles-pp.skb_release_all 0.00 +0.4 0.36 ± 9% perf-profile.children.cycles-pp.native_sched_clock 0.00 +0.4 0.36 ± 8% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.4 0.37 ± 8% perf-profile.children.cycles-pp.sched_clock 0.10 ± 8% +0.4 0.47 ± 2% perf-profile.children.cycles-pp.__sk_dst_check 0.15 ± 5% +0.4 0.53 ± 3% perf-profile.children.cycles-pp.__netif_receive_skb_core 0.27 ± 4% +0.4 0.65 ± 3% perf-profile.children.cycles-pp.mod_timer 0.03 ±100% +0.4 0.40 ± 6% perf-profile.children.cycles-pp.__update_load_avg_se 0.03 ±100% +0.4 0.42 ± 6% perf-profile.children.cycles-pp.account_entity_dequeue 0.00 +0.4 0.40 perf-profile.children.cycles-pp.pick_next_entity 0.00 +0.4 0.41 ± 5% perf-profile.children.cycles-pp.dst_release 0.01 ±173% +0.4 0.42 perf-profile.children.cycles-pp.update_rq_clock 0.00 +0.4 0.41 ± 6% perf-profile.children.cycles-pp.sched_clock_cpu 0.30 ± 5% +0.4 0.72 ± 6% perf-profile.children.cycles-pp.__virt_addr_valid 0.11 ± 7% +0.4 0.53 ± 3% perf-profile.children.cycles-pp.ipv4_dst_check 0.28 ± 2% +0.4 0.70 ± 4% perf-profile.children.cycles-pp.sk_reset_timer 0.20 ± 4% +0.4 0.63 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_bh 0.23 ± 9% +0.4 0.66 perf-profile.children.cycles-pp.tcp_mstamp_refresh 0.00 +0.4 0.43 ± 5% perf-profile.children.cycles-pp.check_preempt_wakeup 0.00 +0.4 0.43 ± 4% perf-profile.children.cycles-pp.finish_task_switch 0.23 ± 6% +0.4 0.67 ± 10% perf-profile.children.cycles-pp.__ip_local_out 0.18 ± 6% +0.4 0.62 ± 4% perf-profile.children.cycles-pp.tcp_event_new_data_sent 0.23 ± 7% +0.5 0.70 ± 9% perf-profile.children.cycles-pp.ip_local_out 0.15 ± 2% +0.5 0.62 perf-profile.children.cycles-pp.enqueue_to_backlog 0.00 +0.5 0.49 ± 4% perf-profile.children.cycles-pp.check_preempt_curr 0.35 +0.5 0.84 ± 3% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 0.13 ± 6% +0.5 0.64 ± 4% perf-profile.children.cycles-pp.avc_has_perm 0.35 ± 2% +0.5 0.88 ± 3% perf-profile.children.cycles-pp.__kmalloc_reserve 0.00 +0.5 0.54 ± 4% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.08 ± 8% +0.5 0.62 ± 4% perf-profile.children.cycles-pp.native_write_msr 0.00 +0.5 0.55 ± 5% perf-profile.children.cycles-pp.put_prev_entity 0.36 ± 5% +0.6 0.91 ± 2% perf-profile.children.cycles-pp.ktime_get 0.23 ± 4% +0.6 0.79 ± 3% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.01 ±173% +0.6 0.61 ± 4% perf-profile.children.cycles-pp.__switch_to_asm 0.22 ± 7% +0.6 0.84 perf-profile.children.cycles-pp.read_tsc 0.00 +0.6 0.62 ± 4% perf-profile.children.cycles-pp.set_next_entity 0.25 ± 2% +0.6 0.89 ± 4% perf-profile.children.cycles-pp.lock_sock_nested 0.11 ± 7% +0.7 0.83 ± 2% perf-profile.children.cycles-pp.tcp_schedule_loss_probe 0.57 ± 2% +0.7 1.30 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.14 ± 11% +0.7 0.87 ± 3% perf-profile.children.cycles-pp.___perf_sw_event 0.00 +0.8 0.77 ± 2% perf-profile.children.cycles-pp.update_cfs_group 0.26 ± 8% +0.8 1.04 perf-profile.children.cycles-pp.__tcp_send_ack 0.00 +0.8 0.79 ± 6% perf-profile.children.cycles-pp.available_idle_cpu 0.42 +0.8 1.22 ± 2% perf-profile.children.cycles-pp.__fget_light 0.16 ± 2% +0.8 0.98 ± 4% perf-profile.children.cycles-pp.selinux_sock_rcv_skb_compat 0.26 ± 4% +0.8 1.10 ± 2% perf-profile.children.cycles-pp.netif_rx_internal 0.27 ± 3% +0.8 1.11 perf-profile.children.cycles-pp.netif_rx 0.24 ± 7% +0.9 1.10 ± 3% perf-profile.children.cycles-pp.selinux_ip_postroute_compat 0.07 ± 17% +0.9 0.96 ± 3% perf-profile.children.cycles-pp.update_load_avg 0.24 ± 6% +0.9 1.15 ± 3% perf-profile.children.cycles-pp.__inet_lookup_established 0.52 ± 2% +0.9 1.43 perf-profile.children.cycles-pp.sockfd_lookup_light 0.30 ± 6% +1.0 1.34 ± 2% perf-profile.children.cycles-pp.selinux_ip_postroute 0.59 ± 6% +1.1 1.65 perf-profile.children.cycles-pp.entry_SYSCALL_64 0.06 ± 15% +1.1 1.19 perf-profile.children.cycles-pp.reweight_entity 0.09 ± 11% +1.1 1.24 perf-profile.children.cycles-pp.enqueue_entity 0.15 ± 10% +1.2 1.32 ± 5% perf-profile.children.cycles-pp.__switch_to 0.30 ± 3% +1.2 1.52 ± 4% perf-profile.children.cycles-pp.selinux_socket_sock_rcv_skb 0.07 ± 17% +1.3 1.34 ± 2% perf-profile.children.cycles-pp.load_new_mm_cr3 0.09 ± 13% +1.3 1.41 ± 3% perf-profile.children.cycles-pp.dequeue_entity 0.33 ± 3% +1.4 1.74 ± 2% perf-profile.children.cycles-pp.security_sock_rcv_skb 0.42 ± 4% +1.4 1.83 ± 4% perf-profile.children.cycles-pp.nf_hook_slow 0.35 ± 4% +1.5 1.87 ± 2% perf-profile.children.cycles-pp.sk_filter_trim_cap 0.36 ± 5% +1.6 1.96 ± 2% perf-profile.children.cycles-pp.kmem_cache_alloc_node 0.46 +1.7 2.12 perf-profile.children.cycles-pp.loopback_xmit 0.17 ± 9% +1.7 1.83 ± 2% perf-profile.children.cycles-pp.update_curr 0.09 ± 13% +1.7 1.81 ± 5% perf-profile.children.cycles-pp.select_idle_sibling 1.14 ± 3% +1.8 2.93 perf-profile.children.cycles-pp.sk_stream_alloc_skb 0.51 ± 2% +1.9 2.35 perf-profile.children.cycles-pp.dev_hard_start_xmit 0.13 ± 16% +2.1 2.20 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair 0.91 ± 7% +2.1 3.04 perf-profile.children.cycles-pp.tcp_clean_rtx_queue 0.21 ± 12% +2.1 2.35 perf-profile.children.cycles-pp.preempt_schedule_common 0.15 ± 11% +2.3 2.42 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop 1.31 ± 3% +2.3 3.61 perf-profile.children.cycles-pp.__alloc_skb 0.10 ± 12% +2.3 2.41 perf-profile.children.cycles-pp.pick_next_task_fair 0.32 ± 6% +2.3 2.66 perf-profile.children.cycles-pp._cond_resched 0.76 ± 2% +2.7 3.49 perf-profile.children.cycles-pp.__dev_queue_xmit 0.18 ± 8% +2.7 2.93 perf-profile.children.cycles-pp.enqueue_task_fair 1.22 ± 6% +2.8 4.04 perf-profile.children.cycles-pp.tcp_ack 0.20 ± 9% +2.9 3.08 perf-profile.children.cycles-pp.ttwu_do_activate 0.27 +3.0 3.25 perf-profile.children.cycles-pp.switch_mm_irqs_off 0.16 ± 18% +3.0 3.17 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair 0.41 ± 9% +6.3 6.76 ± 2% perf-profile.children.cycles-pp.try_to_wake_up 0.43 ± 10% +6.6 7.05 ± 2% perf-profile.children.cycles-pp.__wake_up_common 0.43 ± 9% +6.9 7.29 ± 2% perf-profile.children.cycles-pp.__wake_up_common_lock 0.58 ± 10% +7.4 7.96 perf-profile.children.cycles-pp.schedule_timeout 0.09 ± 48% +7.5 7.56 perf-profile.children.cycles-pp.sock_def_readable 0.58 ± 11% +7.7 8.30 perf-profile.children.cycles-pp.wait_woken 31.19 +7.8 39.02 perf-profile.children.cycles-pp.tcp_sendmsg_locked 5.83 +8.7 14.51 perf-profile.children.cycles-pp.tcp_v4_rcv 5.91 +9.0 14.89 perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 5.93 +9.0 14.96 perf-profile.children.cycles-pp.ip_local_deliver_finish 5.97 +9.2 15.17 perf-profile.children.cycles-pp.ip_local_deliver 0.03 ±173% +9.3 9.34 perf-profile.children.cycles-pp.sk_wait_data 0.73 ± 10% +9.4 10.16 perf-profile.children.cycles-pp.schedule 1.73 ± 5% +9.8 11.49 perf-profile.children.cycles-pp.__release_sock 6.16 +9.8 16.00 perf-profile.children.cycles-pp.ip_rcv 1.94 ± 5% +10.2 12.13 perf-profile.children.cycles-pp.release_sock 6.33 +10.3 16.60 perf-profile.children.cycles-pp.__netif_receive_skb_one_core 6.45 +11.0 17.45 perf-profile.children.cycles-pp.process_backlog 6.20 +11.2 17.45 perf-profile.children.cycles-pp.tcp_rcv_established 0.92 ± 10% +11.4 12.32 perf-profile.children.cycles-pp.__schedule 6.29 +11.5 17.81 perf-profile.children.cycles-pp.tcp_v4_do_rcv 6.56 +11.6 18.13 perf-profile.children.cycles-pp.net_rx_action 6.87 ± 2% +11.7 18.56 perf-profile.children.cycles-pp.__softirqentry_text_start 6.61 +12.0 18.63 perf-profile.children.cycles-pp.do_softirq_own_stack 6.69 +12.4 19.10 perf-profile.children.cycles-pp.do_softirq 6.79 +12.8 19.55 perf-profile.children.cycles-pp.__local_bh_enable_ip 3.74 ± 4% +14.9 18.68 perf-profile.children.cycles-pp.__tcp_push_pending_frames 7.28 +16.2 23.50 perf-profile.children.cycles-pp.ip_finish_output2 7.60 +18.2 25.75 perf-profile.children.cycles-pp.ip_output 31.98 +19.4 51.39 perf-profile.children.cycles-pp.tcp_sendmsg 7.84 +19.6 27.46 perf-profile.children.cycles-pp.__ip_queue_xmit 32.26 +19.7 51.97 perf-profile.children.cycles-pp.sock_sendmsg 32.86 +20.2 53.11 perf-profile.children.cycles-pp.__sys_sendto 32.92 +20.4 53.30 perf-profile.children.cycles-pp.__x64_sys_sendto 3.73 ± 5% +20.5 24.20 perf-profile.children.cycles-pp.tcp_write_xmit 8.20 +22.1 30.33 perf-profile.children.cycles-pp.__tcp_transmit_skb 68.64 -45.8 22.88 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 2.79 ± 3% -1.3 1.54 perf-profile.self.cycles-pp.tcp_sendmsg_locked 1.21 ± 2% -0.9 0.32 ± 2% perf-profile.self.cycles-pp.__free_pages_ok 0.95 ± 8% -0.7 0.22 ± 4% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 1.19 ± 3% -0.7 0.53 perf-profile.self.cycles-pp.__check_object_size 0.59 ± 4% -0.6 0.04 ± 57% perf-profile.self.cycles-pp.skb_clone 0.64 ± 2% -0.5 0.18 ± 9% perf-profile.self.cycles-pp.free_one_page 0.71 ± 3% -0.3 0.37 ± 10% perf-profile.self.cycles-pp.get_page_from_freelist 0.39 ± 5% -0.2 0.22 ± 7% perf-profile.self.cycles-pp.__skb_clone 0.49 -0.1 0.37 ± 3% perf-profile.self.cycles-pp.__skb_datagram_iter 0.09 ± 4% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__mod_zone_page_state 0.13 ± 6% -0.0 0.09 ± 20% perf-profile.self.cycles-pp.prep_new_page 0.36 -0.0 0.33 perf-profile.self.cycles-pp.__list_del_entry_valid 0.04 ± 58% +0.0 0.08 ± 12% perf-profile.self.cycles-pp.check_stack_object 0.01 ±173% +0.0 0.06 ± 9% perf-profile.self.cycles-pp.copyin 0.10 ± 12% +0.0 0.15 ± 7% perf-profile.self.cycles-pp.kfree_skbmem 0.12 ± 10% +0.0 0.17 ± 5% perf-profile.self.cycles-pp.tcp_mstamp_refresh 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__wake_up_common_lock 0.10 +0.1 0.15 ± 6% perf-profile.self.cycles-pp.sockfd_lookup_light 0.04 ± 58% +0.1 0.10 ± 11% perf-profile.self.cycles-pp.tcp_add_backlog 0.01 ±173% +0.1 0.07 ± 19% perf-profile.self.cycles-pp.tcp_send_mss 0.34 ± 3% +0.1 0.40 ± 6% perf-profile.self.cycles-pp.___might_sleep 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.ip_local_deliver_finish 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.__x86_indirect_thunk_r9 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.rb_first 0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.selinux_xfrm_sock_rcv_skb 0.12 ± 8% +0.1 0.18 ± 3% perf-profile.self.cycles-pp.ip_send_check 0.06 ± 7% +0.1 0.12 ± 3% perf-profile.self.cycles-pp.tcp_cleanup_rbuf 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.check_preempt_curr 0.00 +0.1 0.06 perf-profile.self.cycles-pp.tcp_push 0.04 ± 60% +0.1 0.10 ± 12% perf-profile.self.cycles-pp.rb_next 0.99 ± 3% +0.1 1.05 ± 2% perf-profile.self.cycles-pp.tcp_write_xmit 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.tcp_chrono_stop 0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.tcp_chrono_start 0.03 ±100% +0.1 0.09 ± 17% perf-profile.self.cycles-pp.tcp_established_options 0.14 ± 5% +0.1 0.21 ± 7% perf-profile.self.cycles-pp._copy_from_iter_full 0.08 ± 10% +0.1 0.15 ± 3% perf-profile.self.cycles-pp.__might_fault 0.10 ± 5% +0.1 0.17 ± 9% perf-profile.self.cycles-pp.import_single_range 0.09 ± 16% +0.1 0.16 ± 8% perf-profile.self.cycles-pp.inet_sendmsg 0.07 ± 12% +0.1 0.14 ± 5% perf-profile.self.cycles-pp.__tcp_select_window 0.00 +0.1 0.07 ± 5% perf-profile.self.cycles-pp.tcp_rate_gen 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.rb_insert_color_cached 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.tcp_recv_timestamp 0.40 ± 6% +0.1 0.48 ± 3% perf-profile.self.cycles-pp.__alloc_skb 0.04 ± 57% +0.1 0.11 ± 7% perf-profile.self.cycles-pp.__tcp_push_pending_frames 0.08 ± 5% +0.1 0.16 ± 4% perf-profile.self.cycles-pp.rcu_all_qs 0.05 +0.1 0.13 ± 3% perf-profile.self.cycles-pp.tcp_event_new_data_sent 0.00 +0.1 0.08 ± 19% perf-profile.self.cycles-pp.ip_rcv_finish 0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__netif_receive_skb_one_core 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.__copy_skb_header 0.26 ± 3% +0.1 0.33 ± 4% perf-profile.self.cycles-pp._copy_to_iter 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.sk_reset_timer 0.01 ±173% +0.1 0.10 ± 5% perf-profile.self.cycles-pp.tcp_rcv_space_adjust 0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.perf_exclude_event 0.08 ± 6% +0.1 0.16 ± 5% perf-profile.self.cycles-pp.__release_sock 0.00 +0.1 0.09 ± 4% perf-profile.self.cycles-pp.tcp_send_delayed_ack 0.00 +0.1 0.09 ± 9% perf-profile.self.cycles-pp.__sock_wfree 0.00 +0.1 0.09 ± 4% perf-profile.self.cycles-pp.lock_sock_nested 0.00 +0.1 0.09 ± 7% perf-profile.self.cycles-pp.tcp_update_skb_after_send 0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.selinux_ipv4_postroute 0.00 +0.1 0.09 ± 11% perf-profile.self.cycles-pp.netlbl_enabled 0.00 +0.1 0.09 ± 7% perf-profile.self.cycles-pp.resched_curr 0.00 +0.1 0.09 ± 19% perf-profile.self.cycles-pp.skb_clone_tx_timestamp 0.00 +0.1 0.09 ± 4% perf-profile.self.cycles-pp.tcp_rate_check_app_limited 0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.18 ± 4% +0.1 0.27 ± 8% perf-profile.self.cycles-pp.kmem_cache_free 0.01 ±173% +0.1 0.11 ± 7% perf-profile.self.cycles-pp.tcp_stream_memory_free 0.00 +0.1 0.10 ± 5% perf-profile.self.cycles-pp.deactivate_task 0.00 +0.1 0.10 ± 9% perf-profile.self.cycles-pp.sock_put 0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.tcp_queue_rcv 0.50 ± 3% +0.1 0.59 ± 4% perf-profile.self.cycles-pp.skb_release_data 0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.tcp_update_pacing_rate 0.00 +0.1 0.10 ± 14% perf-profile.self.cycles-pp.activate_task 0.17 ± 11% +0.1 0.27 ± 7% perf-profile.self.cycles-pp.ktime_get 0.04 ± 57% +0.1 0.14 ± 11% perf-profile.self.cycles-pp.__tcp_send_ack 0.03 ±100% +0.1 0.13 ± 14% perf-profile.self.cycles-pp.ktime_get_with_offset 0.17 ± 6% +0.1 0.27 ± 4% perf-profile.self.cycles-pp.tcp_current_mss 0.00 +0.1 0.11 ± 15% perf-profile.self.cycles-pp.tcp_v4_fill_cb 0.00 +0.1 0.11 ± 14% perf-profile.self.cycles-pp.selinux_netlbl_sock_rcv_skb 0.00 +0.1 0.11 ± 6% perf-profile.self.cycles-pp.tcp_rate_skb_sent 0.17 ± 12% +0.1 0.28 ± 7% perf-profile.self.cycles-pp.ksize 0.00 +0.1 0.11 ± 11% perf-profile.self.cycles-pp.selinux_ipv4_output 0.00 +0.1 0.11 ± 11% perf-profile.self.cycles-pp.bictcp_cong_avoid 0.04 ± 58% +0.1 0.15 ± 9% perf-profile.self.cycles-pp.tcp_v4_do_rcv 0.00 +0.1 0.11 ± 9% perf-profile.self.cycles-pp.do_softirq_own_stack 0.00 +0.1 0.12 ± 13% perf-profile.self.cycles-pp.validate_xmit_skb 0.00 +0.1 0.12 ± 9% perf-profile.self.cycles-pp.__tcp_v4_send_check 0.00 +0.1 0.12 ± 9% perf-profile.self.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.12 ± 7% perf-profile.self.cycles-pp.__kfree_skb_flush 0.03 ±100% +0.1 0.14 ± 5% perf-profile.self.cycles-pp.simple_copy_to_iter 0.00 +0.1 0.12 ± 5% perf-profile.self.cycles-pp.tcp_newly_delivered 0.00 +0.1 0.12 perf-profile.self.cycles-pp.__tcp_ack_snd_check 0.00 +0.1 0.12 perf-profile.self.cycles-pp.bictcp_acked 0.00 +0.1 0.12 ± 11% perf-profile.self.cycles-pp.bictcp_cwnd_event 0.00 +0.1 0.12 ± 3% perf-profile.self.cycles-pp.eth_type_trans 0.00 +0.1 0.12 ± 4% perf-profile.self.cycles-pp.ip_finish_output 0.00 +0.1 0.13 ± 11% perf-profile.self.cycles-pp.sock_sendmsg 0.00 +0.1 0.13 ± 7% perf-profile.self.cycles-pp.woken_wake_function 0.10 ± 7% +0.1 0.23 ± 10% perf-profile.self.cycles-pp.skb_page_frag_refill 0.00 +0.1 0.13 ± 8% perf-profile.self.cycles-pp.rb_erase_cached 0.00 +0.1 0.13 ± 6% perf-profile.self.cycles-pp._cond_resched 0.01 ±173% +0.1 0.15 ± 7% perf-profile.self.cycles-pp.netif_skb_features 0.00 +0.1 0.14 ± 6% perf-profile.self.cycles-pp.sk_wait_data 0.00 +0.1 0.14 ± 3% perf-profile.self.cycles-pp.__ip_local_out 0.00 +0.1 0.14 ± 3% perf-profile.self.cycles-pp.tcp_v4_send_check 0.02 ±173% +0.1 0.15 ± 9% perf-profile.self.cycles-pp.release_sock 0.00 +0.1 0.14 ± 10% perf-profile.self.cycles-pp.__enqueue_entity 0.00 +0.1 0.14 ± 6% perf-profile.self.cycles-pp.set_next_entity 0.00 +0.1 0.14 ± 7% perf-profile.self.cycles-pp.set_next_buddy 0.00 +0.1 0.14 ± 8% perf-profile.self.cycles-pp.schedule_timeout 0.00 +0.1 0.14 ± 5% perf-profile.self.cycles-pp.sk_filter_trim_cap 0.04 ± 58% +0.1 0.18 ± 2% perf-profile.self.cycles-pp.ip_rcv 0.05 ± 58% +0.1 0.19 ± 8% perf-profile.self.cycles-pp.tcp_sendmsg 0.00 +0.1 0.14 ± 5% perf-profile.self.cycles-pp.tcp_event_data_recv 0.00 +0.1 0.14 ± 7% perf-profile.self.cycles-pp.put_prev_entity 0.00 +0.1 0.14 ± 3% perf-profile.self.cycles-pp.tcp_rearm_rto 0.01 ±173% +0.1 0.16 ± 11% perf-profile.self.cycles-pp.__list_add_valid 0.04 ± 58% +0.1 0.19 ± 8% perf-profile.self.cycles-pp.__x64_sys_sendto 0.00 +0.1 0.15 ± 2% perf-profile.self.cycles-pp.netif_rx_internal 0.00 +0.1 0.15 ± 7% perf-profile.self.cycles-pp.__usecs_to_jiffies 0.03 ±100% +0.2 0.18 ± 14% perf-profile.self.cycles-pp.tcp_release_cb 0.00 +0.2 0.15 ± 2% perf-profile.self.cycles-pp.tcp_wfree 0.00 +0.2 0.16 ± 6% perf-profile.self.cycles-pp.clear_buddies 0.00 +0.2 0.16 ± 6% perf-profile.self.cycles-pp.raw_local_deliver 0.00 +0.2 0.16 ± 8% perf-profile.self.cycles-pp.__check_heap_object 0.00 +0.2 0.16 ± 6% perf-profile.self.cycles-pp.__wake_up_common 0.00 +0.2 0.17 ± 6% perf-profile.self.cycles-pp.__sk_dst_check 0.00 +0.2 0.17 ± 11% perf-profile.self.cycles-pp.find_next_bit 0.04 ± 58% +0.2 0.21 ± 5% perf-profile.self.cycles-pp.ip_protocol_deliver_rcu 0.00 +0.2 0.18 ± 2% perf-profile.self.cycles-pp.schedule 0.01 ±173% +0.2 0.19 ± 28% perf-profile.self.cycles-pp.nf_hook_slow 0.16 ± 7% +0.2 0.34 perf-profile.self.cycles-pp.sock_has_perm 0.06 ± 11% +0.2 0.24 ± 2% perf-profile.self.cycles-pp.selinux_ip_postroute 0.01 ±173% +0.2 0.20 ± 7% perf-profile.self.cycles-pp.security_sock_rcv_skb 0.17 ± 3% +0.2 0.35 ± 5% perf-profile.self.cycles-pp.mod_timer 0.01 ±173% +0.2 0.20 ± 12% perf-profile.self.cycles-pp.inet_recvmsg 0.01 ±173% +0.2 0.20 ± 2% perf-profile.self.cycles-pp.kmalloc_slab 0.00 +0.2 0.19 ± 6% perf-profile.self.cycles-pp.cpumask_next_wrap 0.00 +0.2 0.19 ± 9% perf-profile.self.cycles-pp.sk_stream_alloc_skb 0.07 ± 7% +0.2 0.26 ± 10% perf-profile.self.cycles-pp.sock_def_readable 0.00 +0.2 0.20 ± 2% perf-profile.self.cycles-pp.update_rq_clock 0.00 +0.2 0.20 ± 5% perf-profile.self.cycles-pp.__x64_sys_recvfrom 0.00 +0.2 0.20 ± 2% perf-profile.self.cycles-pp.native_load_tls 0.07 ± 7% +0.2 0.27 ± 4% perf-profile.self.cycles-pp.ksoftirqd_running 0.00 +0.2 0.20 ± 5% perf-profile.self.cycles-pp.tcp_ack_update_rtt 0.16 ± 4% +0.2 0.36 ± 5% perf-profile.self.cycles-pp.__sys_sendto 0.01 ±173% +0.2 0.22 ± 3% perf-profile.self.cycles-pp.ip_local_deliver 0.00 +0.2 0.20 ± 4% perf-profile.self.cycles-pp.do_softirq 0.03 ±100% +0.2 0.23 ± 10% perf-profile.self.cycles-pp.dev_hard_start_xmit 0.00 +0.2 0.21 ± 9% perf-profile.self.cycles-pp.ip_rcv_finish_core 0.00 +0.2 0.21 ± 5% perf-profile.self.cycles-pp.account_entity_enqueue 0.12 ± 5% +0.2 0.33 ± 2% perf-profile.self.cycles-pp.__might_sleep 0.00 +0.2 0.21 ± 11% perf-profile.self.cycles-pp.inet_ehashfn 0.00 +0.2 0.23 ± 3% perf-profile.self.cycles-pp.pick_next_entity 0.00 +0.2 0.23 ± 4% perf-profile.self.cycles-pp.dequeue_entity 0.15 ± 5% +0.2 0.39 ± 4% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.00 +0.2 0.24 ± 5% perf-profile.self.cycles-pp.enqueue_entity 0.09 ± 14% +0.3 0.34 ± 6% perf-profile.self.cycles-pp.ip_rcv_core 0.00 +0.3 0.26 ± 4% perf-profile.self.cycles-pp.check_preempt_wakeup 0.00 +0.3 0.28 ± 8% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.08 ± 6% +0.3 0.36 ± 5% perf-profile.self.cycles-pp.selinux_parse_skb 0.00 +0.3 0.29 ± 5% perf-profile.self.cycles-pp.finish_task_switch 0.08 ± 6% +0.3 0.38 ± 6% perf-profile.self.cycles-pp.__softirqentry_text_start 0.00 +0.3 0.31 ± 6% perf-profile.self.cycles-pp.__calc_delta 0.00 +0.3 0.31 ± 6% perf-profile.self.cycles-pp.cpuacct_charge 0.18 ± 6% +0.3 0.50 perf-profile.self.cycles-pp.tcp_ack 0.08 ± 5% +0.3 0.40 perf-profile.self.cycles-pp.enqueue_to_backlog 0.06 ± 9% +0.3 0.37 ± 6% perf-profile.self.cycles-pp.selinux_sock_rcv_skb_compat 0.00 +0.3 0.32 perf-profile.self.cycles-pp.copy_user_generic_unrolled 0.01 ±173% +0.3 0.33 ± 7% perf-profile.self.cycles-pp.update_min_vruntime 0.08 +0.3 0.40 ± 6% perf-profile.self.cycles-pp.__sys_recvfrom 0.21 ± 8% +0.3 0.54 ± 2% perf-profile.self.cycles-pp.ipv4_mtu 0.00 +0.3 0.33 ± 6% perf-profile.self.cycles-pp.account_entity_dequeue 0.24 ± 3% +0.3 0.57 ± 5% perf-profile.self.cycles-pp.do_syscall_64 0.00 +0.3 0.33 ± 9% perf-profile.self.cycles-pp.native_sched_clock 0.00 +0.3 0.33 ± 4% perf-profile.self.cycles-pp.try_to_wake_up 0.08 ± 13% +0.3 0.42 ± 9% perf-profile.self.cycles-pp.ip_output 0.00 +0.3 0.34 ± 5% perf-profile.self.cycles-pp.wait_woken 0.11 ± 11% +0.3 0.46 ± 4% perf-profile.self.cycles-pp.__local_bh_enable_ip 0.00 +0.3 0.35 ± 8% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.15 ± 8% +0.4 0.51 ± 4% perf-profile.self.cycles-pp.tcp_rcv_established 0.15 ± 4% +0.4 0.52 ± 3% perf-profile.self.cycles-pp.__netif_receive_skb_core 0.10 ± 12% +0.4 0.47 ± 4% perf-profile.self.cycles-pp.selinux_ip_postroute_compat 0.01 ±173% +0.4 0.39 ± 5% perf-profile.self.cycles-pp.__update_load_avg_se 0.00 +0.4 0.38 ± 2% perf-profile.self.cycles-pp.select_task_rq_fair 0.14 ± 10% +0.4 0.53 ± 4% perf-profile.self.cycles-pp.__ip_queue_xmit 0.10 ± 7% +0.4 0.50 ± 3% perf-profile.self.cycles-pp.ipv4_dst_check 0.00 +0.4 0.40 ± 5% perf-profile.self.cycles-pp.dst_release 0.07 ± 10% +0.4 0.47 ± 3% perf-profile.self.cycles-pp.loopback_xmit 0.12 ± 5% +0.4 0.53 ± 5% perf-profile.self.cycles-pp.selinux_socket_sock_rcv_skb 0.29 ± 5% +0.4 0.70 ± 5% perf-profile.self.cycles-pp.__virt_addr_valid 0.17 ± 6% +0.4 0.58 ± 6% perf-profile.self.cycles-pp.__kmalloc_node_track_caller 0.00 +0.4 0.42 ± 4% perf-profile.self.cycles-pp.tcp_schedule_loss_probe 0.07 ± 11% +0.4 0.49 ± 5% perf-profile.self.cycles-pp.net_rx_action 0.17 ± 6% +0.4 0.59 ± 2% perf-profile.self.cycles-pp._raw_spin_lock_bh 0.11 ± 4% +0.4 0.55 ± 2% perf-profile.self.cycles-pp.tcp_clean_rtx_queue 0.01 ±173% +0.4 0.45 ± 8% perf-profile.self.cycles-pp.select_idle_sibling 0.09 ± 9% +0.5 0.55 ± 3% perf-profile.self.cycles-pp.process_backlog 0.00 +0.5 0.48 ± 4% perf-profile.self.cycles-pp.reweight_entity 0.00 +0.5 0.49 ± 4% perf-profile.self.cycles-pp.update_load_avg 0.21 ± 3% +0.5 0.71 ± 3% perf-profile.self.cycles-pp.kmem_cache_alloc_node 0.15 ± 7% +0.5 0.65 ± 2% perf-profile.self.cycles-pp.__dev_queue_xmit 0.12 ± 4% +0.5 0.64 ± 3% perf-profile.self.cycles-pp.avc_has_perm 0.18 ± 6% +0.5 0.71 ± 2% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.06 ± 7% +0.5 0.59 perf-profile.self.cycles-pp.enqueue_task_fair 0.08 ± 8% +0.5 0.62 ± 4% perf-profile.self.cycles-pp.native_write_msr 0.24 +0.6 0.79 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 0.18 ± 8% +0.6 0.74 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.17 ± 7% +0.6 0.75 ± 3% perf-profile.self.cycles-pp.tcp_v4_rcv 0.16 ± 8% +0.6 0.74 ± 6% perf-profile.self.cycles-pp.ip_finish_output2 0.21 ± 7% +0.6 0.80 perf-profile.self.cycles-pp.read_tsc 0.01 ±173% +0.6 0.61 ± 4% perf-profile.self.cycles-pp.__switch_to_asm 0.40 ± 5% +0.6 1.02 ± 2% perf-profile.self.cycles-pp.tcp_recvmsg 0.01 ±173% +0.6 0.63 perf-profile.self.cycles-pp.dequeue_task_fair 0.11 ± 17% +0.6 0.76 ± 4% perf-profile.self.cycles-pp.___perf_sw_event 0.01 ±173% +0.7 0.66 ± 3% perf-profile.self.cycles-pp.pick_next_task_fair 0.57 ± 2% +0.7 1.29 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.20 ± 4% +0.7 0.92 ± 2% perf-profile.self.cycles-pp.__inet_lookup_established 0.00 +0.8 0.75 ± 2% perf-profile.self.cycles-pp.update_cfs_group 0.00 +0.8 0.78 ± 6% perf-profile.self.cycles-pp.available_idle_cpu 0.41 ± 2% +0.8 1.21 ± 2% perf-profile.self.cycles-pp.__fget_light 0.09 ± 7% +0.8 0.91 ± 4% perf-profile.self.cycles-pp.update_curr 0.59 ± 6% +1.1 1.65 perf-profile.self.cycles-pp.entry_SYSCALL_64 0.15 ± 10% +1.1 1.28 ± 6% perf-profile.self.cycles-pp.__switch_to 0.36 ± 4% +1.2 1.56 ± 3% perf-profile.self.cycles-pp.__tcp_transmit_skb 0.07 ± 17% +1.3 1.34 ± 3% perf-profile.self.cycles-pp.load_new_mm_cr3 0.18 ± 10% +1.4 1.58 ± 4% perf-profile.self.cycles-pp.__schedule 0.20 ± 7% +1.7 1.91 perf-profile.self.cycles-pp.switch_mm_irqs_off *************************************************************************************************** lkp-bdw-ex1: 192 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 496G memory ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/process/50%/debian-x86_64-2018-04-03.cgz/lkp-bdw-ex1/hackbench/0xb00002e commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x 1:4 -25% :4 dmesg.WARNING:at_ip__mutex_lock/0x %stddev %change %stddev \ | \ 225085 +20.7% 271587 hackbench.throughput 1058413 ± 7% +33.3% 1410372 hackbench.time.minor_page_faults 19065 -2.3% 18634 hackbench.time.percent_of_cpu_this_job_got 9645 ± 8% +19.0% 11481 hackbench.time.user_time 1.017e+10 ± 7% -19.7% 8.168e+09 ± 2% hackbench.time.voluntary_context_switches 1.44e+09 ± 6% +28.0% 1.843e+09 hackbench.workload 0.79 ± 3% +1.7 2.47 ± 7% mpstat.cpu.all.idle% 34.74 +12.0% 38.90 boot-time.boot 28.21 +14.5% 32.29 boot-time.dhcp 5528 +12.9% 6240 boot-time.idle 91.00 -2.2% 89.00 vmstat.cpu.sy 26090461 -11.9% 22992916 ± 2% vmstat.system.cs 2023424 -67.6% 656476 ± 2% vmstat.system.in 118103 +17.3% 138478 meminfo.KReclaimable 143555 -9.7% 129637 meminfo.PageTables 118103 +17.3% 138478 meminfo.SReclaimable 373765 +11.3% 415847 meminfo.SUnreclaim 491869 +12.7% 554326 meminfo.Slab 6573 ± 5% -19.7% 5280 meminfo.max_used_kB 80384140 ± 5% +1337.5% 1.155e+09 ± 10% cpuidle.C1.time 5827350 ± 3% +2214.5% 1.349e+08 ± 8% cpuidle.C1.usage 46189550 ± 37% +496.9% 2.757e+08 ± 10% cpuidle.C1E.time 1101909 ± 22% +850.6% 10474649 ± 8% cpuidle.C1E.usage 793329 ± 39% +976.4% 8539791 ± 2% cpuidle.C3.usage 4764546 ± 2% +1945.0% 97434431 ± 4% cpuidle.POLL.time 2667063 ± 3% +1184.9% 34270224 ± 7% cpuidle.POLL.usage 14223281 ± 9% +123.8% 31833665 ± 18% numa-numastat.node0.local_node 14245058 ± 9% +123.7% 31860058 ± 18% numa-numastat.node0.numa_hit 13877141 ± 8% +107.3% 28770568 ± 15% numa-numastat.node1.local_node 13897330 ± 8% +107.1% 28787652 ± 15% numa-numastat.node1.numa_hit 13921425 ± 8% +84.1% 25635940 ± 9% numa-numastat.node2.local_node 13944795 ± 8% +84.0% 25662367 ± 9% numa-numastat.node2.numa_hit 13357443 ± 4% +96.2% 26207503 ± 6% numa-numastat.node3.local_node 13384220 ± 4% +96.0% 26230793 ± 5% numa-numastat.node3.numa_hit 2571 -1.4% 2536 turbostat.Avg_MHz 5826140 ± 3% +2214.9% 1.349e+08 ± 8% turbostat.C1 0.07 ± 6% +0.8 0.90 ± 10% turbostat.C1% 1099303 ± 22% +852.3% 10469166 ± 8% turbostat.C1E 0.04 ± 43% +0.2 0.21 ± 11% turbostat.C1E% 791586 ± 39% +978.6% 8538372 ± 2% turbostat.C3 0.44 ± 11% +271.6% 1.64 ± 8% turbostat.CPU%c1 1.274e+09 ± 6% -65.6% 4.386e+08 ± 2% turbostat.IRQ 0.25 ± 12% +30.0% 0.33 ± 16% turbostat.Pkg%pc2 647.04 -2.7% 629.50 turbostat.PkgWatt 32.05 +9.0% 34.95 turbostat.RAMWatt 17253 ± 3% -82.2% 3070 ± 62% numa-meminfo.node0.Inactive 17060 ± 2% -83.1% 2880 ± 66% numa-meminfo.node0.Inactive(anon) 11133 ± 6% -46.5% 5957 ± 9% numa-meminfo.node0.Mapped 3811 ± 55% -65.2% 1325 ± 85% numa-meminfo.node1.Inactive 3808 ± 55% -66.7% 1267 ± 92% numa-meminfo.node1.Inactive(anon) 957.50 ± 10% +1864.8% 18812 ± 5% numa-meminfo.node3.Inactive 861.25 ± 16% +2073.1% 18716 ± 5% numa-meminfo.node3.Inactive(anon) 17808 ± 28% +130.6% 41070 ± 32% numa-meminfo.node3.KReclaimable 5513 ± 2% +103.1% 11197 ± 7% numa-meminfo.node3.Mapped 524693 ± 10% +41.7% 743357 ± 12% numa-meminfo.node3.MemUsed 17808 ± 28% +130.6% 41070 ± 32% numa-meminfo.node3.SReclaimable 50883 ± 11% +30.0% 66155 ± 10% numa-meminfo.node3.SUnreclaim 1836 ± 5% +3416.7% 64584 ±119% numa-meminfo.node3.Shmem 68692 ± 15% +56.1% 107226 ± 14% numa-meminfo.node3.Slab 95537 -4.0% 91729 proc-vmstat.nr_anon_pages 83424 -7.6% 77117 proc-vmstat.nr_kernel_stack 35854 -9.5% 32440 proc-vmstat.nr_page_table_pages 29528 +17.2% 34621 proc-vmstat.nr_slab_reclaimable 93432 +11.3% 103981 proc-vmstat.nr_slab_unreclaimable 178719 ± 3% +61.6% 288853 ± 2% proc-vmstat.numa_hint_faults 12925 ± 15% +307.1% 52624 ± 5% proc-vmstat.numa_hint_faults_local 55484275 ± 5% +102.9% 1.126e+08 ± 5% proc-vmstat.numa_hit 55392142 ± 5% +103.0% 1.125e+08 ± 5% proc-vmstat.numa_local 167271 ± 2% +40.5% 234982 ± 2% proc-vmstat.numa_pages_migrated 232883 ± 10% +59.3% 371095 ± 4% proc-vmstat.numa_pte_updates 55702774 ± 5% +102.5% 1.128e+08 ± 5% proc-vmstat.pgalloc_normal 2462650 ± 6% +34.2% 3304036 proc-vmstat.pgfault 55575748 ± 5% +102.7% 1.127e+08 ± 5% proc-vmstat.pgfree 167271 ± 2% +40.5% 234982 ± 2% proc-vmstat.pgmigrate_success 4245 -83.4% 703.75 ± 67% numa-vmstat.node0.nr_inactive_anon 2768 ± 5% -46.7% 1475 ± 7% numa-vmstat.node0.nr_mapped 4245 -83.4% 703.75 ± 67% numa-vmstat.node0.nr_zone_inactive_anon 7575783 ± 9% +121.7% 16796777 ± 15% numa-vmstat.node0.numa_hit 7553618 ± 9% +121.1% 16701260 ± 15% numa-vmstat.node0.numa_local 22165 ± 30% +330.9% 95520 ± 8% numa-vmstat.node0.numa_other 941.75 ± 55% -64.9% 331.00 ± 95% numa-vmstat.node1.nr_inactive_anon 941.75 ± 55% -64.9% 331.00 ± 95% numa-vmstat.node1.nr_zone_inactive_anon 7139830 ± 10% +106.4% 14735299 ± 17% numa-vmstat.node1.numa_hit 7037135 ± 10% +108.2% 14652179 ± 18% numa-vmstat.node1.numa_local 7348799 ± 8% +82.5% 13409238 ± 10% numa-vmstat.node2.numa_hit 7243086 ± 9% +84.1% 13333727 ± 10% numa-vmstat.node2.numa_local 215.00 ± 16% +2076.3% 4679 ± 5% numa-vmstat.node3.nr_inactive_anon 1376 ± 2% +103.1% 2795 ± 7% numa-vmstat.node3.nr_mapped 458.25 ± 5% +3421.2% 16136 ±119% numa-vmstat.node3.nr_shmem 4451 ± 28% +130.6% 10264 ± 32% numa-vmstat.node3.nr_slab_reclaimable 12720 ± 11% +30.0% 16539 ± 10% numa-vmstat.node3.nr_slab_unreclaimable 215.00 ± 16% +2076.3% 4679 ± 5% numa-vmstat.node3.nr_zone_inactive_anon 6915529 ± 4% +103.4% 14068626 ± 6% numa-vmstat.node3.numa_hit 6806794 ± 4% +105.4% 13980250 ± 6% numa-vmstat.node3.numa_local 118050 +18.4% 139759 slabinfo.Acpi-Parse.active_objs 1669 +16.7% 1948 slabinfo.Acpi-Parse.active_slabs 121872 +16.7% 142239 slabinfo.Acpi-Parse.num_objs 1669 +16.7% 1948 slabinfo.Acpi-Parse.num_slabs 2214 ± 18% +22.8% 2719 ± 6% slabinfo.UNIX.active_objs 2214 ± 18% +22.8% 2719 ± 6% slabinfo.UNIX.num_objs 25084 ± 2% +25.0% 31345 ± 2% slabinfo.cred_jar.active_objs 599.00 ± 2% +24.7% 747.25 ± 2% slabinfo.cred_jar.active_slabs 25176 ± 2% +24.7% 31406 ± 2% slabinfo.cred_jar.num_objs 599.00 ± 2% +24.7% 747.25 ± 2% slabinfo.cred_jar.num_slabs 128657 ± 2% +18.0% 151825 slabinfo.dentry.active_objs 3237 +15.6% 3742 slabinfo.dentry.active_slabs 136004 +15.6% 157201 slabinfo.dentry.num_objs 3237 +15.6% 3742 slabinfo.dentry.num_slabs 22429 ± 3% +15.8% 25964 slabinfo.files_cache.active_objs 22431 ± 3% +15.8% 25965 slabinfo.files_cache.num_objs 15915 ± 2% +9.8% 17481 slabinfo.kmalloc-192.active_objs 16087 ± 2% +9.5% 17613 slabinfo.kmalloc-192.num_objs 15638 ± 2% +9.0% 17045 slabinfo.kmalloc-1k.num_objs 18532 ± 4% +16.0% 21490 slabinfo.mm_struct.active_objs 618.25 ± 4% +16.1% 718.00 slabinfo.mm_struct.active_slabs 18551 ± 4% +16.2% 21552 slabinfo.mm_struct.num_objs 618.25 ± 4% +16.1% 718.00 slabinfo.mm_struct.num_slabs 135.75 ± 7% +60.4% 217.75 ± 19% slabinfo.nfs_read_data.active_objs 135.75 ± 7% +60.4% 217.75 ± 19% slabinfo.nfs_read_data.num_objs 24754 ± 4% +23.8% 30656 slabinfo.pid.active_objs 24785 ± 4% +23.7% 30656 slabinfo.pid.num_objs 32723 ± 2% +87.7% 61435 slabinfo.proc_inode_cache.active_objs 813.00 +57.2% 1277 slabinfo.proc_inode_cache.active_slabs 39863 +57.1% 62638 slabinfo.proc_inode_cache.num_objs 813.00 +57.2% 1277 slabinfo.proc_inode_cache.num_slabs 9611 +62.9% 15655 slabinfo.sighand_cache.active_objs 644.25 +62.5% 1047 slabinfo.sighand_cache.active_slabs 9668 +62.6% 15716 slabinfo.sighand_cache.num_objs 644.25 +62.5% 1047 slabinfo.sighand_cache.num_slabs 12738 +76.2% 22441 slabinfo.signal_cache.active_objs 427.75 +75.4% 750.25 slabinfo.signal_cache.active_slabs 12841 +75.3% 22515 slabinfo.signal_cache.num_objs 427.75 +75.4% 750.25 slabinfo.signal_cache.num_slabs 4592 ± 14% +23.6% 5675 ± 6% slabinfo.sock_inode_cache.active_objs 4592 ± 14% +23.6% 5675 ± 6% slabinfo.sock_inode_cache.num_objs 21488 ± 6% +30.9% 28121 slabinfo.task_delay_info.active_objs 422.00 ± 6% +30.6% 551.00 slabinfo.task_delay_info.active_slabs 21526 ± 6% +30.6% 28121 slabinfo.task_delay_info.num_objs 422.00 ± 6% +30.6% 551.00 slabinfo.task_delay_info.num_slabs 13.54 -21.9% 10.57 perf-stat.i.MPKI 4.103e+10 -9.8% 3.702e+10 perf-stat.i.branch-instructions 6.7e+08 -10.1% 6.024e+08 perf-stat.i.branch-misses 2.05 ± 11% +2.7 4.71 ± 6% perf-stat.i.cache-miss-rate% 50229736 ± 11% +76.3% 88567937 ± 5% perf-stat.i.cache-misses 2.765e+09 -30.8% 1.914e+09 perf-stat.i.cache-references 26233734 -11.7% 23173794 ± 2% perf-stat.i.context-switches 2.45 +10.2% 2.70 perf-stat.i.cpi 4.917e+11 -1.2% 4.858e+11 perf-stat.i.cpu-cycles 5293732 ± 2% +54.8% 8194027 ± 2% perf-stat.i.cpu-migrations 27550 ± 12% -65.5% 9499 ± 8% perf-stat.i.cycles-between-cache-misses 1.45 -0.2 1.30 ± 5% perf-stat.i.dTLB-load-miss-rate% 8.798e+08 -17.4% 7.269e+08 ± 5% perf-stat.i.dTLB-load-misses 5.975e+10 -7.2% 5.545e+10 perf-stat.i.dTLB-loads 0.17 -0.0 0.15 ± 3% perf-stat.i.dTLB-store-miss-rate% 60651584 -18.4% 49461675 ± 2% perf-stat.i.dTLB-store-misses 3.514e+10 -5.7% 3.315e+10 perf-stat.i.dTLB-stores 2.351e+08 -8.5% 2.15e+08 perf-stat.i.iTLB-load-misses 1.892e+08 ± 2% -10.6% 1.692e+08 ± 2% perf-stat.i.iTLB-loads 2.047e+11 -9.3% 1.856e+11 perf-stat.i.instructions 0.42 -8.1% 0.38 perf-stat.i.ipc 3799 +26.5% 4807 perf-stat.i.minor-faults 27633184 ± 12% +54.1% 42582875 ± 5% perf-stat.i.node-load-misses 90038 ± 8% +178.4% 250669 ± 5% perf-stat.i.node-loads 67.09 +5.7 72.77 perf-stat.i.node-store-miss-rate% 9277169 ± 11% +104.8% 19002157 ± 4% perf-stat.i.node-store-misses 3799 +26.5% 4808 perf-stat.i.page-faults 13.51 -23.7% 10.31 perf-stat.overall.MPKI 1.82 ± 11% +2.8 4.62 ± 6% perf-stat.overall.cache-miss-rate% 2.40 +9.0% 2.62 perf-stat.overall.cpi 9929 ± 13% -44.4% 5521 ± 5% perf-stat.overall.cycles-between-cache-misses 1.45 -0.2 1.29 ± 5% perf-stat.overall.dTLB-load-miss-rate% 0.17 -0.0 0.15 ± 3% perf-stat.overall.dTLB-store-miss-rate% 0.42 -8.3% 0.38 perf-stat.overall.ipc 58.76 +14.9 73.64 perf-stat.overall.node-store-miss-rate% 88974 -24.9% 66848 perf-stat.overall.path-length 4.094e+10 -9.9% 3.69e+10 perf-stat.ps.branch-instructions 6.685e+08 -10.2% 6e+08 perf-stat.ps.branch-misses 50223002 ± 11% +75.3% 88020389 ± 5% perf-stat.ps.cache-misses 2.759e+09 -30.9% 1.907e+09 perf-stat.ps.cache-references 26169969 -11.9% 23059459 ± 2% perf-stat.ps.context-switches 4.907e+11 -1.3% 4.846e+11 perf-stat.ps.cpu-cycles 5281365 ± 3% +54.4% 8155464 ± 2% perf-stat.ps.cpu-migrations 8.777e+08 -17.6% 7.234e+08 ± 5% perf-stat.ps.dTLB-load-misses 5.961e+10 -7.3% 5.526e+10 perf-stat.ps.dTLB-loads 60508109 -18.7% 49220837 ± 2% perf-stat.ps.dTLB-store-misses 3.506e+10 -5.8% 3.304e+10 perf-stat.ps.dTLB-stores 2.345e+08 -8.7% 2.141e+08 perf-stat.ps.iTLB-load-misses 1.887e+08 ± 2% -10.8% 1.684e+08 ± 2% perf-stat.ps.iTLB-loads 2.042e+11 -9.4% 1.85e+11 perf-stat.ps.instructions 3839 +26.8% 4870 perf-stat.ps.minor-faults 27612727 ± 12% +53.3% 42317022 ± 5% perf-stat.ps.node-load-misses 90315 ± 8% +177.1% 250238 ± 5% perf-stat.ps.node-loads 9279131 ± 11% +103.5% 18886440 ± 4% perf-stat.ps.node-store-misses 3839 +26.8% 4870 perf-stat.ps.page-faults 7533 ±173% +8874.5% 676122 ± 27% sched_debug.cfs_rq:/.MIN_vruntime.avg 1446490 ±173% +5485.9% 80799552 ± 10% sched_debug.cfs_rq:/.MIN_vruntime.max 104119 ±173% +6629.4% 7006568 ± 17% sched_debug.cfs_rq:/.MIN_vruntime.stddev 5339 +12.9% 6027 ± 6% sched_debug.cfs_rq:/.load.avg 15010 ± 2% +651.7% 112833 ± 53% sched_debug.cfs_rq:/.load.max 2246 +399.3% 11219 ± 37% sched_debug.cfs_rq:/.load.stddev 0.49 ± 32% -100.0% 0.00 sched_debug.cfs_rq:/.load_avg.min 7533 ±173% +8874.5% 676122 ± 27% sched_debug.cfs_rq:/.max_vruntime.avg 1446490 ±173% +5485.9% 80799552 ± 10% sched_debug.cfs_rq:/.max_vruntime.max 104119 ±173% +6629.4% 7006568 ± 17% sched_debug.cfs_rq:/.max_vruntime.stddev 64123643 ± 8% +117.3% 1.393e+08 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg 68790033 ± 8% +130.4% 1.585e+08 ± 4% sched_debug.cfs_rq:/.min_vruntime.max 58488277 ± 9% +107.0% 1.211e+08 ± 5% sched_debug.cfs_rq:/.min_vruntime.min 2495320 ± 9% +169.8% 6731408 ± 3% sched_debug.cfs_rq:/.min_vruntime.stddev 0.09 ± 6% +33.4% 0.12 ± 14% sched_debug.cfs_rq:/.nr_running.stddev 4.32 +12.1% 4.84 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.avg 14.85 ± 5% +379.1% 71.17 ± 59% sched_debug.cfs_rq:/.runnable_load_avg.max 2.29 +266.8% 8.41 ± 33% sched_debug.cfs_rq:/.runnable_load_avg.stddev 14432 ± 2% +674.4% 111767 ± 54% sched_debug.cfs_rq:/.runnable_weight.max 168.95 ± 44% -77.9% 37.34 ± 61% sched_debug.cfs_rq:/.runnable_weight.min 2271 +384.8% 11010 ± 38% sched_debug.cfs_rq:/.runnable_weight.stddev 6934944 ± 35% +219.4% 22147420 ± 29% sched_debug.cfs_rq:/.spread0.max -3299934 +360.4% -15193883 sched_debug.cfs_rq:/.spread0.min 2484365 ± 8% +170.8% 6726686 ± 3% sched_debug.cfs_rq:/.spread0.stddev 950.42 -14.5% 812.63 sched_debug.cfs_rq:/.util_avg.avg 571.85 ± 2% -80.3% 112.55 ± 12% sched_debug.cfs_rq:/.util_avg.min 158.07 ± 4% +85.6% 293.34 ± 4% sched_debug.cfs_rq:/.util_avg.stddev 602.56 +28.5% 774.58 sched_debug.cfs_rq:/.util_est_enqueued.avg 1455 +151.5% 3661 ± 6% sched_debug.cfs_rq:/.util_est_enqueued.max 90.42 ± 12% -98.0% 1.82 ± 52% sched_debug.cfs_rq:/.util_est_enqueued.min 219.40 +214.5% 690.08 ± 3% sched_debug.cfs_rq:/.util_est_enqueued.stddev 226501 ± 8% -44.8% 125051 ± 11% sched_debug.cpu.avg_idle.avg 207832 ± 8% -30.7% 143990 ± 7% sched_debug.cpu.avg_idle.stddev 434.39 ± 3% -65.1% 151.46 ± 37% sched_debug.cpu.clock.stddev 434.39 ± 3% -65.1% 151.46 ± 37% sched_debug.cpu.clock_task.stddev 19482 ± 8% +28.5% 25043 ± 4% sched_debug.cpu.curr->pid.avg 22256 ± 6% +27.9% 28458 ± 3% sched_debug.cpu.curr->pid.max 15765 ± 4% -81.3% 2945 ± 85% sched_debug.cpu.curr->pid.min 1171 ± 10% +194.0% 3444 ± 12% sched_debug.cpu.curr->pid.stddev 5349 +11.8% 5981 ± 6% sched_debug.cpu.load.avg 15081 ± 2% +647.5% 112730 ± 53% sched_debug.cpu.load.max 609.32 ± 51% -98.2% 10.93 ±173% sched_debug.cpu.load.min 2131 +422.5% 11140 ± 37% sched_debug.cpu.load.stddev 500313 +50.9% 755161 sched_debug.cpu.max_idle_balance_cost.avg 525328 ± 2% +141.0% 1265934 ± 3% sched_debug.cpu.max_idle_balance_cost.max 2398 ± 61% +5946.9% 145027 ± 4% sched_debug.cpu.max_idle_balance_cost.stddev 0.00 ± 3% -60.3% 0.00 ± 33% sched_debug.cpu.next_balance.stddev 23.19 ± 3% +59.4% 36.95 ± 2% sched_debug.cpu.nr_running.max 1.50 ± 19% -88.6% 0.17 ± 69% sched_debug.cpu.nr_running.min 3.40 +138.7% 8.11 ± 2% sched_debug.cpu.nr_running.stddev 0.94 ± 24% -82.8% 0.16 ± 7% sched_debug.cpu.nr_uninterruptible.avg 1135 ± 5% -60.8% 445.22 ± 11% sched_debug.cpu.nr_uninterruptible.max -1139 -66.6% -380.52 sched_debug.cpu.nr_uninterruptible.min 411.16 ± 6% -65.7% 141.22 ± 4% sched_debug.cpu.nr_uninterruptible.stddev 2.69 ± 3% +15.9% 3.12 sched_debug.rt_rq:/.rt_runtime.stddev 0.00 ±173% +3.2e+06% 0.16 ± 92% sched_debug.rt_rq:/.rt_time.avg 0.00 ±173% +3.2e+06% 31.42 ± 92% sched_debug.rt_rq:/.rt_time.max 0.00 ±173% +3.2e+06% 2.26 ± 92% sched_debug.rt_rq:/.rt_time.stddev 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 410.50 ± 29% +66.2% 682.25 ± 27% interrupts.135:PCI-MSI.1574917-edge.eth3-TxRx-5 329.50 ± 10% +62.5% 535.50 ± 38% interrupts.136:PCI-MSI.1574918-edge.eth3-TxRx-6 345.25 ± 6% +28.6% 444.00 ± 23% interrupts.139:PCI-MSI.1574921-edge.eth3-TxRx-9 5462964 ± 8% -81.0% 1038418 ± 21% interrupts.CPU0.RES:Rescheduling_interrupts 5183872 ± 9% -81.3% 967437 ± 25% interrupts.CPU1.RES:Rescheduling_interrupts 5365862 ± 10% -80.9% 1025044 ± 19% interrupts.CPU10.RES:Rescheduling_interrupts 5337250 ± 8% -81.6% 981219 ± 19% interrupts.CPU100.RES:Rescheduling_interrupts 5240297 ± 9% -79.8% 1056079 ± 22% interrupts.CPU101.RES:Rescheduling_interrupts 4559 ± 34% +60.2% 7302 interrupts.CPU102.NMI:Non-maskable_interrupts 4559 ± 34% +60.2% 7302 interrupts.CPU102.PMI:Performance_monitoring_interrupts 5343842 ± 6% -80.6% 1034224 ± 21% interrupts.CPU102.RES:Rescheduling_interrupts 5122946 ± 9% -80.0% 1026460 ± 29% interrupts.CPU103.RES:Rescheduling_interrupts 5193731 ± 8% -79.7% 1055687 ± 19% interrupts.CPU104.RES:Rescheduling_interrupts 5301449 ± 7% -81.4% 986673 ± 24% interrupts.CPU105.RES:Rescheduling_interrupts 5265014 ± 9% -80.4% 1033093 ± 19% interrupts.CPU106.RES:Rescheduling_interrupts 5314568 ± 4% -78.7% 1129837 ± 18% interrupts.CPU107.RES:Rescheduling_interrupts 5285793 ± 5% -81.7% 966688 ± 22% interrupts.CPU108.RES:Rescheduling_interrupts 5263596 ± 5% -81.3% 984592 ± 16% interrupts.CPU109.RES:Rescheduling_interrupts 5439939 ± 6% -79.3% 1123573 ± 17% interrupts.CPU11.RES:Rescheduling_interrupts 5366590 ± 6% -80.8% 1031145 ± 20% interrupts.CPU110.RES:Rescheduling_interrupts 5300716 ± 6% -80.6% 1029633 ± 16% interrupts.CPU111.RES:Rescheduling_interrupts 1.00 ± 70% +4000.0% 41.00 ±140% interrupts.CPU111.TLB:TLB_shootdowns 5242314 ± 9% -80.3% 1032501 ± 26% interrupts.CPU112.RES:Rescheduling_interrupts 2.50 ±131% +1720.0% 45.50 ±110% interrupts.CPU112.TLB:TLB_shootdowns 5225141 ± 6% -81.4% 974206 ± 22% interrupts.CPU113.RES:Rescheduling_interrupts 3.25 ±119% +1184.6% 41.75 ±109% interrupts.CPU113.TLB:TLB_shootdowns 5528212 ± 8% -81.4% 1029585 ± 26% interrupts.CPU114.RES:Rescheduling_interrupts 5469151 ± 8% -80.5% 1065412 ± 23% interrupts.CPU115.RES:Rescheduling_interrupts 4.75 ±149% +747.4% 40.25 ±104% interrupts.CPU115.TLB:TLB_shootdowns 5576204 ± 9% -81.8% 1014415 ± 16% interrupts.CPU116.RES:Rescheduling_interrupts 4.00 ±104% +993.8% 43.75 ±115% interrupts.CPU116.TLB:TLB_shootdowns 5217097 ± 7% -80.0% 1042880 ± 23% interrupts.CPU117.RES:Rescheduling_interrupts 5209915 ± 6% -80.7% 1002991 ± 25% interrupts.CPU118.RES:Rescheduling_interrupts 5224685 ± 8% -82.2% 931596 ± 23% interrupts.CPU119.RES:Rescheduling_interrupts 27.75 ± 65% +455.9% 154.25 ± 67% interrupts.CPU119.TLB:TLB_shootdowns 5407909 ± 7% -81.1% 1019586 ± 22% interrupts.CPU12.RES:Rescheduling_interrupts 5353562 ± 7% -81.9% 969357 ± 15% interrupts.CPU120.RES:Rescheduling_interrupts 5396610 ± 6% -81.6% 991466 ± 21% interrupts.CPU121.RES:Rescheduling_interrupts 5354697 ± 9% -81.9% 967707 ± 14% interrupts.CPU122.RES:Rescheduling_interrupts 5448098 ± 7% -82.2% 970154 ± 22% interrupts.CPU123.RES:Rescheduling_interrupts 5311552 ± 7% -83.0% 902456 ± 10% interrupts.CPU124.RES:Rescheduling_interrupts 5510427 ± 9% -82.8% 945593 ± 16% interrupts.CPU125.RES:Rescheduling_interrupts 5268197 ± 9% -81.7% 965375 ± 6% interrupts.CPU126.RES:Rescheduling_interrupts 5238573 ± 7% -81.9% 950543 ± 9% interrupts.CPU127.RES:Rescheduling_interrupts 5459706 ± 7% -83.5% 900078 ± 5% interrupts.CPU128.RES:Rescheduling_interrupts 5441904 ± 8% -81.2% 1024371 ± 8% interrupts.CPU129.RES:Rescheduling_interrupts 5448938 ± 6% -81.5% 1005558 ± 21% interrupts.CPU13.RES:Rescheduling_interrupts 5435775 ± 7% -81.8% 986808 ± 21% interrupts.CPU130.RES:Rescheduling_interrupts 5447326 ± 7% -83.7% 889948 ± 20% interrupts.CPU131.RES:Rescheduling_interrupts 5393830 ± 9% -82.6% 939639 ± 12% interrupts.CPU132.RES:Rescheduling_interrupts 5416079 ± 6% -83.6% 890249 ± 21% interrupts.CPU133.RES:Rescheduling_interrupts 5460459 ± 9% -83.0% 928937 ± 17% interrupts.CPU134.RES:Rescheduling_interrupts 5327963 ± 6% -80.9% 1017458 ± 6% interrupts.CPU135.RES:Rescheduling_interrupts 5288998 ± 8% -81.6% 972161 ± 15% interrupts.CPU136.RES:Rescheduling_interrupts 5349744 ± 7% -83.0% 909341 ± 16% interrupts.CPU137.RES:Rescheduling_interrupts 5434623 ± 8% -82.6% 948030 ± 15% interrupts.CPU138.RES:Rescheduling_interrupts 5347394 ± 8% -82.6% 931342 ± 16% interrupts.CPU139.RES:Rescheduling_interrupts 5492068 ± 7% -81.3% 1028647 ± 21% interrupts.CPU14.RES:Rescheduling_interrupts 5551041 ± 9% -82.2% 987387 ± 16% interrupts.CPU140.RES:Rescheduling_interrupts 5364716 ± 7% -82.2% 952876 ± 13% interrupts.CPU141.RES:Rescheduling_interrupts 5243334 ± 6% -83.0% 890315 ± 14% interrupts.CPU142.RES:Rescheduling_interrupts 5243935 ± 8% -81.3% 981785 ± 6% interrupts.CPU143.RES:Rescheduling_interrupts 5346970 ± 7% -82.6% 931902 ± 4% interrupts.CPU144.RES:Rescheduling_interrupts 5404257 ± 7% -84.4% 845683 ± 5% interrupts.CPU145.RES:Rescheduling_interrupts 5297560 ± 8% -84.8% 803325 ± 16% interrupts.CPU146.RES:Rescheduling_interrupts 5467939 ± 9% -83.6% 898060 ± 5% interrupts.CPU147.RES:Rescheduling_interrupts 5412783 ± 9% -84.1% 860041 ± 5% interrupts.CPU148.RES:Rescheduling_interrupts 5419483 ± 6% -83.0% 921171 ± 5% interrupts.CPU149.RES:Rescheduling_interrupts 5301807 ± 7% -79.7% 1073638 ± 14% interrupts.CPU15.RES:Rescheduling_interrupts 5281416 ± 5% -82.9% 904064 ± 4% interrupts.CPU150.RES:Rescheduling_interrupts 5382637 ± 6% -85.2% 794256 ± 7% interrupts.CPU151.RES:Rescheduling_interrupts 5289499 ± 7% -84.0% 846785 ± 9% interrupts.CPU152.RES:Rescheduling_interrupts 5305681 ± 9% -84.3% 832523 ± 9% interrupts.CPU153.RES:Rescheduling_interrupts 5379441 ± 6% -85.1% 801113 ± 5% interrupts.CPU154.RES:Rescheduling_interrupts 5392635 ± 8% -84.4% 842256 ± 13% interrupts.CPU155.RES:Rescheduling_interrupts 5462683 ± 7% -84.5% 847232 ± 9% interrupts.CPU156.RES:Rescheduling_interrupts 5331786 ± 8% -84.1% 845868 ± 14% interrupts.CPU157.RES:Rescheduling_interrupts 5440358 ± 8% -85.2% 802484 ± 9% interrupts.CPU158.RES:Rescheduling_interrupts 5236443 ± 6% -83.4% 867657 ± 17% interrupts.CPU159.RES:Rescheduling_interrupts 5402795 ± 8% -81.1% 1020426 ± 24% interrupts.CPU16.RES:Rescheduling_interrupts 5255480 ± 6% -83.7% 858624 ± 8% interrupts.CPU160.RES:Rescheduling_interrupts 5330513 ± 8% -84.6% 820103 ± 11% interrupts.CPU161.RES:Rescheduling_interrupts 9.75 ±117% +697.4% 77.75 ± 52% interrupts.CPU161.TLB:TLB_shootdowns 5471221 ± 4% -83.7% 890191 ± 3% interrupts.CPU162.RES:Rescheduling_interrupts 5442676 ± 8% -84.6% 835516 ± 10% interrupts.CPU163.RES:Rescheduling_interrupts 14.25 ± 67% +482.5% 83.00 ± 51% interrupts.CPU163.TLB:TLB_shootdowns 5443036 ± 5% -84.6% 837170 ± 13% interrupts.CPU164.RES:Rescheduling_interrupts 5352649 ± 6% -84.1% 852005 ± 5% interrupts.CPU165.RES:Rescheduling_interrupts 5325219 ± 9% -83.2% 895780 ± 8% interrupts.CPU166.RES:Rescheduling_interrupts 5371594 ± 7% -85.4% 786579 ± 17% interrupts.CPU167.RES:Rescheduling_interrupts 5355521 ± 6% -83.8% 867489 ± 9% interrupts.CPU168.RES:Rescheduling_interrupts 5297817 ± 8% -82.4% 930101 ± 14% interrupts.CPU169.RES:Rescheduling_interrupts 5291753 ± 5% -81.2% 995390 ± 18% interrupts.CPU17.RES:Rescheduling_interrupts 5138213 ± 8% -82.0% 922822 ± 9% interrupts.CPU170.RES:Rescheduling_interrupts 5299888 ± 5% -84.7% 813199 ± 11% interrupts.CPU171.RES:Rescheduling_interrupts 5251161 ± 7% -82.1% 937656 ± 6% interrupts.CPU172.RES:Rescheduling_interrupts 5276705 ± 6% -82.4% 926104 ± 7% interrupts.CPU173.RES:Rescheduling_interrupts 5250973 ± 6% -83.6% 863095 ± 12% interrupts.CPU174.RES:Rescheduling_interrupts 5105789 ± 3% -83.6% 839349 ± 6% interrupts.CPU175.RES:Rescheduling_interrupts 6354 ± 24% -28.4% 4550 ± 34% interrupts.CPU176.NMI:Non-maskable_interrupts 6354 ± 24% -28.4% 4550 ± 34% interrupts.CPU176.PMI:Performance_monitoring_interrupts 5327140 ± 8% -82.4% 936989 ± 5% interrupts.CPU176.RES:Rescheduling_interrupts 6400 ± 24% -28.9% 4553 ± 34% interrupts.CPU177.NMI:Non-maskable_interrupts 6400 ± 24% -28.9% 4553 ± 34% interrupts.CPU177.PMI:Performance_monitoring_interrupts 5317935 ± 6% -83.0% 906340 ± 11% interrupts.CPU177.RES:Rescheduling_interrupts 5298299 ± 7% -81.7% 972143 ± 7% interrupts.CPU178.RES:Rescheduling_interrupts 5355750 ± 8% -83.0% 912401 ± 7% interrupts.CPU179.RES:Rescheduling_interrupts 5449924 ± 8% -80.4% 1068368 ± 24% interrupts.CPU18.RES:Rescheduling_interrupts 5328552 ± 8% -83.3% 891193 ± 12% interrupts.CPU180.RES:Rescheduling_interrupts 22.50 ±113% +286.7% 87.00 ± 45% interrupts.CPU180.TLB:TLB_shootdowns 5359990 ± 6% -82.4% 943569 ± 4% interrupts.CPU181.RES:Rescheduling_interrupts 5292221 ± 9% -82.2% 941649 ± 2% interrupts.CPU182.RES:Rescheduling_interrupts 5224980 ± 6% -83.5% 863062 ± 8% interrupts.CPU183.RES:Rescheduling_interrupts 5139926 ± 9% -82.3% 908920 ± 16% interrupts.CPU184.RES:Rescheduling_interrupts 17.00 ±143% +411.8% 87.00 ± 57% interrupts.CPU184.TLB:TLB_shootdowns 5268294 ± 7% -83.6% 865778 ± 11% interrupts.CPU185.RES:Rescheduling_interrupts 20.50 ±159% +270.7% 76.00 ± 54% interrupts.CPU185.TLB:TLB_shootdowns 5421873 ± 8% -83.4% 901358 ± 8% interrupts.CPU186.RES:Rescheduling_interrupts 5434057 ± 8% -84.2% 860073 ± 12% interrupts.CPU187.RES:Rescheduling_interrupts 5447616 ± 10% -84.0% 873155 ± 6% interrupts.CPU188.RES:Rescheduling_interrupts 5297369 ± 10% -83.0% 902210 ± 8% interrupts.CPU189.RES:Rescheduling_interrupts 42.50 ± 96% +158.8% 110.00 ± 42% interrupts.CPU189.TLB:TLB_shootdowns 5393796 ± 8% -79.9% 1083786 ± 24% interrupts.CPU19.RES:Rescheduling_interrupts 5299321 ± 5% -82.7% 917161 ± 7% interrupts.CPU190.RES:Rescheduling_interrupts 5285541 ± 7% -83.1% 892506 ± 12% interrupts.CPU191.RES:Rescheduling_interrupts 5323136 ± 7% -81.3% 996081 ± 21% interrupts.CPU2.RES:Rescheduling_interrupts 5636641 ± 9% -81.2% 1057766 ± 15% interrupts.CPU20.RES:Rescheduling_interrupts 5326373 ± 5% -80.4% 1044222 ± 23% interrupts.CPU21.RES:Rescheduling_interrupts 5220334 ± 6% -80.6% 1012355 ± 21% interrupts.CPU22.RES:Rescheduling_interrupts 5265783 ± 8% -82.1% 941653 ± 21% interrupts.CPU23.RES:Rescheduling_interrupts 5579736 ± 8% -81.5% 1031971 ± 11% interrupts.CPU24.RES:Rescheduling_interrupts 5600764 ± 7% -82.8% 962491 ± 18% interrupts.CPU25.RES:Rescheduling_interrupts 5391121 ± 9% -82.4% 950538 ± 13% interrupts.CPU26.RES:Rescheduling_interrupts 5538350 ± 10% -83.1% 937100 ± 23% interrupts.CPU27.RES:Rescheduling_interrupts 5398657 ± 7% -83.1% 913526 ± 8% interrupts.CPU28.RES:Rescheduling_interrupts 5501509 ± 8% -83.1% 930565 ± 12% interrupts.CPU29.RES:Rescheduling_interrupts 5405962 ± 7% -81.3% 1009442 ± 16% interrupts.CPU3.RES:Rescheduling_interrupts 5356519 ± 9% -82.2% 954132 ± 6% interrupts.CPU30.RES:Rescheduling_interrupts 5313086 ± 7% -82.1% 952107 ± 8% interrupts.CPU31.RES:Rescheduling_interrupts 5399126 ± 7% -82.5% 944040 ± 8% interrupts.CPU32.RES:Rescheduling_interrupts 5519821 ± 6% -81.2% 1037424 ± 7% interrupts.CPU33.RES:Rescheduling_interrupts 5502433 ± 6% -83.0% 935492 ± 21% interrupts.CPU34.RES:Rescheduling_interrupts 5469237 ± 9% -83.2% 916508 ± 21% interrupts.CPU35.RES:Rescheduling_interrupts 5482589 ± 8% -82.4% 965377 ± 13% interrupts.CPU36.RES:Rescheduling_interrupts 5491197 ± 6% -84.2% 869737 ± 21% interrupts.CPU37.RES:Rescheduling_interrupts 5454697 ± 8% -83.3% 908916 ± 15% interrupts.CPU38.RES:Rescheduling_interrupts 5437983 ± 7% -81.4% 1012352 ± 6% interrupts.CPU39.RES:Rescheduling_interrupts 5403771 ± 6% -81.9% 975655 ± 18% interrupts.CPU4.RES:Rescheduling_interrupts 5320778 ± 10% -82.0% 960082 ± 14% interrupts.CPU40.RES:Rescheduling_interrupts 5317357 ± 10% -82.6% 925830 ± 13% interrupts.CPU41.RES:Rescheduling_interrupts 5382922 ± 6% -82.1% 964021 ± 12% interrupts.CPU42.RES:Rescheduling_interrupts 5480976 ± 7% -82.8% 940220 ± 11% interrupts.CPU43.RES:Rescheduling_interrupts 5522977 ± 10% -81.7% 1012837 ± 15% interrupts.CPU44.RES:Rescheduling_interrupts 5257168 ± 8% -81.8% 956623 ± 16% interrupts.CPU45.RES:Rescheduling_interrupts 5327144 ± 7% -82.8% 914048 ± 11% interrupts.CPU46.RES:Rescheduling_interrupts 5257718 ± 8% -81.3% 985293 ± 6% interrupts.CPU47.RES:Rescheduling_interrupts 5499804 ± 9% -83.6% 900741 ± 6% interrupts.CPU48.RES:Rescheduling_interrupts 5461934 ± 6% -84.3% 856262 ± 5% interrupts.CPU49.RES:Rescheduling_interrupts 410.50 ± 29% +66.2% 682.25 ± 27% interrupts.CPU5.135:PCI-MSI.1574917-edge.eth3-TxRx-5 5322409 ± 6% -80.5% 1038106 ± 19% interrupts.CPU5.RES:Rescheduling_interrupts 5415902 ± 7% -84.4% 842431 ± 16% interrupts.CPU50.RES:Rescheduling_interrupts 5463008 ± 8% -83.7% 891835 ± 5% interrupts.CPU51.RES:Rescheduling_interrupts 5435994 ± 9% -84.1% 861989 ± 5% interrupts.CPU52.RES:Rescheduling_interrupts 5404265 ± 5% -83.9% 871721 ± 3% interrupts.CPU53.RES:Rescheduling_interrupts 5266220 ± 9% -82.7% 908427 ± 6% interrupts.CPU54.RES:Rescheduling_interrupts 5331954 ± 7% -85.1% 794559 ± 3% interrupts.CPU55.RES:Rescheduling_interrupts 5295238 ± 8% -84.4% 826535 ± 10% interrupts.CPU56.RES:Rescheduling_interrupts 5388888 ± 10% -84.7% 827111 ± 6% interrupts.CPU57.RES:Rescheduling_interrupts 5463886 ± 7% -85.7% 780785 ± 6% interrupts.CPU58.RES:Rescheduling_interrupts 5529169 ± 7% -84.8% 838490 ± 12% interrupts.CPU59.RES:Rescheduling_interrupts 329.50 ± 10% +62.5% 535.50 ± 38% interrupts.CPU6.136:PCI-MSI.1574918-edge.eth3-TxRx-6 5389699 ± 9% -81.7% 988800 ± 20% interrupts.CPU6.RES:Rescheduling_interrupts 5491752 ± 7% -84.5% 852401 ± 9% interrupts.CPU60.RES:Rescheduling_interrupts 5457844 ± 6% -83.9% 879582 ± 11% interrupts.CPU61.RES:Rescheduling_interrupts 5508841 ± 9% -85.4% 802775 ± 3% interrupts.CPU62.RES:Rescheduling_interrupts 5336253 ± 5% -83.5% 882307 ± 14% interrupts.CPU63.RES:Rescheduling_interrupts 5309329 ± 7% -83.5% 876896 ± 6% interrupts.CPU64.RES:Rescheduling_interrupts 5363307 ± 7% -85.0% 806230 ± 10% interrupts.CPU65.RES:Rescheduling_interrupts 5457885 ± 5% -84.9% 824626 ± 5% interrupts.CPU66.RES:Rescheduling_interrupts 5395328 ± 7% -84.9% 817040 ± 15% interrupts.CPU67.RES:Rescheduling_interrupts 5524030 ± 6% -84.9% 834101 ± 10% interrupts.CPU68.RES:Rescheduling_interrupts 5307307 ± 4% -83.2% 892619 ± 12% interrupts.CPU69.RES:Rescheduling_interrupts 5226577 ± 6% -80.1% 1041309 ± 22% interrupts.CPU7.RES:Rescheduling_interrupts 5273712 ± 10% -82.5% 924302 ± 9% interrupts.CPU70.RES:Rescheduling_interrupts 5439451 ± 8% -85.7% 779669 ± 14% interrupts.CPU71.RES:Rescheduling_interrupts 5472132 ± 10% -82.8% 942220 ± 6% interrupts.CPU72.RES:Rescheduling_interrupts 5454922 ± 8% -82.4% 959813 ± 11% interrupts.CPU73.RES:Rescheduling_interrupts 5264833 ± 7% -82.3% 931252 ± 4% interrupts.CPU74.RES:Rescheduling_interrupts 5366339 ± 5% -84.0% 857687 ± 9% interrupts.CPU75.RES:Rescheduling_interrupts 5353625 ± 8% -82.4% 944030 ± 6% interrupts.CPU76.RES:Rescheduling_interrupts 5409551 ± 8% -82.7% 937628 ± 8% interrupts.CPU77.RES:Rescheduling_interrupts 5278318 ± 7% -83.4% 876637 ± 11% interrupts.CPU78.RES:Rescheduling_interrupts 5260302 ± 7% -84.2% 832718 ± 3% interrupts.CPU79.RES:Rescheduling_interrupts 5337611 ± 10% -80.1% 1063874 ± 18% interrupts.CPU8.RES:Rescheduling_interrupts 5400408 ± 7% -82.8% 927683 ± 4% interrupts.CPU80.RES:Rescheduling_interrupts 5417027 ± 7% -82.9% 928597 ± 10% interrupts.CPU81.RES:Rescheduling_interrupts 5350995 ± 7% -82.2% 954080 ± 10% interrupts.CPU82.RES:Rescheduling_interrupts 5386013 ± 8% -82.4% 949069 ± 5% interrupts.CPU83.RES:Rescheduling_interrupts 5404818 ± 8% -84.0% 863636 ± 15% interrupts.CPU84.RES:Rescheduling_interrupts 5421469 ± 6% -82.5% 951461 ± 9% interrupts.CPU85.RES:Rescheduling_interrupts 5355367 ± 7% -82.3% 945379 ± 6% interrupts.CPU86.RES:Rescheduling_interrupts 5274728 ± 7% -84.0% 842507 ± 7% interrupts.CPU87.RES:Rescheduling_interrupts 5202607 ± 8% -82.6% 903419 ± 15% interrupts.CPU88.RES:Rescheduling_interrupts 5198129 ± 6% -82.3% 919425 ± 11% interrupts.CPU89.RES:Rescheduling_interrupts 345.25 ± 6% +28.6% 444.00 ± 23% interrupts.CPU9.139:PCI-MSI.1574921-edge.eth3-TxRx-9 5346854 ± 8% -81.3% 1000363 ± 19% interrupts.CPU9.RES:Rescheduling_interrupts 5457231 ± 6% -82.3% 964307 ± 12% interrupts.CPU90.RES:Rescheduling_interrupts 5427939 ± 10% -84.0% 870559 ± 9% interrupts.CPU91.RES:Rescheduling_interrupts 5469138 ± 8% -84.3% 857784 ± 9% interrupts.CPU92.RES:Rescheduling_interrupts 5338540 ± 10% -83.1% 902982 ± 10% interrupts.CPU93.RES:Rescheduling_interrupts 5183783 ± 5% -82.4% 913877 ± 8% interrupts.CPU94.RES:Rescheduling_interrupts 5310673 ± 9% -82.7% 920964 ± 10% interrupts.CPU95.RES:Rescheduling_interrupts 5244217 ± 8% -80.2% 1037244 ± 21% interrupts.CPU96.RES:Rescheduling_interrupts 5237430 ± 8% -81.4% 973729 ± 23% interrupts.CPU97.RES:Rescheduling_interrupts 5199551 ± 8% -80.4% 1020424 ± 21% interrupts.CPU98.RES:Rescheduling_interrupts 5408078 ± 9% -81.8% 981841 ± 17% interrupts.CPU99.RES:Rescheduling_interrupts 1.03e+09 ± 7% -82.6% 1.79e+08 ± 5% interrupts.RES:Rescheduling_interrupts 2010 ± 77% +210.6% 6244 ± 9% interrupts.TLB:TLB_shootdowns 8784 ± 9% +222.5% 28326 ± 14% softirqs.CPU0.SCHED 103747 ± 6% -12.4% 90886 softirqs.CPU1.RCU 6778 ± 2% +270.1% 25086 ± 12% softirqs.CPU1.SCHED 5984 ± 11% +316.6% 24928 ± 17% softirqs.CPU10.SCHED 5884 ± 6% +310.7% 24168 ± 16% softirqs.CPU100.SCHED 6217 ± 7% +309.5% 25461 ± 18% softirqs.CPU101.SCHED 103860 ± 7% -12.5% 90899 softirqs.CPU102.RCU 6159 ± 6% +335.1% 26803 ± 9% softirqs.CPU102.SCHED 5901 ± 5% +327.9% 25254 ± 14% softirqs.CPU103.SCHED 5831 ± 10% +326.5% 24869 ± 10% softirqs.CPU104.SCHED 103012 ± 6% -12.4% 90289 softirqs.CPU105.RCU 5862 ± 10% +342.7% 25953 ± 16% softirqs.CPU105.SCHED 5802 ± 10% +324.1% 24611 ± 17% softirqs.CPU106.SCHED 5837 ± 6% +352.0% 26381 ± 11% softirqs.CPU107.SCHED 5945 ± 5% +296.4% 23568 ± 15% softirqs.CPU108.SCHED 101651 ± 7% -12.1% 89351 softirqs.CPU109.RCU 5995 ± 6% +299.5% 23954 ± 10% softirqs.CPU109.SCHED 102493 ± 7% -12.8% 89395 softirqs.CPU11.RCU 5943 ± 3% +332.8% 25721 ± 11% softirqs.CPU11.SCHED 101602 ± 7% -12.3% 89099 softirqs.CPU110.RCU 6084 ± 10% +317.0% 25376 ± 14% softirqs.CPU110.SCHED 5930 ± 4% +316.6% 24707 ± 13% softirqs.CPU111.SCHED 101164 ± 6% -13.2% 87804 softirqs.CPU112.RCU 5863 ± 3% +349.0% 26324 ± 12% softirqs.CPU112.SCHED 5996 ± 9% +292.9% 23560 ± 15% softirqs.CPU113.SCHED 100390 ± 7% -13.0% 87356 softirqs.CPU114.RCU 6141 ± 9% +297.8% 24432 ± 19% softirqs.CPU114.SCHED 101384 ± 7% -13.5% 87713 softirqs.CPU115.RCU 6294 ± 5% +301.3% 25261 ± 10% softirqs.CPU115.SCHED 6189 ± 6% +297.0% 24573 ± 15% softirqs.CPU116.SCHED 101237 ± 7% -13.0% 88086 softirqs.CPU117.RCU 5981 ± 7% +337.6% 26178 ± 13% softirqs.CPU117.SCHED 5751 ± 10% +339.4% 25270 ± 18% softirqs.CPU118.SCHED 100840 ± 7% -12.7% 88078 softirqs.CPU119.RCU 6039 ± 7% +302.4% 24298 ± 11% softirqs.CPU119.SCHED 101308 ± 7% -12.3% 88886 softirqs.CPU12.RCU 6103 ± 7% +292.6% 23962 ± 16% softirqs.CPU12.SCHED 6223 ± 5% +302.1% 25026 ± 10% softirqs.CPU120.SCHED 6298 ± 2% +258.4% 22573 ± 10% softirqs.CPU121.SCHED 6275 ± 4% +295.8% 24838 ± 13% softirqs.CPU122.SCHED 6294 ± 7% +255.9% 22402 ± 12% softirqs.CPU123.SCHED 6437 ± 3% +253.8% 22777 ± 9% softirqs.CPU124.SCHED 6449 ± 5% +275.2% 24198 ± 18% softirqs.CPU125.SCHED 6386 ± 7% +290.0% 24909 ± 8% softirqs.CPU126.SCHED 6253 ± 4% +266.2% 22902 ± 10% softirqs.CPU127.SCHED 6099 ± 4% +283.6% 23396 ± 12% softirqs.CPU128.SCHED 6249 ± 4% +298.9% 24928 ± 11% softirqs.CPU129.SCHED 5985 ± 6% +299.9% 23935 ± 12% softirqs.CPU13.SCHED 6338 ± 2% +276.8% 23880 ± 17% softirqs.CPU130.SCHED 6086 ± 7% +268.6% 22436 ± 17% softirqs.CPU131.SCHED 6428 ± 3% +287.9% 24934 ± 13% softirqs.CPU132.SCHED 6304 ± 7% +274.4% 23601 ± 17% softirqs.CPU133.SCHED 6402 ± 6% +285.8% 24702 ± 11% softirqs.CPU134.SCHED 6363 ± 3% +276.0% 23926 ± 17% softirqs.CPU135.SCHED 6650 ± 9% +285.7% 25654 ± 11% softirqs.CPU136.SCHED 6122 ± 4% +287.5% 23724 ± 15% softirqs.CPU137.SCHED 6316 ± 6% +275.6% 23725 ± 12% softirqs.CPU138.SCHED 6265 ± 3% +264.0% 22808 ± 12% softirqs.CPU139.SCHED 101084 ± 6% -11.6% 89336 ± 2% softirqs.CPU14.RCU 5966 ± 6% +324.0% 25296 ± 15% softirqs.CPU14.SCHED 6291 ± 7% +289.9% 24527 ± 16% softirqs.CPU140.SCHED 6209 ± 7% +287.3% 24048 ± 15% softirqs.CPU141.SCHED 6189 ± 4% +278.4% 23418 ± 15% softirqs.CPU142.SCHED 6315 ± 6% +289.0% 24568 ± 7% softirqs.CPU143.SCHED 6274 ± 4% +232.9% 20889 ± 9% softirqs.CPU144.SCHED 6060 ± 5% +268.9% 22356 ± 12% softirqs.CPU145.SCHED 6202 ± 6% +220.5% 19881 ± 5% softirqs.CPU146.SCHED 6013 ± 7% +260.8% 21698 ± 4% softirqs.CPU147.SCHED 6186 ± 7% +249.4% 21616 ± 11% softirqs.CPU148.SCHED 6026 ± 8% +268.5% 22209 ± 7% softirqs.CPU149.SCHED 6022 ± 3% +314.5% 24959 ± 15% softirqs.CPU15.SCHED 6389 ± 12% +221.2% 20523 ± 12% softirqs.CPU150.SCHED 6022 ± 7% +264.4% 21948 ± 7% softirqs.CPU151.SCHED 5994 ± 11% +259.0% 21520 ± 8% softirqs.CPU152.SCHED 6345 ± 10% +231.1% 21009 ± 19% softirqs.CPU153.SCHED 6205 ± 6% +240.7% 21138 ± 5% softirqs.CPU154.SCHED 6375 ± 6% +262.2% 23094 ± 7% softirqs.CPU155.SCHED 101975 ± 5% -11.0% 90741 softirqs.CPU156.RCU 6414 ± 4% +234.9% 21481 ± 14% softirqs.CPU156.SCHED 6104 ± 4% +254.9% 21662 ± 6% softirqs.CPU157.SCHED 6297 ± 6% +220.8% 20202 ± 9% softirqs.CPU158.SCHED 6190 ± 6% +233.6% 20649 ± 8% softirqs.CPU159.SCHED 100872 ± 7% -13.3% 87414 softirqs.CPU16.RCU 5986 ± 6% +334.8% 26026 ± 11% softirqs.CPU16.SCHED 97549 ± 4% -11.9% 85921 softirqs.CPU160.RCU 6282 ± 6% +238.4% 21257 ± 4% softirqs.CPU160.SCHED 97838 ± 4% -12.0% 86096 softirqs.CPU161.RCU 6147 ± 8% +227.7% 20145 ± 13% softirqs.CPU161.SCHED 97393 ± 4% -12.2% 85552 softirqs.CPU162.RCU 6387 ± 6% +234.7% 21381 ± 3% softirqs.CPU162.SCHED 96953 ± 4% -10.9% 86337 ± 2% softirqs.CPU163.RCU 6273 ± 5% +247.4% 21793 ± 11% softirqs.CPU163.SCHED 96532 ± 4% -12.2% 84762 softirqs.CPU164.RCU 6347 ± 4% +246.1% 21971 ± 2% softirqs.CPU164.SCHED 97220 ± 4% -11.9% 85666 softirqs.CPU165.RCU 6104 ± 6% +267.9% 22461 ± 9% softirqs.CPU165.SCHED 98222 ± 5% -12.1% 86365 softirqs.CPU166.RCU 5870 ± 9% +276.4% 22097 ± 11% softirqs.CPU166.SCHED 97921 ± 4% -12.9% 85258 ± 2% softirqs.CPU167.RCU 6142 ± 8% +232.1% 20400 ± 10% softirqs.CPU167.SCHED 6301 ± 3% +251.3% 22137 ± 3% softirqs.CPU168.SCHED 96680 ± 6% -11.6% 85423 ± 3% softirqs.CPU169.RCU 6306 ± 6% +277.0% 23777 ± 9% softirqs.CPU169.SCHED 6122 ± 5% +290.7% 23916 ± 14% softirqs.CPU17.SCHED 6035 ± 2% +256.7% 21527 ± 11% softirqs.CPU170.SCHED 6226 ± 3% +238.6% 21083 ± 6% softirqs.CPU171.SCHED 6292 +293.8% 24778 ± 4% softirqs.CPU172.SCHED 6087 ± 4% +286.4% 23521 ± 3% softirqs.CPU173.SCHED 6220 ± 4% +229.3% 20480 ± 3% softirqs.CPU174.SCHED 6264 ± 3% +252.1% 22057 softirqs.CPU175.SCHED 6311 ± 3% +261.1% 22787 ± 9% softirqs.CPU176.SCHED 6133 ± 3% +274.8% 22985 ± 8% softirqs.CPU177.SCHED 6072 ± 2% +267.5% 22315 ± 11% softirqs.CPU178.SCHED 6562 +238.3% 22203 ± 3% softirqs.CPU179.SCHED 6249 ± 7% +281.8% 23861 ± 18% softirqs.CPU18.SCHED 6178 ± 3% +236.2% 20770 ± 11% softirqs.CPU180.SCHED 6095 +267.5% 22396 ± 7% softirqs.CPU181.SCHED 6284 ± 2% +272.9% 23432 ± 4% softirqs.CPU182.SCHED 6390 ± 2% +237.1% 21543 ± 8% softirqs.CPU183.SCHED 6191 ± 4% +252.5% 21824 ± 8% softirqs.CPU184.SCHED 6240 ± 3% +254.4% 22112 ± 11% softirqs.CPU185.SCHED 6327 ± 2% +254.3% 22419 ± 3% softirqs.CPU186.SCHED 6264 ± 7% +253.0% 22110 ± 9% softirqs.CPU187.SCHED 6599 ± 3% +218.6% 21028 ± 10% softirqs.CPU188.SCHED 6216 ± 5% +272.5% 23156 ± 6% softirqs.CPU189.SCHED 100748 ± 7% -13.6% 87038 softirqs.CPU19.RCU 6079 ± 5% +305.3% 24640 ± 10% softirqs.CPU19.SCHED 6083 +267.5% 22357 ± 8% softirqs.CPU190.SCHED 6235 ± 3% +263.4% 22661 ± 7% softirqs.CPU191.SCHED 102386 ± 6% -12.4% 89724 softirqs.CPU2.RCU 6121 +305.5% 24823 ± 15% softirqs.CPU2.SCHED 6153 ± 8% +294.7% 24285 ± 13% softirqs.CPU20.SCHED 5950 ± 6% +329.8% 25575 ± 13% softirqs.CPU21.SCHED 5967 ± 7% +320.7% 25103 ± 18% softirqs.CPU22.SCHED 6269 ± 10% +287.9% 24319 ± 14% softirqs.CPU23.SCHED 6190 ± 6% +277.9% 23395 ± 10% softirqs.CPU24.SCHED 6141 ± 7% +259.2% 22057 ± 8% softirqs.CPU25.SCHED 6227 ± 6% +286.6% 24074 ± 16% softirqs.CPU26.SCHED 6095 ± 2% +264.6% 22225 ± 13% softirqs.CPU27.SCHED 6576 ± 8% +228.7% 21616 ± 9% softirqs.CPU28.SCHED 6383 ± 6% +271.7% 23724 ± 19% softirqs.CPU29.SCHED 6182 ± 8% +260.4% 22280 ± 14% softirqs.CPU3.SCHED 6376 ± 6% +278.1% 24112 ± 8% softirqs.CPU30.SCHED 6234 ± 5% +258.6% 22354 ± 9% softirqs.CPU31.SCHED 6251 ± 2% +272.4% 23276 ± 12% softirqs.CPU32.SCHED 6274 ± 4% +294.2% 24732 ± 11% softirqs.CPU33.SCHED 6252 ± 3% +273.3% 23335 ± 17% softirqs.CPU34.SCHED 6258 ± 5% +250.2% 21915 ± 16% softirqs.CPU35.SCHED 6163 ± 4% +307.6% 25121 ± 15% softirqs.CPU36.SCHED 6293 ± 3% +274.7% 23577 ± 18% softirqs.CPU37.SCHED 6305 ± 7% +286.3% 24356 ± 9% softirqs.CPU38.SCHED 6198 ± 6% +277.3% 23385 ± 17% softirqs.CPU39.SCHED 6146 ± 7% +286.1% 23729 ± 16% softirqs.CPU4.SCHED 6345 ± 6% +288.8% 24669 ± 10% softirqs.CPU40.SCHED 6266 ± 4% +275.1% 23506 ± 13% softirqs.CPU41.SCHED 6229 ± 4% +281.1% 23739 ± 12% softirqs.CPU42.SCHED 6377 ± 4% +253.0% 22510 ± 12% softirqs.CPU43.SCHED 6238 ± 6% +294.0% 24581 ± 12% softirqs.CPU44.SCHED 6143 ± 4% +276.0% 23097 ± 15% softirqs.CPU45.SCHED 6480 ± 2% +259.6% 23302 ± 12% softirqs.CPU46.SCHED 6459 ± 5% +272.5% 24065 ± 7% softirqs.CPU47.SCHED 6864 ± 10% +190.4% 19938 ± 7% softirqs.CPU48.SCHED 6317 ± 3% +232.8% 21021 ± 14% softirqs.CPU49.SCHED 100929 ± 7% -11.2% 89579 softirqs.CPU5.RCU 6162 ± 5% +302.9% 24829 ± 18% softirqs.CPU5.SCHED 6180 ± 5% +221.0% 19839 ± 5% softirqs.CPU50.SCHED 6223 ± 6% +255.6% 22129 ± 4% softirqs.CPU51.SCHED 6326 ± 7% +232.8% 21052 ± 9% softirqs.CPU52.SCHED 100873 ± 5% -10.9% 89873 softirqs.CPU53.RCU 6128 ± 7% +252.4% 21593 ± 9% softirqs.CPU53.SCHED 6157 ± 7% +232.8% 20493 ± 12% softirqs.CPU54.SCHED 6267 ± 6% +251.4% 22028 ± 6% softirqs.CPU55.SCHED 6226 ± 6% +249.5% 21759 ± 7% softirqs.CPU56.SCHED 6043 ± 8% +232.8% 20110 ± 11% softirqs.CPU57.SCHED 6289 ± 3% +231.0% 20814 ± 8% softirqs.CPU58.SCHED 6062 ± 7% +270.1% 22438 ± 6% softirqs.CPU59.SCHED 103009 ± 7% -12.2% 90417 softirqs.CPU6.RCU 6268 ± 5% +306.2% 25461 ± 10% softirqs.CPU6.SCHED 6231 ± 5% +241.9% 21307 ± 14% softirqs.CPU60.SCHED 6156 ± 5% +250.9% 21604 ± 5% softirqs.CPU61.SCHED 6356 ± 11% +207.0% 19513 ± 8% softirqs.CPU62.SCHED 6014 ± 8% +232.7% 20007 ± 8% softirqs.CPU63.SCHED 98408 ± 4% -12.3% 86345 softirqs.CPU64.RCU 6268 ± 7% +228.0% 20561 ± 6% softirqs.CPU64.SCHED 98385 ± 4% -11.9% 86675 softirqs.CPU65.RCU 6377 ± 9% +214.6% 20061 ± 13% softirqs.CPU65.SCHED 97721 ± 4% -12.2% 85813 softirqs.CPU66.RCU 6277 ± 7% +235.6% 21067 ± 5% softirqs.CPU66.SCHED 97451 ± 4% -12.4% 85358 softirqs.CPU67.RCU 6158 ± 6% +249.9% 21547 ± 11% softirqs.CPU67.SCHED 97063 ± 4% -12.3% 85088 softirqs.CPU68.RCU 6355 ± 5% +239.4% 21570 ± 2% softirqs.CPU68.SCHED 98041 ± 4% -10.6% 87675 ± 3% softirqs.CPU69.RCU 6200 ± 5% +263.6% 22543 ± 5% softirqs.CPU69.SCHED 101857 ± 6% -11.8% 89792 softirqs.CPU7.RCU 5993 ± 5% +309.9% 24569 ± 15% softirqs.CPU7.SCHED 98359 ± 4% -11.6% 86918 softirqs.CPU70.RCU 5967 ± 7% +265.9% 21834 ± 10% softirqs.CPU70.SCHED 6310 ± 6% +234.5% 21106 ± 10% softirqs.CPU71.SCHED 6125 ± 6% +238.3% 20722 ± 6% softirqs.CPU72.SCHED 6342 ± 5% +254.2% 22464 ± 8% softirqs.CPU73.SCHED 6138 ± 3% +252.5% 21637 ± 8% softirqs.CPU74.SCHED 6203 ± 2% +241.9% 21209 ± 6% softirqs.CPU75.SCHED 6229 ± 2% +291.6% 24393 ± 5% softirqs.CPU76.SCHED 6349 ± 5% +257.7% 22716 ± 5% softirqs.CPU77.SCHED 6316 ± 6% +218.4% 20110 ± 3% softirqs.CPU78.SCHED 6189 ± 3% +259.7% 22263 ± 2% softirqs.CPU79.SCHED 101827 ± 6% -12.3% 89264 softirqs.CPU8.RCU 5995 ± 6% +304.7% 24265 ± 9% softirqs.CPU8.SCHED 6432 ± 4% +244.4% 22155 ± 8% softirqs.CPU80.SCHED 6241 ± 4% +258.4% 22370 ± 9% softirqs.CPU81.SCHED 6337 ± 6% +248.2% 22065 ± 8% softirqs.CPU82.SCHED 6525 ± 4% +236.2% 21940 ± 4% softirqs.CPU83.SCHED 6285 ± 5% +222.8% 20287 ± 12% softirqs.CPU84.SCHED 6332 +239.5% 21497 ± 6% softirqs.CPU85.SCHED 6222 ± 2% +262.9% 22581 ± 6% softirqs.CPU86.SCHED 6269 ± 4% +232.5% 20845 ± 10% softirqs.CPU87.SCHED 6164 ± 3% +245.8% 21318 ± 8% softirqs.CPU88.SCHED 6396 ± 3% +238.8% 21668 ± 12% softirqs.CPU89.SCHED 101992 ± 6% -11.9% 89810 softirqs.CPU9.RCU 5955 ± 8% +319.6% 24988 ± 15% softirqs.CPU9.SCHED 6372 ± 2% +246.9% 22106 ± 5% softirqs.CPU90.SCHED 6362 ± 8% +247.9% 22134 ± 9% softirqs.CPU91.SCHED 6398 ± 3% +227.9% 20982 ± 11% softirqs.CPU92.SCHED 6301 ± 4% +256.2% 22446 ± 6% softirqs.CPU93.SCHED 6320 +243.2% 21693 ± 8% softirqs.CPU94.SCHED 6532 ± 3% +230.6% 21597 ± 4% softirqs.CPU95.SCHED 108543 ± 7% -18.3% 88650 ± 5% softirqs.CPU96.RCU 6408 ± 11% +298.8% 25553 ± 15% softirqs.CPU96.SCHED 104355 ± 6% -11.2% 92682 ± 4% softirqs.CPU97.RCU 6009 ± 11% +321.3% 25321 ± 14% softirqs.CPU97.SCHED 5702 ± 7% +351.9% 25771 ± 14% softirqs.CPU98.SCHED 6109 ± 10% +281.7% 23318 ± 13% softirqs.CPU99.SCHED 1194898 ± 3% +269.1% 4410557 ± 3% softirqs.SCHED 10.77 ± 10% -6.8 3.99 ± 7% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 9.06 ± 12% -6.2 2.85 ± 10% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 36.77 -5.8 30.94 ± 3% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 34.18 -5.2 28.98 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 33.59 -5.2 28.42 ± 2% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 33.34 -5.1 28.22 ± 2% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 5.97 ± 14% -4.7 1.31 ± 20% perf-profile.calltrace.cycles-pp.available_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 42.08 -3.9 38.20 ± 2% perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 42.50 -3.8 38.75 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 88.28 -3.7 84.54 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 88.86 -3.7 85.18 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 23.37 -3.0 20.35 ± 2% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 44.79 -3.0 41.78 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 45.66 -2.8 42.85 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.99 ± 8% -2.7 1.29 ± 23% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 3.63 ± 8% -2.6 1.00 ± 29% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common 21.63 ± 2% -2.6 19.03 ± 2% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read 21.38 ± 2% -2.6 18.82 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read 30.25 -2.4 27.86 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 30.76 -2.3 28.47 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 34.05 -1.5 32.53 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 34.95 -1.4 33.57 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.51 -0.6 1.87 perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.pipe_wait.pipe_read 2.02 -0.5 1.50 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read 1.55 ± 4% -0.5 1.05 ± 19% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write 1.27 -0.5 0.82 ± 4% perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 1.76 ± 4% -0.4 1.33 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 0.96 ± 3% -0.4 0.55 ± 4% perf-profile.calltrace.cycles-pp.___perf_sw_event.__schedule.schedule.pipe_wait.pipe_read 1.22 -0.4 0.82 ± 4% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 0.63 -0.4 0.26 ±100% perf-profile.calltrace.cycles-pp.anon_pipe_buf_release.pipe_read.new_sync_read.vfs_read.ksys_read 1.05 -0.3 0.78 ± 3% perf-profile.calltrace.cycles-pp.load_new_mm_cr3.switch_mm_irqs_off.__schedule.schedule.pipe_wait 0.92 -0.2 0.69 ± 3% perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.88 -0.2 0.65 ± 4% perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common 2.54 -0.2 2.32 perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 0.90 -0.2 0.70 ± 2% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.73 -0.2 0.55 ± 4% perf-profile.calltrace.cycles-pp.check_preempt_wakeup.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function 0.95 ± 5% -0.2 0.78 ± 2% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule 0.65 +0.0 0.70 ± 2% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.67 +0.1 0.74 ± 2% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.89 ± 2% +0.1 0.95 ± 2% perf-profile.calltrace.cycles-pp.native_write_msr 1.30 ± 2% +0.1 1.41 perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.79 ± 3% +0.1 0.90 ± 3% perf-profile.calltrace.cycles-pp.load_new_mm_cr3.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop 0.66 +0.1 0.79 perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.69 +0.1 0.82 perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.81 ± 2% +0.1 0.96 ± 2% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write 1.14 ± 3% +0.2 1.32 perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.new_sync_write.vfs_write.ksys_write 0.71 ± 3% +0.2 0.96 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write 0.55 ± 4% +0.2 0.80 ± 6% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.77 ± 3% +0.3 1.04 ± 2% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 0.89 +0.3 1.17 ± 2% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 2.41 ± 4% +0.4 2.76 ± 2% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read 2.08 ± 3% +0.4 2.45 ± 2% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 2.14 +0.5 2.60 ± 2% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.12 ±173% +0.5 0.60 ± 3% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.13 ±173% +0.5 0.64 ± 2% perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.new_sync_write.vfs_write.ksys_write 1.47 ± 3% +0.5 2.00 ± 6% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up 1.47 +0.5 2.01 ± 3% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.41 +0.5 1.94 ± 2% perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 0.39 ± 57% +0.5 0.92 ± 4% perf-profile.calltrace.cycles-pp.migrate_task_rq_fair.set_task_cpu.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.00 +0.6 0.56 ± 3% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read 0.00 +0.6 0.56 ± 6% perf-profile.calltrace.cycles-pp.avc_has_perm.file_has_perm.security_file_permission.vfs_read.ksys_read 0.13 ±173% +0.6 0.70 ± 5% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64 0.00 +0.6 0.64 ± 12% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +0.8 0.76 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_read.new_sync_read.vfs_read.ksys_read 0.00 +0.9 0.85 ± 12% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_write.new_sync_write 0.00 +0.9 0.86 ± 12% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_write.new_sync_write.vfs_write 11.62 ± 3% +0.9 12.55 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_wait.pipe_read 0.00 +1.0 0.96 ± 11% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_write.new_sync_write.vfs_write.ksys_write 2.83 +1.0 3.84 ± 3% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 3.37 +1.1 4.45 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 12.51 ± 4% +1.1 13.66 perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 12.78 ± 4% +1.2 13.95 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.00 +1.3 1.31 ± 5% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +1.3 1.31 ± 5% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +1.3 1.31 ± 5% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 0.00 +1.3 1.32 ± 5% perf-profile.calltrace.cycles-pp.secondary_startup_64 6.66 ± 7% +1.8 8.50 ± 2% perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_task_fair.__schedule.schedule.pipe_wait 6.47 ± 7% +2.1 8.57 ± 2% perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 2.79 ± 2% +4.0 6.75 ± 2% perf-profile.calltrace.cycles-pp.set_task_cpu.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 10.79 ± 10% -6.7 4.05 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair 9.24 ± 12% -6.3 2.95 ± 10% perf-profile.children.cycles-pp.select_idle_sibling 37.16 -5.4 31.72 ± 3% perf-profile.children.cycles-pp.__wake_up_common_lock 33.51 -4.8 28.70 ± 2% perf-profile.children.cycles-pp.try_to_wake_up 34.24 -4.8 29.48 ± 2% perf-profile.children.cycles-pp.__wake_up_common 33.60 -4.7 28.88 ± 2% perf-profile.children.cycles-pp.autoremove_wake_function 6.04 ± 14% -4.7 1.35 ± 20% perf-profile.children.cycles-pp.available_idle_cpu 7.03 ± 7% -4.1 2.94 ± 19% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 42.12 -3.9 38.24 ± 2% perf-profile.children.cycles-pp.pipe_write 42.52 -3.7 38.79 ± 2% perf-profile.children.cycles-pp.new_sync_write 88.33 -3.7 84.61 perf-profile.children.cycles-pp.do_syscall_64 6.32 ± 8% -3.6 2.68 ± 14% perf-profile.children.cycles-pp._raw_spin_lock 88.96 -3.6 85.31 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 44.83 -3.0 41.84 perf-profile.children.cycles-pp.vfs_write 45.69 -2.8 42.91 perf-profile.children.cycles-pp.ksys_write 30.29 -2.4 27.92 perf-profile.children.cycles-pp.pipe_read 30.78 -2.3 28.50 perf-profile.children.cycles-pp.new_sync_read 23.45 -2.1 21.35 perf-profile.children.cycles-pp.pipe_wait 27.81 -1.7 26.14 perf-profile.children.cycles-pp.schedule 34.09 -1.5 32.58 perf-profile.children.cycles-pp.vfs_read 34.98 -1.4 33.60 perf-profile.children.cycles-pp.ksys_read 27.71 -1.2 26.49 perf-profile.children.cycles-pp.__schedule 1.51 ± 10% -1.1 0.39 ± 14% perf-profile.children.cycles-pp.cpumask_next_wrap 2.54 -0.8 1.75 ± 4% perf-profile.children.cycles-pp.reweight_entity 3.18 ± 3% -0.8 2.41 ± 3% perf-profile.children.cycles-pp.update_curr 1.44 ± 5% -0.7 0.78 ± 2% perf-profile.children.cycles-pp.update_rq_clock 3.91 -0.5 3.42 ± 2% perf-profile.children.cycles-pp.pick_next_task_fair 0.82 ± 6% -0.5 0.35 ± 3% perf-profile.children.cycles-pp.find_next_bit 1.14 -0.4 0.71 ± 3% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 1.27 -0.4 0.87 ± 2% perf-profile.children.cycles-pp.__update_load_avg_se 2.72 ± 2% -0.4 2.35 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.37 -0.3 0.03 ±100% perf-profile.children.cycles-pp.__mutex_unlock_slowpath 0.67 ± 2% -0.3 0.35 ± 3% perf-profile.children.cycles-pp.__enqueue_entity 1.67 ± 4% -0.3 1.35 ± 5% perf-profile.children.cycles-pp.___perf_sw_event 1.21 -0.3 0.89 ± 3% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.40 ± 13% -0.3 0.12 ± 25% perf-profile.children.cycles-pp.reschedule_interrupt 0.61 -0.3 0.35 ± 4% perf-profile.children.cycles-pp.account_entity_dequeue 0.94 ± 2% -0.2 0.71 ± 3% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.89 ± 2% -0.2 0.67 ± 4% perf-profile.children.cycles-pp.check_preempt_curr 0.81 -0.2 0.61 ± 3% perf-profile.children.cycles-pp.pick_next_entity 0.32 ± 2% -0.2 0.14 perf-profile.children.cycles-pp.__mutex_lock 0.76 ± 2% -0.2 0.58 ± 4% perf-profile.children.cycles-pp.check_preempt_wakeup 0.52 -0.2 0.35 ± 3% perf-profile.children.cycles-pp.account_entity_enqueue 4.68 -0.2 4.53 perf-profile.children.cycles-pp.switch_mm_irqs_off 2.57 -0.1 2.42 perf-profile.children.cycles-pp.dequeue_entity 2.19 ± 2% -0.1 2.05 ± 3% perf-profile.children.cycles-pp.load_new_mm_cr3 0.63 -0.1 0.50 ± 3% perf-profile.children.cycles-pp.anon_pipe_buf_release 0.41 ± 2% -0.1 0.30 ± 3% perf-profile.children.cycles-pp.update_min_vruntime 0.38 -0.1 0.27 ± 3% perf-profile.children.cycles-pp.rb_erase_cached 1.25 -0.1 1.15 perf-profile.children.cycles-pp.set_next_entity 0.70 -0.1 0.60 ± 4% perf-profile.children.cycles-pp.__calc_delta 0.28 -0.1 0.18 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid 0.18 ± 2% -0.1 0.10 perf-profile.children.cycles-pp.deactivate_task 0.53 ± 2% -0.1 0.47 ± 3% perf-profile.children.cycles-pp.sched_clock_cpu 0.13 -0.1 0.08 perf-profile.children.cycles-pp.rb_next 0.45 ± 2% -0.0 0.41 ± 4% perf-profile.children.cycles-pp.sched_clock 0.43 ± 2% -0.0 0.39 ± 4% perf-profile.children.cycles-pp.native_sched_clock 0.33 ± 3% -0.0 0.28 ± 4% perf-profile.children.cycles-pp.clear_buddies 0.17 ± 2% -0.0 0.13 ± 5% perf-profile.children.cycles-pp.set_next_buddy 0.17 ± 3% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.21 ± 5% -0.0 0.17 ± 6% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.41 -0.0 0.38 ± 2% perf-profile.children.cycles-pp.prepare_to_wait 0.11 ± 3% -0.0 0.08 perf-profile.children.cycles-pp.finish_wait 0.12 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.rb_insert_color_cached 0.11 ± 3% -0.0 0.10 ± 5% perf-profile.children.cycles-pp.__list_add_valid 0.16 ± 4% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.resched_curr 0.18 ± 4% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.__sb_start_write 0.09 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.__sb_end_write 0.11 ± 7% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64 0.17 +0.0 0.21 ± 2% perf-profile.children.cycles-pp.generic_pipe_buf_confirm 0.01 ±173% +0.0 0.06 ± 9% perf-profile.children.cycles-pp.__strcspn_sse42 0.01 ±173% +0.0 0.06 ± 9% perf-profile.children.cycles-pp.generic_start_main 0.01 ±173% +0.0 0.06 ± 9% perf-profile.children.cycles-pp.main 0.01 ±173% +0.0 0.06 ± 9% perf-profile.children.cycles-pp.run_builtin 0.29 ± 3% +0.0 0.33 ± 3% perf-profile.children.cycles-pp.cpus_share_cache 0.18 ± 2% +0.0 0.22 ± 3% perf-profile.children.cycles-pp.activate_task 0.09 +0.0 0.14 ± 6% perf-profile.children.cycles-pp.iov_iter_init 0.00 +0.1 0.05 perf-profile.children.cycles-pp.bpf_fd_pass 0.23 ± 6% +0.1 0.29 ± 9% perf-profile.children.cycles-pp.scheduler_tick 0.18 ± 3% +0.1 0.24 ± 3% perf-profile.children.cycles-pp.__task_rq_lock 0.30 ± 6% +0.1 0.36 ± 10% perf-profile.children.cycles-pp.tick_sched_timer 0.28 ± 6% +0.1 0.33 ± 10% perf-profile.children.cycles-pp.update_process_times 0.20 ± 6% +0.1 0.26 ± 9% perf-profile.children.cycles-pp.task_tick_fair 0.28 ± 6% +0.1 0.34 ± 9% perf-profile.children.cycles-pp.tick_sched_handle 0.97 +0.1 1.04 ± 2% perf-profile.children.cycles-pp.native_write_msr 0.41 +0.1 0.48 ± 4% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.36 ± 6% +0.1 0.43 ± 8% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.09 +0.1 0.16 ± 6% perf-profile.children.cycles-pp.timespec64_trunc 0.13 ± 6% +0.1 0.21 ± 2% perf-profile.children.cycles-pp.attach_entity_load_avg 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.menu_select 0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.attach_task 0.51 ± 5% +0.1 0.58 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt 0.11 ± 4% +0.1 0.19 ± 6% perf-profile.children.cycles-pp.inode_has_perm 0.20 ± 4% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.rcu_all_qs 0.26 +0.1 0.35 ± 3% perf-profile.children.cycles-pp.__x64_sys_write 0.46 ± 2% +0.1 0.55 ± 3% perf-profile.children.cycles-pp._cond_resched 0.38 ± 5% +0.1 0.51 ± 3% perf-profile.children.cycles-pp.__fsnotify_parent 0.00 +0.1 0.13 ± 11% perf-profile.children.cycles-pp.poll_idle 0.19 ± 4% +0.1 0.33 ± 6% perf-profile.children.cycles-pp.remove_entity_load_avg 0.39 +0.1 0.53 ± 4% perf-profile.children.cycles-pp.__might_fault 0.51 ± 2% +0.1 0.66 ± 2% perf-profile.children.cycles-pp.file_update_time 0.06 ± 13% +0.2 0.21 ± 7% perf-profile.children.cycles-pp.irq_exit 0.06 ± 9% +0.2 0.21 ± 7% perf-profile.children.cycles-pp.__softirqentry_text_start 0.73 ± 2% +0.2 0.89 ± 3% perf-profile.children.cycles-pp.fsnotify 1.32 +0.2 1.48 perf-profile.children.cycles-pp.__fget_light 0.00 +0.2 0.17 ± 7% perf-profile.children.cycles-pp.load_balance 0.00 +0.2 0.17 ± 7% perf-profile.children.cycles-pp.rebalance_domains 0.40 +0.2 0.57 ± 5% perf-profile.children.cycles-pp.current_time 0.48 +0.2 0.66 ± 7% perf-profile.children.cycles-pp.__inode_security_revalidate 0.51 ± 2% +0.2 0.69 ± 5% perf-profile.children.cycles-pp.__might_sleep 1.39 +0.2 1.60 perf-profile.children.cycles-pp.__fdget_pos 1.60 ± 3% +0.2 1.83 ± 2% perf-profile.children.cycles-pp.mutex_unlock 0.59 ± 6% +0.2 0.83 ± 7% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.65 ± 6% +0.2 0.89 ± 7% perf-profile.children.cycles-pp.apic_timer_interrupt 0.74 +0.2 0.99 ± 5% perf-profile.children.cycles-pp.___might_sleep 0.78 ± 3% +0.3 1.06 ± 2% perf-profile.children.cycles-pp.copyin 0.74 ± 3% +0.3 1.03 ± 4% perf-profile.children.cycles-pp.avc_has_perm 1.68 +0.3 2.00 ± 2% perf-profile.children.cycles-pp.mutex_lock 2.21 ± 5% +0.3 2.53 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 2.43 ± 4% +0.4 2.81 ± 2% perf-profile.children.cycles-pp.copy_page_to_iter 2.21 +0.4 2.59 perf-profile.children.cycles-pp.selinux_file_permission 0.52 ± 3% +0.4 0.96 ± 4% perf-profile.children.cycles-pp.migrate_task_rq_fair 1.06 ± 2% +0.5 1.54 ± 5% perf-profile.children.cycles-pp.file_has_perm 0.00 +0.5 0.49 ± 12% perf-profile.children.cycles-pp.intel_idle 0.00 +0.5 0.54 ± 10% perf-profile.children.cycles-pp.schedule_idle 1.43 +0.5 1.98 ± 3% perf-profile.children.cycles-pp.copy_page_from_iter 3.58 ± 2% +0.6 4.17 ± 3% perf-profile.children.cycles-pp.update_load_avg 0.00 +0.6 0.64 ± 11% perf-profile.children.cycles-pp.cpuidle_enter_state 3.63 +1.0 4.64 ± 3% perf-profile.children.cycles-pp.security_file_permission 3.38 +1.1 4.46 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64 3.23 +1.2 4.39 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.00 +1.3 1.31 ± 5% perf-profile.children.cycles-pp.start_secondary 0.00 +1.3 1.32 ± 5% perf-profile.children.cycles-pp.secondary_startup_64 0.00 +1.3 1.32 ± 5% perf-profile.children.cycles-pp.cpu_startup_entry 0.00 +1.3 1.32 ± 5% perf-profile.children.cycles-pp.do_idle 12.87 ± 4% +1.5 14.33 perf-profile.children.cycles-pp.ttwu_do_activate 11.67 ± 3% +1.5 13.14 perf-profile.children.cycles-pp.dequeue_task_fair 12.62 ± 4% +1.5 14.12 perf-profile.children.cycles-pp.enqueue_task_fair 2.81 ± 2% +4.0 6.82 ± 2% perf-profile.children.cycles-pp.set_task_cpu 13.32 ± 7% +4.9 18.24 perf-profile.children.cycles-pp.update_cfs_group 5.97 ± 14% -4.6 1.33 ± 20% perf-profile.self.cycles-pp.available_idle_cpu 7.01 ± 7% -4.1 2.93 ± 19% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.88 ± 10% -0.7 0.23 ± 14% perf-profile.self.cycles-pp.cpumask_next_wrap 1.22 ± 7% -0.7 0.56 ± 2% perf-profile.self.cycles-pp.select_idle_sibling 1.69 ± 3% -0.6 1.07 perf-profile.self.cycles-pp.update_curr 1.10 ± 6% -0.6 0.49 ± 5% perf-profile.self.cycles-pp.update_rq_clock 1.24 -0.4 0.84 ± 2% perf-profile.self.cycles-pp.__update_load_avg_se 0.71 ± 6% -0.4 0.32 ± 4% perf-profile.self.cycles-pp.find_next_bit 1.07 -0.4 0.68 ± 3% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 1.29 -0.4 0.91 ± 3% perf-profile.self.cycles-pp.select_task_rq_fair 1.55 ± 4% -0.3 1.21 ± 5% perf-profile.self.cycles-pp.___perf_sw_event 0.66 ± 2% -0.3 0.34 ± 3% perf-profile.self.cycles-pp.__enqueue_entity 2.27 ± 3% -0.2 2.03 perf-profile.self.cycles-pp.__schedule 0.50 -0.2 0.31 ± 4% perf-profile.self.cycles-pp.account_entity_dequeue 0.85 -0.2 0.67 ± 5% perf-profile.self.cycles-pp.enqueue_task_fair 0.80 -0.2 0.62 ± 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.86 -0.2 0.70 ± 4% perf-profile.self.cycles-pp.pick_next_task_fair 0.60 ± 2% -0.2 0.44 perf-profile.self.cycles-pp.try_to_wake_up 0.53 -0.2 0.38 ± 3% perf-profile.self.cycles-pp.pipe_wait 0.47 -0.1 0.33 ± 3% perf-profile.self.cycles-pp.account_entity_enqueue 0.81 -0.1 0.66 ± 4% perf-profile.self.cycles-pp.reweight_entity 2.18 ± 2% -0.1 2.04 ± 3% perf-profile.self.cycles-pp.load_new_mm_cr3 0.61 -0.1 0.48 ± 4% perf-profile.self.cycles-pp.anon_pipe_buf_release 0.36 ± 2% -0.1 0.25 ± 4% perf-profile.self.cycles-pp.enqueue_entity 0.39 ± 2% -0.1 0.28 ± 3% perf-profile.self.cycles-pp.update_min_vruntime 0.16 ± 4% -0.1 0.05 ± 8% perf-profile.self.cycles-pp.__mutex_lock 0.70 -0.1 0.60 ± 4% perf-profile.self.cycles-pp.__calc_delta 0.27 ± 3% -0.1 0.18 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid 0.38 ± 6% -0.1 0.29 ± 3% perf-profile.self.cycles-pp.finish_task_switch 0.35 ± 3% -0.1 0.27 ± 4% perf-profile.self.cycles-pp.check_preempt_wakeup 0.18 ± 2% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.deactivate_task 0.65 -0.1 0.57 ± 2% perf-profile.self.cycles-pp.dequeue_task_fair 0.36 -0.1 0.30 ± 4% perf-profile.self.cycles-pp.pick_next_entity 0.13 ± 5% -0.1 0.07 perf-profile.self.cycles-pp.check_preempt_curr 0.26 -0.1 0.20 ± 3% perf-profile.self.cycles-pp.rb_erase_cached 0.12 -0.0 0.07 perf-profile.self.cycles-pp.rb_next 0.83 ± 2% -0.0 0.78 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 0.16 ± 2% -0.0 0.11 ± 7% perf-profile.self.cycles-pp.set_next_buddy 0.23 ± 3% -0.0 0.18 ± 2% perf-profile.self.cycles-pp.dequeue_entity 0.42 -0.0 0.37 ± 3% perf-profile.self.cycles-pp.native_sched_clock 0.28 ± 4% -0.0 0.24 ± 4% perf-profile.self.cycles-pp.clear_buddies 0.15 ± 5% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.23 ± 2% -0.0 0.19 ± 3% perf-profile.self.cycles-pp.prepare_to_wait 0.21 ± 5% -0.0 0.17 ± 6% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.08 ± 5% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.finish_wait 0.19 ± 3% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.set_next_entity 0.12 ± 4% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.autoremove_wake_function 0.12 ± 3% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.rb_insert_color_cached 0.11 ± 4% -0.0 0.09 ± 4% perf-profile.self.cycles-pp.__list_add_valid 0.07 ± 5% -0.0 0.06 perf-profile.self.cycles-pp.sched_clock_cpu 0.05 +0.0 0.06 perf-profile.self.cycles-pp.kill_fasync 0.12 ± 3% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.15 ± 3% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.__might_fault 0.19 +0.0 0.21 ± 3% perf-profile.self.cycles-pp.__wake_up_common_lock 0.10 ± 8% +0.0 0.13 ± 6% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.18 ± 4% +0.0 0.21 ± 3% perf-profile.self.cycles-pp.__sb_start_write 0.15 +0.0 0.18 ± 2% perf-profile.self.cycles-pp.generic_pipe_buf_confirm 0.09 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.iov_iter_init 0.09 +0.0 0.13 ± 5% perf-profile.self.cycles-pp.__sb_end_write 0.28 ± 4% +0.0 0.33 ± 2% perf-profile.self.cycles-pp.cpus_share_cache 0.18 ± 2% +0.0 0.22 ± 3% perf-profile.self.cycles-pp.activate_task 0.08 ± 5% +0.1 0.13 ± 3% perf-profile.self.cycles-pp.__fdget_pos 0.17 +0.1 0.23 ± 3% perf-profile.self.cycles-pp.file_update_time 0.17 ± 3% +0.1 0.23 ± 7% perf-profile.self.cycles-pp.ksys_write 0.97 +0.1 1.03 ± 2% perf-profile.self.cycles-pp.native_write_msr 0.08 ± 5% +0.1 0.15 ± 5% perf-profile.self.cycles-pp.timespec64_trunc 0.38 +0.1 0.44 ± 3% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.43 ± 3% +0.1 0.49 ± 3% perf-profile.self.cycles-pp.new_sync_read 0.10 ± 4% +0.1 0.17 ± 6% perf-profile.self.cycles-pp.inode_has_perm 0.15 ± 3% +0.1 0.22 ± 4% perf-profile.self.cycles-pp.rcu_all_qs 0.20 ± 3% +0.1 0.27 ± 3% perf-profile.self.cycles-pp.ksys_read 0.21 ± 2% +0.1 0.28 ± 6% perf-profile.self.cycles-pp.current_time 0.12 ± 6% +0.1 0.20 ± 2% perf-profile.self.cycles-pp.attach_entity_load_avg 0.23 +0.1 0.30 ± 3% perf-profile.self.cycles-pp.__x64_sys_write 0.17 ± 3% +0.1 0.24 ± 4% perf-profile.self.cycles-pp._cond_resched 0.17 ± 2% +0.1 0.25 ± 6% perf-profile.self.cycles-pp.__inode_security_revalidate 1.12 +0.1 1.22 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.67 +0.1 0.77 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.23 ± 2% +0.1 0.33 ± 9% perf-profile.self.cycles-pp.vfs_write 0.20 ± 2% +0.1 0.30 ± 7% perf-profile.self.cycles-pp.file_has_perm 0.29 ± 2% +0.1 0.40 ± 7% perf-profile.self.cycles-pp.security_file_permission 0.00 +0.1 0.10 ± 10% perf-profile.self.cycles-pp.poll_idle 0.35 ± 7% +0.1 0.46 ± 3% perf-profile.self.cycles-pp.__fsnotify_parent 0.36 +0.1 0.47 perf-profile.self.cycles-pp.new_sync_write 0.28 +0.1 0.40 ± 4% perf-profile.self.cycles-pp.copy_page_from_iter 0.47 +0.1 0.60 ± 2% perf-profile.self.cycles-pp.vfs_read 0.70 ± 3% +0.2 0.85 ± 3% perf-profile.self.cycles-pp.fsnotify 1.29 +0.2 1.44 ± 2% perf-profile.self.cycles-pp.__fget_light 0.55 +0.2 0.70 ± 3% perf-profile.self.cycles-pp.copy_page_to_iter 1.05 +0.2 1.21 ± 2% perf-profile.self.cycles-pp.mutex_lock 0.68 ± 2% +0.2 0.84 ± 3% perf-profile.self.cycles-pp.pipe_write 0.45 +0.2 0.61 ± 5% perf-profile.self.cycles-pp.__might_sleep 0.76 +0.2 0.93 ± 3% perf-profile.self.cycles-pp.do_syscall_64 1.68 +0.2 1.88 ± 2% perf-profile.self.cycles-pp.selinux_file_permission 1.58 ± 3% +0.2 1.79 ± 2% perf-profile.self.cycles-pp.mutex_unlock 0.72 +0.2 0.96 ± 5% perf-profile.self.cycles-pp.___might_sleep 0.28 ± 3% +0.3 0.53 ± 5% perf-profile.self.cycles-pp.migrate_task_rq_fair 0.74 ± 3% +0.3 1.02 ± 5% perf-profile.self.cycles-pp.avc_has_perm 2.19 ± 5% +0.3 2.49 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.00 +0.5 0.48 ± 12% perf-profile.self.cycles-pp.intel_idle 1.89 ± 3% +0.8 2.72 ± 5% perf-profile.self.cycles-pp.update_load_avg 3.38 +1.1 4.46 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64 3.22 +1.2 4.38 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret 2.28 ± 3% +3.6 5.85 ± 2% perf-profile.self.cycles-pp.set_task_cpu 13.30 ± 7% +4.9 18.23 perf-profile.self.cycles-pp.update_cfs_group *************************************************************************************************** lkp-bdw-ep6: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-7/performance/x86_64-rhel-7.6/debian-x86_64-2018-04-03.cgz/300s/lkp-bdw-ep6/small-allocs-mt/vm-scalability/0xb00002e commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 0:4 5% 0:4 perf-profile.children.cycles-pp.error_exit 1:4 12% 1:4 perf-profile.children.cycles-pp.error_entry 1:4 7% 1:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 22613 +24.6% 28175 vm-scalability.median 1989974 +24.6% 2479420 vm-scalability.throughput 1131 ± 4% +7.8% 1219 ± 3% vm-scalability.time.involuntary_context_switches 1.33e+08 +24.5% 1.656e+08 vm-scalability.time.minor_page_faults 476.50 ± 2% -25.1% 356.75 vm-scalability.time.percent_of_cpu_this_job_got 1204 ± 4% -36.6% 763.78 vm-scalability.time.system_time 1.446e+08 +24.4% 1.8e+08 vm-scalability.time.voluntary_context_switches 5.985e+08 +24.5% 7.453e+08 vm-scalability.workload 915061 +24.5% 1139054 vmstat.system.cs 3.77 ± 12% -1.5 2.27 mpstat.cpu.all.sys% 0.91 ± 4% +0.1 1.06 mpstat.cpu.all.usr% 3706921 +12.3% 4163788 meminfo.Memused 528998 ± 2% +24.0% 655722 meminfo.PageTables 1477038 +22.1% 1803658 meminfo.SUnreclaim 1547764 +21.1% 1874732 meminfo.Slab 17328 +16.9% 20265 meminfo.max_used_kB 2.027e+08 ± 52% +956.6% 2.142e+09 ± 2% cpuidle.C1.time 12871136 ± 75% +372.0% 60753188 ± 7% cpuidle.C1.usage 74787475 ± 12% +66.3% 1.244e+08 ± 5% cpuidle.C1E.usage 1.571e+10 -75.4% 3.871e+09 ± 48% cpuidle.C3.time 1.051e+08 ± 3% -70.4% 31151311 ± 24% cpuidle.C3.usage 1.748e+09 ± 16% +600.8% 1.225e+10 ± 12% cpuidle.C6.time 2406825 ± 9% +500.3% 14448623 cpuidle.C6.usage 762045 ± 10% +86.8% 1423580 ± 63% cpuidle.POLL.usage 132112 +24.1% 163946 proc-vmstat.nr_page_table_pages 369229 +22.1% 450884 proc-vmstat.nr_slab_unreclaimable 1347985 +10.2% 1485730 proc-vmstat.numa_hit 1319458 +10.4% 1457207 proc-vmstat.numa_local 4456 ± 3% -5.5% 4212 ± 3% proc-vmstat.pgactivate 1737173 +12.9% 1961980 proc-vmstat.pgalloc_normal 1.337e+08 +24.4% 1.664e+08 proc-vmstat.pgfault 1685549 ± 2% +11.1% 1872507 ± 2% proc-vmstat.pgfree 12324 ± 4% +8.8% 13407 slabinfo.anon_vma.active_objs 12324 ± 4% +8.8% 13407 slabinfo.anon_vma.num_objs 24335 ± 4% +9.3% 26597 slabinfo.anon_vma_chain.active_objs 24335 ± 4% +9.3% 26597 slabinfo.anon_vma_chain.num_objs 8554 ± 4% +7.3% 9180 ± 5% slabinfo.kmalloc-512.num_objs 598.00 +21.4% 726.00 ± 10% slabinfo.kmem_cache_node.active_objs 639.25 +20.0% 767.25 ± 10% slabinfo.kmem_cache_node.num_objs 6821251 +24.1% 8463898 slabinfo.vm_area_struct.active_objs 170531 +24.1% 211597 slabinfo.vm_area_struct.active_slabs 6821276 +24.1% 8463916 slabinfo.vm_area_struct.num_objs 170531 +24.1% 211597 slabinfo.vm_area_struct.num_slabs 151.25 ± 30% -76.9% 35.00 slabinfo.xfs_btree_cur.active_objs 151.25 ± 30% -76.9% 35.00 slabinfo.xfs_btree_cur.num_objs 220.50 -10.0% 198.50 turbostat.Avg_MHz 2724 -15.8% 2293 ± 2% turbostat.Bzy_MHz 12871160 ± 74% +372.0% 60749021 ± 7% turbostat.C1 0.73 ± 52% +7.0 7.74 ± 3% turbostat.C1% 74787402 ± 12% +66.3% 1.244e+08 ± 5% turbostat.C1E 1.051e+08 ± 3% -70.4% 31150625 ± 24% turbostat.C3 56.64 -42.7 13.97 ± 48% turbostat.C3% 2396765 ± 9% +502.4% 14439199 turbostat.C6 6.29 ± 16% +37.9 44.23 ± 12% turbostat.C6% 87.90 -35.0% 57.14 ± 6% turbostat.CPU%c1 3.21 ± 24% +926.4% 32.92 ± 18% turbostat.CPU%c6 1.76 ± 24% +1551.8% 29.03 ± 11% turbostat.Pkg%pc2 60.00 ± 4% -7.5% 55.50 ± 5% turbostat.PkgTmp 153.97 -25.7% 114.38 turbostat.PkgWatt 12.47 -32.9% 8.36 ± 3% turbostat.RAMWatt 9098 ± 12% +89.2% 17217 ± 8% sched_debug.cfs_rq:/.load.avg 35294 ± 20% +36.3% 48100 ± 4% sched_debug.cfs_rq:/.load.stddev 11.98 ± 13% +45.9% 17.48 ± 15% sched_debug.cfs_rq:/.load_avg.avg 70834 ± 5% -35.8% 45506 ± 5% sched_debug.cfs_rq:/.min_vruntime.avg 92174 ± 11% -22.2% 71682 ± 10% sched_debug.cfs_rq:/.min_vruntime.max 58455 ± 5% -57.4% 24893 ± 17% sched_debug.cfs_rq:/.min_vruntime.min 6239 ± 15% +102.3% 12623 ± 26% sched_debug.cfs_rq:/.min_vruntime.stddev 0.08 ± 11% +43.6% 0.12 ± 9% sched_debug.cfs_rq:/.nr_running.avg 0.27 ± 5% +19.1% 0.32 ± 4% sched_debug.cfs_rq:/.nr_running.stddev 2.61 ± 19% +83.9% 4.81 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.avg 139.50 ± 7% +19.9% 167.30 ± 5% sched_debug.cfs_rq:/.runnable_load_avg.max 16.50 ± 12% +42.2% 23.46 ± 2% sched_debug.cfs_rq:/.runnable_load_avg.stddev 9067 ± 11% +89.0% 17135 ± 10% sched_debug.cfs_rq:/.runnable_weight.avg 35173 ± 20% +35.6% 47707 ± 5% sched_debug.cfs_rq:/.runnable_weight.stddev -1153 +834.8% -10782 sched_debug.cfs_rq:/.spread0.min 6240 ± 15% +102.3% 12623 ± 26% sched_debug.cfs_rq:/.spread0.stddev 114.71 +14.3% 131.11 ± 4% sched_debug.cfs_rq:/.util_avg.avg 101.61 +15.4% 117.30 ± 5% sched_debug.cfs_rq:/.util_avg.stddev 256259 +119.3% 562028 sched_debug.cpu.avg_idle.avg 645155 ± 15% +55.0% 1000000 sched_debug.cpu.avg_idle.max 91032 ± 15% +352.7% 412131 ± 2% sched_debug.cpu.avg_idle.stddev 0.00 ± 11% +22.1% 0.00 ± 3% sched_debug.cpu.next_balance.stddev 1743472 ± 3% +56.1% 2722232 ± 14% sched_debug.cpu.nr_switches.max 86537 ± 43% +775.9% 757950 ± 39% sched_debug.cpu.nr_switches.stddev 10.25 ± 11% +152.5% 25.88 ± 23% sched_debug.cpu.nr_uninterruptible.max -6.33 +212.2% -19.77 sched_debug.cpu.nr_uninterruptible.min 3.21 ± 4% +95.7% 6.28 ± 25% sched_debug.cpu.nr_uninterruptible.stddev 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 10.56 ± 4% +30.3% 13.75 ± 3% perf-stat.i.MPKI 3.259e+09 +15.9% 3.776e+09 perf-stat.i.branch-instructions 0.84 +0.1 0.95 ± 2% perf-stat.i.branch-miss-rate% 23719999 +36.6% 32406630 perf-stat.i.branch-misses 20.24 ± 2% -19.3 0.92 ± 3% perf-stat.i.cache-miss-rate% 22661784 ± 5% -95.7% 966072 perf-stat.i.cache-misses 1.132e+08 ± 4% +57.5% 1.784e+08 ± 2% perf-stat.i.cache-references 924435 +24.5% 1151267 perf-stat.i.context-switches 1.74 -21.4% 1.37 ± 4% perf-stat.i.cpi 1.923e+10 -9.9% 1.732e+10 ± 3% perf-stat.i.cpu-cycles 815.74 ± 15% +1177.7% 10422 perf-stat.i.cpu-migrations 1779 ± 28% +2788.4% 51403 ± 5% perf-stat.i.cycles-between-cache-misses 0.19 ± 4% -0.0 0.14 ± 10% perf-stat.i.dTLB-load-miss-rate% 3.14e+09 +16.6% 3.66e+09 perf-stat.i.dTLB-loads 0.06 ± 7% -0.0 0.03 ± 29% perf-stat.i.dTLB-store-miss-rate% 1.12e+09 +30.9% 1.466e+09 perf-stat.i.dTLB-stores 14.07 ± 3% +6.3 20.33 ± 6% perf-stat.i.iTLB-load-miss-rate% 1281739 ± 3% +46.6% 1879343 ± 7% perf-stat.i.iTLB-load-misses 9438199 ± 2% -13.9% 8127724 ± 4% perf-stat.i.iTLB-loads 1.19e+10 +14.4% 1.361e+10 perf-stat.i.instructions 9245 ± 2% -21.5% 7253 ± 7% perf-stat.i.instructions-per-iTLB-miss 0.61 +27.2% 0.78 ± 3% perf-stat.i.ipc 426825 +24.6% 531629 perf-stat.i.minor-faults 96.99 -9.4 87.54 perf-stat.i.node-load-miss-rate% 9536042 -96.6% 321484 ± 36% perf-stat.i.node-load-misses 64.92 -56.6 8.28 ± 13% perf-stat.i.node-store-miss-rate% 4431276 ± 2% -99.7% 13931 ± 21% perf-stat.i.node-store-misses 2223334 ± 4% -94.5% 123128 ± 11% perf-stat.i.node-stores 426825 +24.6% 531629 perf-stat.i.page-faults 9.52 ± 4% +37.6% 13.11 ± 2% perf-stat.overall.MPKI 0.73 +0.1 0.86 perf-stat.overall.branch-miss-rate% 20.00 ± 2% -19.5 0.54 ± 2% perf-stat.overall.cache-miss-rate% 1.62 -21.2% 1.27 ± 3% perf-stat.overall.cpi 851.12 ± 5% +2005.4% 17919 ± 3% perf-stat.overall.cycles-between-cache-misses 0.18 ± 4% -0.0 0.14 ± 8% perf-stat.overall.dTLB-load-miss-rate% 0.06 ± 7% -0.0 0.03 ± 28% perf-stat.overall.dTLB-store-miss-rate% 11.96 ± 2% +6.8 18.77 ± 4% perf-stat.overall.iTLB-load-miss-rate% 9290 ± 2% -21.6% 7279 ± 7% perf-stat.overall.instructions-per-iTLB-miss 0.62 +27.1% 0.79 ± 3% perf-stat.overall.ipc 97.10 -45.3 51.79 ± 37% perf-stat.overall.node-load-miss-rate% 66.60 -56.2 10.36 ± 26% perf-stat.overall.node-store-miss-rate% 6227 -8.3% 5713 perf-stat.overall.path-length 3.248e+09 +15.9% 3.764e+09 perf-stat.ps.branch-instructions 23650177 +36.6% 32303758 perf-stat.ps.branch-misses 22585376 ± 5% -95.7% 963905 perf-stat.ps.cache-misses 1.129e+08 ± 4% +57.5% 1.778e+08 ± 2% perf-stat.ps.cache-references 921340 +24.5% 1147455 perf-stat.ps.context-switches 1.916e+10 -9.9% 1.727e+10 ± 3% perf-stat.ps.cpu-cycles 813.83 ± 15% +1176.4% 10387 perf-stat.ps.cpu-migrations 3.13e+09 +16.6% 3.648e+09 perf-stat.ps.dTLB-loads 1.116e+09 +30.9% 1.461e+09 perf-stat.ps.dTLB-stores 1277627 ± 3% +46.6% 1873208 ± 7% perf-stat.ps.iTLB-load-misses 9406334 ± 2% -13.9% 8100828 ± 4% perf-stat.ps.iTLB-loads 1.186e+10 +14.4% 1.357e+10 perf-stat.ps.instructions 425397 +24.6% 529869 perf-stat.ps.minor-faults 9503798 -96.6% 320762 ± 36% perf-stat.ps.node-load-misses 4416024 ± 2% -99.7% 13891 ± 21% perf-stat.ps.node-store-misses 2215742 ± 4% -94.5% 122740 ± 11% perf-stat.ps.node-stores 425397 +24.6% 529869 perf-stat.ps.page-faults 3.727e+12 +14.2% 4.258e+12 perf-stat.total.instructions 17853 ± 9% +99.2% 35566 ± 9% softirqs.CPU0.RCU 117439 ± 11% +46.3% 171782 softirqs.CPU0.TIMER 23068 ± 3% +75.6% 40503 ± 15% softirqs.CPU1.RCU 41689 ± 2% +41.3% 58902 ± 36% softirqs.CPU1.SCHED 102274 ± 2% +64.5% 168216 softirqs.CPU1.TIMER 22173 ± 6% +55.3% 34426 ± 25% softirqs.CPU10.RCU 41255 +9.5% 45182 ± 2% softirqs.CPU10.SCHED 105559 ± 3% +59.6% 168428 ± 2% softirqs.CPU10.TIMER 107915 ± 3% +56.9% 169305 softirqs.CPU11.TIMER 24851 ± 18% +39.1% 34578 ± 11% softirqs.CPU12.RCU 41165 +10.5% 45498 softirqs.CPU12.SCHED 105091 ± 3% +61.1% 169340 softirqs.CPU12.TIMER 22107 ± 4% +50.9% 33361 ± 7% softirqs.CPU13.RCU 41280 +9.5% 45196 ± 2% softirqs.CPU13.SCHED 104854 ± 2% +60.6% 168413 softirqs.CPU13.TIMER 104868 ± 2% +60.9% 168735 softirqs.CPU14.TIMER 106241 +59.5% 169446 softirqs.CPU15.TIMER 106413 ± 2% +58.6% 168802 softirqs.CPU16.TIMER 21005 ± 2% -20.6% 16683 ± 14% softirqs.CPU17.RCU 110697 ± 11% +53.1% 169499 softirqs.CPU17.TIMER 41627 +9.5% 45589 softirqs.CPU18.SCHED 104756 ± 2% +61.6% 169303 softirqs.CPU18.TIMER 20999 ± 6% -19.8% 16838 ± 13% softirqs.CPU19.RCU 41316 +9.9% 45405 softirqs.CPU19.SCHED 105320 ± 2% +60.6% 169097 softirqs.CPU19.TIMER 25266 ± 16% +60.8% 40635 ± 7% softirqs.CPU2.RCU 41092 +29.3% 53125 ± 23% softirqs.CPU2.SCHED 105412 ± 2% +59.8% 168409 softirqs.CPU2.TIMER 104736 ± 2% +61.8% 169442 softirqs.CPU20.TIMER 105434 ± 2% +60.0% 168686 softirqs.CPU21.TIMER 23707 ± 15% -21.9% 18517 ± 18% softirqs.CPU22.RCU 22865 -21.3% 17991 ± 15% softirqs.CPU23.RCU 107180 ± 3% -7.1% 99568 ± 2% softirqs.CPU26.TIMER 22117 ± 6% -15.5% 18686 ± 7% softirqs.CPU27.RCU 107169 ± 3% -9.1% 97429 softirqs.CPU27.TIMER 20965 ± 3% +63.9% 34367 ± 12% softirqs.CPU3.RCU 41289 ± 2% +10.2% 45514 softirqs.CPU3.SCHED 107126 ± 3% +58.3% 169576 softirqs.CPU3.TIMER 22918 ± 11% +22.6% 28093 ± 13% softirqs.CPU30.RCU 107521 ± 3% -8.0% 98939 ± 2% softirqs.CPU30.TIMER 22052 ± 2% +26.6% 27917 ± 18% softirqs.CPU31.RCU 107233 ± 3% -9.1% 97458 softirqs.CPU31.TIMER 24313 ± 4% +24.6% 30306 ± 17% softirqs.CPU33.RCU 23856 ± 6% +48.3% 35374 ± 10% softirqs.CPU34.RCU 23613 ± 6% +50.4% 35524 ± 13% softirqs.CPU35.RCU 26445 ± 10% +22.2% 32310 ± 7% softirqs.CPU36.RCU 25247 ± 11% +38.7% 35014 ± 9% softirqs.CPU38.RCU 24034 ± 2% +26.9% 30488 ± 4% softirqs.CPU39.RCU 22346 ± 5% +50.6% 33653 ± 9% softirqs.CPU4.RCU 41087 +10.7% 45476 softirqs.CPU4.SCHED 105197 ± 3% +59.7% 167961 ± 2% softirqs.CPU4.TIMER 23680 ± 3% +26.9% 30044 ± 12% softirqs.CPU40.RCU 22599 ± 17% +50.1% 33911 ± 17% softirqs.CPU43.RCU 16255 ± 7% -30.3% 11329 ± 9% softirqs.CPU44.RCU 105102 ± 2% +60.1% 168254 softirqs.CPU44.TIMER 31030 ± 2% +22.8% 38113 ± 9% softirqs.CPU45.RCU 41424 +10.1% 45607 softirqs.CPU45.SCHED 107986 ± 2% +58.5% 171115 softirqs.CPU45.TIMER 24014 ± 5% +48.3% 35616 ± 9% softirqs.CPU46.RCU 41038 +10.9% 45500 ± 2% softirqs.CPU46.SCHED 105978 ± 3% +59.0% 168504 softirqs.CPU46.TIMER 23279 ± 4% +54.3% 35913 ± 9% softirqs.CPU47.RCU 40779 +11.7% 45564 softirqs.CPU47.SCHED 105522 ± 2% +60.1% 168920 softirqs.CPU47.TIMER 25039 ± 6% +33.6% 33441 ± 7% softirqs.CPU48.RCU 41055 +9.3% 44885 ± 2% softirqs.CPU48.SCHED 104604 ± 3% +60.3% 167711 ± 2% softirqs.CPU48.TIMER 40930 +11.3% 45562 softirqs.CPU49.SCHED 103881 ± 2% +62.7% 169055 softirqs.CPU49.TIMER 22696 ± 5% +61.1% 36556 ± 21% softirqs.CPU5.RCU 41239 +10.2% 45444 ± 2% softirqs.CPU5.SCHED 105011 ± 3% +61.1% 169181 softirqs.CPU5.TIMER 26042 ± 3% +38.0% 35934 ± 8% softirqs.CPU50.RCU 40987 +10.7% 45393 ± 2% softirqs.CPU50.SCHED 105050 ± 3% +60.4% 168503 softirqs.CPU50.TIMER 41154 +10.7% 45543 softirqs.CPU51.SCHED 104348 ± 2% +61.7% 168696 softirqs.CPU51.TIMER 40684 +12.3% 45678 softirqs.CPU52.SCHED 105842 ± 2% +59.8% 169171 softirqs.CPU52.TIMER 40924 +10.5% 45215 ± 2% softirqs.CPU53.SCHED 104488 ± 3% +60.8% 168029 ± 2% softirqs.CPU53.TIMER 40962 +11.4% 45620 softirqs.CPU54.SCHED 103436 ± 2% +63.2% 168859 softirqs.CPU54.TIMER 24028 ± 6% +65.3% 39723 ± 13% softirqs.CPU55.RCU 40689 +12.0% 45575 softirqs.CPU55.SCHED 105258 ± 2% +60.2% 168674 softirqs.CPU55.TIMER 23701 ± 5% +57.9% 37435 ± 6% softirqs.CPU56.RCU 41036 +10.5% 45338 ± 2% softirqs.CPU56.SCHED 106255 ± 3% +59.0% 168959 softirqs.CPU56.TIMER 24101 ± 5% +50.5% 36262 ± 6% softirqs.CPU57.RCU 41244 +10.0% 45372 ± 2% softirqs.CPU57.SCHED 105166 ± 4% +60.1% 168325 softirqs.CPU57.TIMER 26021 ± 6% +48.9% 38758 ± 7% softirqs.CPU58.RCU 41388 +9.6% 45371 ± 2% softirqs.CPU58.SCHED 103775 +62.0% 168136 softirqs.CPU58.TIMER 25424 ± 6% +48.6% 37787 ± 6% softirqs.CPU59.RCU 41425 +9.9% 45539 softirqs.CPU59.SCHED 105272 +60.9% 169353 softirqs.CPU59.TIMER 23815 ± 7% +49.4% 35573 ± 5% softirqs.CPU6.RCU 41200 +11.3% 45864 softirqs.CPU6.SCHED 105113 ± 3% +61.4% 169639 softirqs.CPU6.TIMER 104361 ± 2% +61.0% 168062 softirqs.CPU60.TIMER 24714 ± 16% -39.5% 14955 ± 9% softirqs.CPU61.RCU 41376 +10.4% 45685 softirqs.CPU61.SCHED 103324 ± 3% +63.7% 169143 softirqs.CPU61.TIMER 41365 +10.1% 45553 softirqs.CPU62.SCHED 103598 ± 2% +62.9% 168742 softirqs.CPU62.TIMER 20623 ± 10% -23.1% 15855 ± 11% softirqs.CPU63.RCU 40797 +10.8% 45202 ± 2% softirqs.CPU63.SCHED 106760 +57.4% 168067 softirqs.CPU63.TIMER 103749 ± 2% +61.3% 167297 ± 2% softirqs.CPU64.TIMER 24936 ± 5% -23.7% 19023 ± 15% softirqs.CPU66.RCU 25162 ± 9% -23.0% 19385 ± 17% softirqs.CPU67.RCU 23345 ± 6% -10.3% 20952 ± 8% softirqs.CPU68.RCU 27222 ± 16% -25.0% 20428 ± 13% softirqs.CPU69.RCU 22281 ± 3% +59.6% 35557 ± 9% softirqs.CPU7.RCU 41332 +10.2% 45550 softirqs.CPU7.SCHED 106502 ± 3% +59.0% 169306 softirqs.CPU7.TIMER 107659 ± 2% -8.0% 99032 softirqs.CPU70.TIMER 23110 ± 8% -19.9% 18515 ± 9% softirqs.CPU71.RCU 106360 ± 3% -8.8% 97006 softirqs.CPU71.TIMER 26482 ± 23% -29.6% 18631 ± 21% softirqs.CPU72.RCU 120806 ± 22% -19.2% 97653 ± 3% softirqs.CPU73.TIMER 24066 ± 13% -26.0% 17798 ± 12% softirqs.CPU74.RCU 106042 ± 2% -7.2% 98459 softirqs.CPU74.TIMER 107408 ± 5% -9.7% 96956 softirqs.CPU75.TIMER 20448 ± 12% +33.9% 27373 ± 5% softirqs.CPU78.RCU 20966 ± 6% +16.8% 24490 ± 2% softirqs.CPU8.RCU 40801 +15.6% 47176 ± 4% softirqs.CPU8.SCHED 106037 ± 3% +58.2% 167784 ± 2% softirqs.CPU8.TIMER 24892 ± 12% +32.1% 32891 ± 6% softirqs.CPU80.RCU 21590 ± 9% +40.3% 30293 ± 5% softirqs.CPU82.RCU 20655 ± 8% +33.5% 27573 ± 10% softirqs.CPU83.RCU 21226 ± 2% +45.9% 30976 ± 9% softirqs.CPU86.RCU 127541 ± 22% -18.8% 103512 ± 4% softirqs.CPU87.TIMER 41118 +10.1% 45286 ± 2% softirqs.CPU9.SCHED 104193 ± 3% +61.8% 168581 softirqs.CPU9.TIMER 2109779 ± 4% +16.5% 2458673 ± 8% softirqs.RCU 9403725 ± 2% +27.2% 11960127 softirqs.TIMER 238.50 ± 27% +78.3% 425.25 ± 44% interrupts.36:IR-PCI-MSI.1572867-edge.eth0-TxRx-2 590.50 ± 35% -48.8% 302.25 ± 28% interrupts.41:IR-PCI-MSI.1572872-edge.eth0-TxRx-7 150.75 ± 5% -98.7% 2.00 ±145% interrupts.CPU0.TLB:TLB_shootdowns 136.75 ± 18% -85.6% 19.75 ±153% interrupts.CPU1.TLB:TLB_shootdowns 5744 ± 6% -67.4% 1874 ± 43% interrupts.CPU10.RES:Rescheduling_interrupts 153.25 ± 14% -85.3% 22.50 ±111% interrupts.CPU10.TLB:TLB_shootdowns 5684 ± 7% -68.2% 1807 ± 43% interrupts.CPU11.RES:Rescheduling_interrupts 124.25 ± 10% -85.9% 17.50 ±173% interrupts.CPU11.TLB:TLB_shootdowns 5372 ± 4% -65.2% 1870 ± 42% interrupts.CPU12.RES:Rescheduling_interrupts 5424 ± 5% -64.8% 1909 ± 46% interrupts.CPU13.RES:Rescheduling_interrupts 136.00 ± 42% -87.9% 16.50 ±169% interrupts.CPU13.TLB:TLB_shootdowns 5616 ± 5% -65.9% 1916 ± 42% interrupts.CPU14.RES:Rescheduling_interrupts 136.00 ± 12% -86.0% 19.00 ±161% interrupts.CPU14.TLB:TLB_shootdowns 238.50 ± 27% +78.3% 425.25 ± 44% interrupts.CPU15.36:IR-PCI-MSI.1572867-edge.eth0-TxRx-2 5672 ± 5% -64.1% 2034 ± 43% interrupts.CPU15.RES:Rescheduling_interrupts 135.25 ± 28% -86.1% 18.75 ±157% interrupts.CPU15.TLB:TLB_shootdowns 5561 ± 7% -64.7% 1962 ± 46% interrupts.CPU16.RES:Rescheduling_interrupts 118.50 ± 48% -84.8% 18.00 ±163% interrupts.CPU16.TLB:TLB_shootdowns 5589 ± 3% -67.3% 1826 ± 42% interrupts.CPU17.RES:Rescheduling_interrupts 126.50 ± 42% -92.1% 10.00 ±139% interrupts.CPU17.TLB:TLB_shootdowns 5403 ± 3% -63.8% 1957 ± 46% interrupts.CPU18.RES:Rescheduling_interrupts 146.00 ± 20% -84.8% 22.25 ±160% interrupts.CPU18.TLB:TLB_shootdowns 5318 ± 2% -62.4% 2002 ± 37% interrupts.CPU19.RES:Rescheduling_interrupts 137.50 ± 41% -98.5% 2.00 ±117% interrupts.CPU19.TLB:TLB_shootdowns 122.25 ± 47% -84.0% 19.50 ±152% interrupts.CPU2.TLB:TLB_shootdowns 590.50 ± 35% -48.8% 302.25 ± 28% interrupts.CPU20.41:IR-PCI-MSI.1572872-edge.eth0-TxRx-7 5573 ± 4% -63.8% 2015 ± 45% interrupts.CPU20.RES:Rescheduling_interrupts 124.75 ± 9% -86.4% 17.00 ±163% interrupts.CPU20.TLB:TLB_shootdowns 114.25 ± 48% -85.8% 16.25 ±166% interrupts.CPU21.TLB:TLB_shootdowns 127.50 ± 14% -53.5% 59.25 ± 57% interrupts.CPU22.TLB:TLB_shootdowns 4912 ± 6% -33.1% 3286 ± 26% interrupts.CPU24.RES:Rescheduling_interrupts 5119 ± 7% -38.9% 3126 ± 29% interrupts.CPU25.RES:Rescheduling_interrupts 129.50 ± 26% -53.5% 60.25 ± 58% interrupts.CPU25.TLB:TLB_shootdowns 5152 ± 6% -38.2% 3185 ± 30% interrupts.CPU26.RES:Rescheduling_interrupts 107.75 ± 4% -47.3% 56.75 ± 57% interrupts.CPU26.TLB:TLB_shootdowns 5184 ± 5% -38.4% 3195 ± 23% interrupts.CPU27.RES:Rescheduling_interrupts 144.25 ± 6% -75.9% 34.75 ± 92% interrupts.CPU27.TLB:TLB_shootdowns 5319 ± 6% -37.0% 3352 ± 24% interrupts.CPU28.RES:Rescheduling_interrupts 125.00 ± 26% -52.6% 59.25 ± 57% interrupts.CPU28.TLB:TLB_shootdowns 6434 ± 30% -47.4% 3383 ± 27% interrupts.CPU29.RES:Rescheduling_interrupts 145.25 ± 17% -70.2% 43.25 ± 96% interrupts.CPU29.TLB:TLB_shootdowns 6155 ± 30% -68.5% 1938 ± 44% interrupts.CPU3.RES:Rescheduling_interrupts 146.75 ± 11% -93.4% 9.75 ±149% interrupts.CPU3.TLB:TLB_shootdowns 5173 ± 9% -38.7% 3171 ± 26% interrupts.CPU31.RES:Rescheduling_interrupts 115.50 ± 33% -66.9% 38.25 ± 88% interrupts.CPU31.TLB:TLB_shootdowns 5004 ± 9% -35.5% 3227 ± 25% interrupts.CPU32.RES:Rescheduling_interrupts 5096 ± 4% -37.7% 3172 ± 25% interrupts.CPU33.RES:Rescheduling_interrupts 5111 ± 6% -37.9% 3176 ± 27% interrupts.CPU34.RES:Rescheduling_interrupts 142.75 ± 10% -54.5% 65.00 ± 59% interrupts.CPU34.TLB:TLB_shootdowns 5150 ± 3% -39.7% 3104 ± 27% interrupts.CPU35.RES:Rescheduling_interrupts 5140 ± 6% -36.1% 3287 ± 26% interrupts.CPU36.RES:Rescheduling_interrupts 139.50 ± 8% -64.5% 49.50 ± 60% interrupts.CPU36.TLB:TLB_shootdowns 5536 ± 7% -41.6% 3232 ± 23% interrupts.CPU37.RES:Rescheduling_interrupts 154.25 ± 8% -61.1% 60.00 ± 58% interrupts.CPU38.TLB:TLB_shootdowns 5564 ± 8% -42.7% 3190 ± 27% interrupts.CPU39.RES:Rescheduling_interrupts 5209 ± 4% -44.1% 2913 ± 34% interrupts.CPU4.RES:Rescheduling_interrupts 127.75 ± 35% -77.5% 28.75 ±112% interrupts.CPU4.TLB:TLB_shootdowns 5604 ± 8% -43.3% 3177 ± 24% interrupts.CPU40.RES:Rescheduling_interrupts 5427 ± 8% -42.1% 3143 ± 27% interrupts.CPU41.RES:Rescheduling_interrupts 5521 ± 4% -39.0% 3368 ± 25% interrupts.CPU42.RES:Rescheduling_interrupts 5503 ± 7% -35.2% 3563 ± 20% interrupts.CPU43.RES:Rescheduling_interrupts 5574 ± 8% -61.3% 2159 ± 45% interrupts.CPU44.RES:Rescheduling_interrupts 122.00 ± 42% -83.8% 19.75 ±155% interrupts.CPU44.TLB:TLB_shootdowns 5454 ± 10% -61.0% 2126 ± 42% interrupts.CPU45.RES:Rescheduling_interrupts 143.50 ± 19% -87.3% 18.25 ±160% interrupts.CPU45.TLB:TLB_shootdowns 5901 ± 8% -64.0% 2126 ± 42% interrupts.CPU46.RES:Rescheduling_interrupts 115.50 ± 27% -83.1% 19.50 ±152% interrupts.CPU46.TLB:TLB_shootdowns 5922 ± 8% -63.7% 2149 ± 47% interrupts.CPU47.RES:Rescheduling_interrupts 101.00 ± 49% -80.4% 19.75 ±164% interrupts.CPU47.TLB:TLB_shootdowns 5722 ± 10% -65.1% 1998 ± 44% interrupts.CPU48.RES:Rescheduling_interrupts 138.75 ± 9% -86.8% 18.25 ±160% interrupts.CPU48.TLB:TLB_shootdowns 5587 ± 8% -64.6% 1980 ± 42% interrupts.CPU49.RES:Rescheduling_interrupts 85.25 ± 55% -79.5% 17.50 ±153% interrupts.CPU49.TLB:TLB_shootdowns 5320 ± 2% -65.8% 1817 ± 41% interrupts.CPU5.RES:Rescheduling_interrupts 106.50 ± 30% -79.1% 22.25 ±168% interrupts.CPU5.TLB:TLB_shootdowns 6284 ± 11% -67.9% 2015 ± 44% interrupts.CPU50.RES:Rescheduling_interrupts 151.75 ± 19% -89.1% 16.50 ±162% interrupts.CPU50.TLB:TLB_shootdowns 5578 ± 8% -62.2% 2107 ± 44% interrupts.CPU51.RES:Rescheduling_interrupts 118.50 ± 31% -83.1% 20.00 ±144% interrupts.CPU51.TLB:TLB_shootdowns 5902 ± 9% -64.4% 2101 ± 43% interrupts.CPU52.RES:Rescheduling_interrupts 5842 ± 9% -65.1% 2039 ± 43% interrupts.CPU53.RES:Rescheduling_interrupts 165.25 ± 12% -87.1% 21.25 ±109% interrupts.CPU53.TLB:TLB_shootdowns 5673 ± 6% -65.9% 1936 ± 41% interrupts.CPU54.RES:Rescheduling_interrupts 142.50 ± 11% -90.4% 13.75 ±169% interrupts.CPU54.TLB:TLB_shootdowns 5558 ± 6% -63.0% 2057 ± 42% interrupts.CPU55.RES:Rescheduling_interrupts 117.75 ± 48% -84.7% 18.00 ±121% interrupts.CPU55.TLB:TLB_shootdowns 5492 ± 6% -64.5% 1949 ± 41% interrupts.CPU56.RES:Rescheduling_interrupts 140.00 ± 17% -86.8% 18.50 ±139% interrupts.CPU56.TLB:TLB_shootdowns 5747 ± 7% -64.3% 2051 ± 46% interrupts.CPU57.RES:Rescheduling_interrupts 100.00 ± 24% -80.5% 19.50 ±164% interrupts.CPU57.TLB:TLB_shootdowns 5875 ± 6% -65.0% 2057 ± 44% interrupts.CPU58.RES:Rescheduling_interrupts 143.75 ± 11% -98.3% 2.50 ±131% interrupts.CPU58.TLB:TLB_shootdowns 5431 ± 5% -64.2% 1941 ± 44% interrupts.CPU59.RES:Rescheduling_interrupts 144.00 ± 15% -99.0% 1.50 ± 74% interrupts.CPU59.TLB:TLB_shootdowns 5267 ± 4% -63.4% 1929 ± 42% interrupts.CPU6.RES:Rescheduling_interrupts 93.50 ± 49% -79.1% 19.50 ±167% interrupts.CPU6.TLB:TLB_shootdowns 5481 ± 4% -63.9% 1978 ± 46% interrupts.CPU60.RES:Rescheduling_interrupts 155.50 ± 9% -87.9% 18.75 ±164% interrupts.CPU60.TLB:TLB_shootdowns 5312 ± 4% -62.0% 2016 ± 42% interrupts.CPU61.RES:Rescheduling_interrupts 114.50 ± 56% -83.8% 18.50 ±157% interrupts.CPU61.TLB:TLB_shootdowns 5311 ± 4% -61.6% 2042 ± 47% interrupts.CPU62.RES:Rescheduling_interrupts 94.25 ± 54% -79.6% 19.25 ±158% interrupts.CPU62.TLB:TLB_shootdowns 5368 ± 6% -62.3% 2026 ± 42% interrupts.CPU63.RES:Rescheduling_interrupts 147.25 ± 11% -99.3% 1.00 ± 70% interrupts.CPU63.TLB:TLB_shootdowns 5561 ± 5% -63.5% 2032 ± 42% interrupts.CPU64.RES:Rescheduling_interrupts 149.25 ± 7% -95.1% 7.25 ±149% interrupts.CPU64.TLB:TLB_shootdowns 5673 ± 4% -59.9% 2274 ± 46% interrupts.CPU65.RES:Rescheduling_interrupts 111.50 ± 43% -83.2% 18.75 ±170% interrupts.CPU65.TLB:TLB_shootdowns 5351 ± 4% -28.8% 3812 ± 20% interrupts.CPU66.RES:Rescheduling_interrupts 5357 ± 6% -35.2% 3469 ± 27% interrupts.CPU68.RES:Rescheduling_interrupts 144.00 ± 23% -52.3% 68.75 ± 63% interrupts.CPU68.TLB:TLB_shootdowns 5189 ± 6% -38.7% 3181 ± 24% interrupts.CPU69.RES:Rescheduling_interrupts 5671 ± 2% -64.5% 2010 ± 44% interrupts.CPU7.RES:Rescheduling_interrupts 122.00 ± 33% -82.2% 21.75 ±154% interrupts.CPU7.TLB:TLB_shootdowns 5628 ± 6% -40.5% 3346 ± 28% interrupts.CPU70.RES:Rescheduling_interrupts 143.50 ± 16% -53.1% 67.25 ± 58% interrupts.CPU70.TLB:TLB_shootdowns 5133 -35.0% 3335 ± 24% interrupts.CPU71.RES:Rescheduling_interrupts 157.75 ± 13% -63.7% 57.25 ± 56% interrupts.CPU71.TLB:TLB_shootdowns 5564 ± 4% -40.1% 3333 ± 26% interrupts.CPU72.RES:Rescheduling_interrupts 5505 ± 5% -42.5% 3166 ± 25% interrupts.CPU73.RES:Rescheduling_interrupts 134.00 ± 5% -69.4% 41.00 ± 92% interrupts.CPU73.TLB:TLB_shootdowns 5274 -37.1% 3318 ± 25% interrupts.CPU74.RES:Rescheduling_interrupts 5310 ± 6% -39.9% 3190 ± 25% interrupts.CPU75.RES:Rescheduling_interrupts 134.75 ± 11% -59.6% 54.50 ± 58% interrupts.CPU75.TLB:TLB_shootdowns 5343 ± 13% -40.4% 3185 ± 25% interrupts.CPU76.RES:Rescheduling_interrupts 136.50 ± 20% -65.8% 46.75 ± 60% interrupts.CPU76.TLB:TLB_shootdowns 5318 ± 12% -41.0% 3137 ± 24% interrupts.CPU77.RES:Rescheduling_interrupts 153.00 ± 13% -71.1% 44.25 ± 74% interrupts.CPU77.TLB:TLB_shootdowns 5196 ± 13% -39.9% 3125 ± 24% interrupts.CPU78.RES:Rescheduling_interrupts 158.50 ± 9% -59.8% 63.75 ± 58% interrupts.CPU78.TLB:TLB_shootdowns 5299 ± 5% -42.0% 3072 ± 25% interrupts.CPU79.RES:Rescheduling_interrupts 158.50 ± 10% -73.7% 41.75 ± 85% interrupts.CPU79.TLB:TLB_shootdowns 152.75 ± 12% -87.7% 18.75 ±167% interrupts.CPU8.TLB:TLB_shootdowns 5296 ± 6% -36.5% 3366 ± 27% interrupts.CPU80.RES:Rescheduling_interrupts 163.00 ± 10% -74.2% 42.00 ± 71% interrupts.CPU80.TLB:TLB_shootdowns 5307 ± 7% -37.3% 3326 ± 23% interrupts.CPU81.RES:Rescheduling_interrupts 5326 ± 10% -38.1% 3295 ± 25% interrupts.CPU82.RES:Rescheduling_interrupts 5253 ± 11% -39.5% 3179 ± 28% interrupts.CPU83.RES:Rescheduling_interrupts 123.50 ± 36% -68.4% 39.00 ± 78% interrupts.CPU83.TLB:TLB_shootdowns 5059 ± 4% -37.4% 3169 ± 24% interrupts.CPU84.RES:Rescheduling_interrupts 5356 ± 6% -42.1% 3100 ± 26% interrupts.CPU85.RES:Rescheduling_interrupts 158.25 ± 16% -62.6% 59.25 ± 57% interrupts.CPU85.TLB:TLB_shootdowns 5482 ± 3% -37.5% 3425 ± 26% interrupts.CPU86.RES:Rescheduling_interrupts 172.00 ± 11% -66.7% 57.25 ± 57% interrupts.CPU86.TLB:TLB_shootdowns 5817 ± 5% -38.9% 3555 ± 18% interrupts.CPU87.RES:Rescheduling_interrupts 5078 ± 4% -62.4% 1909 ± 44% interrupts.CPU9.RES:Rescheduling_interrupts 148.50 ± 17% -88.7% 16.75 ±162% interrupts.CPU9.TLB:TLB_shootdowns 482362 ± 2% -38.4% 297362 ± 29% interrupts.RES:Rescheduling_interrupts 11357 ± 18% -73.9% 2959 ± 7% interrupts.TLB:TLB_shootdowns 16.98 ± 5% -10.0 6.97 ± 4% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault.do_access 17.08 ± 5% -10.0 7.10 ± 3% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault.do_access 18.50 ± 4% -9.6 8.90 ± 4% perf-profile.calltrace.cycles-pp.page_fault.do_access 13.54 ± 6% -8.7 4.79 ± 3% perf-profile.calltrace.cycles-pp.down_read.__do_page_fault.do_page_fault.page_fault.do_access 13.36 ± 6% -8.7 4.67 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_read_failed.down_read.__do_page_fault.do_page_fault.page_fault 13.32 ± 6% -8.7 4.65 ± 3% perf-profile.calltrace.cycles-pp.rwsem_down_read_failed.call_rwsem_down_read_failed.down_read.__do_page_fault.do_page_fault 20.89 ± 3% -8.7 12.23 ± 3% perf-profile.calltrace.cycles-pp.do_access 8.00 ± 11% -8.0 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_failed.call_rwsem_down_read_failed.down_read.__do_page_fault 7.38 ± 12% -7.4 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_failed.call_rwsem_down_read_failed.down_read 1.71 ± 8% -1.2 0.52 perf-profile.calltrace.cycles-pp.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.79 ± 2% -0.8 0.97 ± 7% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.do_access 1.60 ± 3% -0.8 0.80 ± 7% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 1.41 ± 7% -0.6 0.77 ± 3% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule_idle.do_idle.cpu_startup_entry 0.62 ± 2% -0.3 0.28 ±100% perf-profile.calltrace.cycles-pp.arch_get_unmapped_area_topdown.get_unmapped_area.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 0.76 ± 3% -0.3 0.43 ± 57% perf-profile.calltrace.cycles-pp.__rwsem_mark_wake.rwsem_wake.call_rwsem_wake.up_write.vm_mmap_pgoff 0.60 ± 2% -0.3 0.27 ±100% perf-profile.calltrace.cycles-pp.unmapped_area_topdown.arch_get_unmapped_area_topdown.get_unmapped_area.do_mmap.vm_mmap_pgoff 0.55 ± 6% -0.3 0.25 ±100% perf-profile.calltrace.cycles-pp.up_read.__do_page_fault.do_page_fault.page_fault.do_access 0.68 ± 2% -0.1 0.56 ± 6% perf-profile.calltrace.cycles-pp.get_unmapped_area.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 0.84 ± 3% -0.1 0.73 ± 6% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake 1.42 -0.1 1.32 ± 3% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.44 ± 2% +0.2 1.66 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.rwsem_down_read_failed.call_rwsem_down_read_failed 1.19 ± 2% +0.2 1.42 ± 2% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.rwsem_down_read_failed 1.12 ± 7% +0.3 1.42 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 0.80 ± 5% +0.4 1.18 ± 2% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle 1.47 ± 6% +0.4 1.89 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.63 ± 4% +0.4 1.06 ± 2% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry 0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 0.00 +0.7 0.71 ± 2% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select 0.00 +0.8 0.77 ± 13% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt 0.00 +0.8 0.78 ± 3% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle 0.00 +0.9 0.90 ± 3% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up 4.49 +0.9 5.39 ± 4% perf-profile.calltrace.cycles-pp.do_rw_once 0.00 +0.9 0.93 ± 14% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 0.75 ± 6% +1.1 1.83 ± 11% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.75 ± 3% +1.1 1.88 ± 4% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q 2.76 ± 5% +1.2 3.94 perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 3.82 ± 2% +1.2 5.01 ± 4% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_write.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 3.82 ± 2% +1.2 5.01 ± 4% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_write.vm_mmap_pgoff.ksys_mmap_pgoff 3.83 ± 2% +1.2 5.02 ± 4% perf-profile.calltrace.cycles-pp.up_write.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.84 ± 3% +1.2 2.07 ± 4% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake 0.85 ± 4% +1.2 2.10 ± 4% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake 2.95 ± 2% +1.3 4.26 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_write 3.04 ± 2% +1.4 4.43 ± 3% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_write.vm_mmap_pgoff 1.43 ± 6% +1.4 2.84 ± 12% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle 2.61 ± 10% +2.0 4.61 ± 10% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry 2.88 ± 9% +2.1 5.00 ± 10% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 52.91 +5.9 58.80 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 66.55 +7.8 74.35 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 66.60 +7.8 74.43 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 66.61 +7.8 74.44 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 67.15 +8.1 75.29 perf-profile.calltrace.cycles-pp.secondary_startup_64 56.16 +8.6 64.78 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 17.01 ± 5% -10.0 7.01 ± 4% perf-profile.children.cycles-pp.__do_page_fault 17.10 ± 5% -10.0 7.13 ± 3% perf-profile.children.cycles-pp.do_page_fault 17.96 ± 4% -9.7 8.21 ± 4% perf-profile.children.cycles-pp.page_fault 21.78 ± 3% -9.0 12.75 ± 4% perf-profile.children.cycles-pp.do_access 13.54 ± 6% -8.7 4.81 ± 3% perf-profile.children.cycles-pp.down_read 13.36 ± 6% -8.7 4.67 ± 3% perf-profile.children.cycles-pp.call_rwsem_down_read_failed 13.34 ± 6% -8.7 4.66 ± 3% perf-profile.children.cycles-pp.rwsem_down_read_failed 9.04 ± 11% -8.6 0.47 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irq 8.45 ± 12% -8.2 0.29 ± 3% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 2.51 ± 2% -2.5 0.04 ± 59% perf-profile.children.cycles-pp.sched_ttwu_pending 3.34 ± 5% -2.4 0.98 ± 3% perf-profile.children.cycles-pp.switch_mm_irqs_off 1.95 ± 4% -1.7 0.20 ± 5% perf-profile.children.cycles-pp.switch_mm 1.71 ± 8% -1.2 0.52 perf-profile.children.cycles-pp.down_write_killable 1.63 ± 8% -1.1 0.49 ± 2% perf-profile.children.cycles-pp.call_rwsem_down_write_failed_killable 1.63 ± 8% -1.1 0.49 ± 2% perf-profile.children.cycles-pp.rwsem_down_write_failed_killable 1.83 -0.8 1.00 ± 7% perf-profile.children.cycles-pp.handle_mm_fault 1.65 ± 3% -0.8 0.83 ± 7% perf-profile.children.cycles-pp.__handle_mm_fault 0.56 ± 2% -0.4 0.18 ± 8% perf-profile.children.cycles-pp.load_new_mm_cr3 2.66 ± 2% -0.4 2.28 ± 4% perf-profile.children.cycles-pp.ttwu_do_activate 2.62 ± 2% -0.4 2.24 ± 4% perf-profile.children.cycles-pp.enqueue_task_fair 0.40 ± 5% -0.3 0.07 ± 13% perf-profile.children.cycles-pp.down_read_trylock 0.75 ± 3% -0.3 0.46 ± 9% perf-profile.children.cycles-pp.do_anonymous_page 0.77 ± 7% -0.3 0.49 ± 8% perf-profile.children.cycles-pp.finish_task_switch 0.97 ± 4% -0.3 0.71 ± 5% perf-profile.children.cycles-pp._raw_spin_lock 2.30 ± 2% -0.3 2.04 ± 4% perf-profile.children.cycles-pp.enqueue_entity 0.79 ± 4% -0.2 0.57 ± 7% perf-profile.children.cycles-pp.__rwsem_mark_wake 0.49 ± 3% -0.2 0.28 ± 2% perf-profile.children.cycles-pp.__update_load_avg_se 0.35 ± 10% -0.2 0.16 ± 7% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.90 ± 2% -0.2 0.73 ± 6% perf-profile.children.cycles-pp.update_curr 0.31 ± 15% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.18 ± 18% -0.1 0.05 ± 58% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.22 -0.1 0.10 ± 11% perf-profile.children.cycles-pp.cpuacct_charge 0.24 ± 6% -0.1 0.11 ± 25% perf-profile.children.cycles-pp.__list_add_valid 0.91 ± 3% -0.1 0.79 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair 0.68 ± 2% -0.1 0.57 ± 6% perf-profile.children.cycles-pp.get_unmapped_area 1.42 -0.1 1.33 ± 3% perf-profile.children.cycles-pp.do_mmap 0.62 ± 2% -0.1 0.52 ± 6% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.60 ± 2% -0.1 0.51 ± 7% perf-profile.children.cycles-pp.unmapped_area_topdown 0.20 ± 28% -0.1 0.12 ± 11% perf-profile.children.cycles-pp.call_cpuidle 0.55 ± 6% -0.1 0.48 ± 5% perf-profile.children.cycles-pp.up_read 0.10 ± 43% -0.1 0.04 ± 57% perf-profile.children.cycles-pp._raw_spin_trylock 0.16 ± 6% -0.0 0.11 ± 13% perf-profile.children.cycles-pp.pick_next_task_idle 0.15 ± 9% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.clear_buddies 0.15 ± 8% -0.0 0.12 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid 0.22 ± 3% -0.0 0.19 ± 5% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.09 ± 4% -0.0 0.07 ± 12% perf-profile.children.cycles-pp.put_prev_task_fair 0.09 ± 12% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.__calc_delta 0.07 ± 12% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.account_entity_dequeue 0.08 ± 10% +0.0 0.11 ± 7% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit 0.20 ± 11% +0.0 0.23 ± 9% perf-profile.children.cycles-pp.__perf_sw_event 0.32 ± 3% +0.0 0.35 ± 2% perf-profile.children.cycles-pp.update_ts_time_stats 0.10 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.rcu_eqs_enter 0.07 ± 7% +0.0 0.10 ± 7% perf-profile.children.cycles-pp.sync_regs 0.07 ± 6% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.10 ± 15% +0.0 0.14 ± 15% perf-profile.children.cycles-pp.native_apic_msr_eoi_write 0.11 ± 19% +0.0 0.15 ± 20% perf-profile.children.cycles-pp.update_blocked_averages 0.17 ± 10% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.rcu_idle_exit 0.08 ± 6% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.rb_erase_cached 0.18 ± 8% +0.0 0.23 ± 8% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.14 ± 11% +0.0 0.19 ± 6% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.06 ± 17% +0.0 0.11 ± 9% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.1 0.05 perf-profile.children.cycles-pp.rb_erase 0.10 ± 8% +0.1 0.15 ± 4% perf-profile.children.cycles-pp.menu_reflect 0.28 ± 5% +0.1 0.33 ± 5% perf-profile.children.cycles-pp.__switch_to_asm 0.07 ± 19% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.11 ± 21% +0.1 0.17 ± 22% perf-profile.children.cycles-pp.run_rebalance_domains 0.26 ± 7% +0.1 0.32 ± 5% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.18 ± 4% +0.1 0.24 perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.20 ± 8% +0.1 0.27 ± 3% perf-profile.children.cycles-pp.reweight_entity 0.08 ± 33% +0.1 0.15 ± 26% perf-profile.children.cycles-pp.update_sd_lb_stats 0.08 ± 6% +0.1 0.14 ± 8% perf-profile.children.cycles-pp.select_idle_sibling 0.07 ± 5% +0.1 0.14 ± 10% perf-profile.children.cycles-pp.pick_next_entity 0.06 ± 6% +0.1 0.13 ± 3% perf-profile.children.cycles-pp.deactivate_task 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.interrupt_entry 0.00 +0.1 0.07 ± 13% perf-profile.children.cycles-pp.perf_event_task_tick 0.00 +0.1 0.07 ± 21% perf-profile.children.cycles-pp.run_local_timers 0.32 ± 8% +0.1 0.39 ± 4% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.run_posix_cpu_timers 0.09 ± 29% +0.1 0.17 ± 28% perf-profile.children.cycles-pp.find_busiest_group 0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.pmd_page_vaddr 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.leave_mm 0.03 ±100% +0.1 0.10 ± 4% perf-profile.children.cycles-pp.rb_next 0.00 +0.1 0.08 ± 19% perf-profile.children.cycles-pp.rcu_irq_enter 0.46 ± 6% +0.1 0.55 ± 3% perf-profile.children.cycles-pp.native_write_msr 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.__hrtimer_get_next_event 0.04 ± 60% +0.1 0.14 ± 20% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.01 ±173% +0.1 0.11 ± 26% perf-profile.children.cycles-pp.mga_dirty_update 0.01 ±173% +0.1 0.11 ± 26% perf-profile.children.cycles-pp.memcpy_toio 0.01 ±173% +0.1 0.11 ± 26% perf-profile.children.cycles-pp.fb_flashcursor 0.01 ±173% +0.1 0.11 ± 26% perf-profile.children.cycles-pp.bit_cursor 0.01 ±173% +0.1 0.11 ± 26% perf-profile.children.cycles-pp.soft_cursor 0.01 ±173% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.pm_qos_request 0.28 ± 4% +0.1 0.39 ± 3% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.20 ± 4% +0.1 0.30 ± 4% perf-profile.children.cycles-pp.lapic_next_deadline 0.30 ± 4% +0.1 0.41 ± 7% perf-profile.children.cycles-pp.wake_q_add_safe 0.52 ± 4% +0.1 0.63 ± 2% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.12 ± 27% +0.1 0.24 ± 25% perf-profile.children.cycles-pp.load_balance 0.01 ±173% +0.1 0.14 ± 27% perf-profile.children.cycles-pp.io_serial_in 0.01 ±173% +0.1 0.13 ± 9% perf-profile.children.cycles-pp.tick_nohz_tick_stopped 0.32 ± 4% +0.1 0.44 ± 4% perf-profile.children.cycles-pp.sched_clock 0.30 ± 4% +0.1 0.43 ± 5% perf-profile.children.cycles-pp.native_sched_clock 0.14 ± 8% +0.1 0.27 ± 7% perf-profile.children.cycles-pp.account_entity_enqueue 0.66 ± 3% +0.1 0.80 perf-profile.children.cycles-pp.native_irq_return_iret 0.13 ± 6% +0.1 0.28 ± 16% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 0.06 ± 34% +0.1 0.21 ± 27% perf-profile.children.cycles-pp.serial8250_console_putchar 0.00 +0.1 0.15 ± 7% perf-profile.children.cycles-pp.timerqueue_del 0.07 ± 31% +0.1 0.21 ± 27% perf-profile.children.cycles-pp.wait_for_xmitr 0.38 ± 6% +0.1 0.53 ± 5% perf-profile.children.cycles-pp.read_tsc 0.14 ± 6% +0.2 0.29 ± 3% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.06 ± 34% +0.2 0.21 ± 28% perf-profile.children.cycles-pp.uart_console_write 0.31 ± 4% +0.2 0.47 ± 4% perf-profile.children.cycles-pp.__switch_to 0.07 ± 31% +0.2 0.22 ± 26% perf-profile.children.cycles-pp.serial8250_console_write 0.34 ± 2% +0.2 0.50 ± 4% perf-profile.children.cycles-pp.sched_clock_cpu 0.00 +0.2 0.16 ± 9% perf-profile.children.cycles-pp.timerqueue_add 0.07 ± 33% +0.2 0.23 ± 27% perf-profile.children.cycles-pp.console_unlock 0.04 ± 57% +0.2 0.20 ± 9% perf-profile.children.cycles-pp.__remove_hrtimer 0.00 +0.2 0.17 ± 34% perf-profile.children.cycles-pp.irq_work_interrupt 0.00 +0.2 0.17 ± 34% perf-profile.children.cycles-pp.smp_irq_work_interrupt 0.00 +0.2 0.17 ± 34% perf-profile.children.cycles-pp.irq_work_run 0.00 +0.2 0.17 ± 34% perf-profile.children.cycles-pp.printk 0.00 +0.2 0.17 ± 34% perf-profile.children.cycles-pp.vprintk_emit 0.33 ± 4% +0.2 0.50 perf-profile.children.cycles-pp.find_next_bit 0.01 ±173% +0.2 0.19 ± 11% perf-profile.children.cycles-pp.enqueue_hrtimer 0.14 ± 12% +0.2 0.33 ± 14% perf-profile.children.cycles-pp.scheduler_tick 0.05 ± 62% +0.2 0.24 ± 24% perf-profile.children.cycles-pp.irq_work_run_list 1.47 +0.2 1.66 ± 2% perf-profile.children.cycles-pp.dequeue_entity 0.21 ± 7% +0.2 0.41 ± 5% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.36 ± 2% +0.2 0.57 ± 5% perf-profile.children.cycles-pp.ttwu_do_wakeup 1.60 +0.2 1.83 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair 0.08 ± 13% +0.3 0.34 ± 11% perf-profile.children.cycles-pp.tick_irq_enter 0.51 ± 3% +0.3 0.79 ± 2% perf-profile.children.cycles-pp.__next_timer_interrupt 0.20 ± 4% +0.3 0.51 ± 5% perf-profile.children.cycles-pp.resched_curr 0.23 ± 4% +0.3 0.55 ± 5% perf-profile.children.cycles-pp.check_preempt_curr 1.14 ± 7% +0.3 1.46 ± 2% perf-profile.children.cycles-pp.tick_nohz_next_event 0.11 ± 13% +0.3 0.45 ± 12% perf-profile.children.cycles-pp.irq_enter 0.45 ± 4% +0.4 0.80 ± 3% perf-profile.children.cycles-pp.set_next_entity 0.81 ± 5% +0.4 1.20 ± 2% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.34 ± 7% +0.4 0.77 ± 12% perf-profile.children.cycles-pp.update_process_times 1.48 ± 6% +0.4 1.93 ± 2% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.37 ± 8% +0.5 0.86 ± 12% perf-profile.children.cycles-pp.tick_sched_handle 0.48 ± 9% +0.5 1.02 ± 13% perf-profile.children.cycles-pp.tick_sched_timer 0.84 ± 2% +0.6 1.41 ± 2% perf-profile.children.cycles-pp.pick_next_task_fair 4.42 +0.9 5.35 ± 4% perf-profile.children.cycles-pp.do_rw_once 0.85 ± 8% +1.1 2.00 ± 9% perf-profile.children.cycles-pp.__hrtimer_run_queues 3.89 ± 2% +1.2 5.07 ± 4% perf-profile.children.cycles-pp.up_write 2.80 ± 5% +1.2 4.03 perf-profile.children.cycles-pp.menu_select 4.00 ± 2% +1.3 5.33 ± 4% perf-profile.children.cycles-pp.rwsem_wake 4.00 ± 2% +1.3 5.34 ± 4% perf-profile.children.cycles-pp.call_rwsem_wake 1.58 ± 6% +1.5 3.06 ± 10% perf-profile.children.cycles-pp.hrtimer_interrupt 3.27 ± 2% +1.5 4.78 ± 4% perf-profile.children.cycles-pp.try_to_wake_up 3.39 ± 2% +1.6 4.98 ± 3% perf-profile.children.cycles-pp.wake_up_q 2.82 ± 11% +2.1 4.88 ± 8% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 3.11 ± 10% +2.2 5.31 ± 9% perf-profile.children.cycles-pp.apic_timer_interrupt 53.36 +6.1 59.49 perf-profile.children.cycles-pp.intel_idle 66.61 +7.8 74.44 perf-profile.children.cycles-pp.start_secondary 67.15 +8.1 75.29 perf-profile.children.cycles-pp.secondary_startup_64 67.15 +8.1 75.29 perf-profile.children.cycles-pp.cpu_startup_entry 67.16 +8.1 75.30 perf-profile.children.cycles-pp.do_idle 56.88 +9.0 65.89 perf-profile.children.cycles-pp.cpuidle_enter_state 8.45 ± 12% -8.2 0.29 ± 3% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 2.78 ± 6% -2.0 0.80 ± 3% perf-profile.self.cycles-pp.switch_mm_irqs_off 1.48 ± 5% -0.8 0.67 ± 5% perf-profile.self.cycles-pp.rwsem_down_read_failed 0.84 ± 2% -0.5 0.31 ± 7% perf-profile.self.cycles-pp.try_to_wake_up 0.85 ± 3% -0.5 0.33 ± 3% perf-profile.self.cycles-pp.__handle_mm_fault 0.71 ± 3% -0.4 0.32 ± 15% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.56 ± 2% -0.4 0.18 ± 8% perf-profile.self.cycles-pp.load_new_mm_cr3 0.40 ± 5% -0.3 0.06 ± 11% perf-profile.self.cycles-pp.down_read_trylock 0.72 ± 6% -0.3 0.41 ± 6% perf-profile.self.cycles-pp.finish_task_switch 0.39 ± 4% -0.2 0.15 ± 11% perf-profile.self.cycles-pp.__rwsem_mark_wake 0.91 ± 4% -0.2 0.68 ± 4% perf-profile.self.cycles-pp._raw_spin_lock 0.37 ± 3% -0.2 0.14 ± 7% perf-profile.self.cycles-pp.up_read 0.47 ± 3% -0.2 0.26 perf-profile.self.cycles-pp.__update_load_avg_se 0.59 ± 20% -0.2 0.40 ± 20% perf-profile.self.cycles-pp.ktime_get 0.35 ± 10% -0.2 0.16 ± 6% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.34 ± 6% -0.1 0.20 ± 4% perf-profile.self.cycles-pp.enqueue_task_fair 0.18 ± 18% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.47 ± 7% -0.1 0.33 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.21 ± 8% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.rwsem_down_write_failed_killable 0.22 -0.1 0.10 ± 11% perf-profile.self.cycles-pp.cpuacct_charge 0.23 ± 8% -0.1 0.11 ± 25% perf-profile.self.cycles-pp.__list_add_valid 0.36 ± 3% -0.1 0.26 ± 8% perf-profile.self.cycles-pp.enqueue_entity 0.59 ± 2% -0.1 0.50 ± 6% perf-profile.self.cycles-pp.unmapped_area_topdown 0.13 ± 9% -0.1 0.04 ± 59% perf-profile.self.cycles-pp.sched_ttwu_pending 0.20 ± 28% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.call_cpuidle 0.16 ± 18% -0.1 0.08 ± 13% perf-profile.self.cycles-pp.down_read 0.56 ± 5% -0.1 0.49 ± 8% perf-profile.self.cycles-pp.update_curr 0.10 ± 43% -0.1 0.04 ± 58% perf-profile.self.cycles-pp._raw_spin_trylock 0.27 -0.1 0.21 ± 13% perf-profile.self.cycles-pp.find_vma 0.20 ± 9% -0.0 0.15 ± 8% perf-profile.self.cycles-pp.handle_mm_fault 0.15 ± 8% -0.0 0.12 ± 8% perf-profile.self.cycles-pp.__list_del_entry_valid 0.22 ± 3% -0.0 0.19 ± 5% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.15 ± 4% +0.0 0.17 ± 2% perf-profile.self.cycles-pp.__do_page_fault 0.07 ± 7% +0.0 0.09 ± 9% perf-profile.self.cycles-pp.account_entity_dequeue 0.09 ± 12% +0.0 0.11 ± 3% perf-profile.self.cycles-pp.__calc_delta 0.08 ± 10% +0.0 0.11 perf-profile.self.cycles-pp.rcu_idle_exit 0.08 ± 8% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit 0.06 ± 9% +0.0 0.09 ± 7% perf-profile.self.cycles-pp.sync_regs 0.09 ± 4% +0.0 0.13 ± 6% perf-profile.self.cycles-pp.rcu_eqs_enter 0.09 ± 11% +0.0 0.13 ± 17% perf-profile.self.cycles-pp.native_apic_msr_eoi_write 0.08 ± 8% +0.0 0.12 perf-profile.self.cycles-pp.menu_reflect 0.06 ± 11% +0.0 0.10 ± 14% perf-profile.self.cycles-pp.rb_erase_cached 0.63 ± 2% +0.0 0.68 ± 3% perf-profile.self.cycles-pp.do_idle 0.13 ± 10% +0.0 0.17 ± 6% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.hrtimer_next_event_without 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.update_ts_time_stats 0.00 +0.1 0.06 ± 15% perf-profile.self.cycles-pp.sched_clock_cpu 0.28 ± 6% +0.1 0.33 ± 5% perf-profile.self.cycles-pp.__switch_to_asm 0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.__hrtimer_get_next_event 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.new_slab 0.00 +0.1 0.06 ± 20% perf-profile.self.cycles-pp.__remove_hrtimer 0.22 ± 8% +0.1 0.28 ± 7% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.31 ± 8% +0.1 0.37 ± 5% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.07 ± 7% +0.1 0.13 ± 11% perf-profile.self.cycles-pp.pick_next_entity 0.06 ± 6% +0.1 0.13 ± 3% perf-profile.self.cycles-pp.deactivate_task 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.clockevents_program_event 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.interrupt_entry 0.00 +0.1 0.07 ± 13% perf-profile.self.cycles-pp.perf_event_task_tick 0.20 ± 9% +0.1 0.27 ± 3% perf-profile.self.cycles-pp.reweight_entity 0.04 ± 58% +0.1 0.11 ± 7% perf-profile.self.cycles-pp.get_next_timer_interrupt 0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.scheduler_tick 0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.run_posix_cpu_timers 0.49 ± 5% +0.1 0.56 ± 4% perf-profile.self.cycles-pp.update_load_avg 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.pmd_page_vaddr 0.00 +0.1 0.07 ± 5% perf-profile.self.cycles-pp.lapic_next_deadline 0.46 ± 6% +0.1 0.55 ± 3% perf-profile.self.cycles-pp.native_write_msr 0.06 ± 7% +0.1 0.14 ± 16% perf-profile.self.cycles-pp.hrtimer_interrupt 0.12 ± 5% +0.1 0.21 ± 5% perf-profile.self.cycles-pp.wake_up_q 0.01 ±173% +0.1 0.10 perf-profile.self.cycles-pp.rb_next 0.00 +0.1 0.09 ± 9% perf-profile.self.cycles-pp.tick_nohz_tick_stopped 0.00 +0.1 0.09 ± 29% perf-profile.self.cycles-pp.smp_apic_timer_interrupt 0.01 ±173% +0.1 0.11 ± 26% perf-profile.self.cycles-pp.memcpy_toio 0.01 ±173% +0.1 0.11 ± 22% perf-profile.self.cycles-pp.pm_qos_request 0.00 +0.1 0.11 ± 8% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.1 0.11 ± 10% perf-profile.self.cycles-pp.timerqueue_add 0.01 ±173% +0.1 0.12 ± 25% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.30 ± 4% +0.1 0.41 ± 7% perf-profile.self.cycles-pp.wake_q_add_safe 0.00 +0.1 0.11 ± 6% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.51 ± 4% +0.1 0.62 ± 2% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.29 ± 4% +0.1 0.41 ± 6% perf-profile.self.cycles-pp.native_sched_clock 0.01 ±173% +0.1 0.14 ± 27% perf-profile.self.cycles-pp.io_serial_in 0.25 ± 3% +0.1 0.37 ± 5% perf-profile.self.cycles-pp.pick_next_task_fair 1.22 +0.1 1.35 ± 4% perf-profile.self.cycles-pp.__schedule 0.37 ± 7% +0.1 0.50 ± 6% perf-profile.self.cycles-pp.read_tsc 0.13 ± 6% +0.1 0.26 ± 7% perf-profile.self.cycles-pp.account_entity_enqueue 0.23 ± 6% +0.1 0.36 ± 5% perf-profile.self.cycles-pp.__next_timer_interrupt 0.11 ± 9% +0.1 0.24 ± 4% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.66 ± 3% +0.1 0.80 perf-profile.self.cycles-pp.native_irq_return_iret 0.30 ± 6% +0.2 0.45 ± 5% perf-profile.self.cycles-pp.__switch_to 0.28 ± 5% +0.2 0.44 ± 2% perf-profile.self.cycles-pp.find_next_bit 0.25 ± 6% +0.3 0.52 ± 6% perf-profile.self.cycles-pp.set_next_entity 0.40 ± 5% +0.3 0.69 ± 8% perf-profile.self.cycles-pp.cpuidle_enter_state 0.20 ± 4% +0.3 0.51 ± 5% perf-profile.self.cycles-pp.resched_curr 2.47 ± 3% +0.5 2.96 ± 4% perf-profile.self.cycles-pp.do_access 1.15 ± 5% +0.6 1.73 perf-profile.self.cycles-pp.menu_select 3.62 +0.8 4.42 ± 4% perf-profile.self.cycles-pp.do_rw_once 51.40 +7.8 59.22 perf-profile.self.cycles-pp.intel_idle *************************************************************************************************** lkp-hsw-d01: 8 threads Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G memory ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode: cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/200%/debian-x86_64-2018-04-03.cgz/900s/lkp-hsw-d01/TCP_STREAM/netperf/0x25 commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 3373 +73.3% 5846 netperf.Throughput_Mbps 53970 +73.3% 93550 netperf.Throughput_total_Mbps 1010414 ± 72% +41768.7% 4.23e+08 netperf.time.involuntary_context_switches 262.00 +60.1% 419.33 netperf.time.percent_of_cpu_this_job_got 2251 +59.7% 3594 netperf.time.system_time 112.55 +67.5% 188.47 netperf.time.user_time 3808423 -98.3% 65118 ± 38% netperf.time.voluntary_context_switches 3.706e+08 +73.3% 6.424e+08 netperf.workload 3517 ± 55% +176.6% 9729 ± 33% cpuidle.POLL.time 3472 ± 50% +135.8% 8187 ± 38% cpuidle.POLL.usage 120964 ± 2% -13.7% 104409 ± 7% meminfo.DirectMap4k 1565488 -9.5% 1416373 meminfo.Memused 97.00 -4.1% 93.00 vmstat.cpu.sy 12575 ± 12% +7364.3% 938689 vmstat.system.cs 6.52 +11.9 18.47 mpstat.cpu.all.soft% 90.86 -15.6 75.28 mpstat.cpu.all.sys% 2.44 ± 2% +3.6 6.07 mpstat.cpu.all.usr% 3566 +3.3% 3683 turbostat.Avg_MHz 0.42 ± 3% -79.5% 0.09 ± 5% turbostat.CPU%c1 40.02 +39.2% 55.70 turbostat.CorWatt 49.70 +28.3% 63.79 turbostat.PkgWatt 15728 ± 16% -69.8% 4752 ± 82% interrupts.CPU1.RES:Rescheduling_interrupts 16828 ± 14% -30.3% 11728 ± 29% interrupts.CPU2.RES:Rescheduling_interrupts 7241 ± 6% -64.1% 2599 ±124% interrupts.CPU3.CAL:Function_call_interrupts 14194 ± 3% -92.8% 1024 ± 55% interrupts.CPU4.RES:Rescheduling_interrupts 13830 ± 10% -89.6% 1444 ± 47% interrupts.CPU5.RES:Rescheduling_interrupts 127410 ± 4% -48.8% 65278 ± 26% interrupts.RES:Rescheduling_interrupts 159057 +2.3% 162779 proc-vmstat.nr_dirty_background_threshold 318505 +2.3% 325958 proc-vmstat.nr_dirty_threshold 1626033 +2.3% 1663305 proc-vmstat.nr_free_pages 7341 -5.2% 6959 ± 2% proc-vmstat.nr_slab_unreclaimable 1.858e+08 +16.3% 2.161e+08 proc-vmstat.numa_hit 1.858e+08 +16.3% 2.161e+08 proc-vmstat.numa_local 1.481e+09 +16.4% 1.724e+09 proc-vmstat.pgalloc_normal 1.481e+09 +16.4% 1.724e+09 proc-vmstat.pgfree 7407 ± 2% -9.7% 6685 ± 5% slabinfo.anon_vma_chain.active_objs 2068 ± 7% +16.8% 2415 ± 3% slabinfo.cred_jar.active_objs 2068 ± 7% +16.8% 2415 ± 3% slabinfo.cred_jar.num_objs 2484 -35.4% 1604 ± 10% slabinfo.kmalloc-1k.active_objs 2566 -35.6% 1654 ± 10% slabinfo.kmalloc-1k.num_objs 2535 -20.8% 2008 slabinfo.kmalloc-96.active_objs 2535 -20.8% 2008 slabinfo.kmalloc-96.num_objs 2157 -20.4% 1717 ± 10% slabinfo.skbuff_fclone_cache.active_objs 2206 -22.1% 1718 ± 10% slabinfo.skbuff_fclone_cache.num_objs 2530722 +1727.5% 46248079 softirqs.CPU0.NET_RX 2609005 ± 2% +1685.3% 46579298 softirqs.CPU1.NET_RX 2484840 +1775.7% 46608167 softirqs.CPU2.NET_RX 434517 ± 4% -10.0% 391098 softirqs.CPU2.TIMER 2493566 +1756.3% 46287289 softirqs.CPU3.NET_RX 94184 ± 2% -8.6% 86088 ± 4% softirqs.CPU3.RCU 2700700 ± 9% +1606.1% 46077887 softirqs.CPU4.NET_RX 2725143 ± 8% +1595.0% 46189900 softirqs.CPU5.NET_RX 2490447 +1765.9% 46469321 softirqs.CPU6.NET_RX 434086 ± 3% -9.5% 392911 softirqs.CPU6.TIMER 2479618 +1764.9% 46243232 softirqs.CPU7.NET_RX 92240 ± 2% -9.3% 83656 ± 4% softirqs.CPU7.RCU 422709 ± 3% -7.9% 389154 softirqs.CPU7.TIMER 20514045 ± 2% +1707.1% 3.707e+08 softirqs.NET_RX 284.97 ± 8% -15.8% 240.04 sched_debug.cfs_rq:/.load_avg.max 60.25 ± 12% -22.6% 46.62 ± 4% sched_debug.cfs_rq:/.load_avg.stddev 75946 ± 19% -66.7% 25254 ± 30% sched_debug.cfs_rq:/.min_vruntime.stddev 0.02 ± 57% +136.0% 0.04 ± 18% sched_debug.cfs_rq:/.nr_running.stddev 173.83 ± 2% -13.2% 150.94 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.max 31.01 ± 5% -18.3% 25.32 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.stddev 158427 ± 53% -74.7% 40007 ± 47% sched_debug.cfs_rq:/.spread0.max 75936 ± 19% -66.8% 25248 ± 30% sched_debug.cfs_rq:/.spread0.stddev 863.70 ± 2% +10.0% 949.88 ± 3% sched_debug.cfs_rq:/.util_avg.min 86.13 ± 9% -56.0% 37.94 ± 39% sched_debug.cfs_rq:/.util_avg.stddev 238.77 ± 43% +92.1% 458.60 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.min 264.42 ± 6% -41.5% 154.69 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.stddev 42486 ± 47% -79.8% 8571 ± 35% sched_debug.cpu.avg_idle.min 3.28 ± 6% -42.6% 1.89 ± 2% sched_debug.cpu.clock.stddev 3.29 ± 6% -42.6% 1.89 ± 2% sched_debug.cpu.clock_task.stddev 27019 ± 4% -12.4% 23658 ± 7% sched_debug.cpu.load.stddev 878548 ± 18% +5841.5% 52199104 sched_debug.cpu.nr_switches.avg 1612240 ± 17% +3167.5% 52680426 sched_debug.cpu.nr_switches.max 524642 +9743.9% 51645448 sched_debug.cpu.nr_switches.min 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 89.20 -38.3% 55.00 perf-stat.i.MPKI 4.603e+08 +377.8% 2.199e+09 perf-stat.i.branch-instructions 2.18 +0.4 2.60 perf-stat.i.branch-miss-rate% 10173458 +460.7% 57045617 perf-stat.i.branch-misses 41.14 -40.4 0.70 ± 25% perf-stat.i.cache-miss-rate% 84597670 -97.0% 2563290 ± 18% perf-stat.i.cache-misses 2.059e+08 +193.3% 6.04e+08 perf-stat.i.cache-references 12585 ± 12% +7375.8% 940853 perf-stat.i.context-switches 12.12 -77.7% 2.70 perf-stat.i.cpi 2.792e+10 +4.9% 2.93e+10 perf-stat.i.cpu-cycles 73.96 +16.8% 86.42 ± 2% perf-stat.i.cpu-migrations 334.69 +10192.1% 34446 ± 46% perf-stat.i.cycles-between-cache-misses 0.16 ± 11% +1.3 1.47 ± 4% perf-stat.i.dTLB-load-miss-rate% 1682997 ± 10% +3303.7% 57283460 ± 3% perf-stat.i.dTLB-load-misses 1.028e+09 +270.0% 3.803e+09 perf-stat.i.dTLB-loads 0.23 ± 33% +0.2 0.48 ± 10% perf-stat.i.dTLB-store-miss-rate% 1902010 ± 34% +599.1% 13296530 ± 10% perf-stat.i.dTLB-store-misses 8.128e+08 +235.6% 2.728e+09 perf-stat.i.dTLB-stores 90.48 -23.7 66.75 perf-stat.i.iTLB-load-miss-rate% 636565 ± 6% +1492.7% 10138519 perf-stat.i.iTLB-load-misses 79913 ± 14% +6159.8% 5002428 perf-stat.i.iTLB-loads 2.328e+09 +371.6% 1.098e+10 perf-stat.i.instructions 3716 ± 5% -68.3% 1178 ± 2% perf-stat.i.instructions-per-iTLB-miss 0.08 +344.8% 0.37 perf-stat.i.ipc 63784934 -97.6% 1562161 ± 23% perf-stat.i.node-loads 19974210 ± 3% -95.5% 890433 ± 16% perf-stat.i.node-stores 88.45 -37.8% 55.02 perf-stat.overall.MPKI 2.21 +0.4 2.59 perf-stat.overall.branch-miss-rate% 41.09 -40.7 0.42 ± 18% perf-stat.overall.cache-miss-rate% 11.99 -77.7% 2.67 perf-stat.overall.cpi 330.01 +3494.0% 11860 ± 19% perf-stat.overall.cycles-between-cache-misses 0.16 ± 11% +1.3 1.48 ± 4% perf-stat.overall.dTLB-load-miss-rate% 0.23 ± 33% +0.3 0.48 ± 9% perf-stat.overall.dTLB-store-miss-rate% 88.90 -21.9 66.96 perf-stat.overall.iTLB-load-miss-rate% 3670 ± 6% -70.5% 1083 perf-stat.overall.instructions-per-iTLB-miss 0.08 +349.4% 0.37 perf-stat.overall.ipc 5659 +172.0% 15391 perf-stat.overall.path-length 4.598e+08 +377.8% 2.197e+09 perf-stat.ps.branch-instructions 10162343 +460.7% 56982017 perf-stat.ps.branch-misses 84503333 -97.0% 2561315 ± 18% perf-stat.ps.cache-misses 2.057e+08 +193.3% 6.033e+08 perf-stat.ps.cache-references 12571 ± 12% +7375.8% 939800 perf-stat.ps.context-switches 2.789e+10 +4.9% 2.926e+10 perf-stat.ps.cpu-cycles 73.88 +16.8% 86.32 ± 2% perf-stat.ps.cpu-migrations 1681117 ± 10% +3303.6% 57219251 ± 3% perf-stat.ps.dTLB-load-misses 1.027e+09 +270.0% 3.798e+09 perf-stat.ps.dTLB-loads 1899893 ± 34% +599.1% 13281641 ± 10% perf-stat.ps.dTLB-store-misses 8.119e+08 +235.6% 2.725e+09 perf-stat.ps.dTLB-stores 635854 ± 6% +1492.7% 10127160 perf-stat.ps.iTLB-load-misses 79823 ± 14% +6159.8% 4996833 perf-stat.ps.iTLB-loads 2.325e+09 +371.6% 1.097e+10 perf-stat.ps.instructions 63713791 -97.5% 1561094 ± 23% perf-stat.ps.node-loads 19951942 ± 3% -95.5% 889635 ± 16% perf-stat.ps.node-stores 2.097e+12 +371.5% 9.887e+12 perf-stat.total.instructions 52.66 -41.4 11.31 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 52.69 -41.3 11.35 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 50.53 -41.2 9.35 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg 50.73 -41.0 9.73 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg 49.46 -40.3 9.19 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 65.85 -31.1 34.75 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64 65.90 -30.9 35.04 perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 66.25 -29.8 36.40 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 66.27 -29.7 36.53 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 21.12 -11.0 10.09 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg 21.34 -11.0 10.33 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 21.82 -10.8 10.98 perf-profile.calltrace.cycles-pp._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 97.81 -4.6 93.17 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 97.95 -4.4 93.50 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 1.57 ± 4% -0.8 0.76 ± 3% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked 1.71 ± 4% -0.8 0.95 perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg 1.89 ± 3% -0.6 1.32 ± 2% perf-profile.calltrace.cycles-pp.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 1.91 ± 3% -0.5 1.37 perf-profile.calltrace.cycles-pp.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.83 ± 8% -0.3 0.51 ± 2% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv 1.16 ± 2% -0.2 0.91 ± 2% perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg 1.12 ± 5% -0.2 0.90 ± 5% perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 1.20 ± 2% -0.1 1.09 perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg 0.14 ±173% +0.5 0.62 ± 13% perf-profile.calltrace.cycles-pp.tcp_current_mss.tcp_send_mss.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 0.00 +0.5 0.53 perf-profile.calltrace.cycles-pp.load_new_mm_cr3.switch_mm_irqs_off.__schedule.schedule.schedule_timeout 0.00 +0.5 0.54 perf-profile.calltrace.cycles-pp.__fget_light.sockfd_lookup_light.__sys_sendto.__x64_sys_sendto.do_syscall_64 0.14 ±173% +0.5 0.69 ± 11% perf-profile.calltrace.cycles-pp.tcp_send_mss.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +0.6 0.56 ± 6% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 0.00 +0.6 0.57 ± 5% perf-profile.calltrace.cycles-pp.__switch_to_asm 0.00 +0.6 0.58 ± 2% perf-profile.calltrace.cycles-pp.selinux_ip_postroute.nf_hook_slow.ip_output.__ip_queue_xmit.__tcp_transmit_skb 0.00 +0.6 0.58 ± 4% perf-profile.calltrace.cycles-pp.__fget_light.sockfd_lookup_light.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64 0.00 +0.6 0.61 ± 9% perf-profile.calltrace.cycles-pp.selinux_socket_sock_rcv_skb.security_sock_rcv_skb.sk_filter_trim_cap.tcp_v4_rcv.ip_protocol_deliver_rcu 0.00 +0.6 0.63 ± 6% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule 0.00 +0.6 0.63 ± 4% perf-profile.calltrace.cycles-pp.sockfd_lookup_light.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.7 0.66 perf-profile.calltrace.cycles-pp.nf_hook_slow.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg 0.00 +0.7 0.67 ± 12% perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack 0.00 +0.7 0.67 ± 6% perf-profile.calltrace.cycles-pp.__check_object_size.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +0.7 0.67 perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common 0.42 ± 57% +0.7 1.13 ± 5% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 0.00 +0.7 0.72 ± 4% perf-profile.calltrace.cycles-pp.sockfd_lookup_light.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.8 0.80 ± 3% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.00 +0.9 0.86 ± 7% perf-profile.calltrace.cycles-pp.__alloc_skb.__tcp_send_ack.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 0.00 +0.9 0.95 ± 2% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.00 +1.0 0.97 ± 7% perf-profile.calltrace.cycles-pp.__tcp_send_ack.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 6.74 +1.0 7.72 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg 0.59 ± 5% +1.0 1.61 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 0.00 +1.0 1.03 ± 17% perf-profile.calltrace.cycles-pp.security_sock_rcv_skb.sk_filter_trim_cap.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 0.00 +1.1 1.08 perf-profile.calltrace.cycles-pp.__schedule.preempt_schedule_common._cond_resched.kmem_cache_alloc_node.__alloc_skb 0.00 +1.1 1.10 perf-profile.calltrace.cycles-pp.preempt_schedule_common._cond_resched.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb 0.00 +1.1 1.13 perf-profile.calltrace.cycles-pp._cond_resched.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked 0.00 +1.2 1.18 ± 9% perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established 0.00 +1.2 1.19 ± 2% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.wait_woken 0.00 +1.2 1.24 ± 23% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock 0.00 +1.3 1.34 ± 3% perf-profile.calltrace.cycles-pp.sk_filter_trim_cap.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver 0.00 +1.3 1.35 ± 6% perf-profile.calltrace.cycles-pp.__schedule.preempt_schedule_common._cond_resched.__release_sock.release_sock 0.00 +1.4 1.38 ± 6% perf-profile.calltrace.cycles-pp.preempt_schedule_common._cond_resched.__release_sock.release_sock.tcp_sendmsg 0.00 +1.4 1.38 ± 10% perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv 0.00 +1.4 1.39 ± 6% perf-profile.calltrace.cycles-pp._cond_resched.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg 0.00 +1.4 1.43 ± 2% perf-profile.calltrace.cycles-pp.__switch_to 0.00 +1.5 1.45 ± 8% perf-profile.calltrace.cycles-pp.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output 0.00 +1.5 1.49 ± 3% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 0.00 +1.6 1.61 ± 5% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.schedule_timeout.wait_woken 0.00 +1.6 1.64 ± 6% perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg 1.02 ± 5% +1.7 2.68 perf-profile.calltrace.cycles-pp.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 0.00 +1.7 1.68 ± 4% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 0.00 +1.7 1.72 ± 6% perf-profile.calltrace.cycles-pp.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit 6.73 +1.8 8.49 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 1.05 ± 4% +1.9 2.90 ± 2% perf-profile.calltrace.cycles-pp.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +2.4 2.37 ± 8% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock 0.00 +2.6 2.59 perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.6 2.63 perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.7 2.71 perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.0 2.96 perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock 0.00 +3.1 3.09 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 0.00 +3.2 3.15 ± 5% perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock 0.00 +3.3 3.31 ± 4% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.wait_woken 5.79 +3.6 9.43 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 0.00 +3.7 3.74 perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb 1.96 ± 2% +3.9 5.81 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv 0.00 +4.4 4.41 ± 2% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked 0.78 ± 9% +4.5 5.28 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established 0.00 +4.7 4.68 ± 2% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg 0.00 +5.2 5.18 ± 2% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 4.73 ± 2% +5.6 10.33 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 4.76 +5.8 10.57 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver 0.00 +5.8 5.82 perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.00 +6.6 6.55 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock 0.00 +6.6 6.58 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock 0.00 +6.9 6.89 perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established 0.00 +7.2 7.23 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv 0.00 +7.5 7.54 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv 0.00 +7.8 7.80 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg 0.00 +7.9 7.91 perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 0.00 +7.9 7.94 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg 0.00 +8.1 8.10 ± 3% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_woken.sk_wait_data 0.00 +8.3 8.28 ± 2% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg 0.00 +8.4 8.39 ± 2% perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg 0.00 +8.7 8.72 ± 3% perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 29.47 +8.7 38.20 perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 5.70 +9.1 14.84 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv 5.78 +9.5 15.27 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core 5.79 +9.6 15.38 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog 5.85 +9.7 15.58 perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action 0.00 +9.9 9.88 ± 3% perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 0.00 +10.3 10.30 ± 3% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked 6.03 +10.5 16.50 perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start 6.19 +11.0 17.17 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack 0.00 +11.5 11.49 ± 3% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg 6.31 +11.7 18.04 perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq 0.00 +12.1 12.09 perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto 0.13 ±173% +12.3 12.43 perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 6.40 +12.3 18.72 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip 0.60 ± 3% +12.6 13.25 ± 3% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 6.48 +12.7 19.14 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2 0.63 ± 4% +12.8 13.39 ± 3% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 6.49 +12.8 19.27 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output 6.57 +13.1 19.71 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit 6.58 +13.4 19.94 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb 0.57 ± 8% +14.1 14.72 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames 0.00 +17.8 17.77 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit 30.13 +21.2 51.28 perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64 30.43 +21.4 51.88 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 31.04 +22.0 53.08 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 31.08 +22.1 53.22 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 71.87 -52.5 19.37 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 52.67 -41.3 11.32 perf-profile.children.cycles-pp.__skb_datagram_iter 52.69 -41.3 11.35 perf-profile.children.cycles-pp.skb_copy_datagram_iter 50.54 -41.2 9.36 perf-profile.children.cycles-pp.copyout 50.76 -41.0 9.75 perf-profile.children.cycles-pp._copy_to_iter 65.86 -31.0 34.83 perf-profile.children.cycles-pp.tcp_recvmsg 65.90 -30.9 35.04 perf-profile.children.cycles-pp.inet_recvmsg 66.25 -29.8 36.41 perf-profile.children.cycles-pp.__sys_recvfrom 66.27 -29.7 36.55 perf-profile.children.cycles-pp.__x64_sys_recvfrom 21.36 -11.0 10.34 perf-profile.children.cycles-pp.copyin 21.84 -10.8 11.01 perf-profile.children.cycles-pp._copy_from_iter_full 98.12 -4.9 93.25 perf-profile.children.cycles-pp.do_syscall_64 98.25 -4.7 93.60 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 2.22 ± 11% -1.8 0.39 ± 3% perf-profile.children.cycles-pp.apic_timer_interrupt 2.81 ± 5% -1.4 1.37 ± 8% perf-profile.children.cycles-pp.skb_release_data 2.08 ± 2% -1.4 0.67 ± 12% perf-profile.children.cycles-pp.__free_pages_ok 3.35 ± 4% -1.2 2.16 ± 7% perf-profile.children.cycles-pp.__kfree_skb 1.59 ± 3% -0.8 0.78 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist 1.73 ± 4% -0.8 0.96 ± 2% perf-profile.children.cycles-pp.__alloc_pages_nodemask 1.03 ± 19% -0.7 0.31 ± 4% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.91 ± 3% -0.6 0.32 ± 8% perf-profile.children.cycles-pp.free_one_page 1.89 ± 3% -0.6 1.32 ± 2% perf-profile.children.cycles-pp.skb_page_frag_refill 0.80 ± 12% -0.5 0.25 ± 6% perf-profile.children.cycles-pp.hrtimer_interrupt 1.92 ± 3% -0.5 1.38 perf-profile.children.cycles-pp.sk_page_frag_refill 0.57 ± 3% -0.5 0.07 ± 20% perf-profile.children.cycles-pp.skb_clone 0.66 ± 12% -0.5 0.20 ± 8% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.56 ± 9% -0.5 0.10 ± 16% perf-profile.children.cycles-pp.tcp_queue_rcv 0.51 ± 6% -0.4 0.08 ± 12% perf-profile.children.cycles-pp.tcp_check_space 0.46 ± 15% -0.3 0.13 ± 6% perf-profile.children.cycles-pp.tick_sched_timer 0.41 ± 13% -0.3 0.10 ± 12% perf-profile.children.cycles-pp.tick_sched_handle 0.40 ± 14% -0.3 0.10 ± 12% perf-profile.children.cycles-pp.update_process_times 0.57 ± 35% -0.3 0.30 ± 23% perf-profile.children.cycles-pp.io_serial_in 0.27 ± 7% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.24 ± 20% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.scheduler_tick 0.25 ± 16% -0.2 0.08 ± 27% perf-profile.children.cycles-pp.__put_compound_page 0.16 ± 17% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.task_tick_fair 0.43 ± 2% -0.1 0.31 ± 12% perf-profile.children.cycles-pp.__skb_clone 1.20 ± 2% -0.1 1.10 perf-profile.children.cycles-pp.simple_copy_to_iter 0.37 ± 10% -0.1 0.29 ± 7% perf-profile.children.cycles-pp.__list_del_entry_valid 0.30 ± 3% -0.1 0.24 ± 10% perf-profile.children.cycles-pp.kmem_cache_free 0.32 ± 12% -0.1 0.26 ± 9% perf-profile.children.cycles-pp.kfree 0.10 ± 5% +0.0 0.12 perf-profile.children.cycles-pp.alloc_pages_current 0.04 ± 58% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.get_task_policy 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.__x86_indirect_thunk_r9 0.03 ±100% +0.1 0.09 ± 14% perf-profile.children.cycles-pp.rb_erase 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.ns_to_timespec64 0.07 ± 6% +0.1 0.13 ± 9% perf-profile.children.cycles-pp.lock_timer_base 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.tcp_rate_gen 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.perf_exclude_event 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.tcp_v4_inbound_md5_hash 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.rb_insert_color_cached 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.detach_if_pending 0.11 ± 13% +0.1 0.18 ± 2% perf-profile.children.cycles-pp.inet_sendmsg 0.02 ±173% +0.1 0.09 ± 9% perf-profile.children.cycles-pp.sock_put 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.rb_first 0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.__fdget 0.00 +0.1 0.08 ± 12% perf-profile.children.cycles-pp.activate_task 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.tcp_chrono_start 0.01 ±173% +0.1 0.09 ± 9% perf-profile.children.cycles-pp.eth_type_trans 0.00 +0.1 0.08 ± 20% perf-profile.children.cycles-pp.tcp_chrono_stop 0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.__copy_skb_header 0.00 +0.1 0.08 ± 20% perf-profile.children.cycles-pp.tcp_push 0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.00 +0.1 0.09 ± 5% perf-profile.children.cycles-pp.selinux_xfrm_sock_rcv_skb 0.08 ± 61% +0.1 0.17 ± 4% perf-profile.children.cycles-pp.ip_send_check 0.00 +0.1 0.09 ± 9% perf-profile.children.cycles-pp.__raise_softirq_irqoff 0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.netdev_pick_tx 0.00 +0.1 0.09 ± 9% perf-profile.children.cycles-pp.tcp_update_pacing_rate 0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.jiffies_to_usecs 0.07 ± 21% +0.1 0.16 ± 7% perf-profile.children.cycles-pp.security_socket_recvmsg 0.01 ±173% +0.1 0.11 perf-profile.children.cycles-pp.tcp_stream_memory_free 0.00 +0.1 0.10 ± 16% perf-profile.children.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.__sock_wfree 0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.tcp_send_delayed_ack 0.00 +0.1 0.10 ± 4% perf-profile.children.cycles-pp.deactivate_task 0.03 ±100% +0.1 0.13 ± 6% perf-profile.children.cycles-pp.__kfree_skb_flush 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.tcp_v4_fill_cb 1.55 ± 5% +0.1 1.66 ± 3% perf-profile.children.cycles-pp.__check_object_size 0.01 ±173% +0.1 0.12 ± 26% perf-profile.children.cycles-pp.netlbl_enabled 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.tcp_established_options 0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.bictcp_cwnd_event 0.00 +0.1 0.12 ± 35% perf-profile.children.cycles-pp.tcp_rate_check_app_limited 0.15 ± 8% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.security_socket_sendmsg 0.00 +0.1 0.12 ± 22% perf-profile.children.cycles-pp.tcp_newly_delivered 0.01 ±173% +0.1 0.13 ± 12% perf-profile.children.cycles-pp.selinux_ipv4_postroute 0.08 ± 14% +0.1 0.19 ± 6% perf-profile.children.cycles-pp.sock_recvmsg 0.16 ± 15% +0.1 0.28 ± 13% perf-profile.children.cycles-pp.ksize 0.03 ±100% +0.1 0.15 ± 3% perf-profile.children.cycles-pp.check_stack_object 0.00 +0.1 0.12 ± 11% perf-profile.children.cycles-pp.tcp_rate_skb_sent 0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.bictcp_acked 0.10 ± 17% +0.1 0.22 ± 7% perf-profile.children.cycles-pp.rcu_all_qs 0.14 ± 13% +0.1 0.26 ± 3% perf-profile.children.cycles-pp.tcp_add_backlog 0.00 +0.1 0.12 ± 15% perf-profile.children.cycles-pp.check_cfs_rq_runtime 0.00 +0.1 0.12 ± 10% perf-profile.children.cycles-pp.resched_curr 0.03 ±100% +0.1 0.15 ± 21% perf-profile.children.cycles-pp.netif_skb_features 0.00 +0.1 0.13 ± 27% perf-profile.children.cycles-pp.tcp_event_data_recv 0.00 +0.1 0.13 ± 3% perf-profile.children.cycles-pp.tcp_recv_timestamp 0.17 ± 7% +0.1 0.30 ± 8% perf-profile.children.cycles-pp.skb_entail 0.00 +0.1 0.14 ± 12% perf-profile.children.cycles-pp.cpumask_next 0.00 +0.1 0.14 ± 12% perf-profile.children.cycles-pp.skb_clone_tx_timestamp 0.00 +0.1 0.14 ± 20% perf-profile.children.cycles-pp.woken_wake_function 0.07 ± 21% +0.1 0.21 ± 6% perf-profile.children.cycles-pp.tcp_release_cb 0.29 ± 4% +0.1 0.43 ± 3% perf-profile.children.cycles-pp.___might_sleep 0.00 +0.1 0.14 ± 52% perf-profile.children.cycles-pp.bictcp_cong_avoid 0.01 ±173% +0.1 0.16 ± 8% perf-profile.children.cycles-pp.__list_add_valid 0.01 ±173% +0.1 0.16 ± 5% perf-profile.children.cycles-pp.raw_local_deliver 0.03 ±100% +0.1 0.17 ± 10% perf-profile.children.cycles-pp.__tcp_ack_snd_check 0.03 ±100% +0.1 0.17 ± 21% perf-profile.children.cycles-pp.tcp_wfree 0.11 ± 23% +0.2 0.26 ± 6% perf-profile.children.cycles-pp.import_single_range 0.00 +0.2 0.15 ± 3% perf-profile.children.cycles-pp.tcp_v4_send_check 0.00 +0.2 0.15 ± 11% perf-profile.children.cycles-pp.tcp_update_skb_after_send 0.00 +0.2 0.16 ± 16% perf-profile.children.cycles-pp.__check_heap_object 0.01 ±173% +0.2 0.17 ± 4% perf-profile.children.cycles-pp.selinux_netlbl_sock_rcv_skb 0.04 ± 59% +0.2 0.20 ± 2% perf-profile.children.cycles-pp.__tcp_select_window 0.00 +0.2 0.16 ± 5% perf-profile.children.cycles-pp.__tcp_v4_send_check 0.00 +0.2 0.16 ± 12% perf-profile.children.cycles-pp.__usecs_to_jiffies 0.01 ±173% +0.2 0.18 ± 15% perf-profile.children.cycles-pp.inet_ehashfn 0.03 ±100% +0.2 0.20 ± 4% perf-profile.children.cycles-pp.rb_next 0.07 ± 5% +0.2 0.25 ± 14% perf-profile.children.cycles-pp.ksoftirqd_running 0.00 +0.2 0.19 ± 6% perf-profile.children.cycles-pp.remove_wait_queue 0.16 ± 7% +0.2 0.35 ± 8% perf-profile.children.cycles-pp.sock_has_perm 0.03 ±100% +0.2 0.22 ± 17% perf-profile.children.cycles-pp.selinux_ipv4_output 0.00 +0.2 0.19 ± 10% perf-profile.children.cycles-pp.__enqueue_entity 0.00 +0.2 0.19 ± 13% perf-profile.children.cycles-pp.kmalloc_slab 0.06 ± 59% +0.2 0.25 ± 8% perf-profile.children.cycles-pp.tcp_cleanup_rbuf 0.49 ± 13% +0.2 0.70 ± 11% perf-profile.children.cycles-pp.tcp_send_mss 0.00 +0.2 0.21 ± 10% perf-profile.children.cycles-pp.add_wait_queue 0.00 +0.2 0.22 ± 11% perf-profile.children.cycles-pp.set_next_buddy 0.19 ± 9% +0.2 0.41 ± 10% perf-profile.children.cycles-pp.__might_fault 0.00 +0.2 0.22 ± 13% perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.48 ± 13% +0.2 0.71 ± 11% perf-profile.children.cycles-pp.tcp_current_mss 0.08 ± 22% +0.2 0.30 ± 19% perf-profile.children.cycles-pp.validate_xmit_skb 0.00 +0.2 0.22 ± 12% perf-profile.children.cycles-pp.find_next_bit 0.00 +0.2 0.23 ± 2% perf-profile.children.cycles-pp.account_entity_enqueue 0.35 ± 25% +0.2 0.57 ± 9% perf-profile.children.cycles-pp.ipv4_mtu 0.00 +0.2 0.24 ± 5% perf-profile.children.cycles-pp.ip_rcv_finish_core 0.00 +0.2 0.24 ± 23% perf-profile.children.cycles-pp.tcp_rearm_rto 0.09 ± 17% +0.2 0.33 perf-profile.children.cycles-pp.ip_finish_output 0.00 +0.3 0.26 ± 12% perf-profile.children.cycles-pp.native_load_tls 0.16 ± 15% +0.3 0.42 ± 5% perf-profile.children.cycles-pp.tcp_rcv_space_adjust 0.04 ± 59% +0.3 0.31 ± 13% perf-profile.children.cycles-pp.tcp_ack_update_rtt 0.11 ± 4% +0.3 0.38 ± 11% perf-profile.children.cycles-pp.ip_rcv_core 0.00 +0.3 0.27 ± 11% perf-profile.children.cycles-pp.clear_buddies 0.00 +0.3 0.28 ± 7% perf-profile.children.cycles-pp.cpumask_next_wrap 0.12 ± 5% +0.3 0.40 ± 7% perf-profile.children.cycles-pp.__might_sleep 0.04 ± 58% +0.3 0.36 ± 4% perf-profile.children.cycles-pp.ip_rcv_finish 0.08 ± 10% +0.3 0.40 ± 2% perf-profile.children.cycles-pp.__sk_dst_check 0.00 +0.3 0.32 ± 5% perf-profile.children.cycles-pp.__calc_delta 0.00 +0.3 0.33 ± 16% perf-profile.children.cycles-pp.cpuacct_charge 0.00 +0.3 0.35 ± 7% perf-profile.children.cycles-pp.update_min_vruntime 0.00 +0.4 0.35 ± 14% perf-profile.children.cycles-pp.native_sched_clock 0.00 +0.4 0.36 ± 13% perf-profile.children.cycles-pp.sched_clock 0.03 ±100% +0.4 0.39 ± 10% perf-profile.children.cycles-pp.update_rq_clock 0.04 ± 58% +0.4 0.41 ± 8% perf-profile.children.cycles-pp.ktime_get_with_offset 0.09 ± 12% +0.4 0.46 ± 9% perf-profile.children.cycles-pp.ipv4_dst_check 0.08 ± 15% +0.4 0.46 perf-profile.children.cycles-pp.skb_release_head_state 0.00 +0.4 0.38 ± 18% perf-profile.children.cycles-pp.finish_task_switch 0.00 +0.4 0.39 ± 4% perf-profile.children.cycles-pp.rb_erase_cached 0.00 +0.4 0.39 ± 5% perf-profile.children.cycles-pp.dst_release 0.09 ± 16% +0.4 0.49 ± 2% perf-profile.children.cycles-pp.skb_release_all 0.26 ± 7% +0.4 0.66 ± 3% perf-profile.children.cycles-pp.mod_timer 0.01 ±173% +0.4 0.42 ± 5% perf-profile.children.cycles-pp.__update_load_avg_se 0.15 ± 11% +0.4 0.56 ± 5% perf-profile.children.cycles-pp.avc_has_perm 0.00 +0.4 0.41 perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.15 ± 18% +0.4 0.57 ± 4% perf-profile.children.cycles-pp.__netif_receive_skb_core 0.00 +0.4 0.43 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.00 +0.4 0.43 ± 12% perf-profile.children.cycles-pp.sched_clock_cpu 0.34 ± 16% +0.4 0.77 ± 14% perf-profile.children.cycles-pp.__virt_addr_valid 0.34 ± 2% +0.4 0.78 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.26 ± 7% +0.4 0.70 ± 3% perf-profile.children.cycles-pp.sk_reset_timer 0.03 ±100% +0.5 0.48 ± 10% perf-profile.children.cycles-pp.account_entity_dequeue 0.08 ± 8% +0.5 0.56 ± 4% perf-profile.children.cycles-pp.selinux_parse_skb 0.24 ± 7% +0.5 0.73 ± 2% perf-profile.children.cycles-pp.tcp_mstamp_refresh 0.05 ± 9% +0.5 0.55 ± 7% perf-profile.children.cycles-pp.native_write_msr 0.18 +0.5 0.69 ± 22% perf-profile.children.cycles-pp._raw_spin_lock_bh 0.16 ± 23% +0.5 0.70 ± 8% perf-profile.children.cycles-pp.enqueue_to_backlog 0.30 ± 7% +0.5 0.85 ± 12% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 0.00 +0.5 0.55 ± 5% perf-profile.children.cycles-pp.pick_next_entity 0.31 ± 4% +0.6 0.87 ± 3% perf-profile.children.cycles-pp._raw_spin_lock 0.03 ±100% +0.6 0.60 ± 3% perf-profile.children.cycles-pp.__switch_to_asm 0.31 ± 7% +0.6 0.88 ± 10% perf-profile.children.cycles-pp.__kmalloc_reserve 0.19 ± 16% +0.6 0.76 ± 6% perf-profile.children.cycles-pp.tcp_event_new_data_sent 0.00 +0.6 0.59 ± 7% perf-profile.children.cycles-pp.check_preempt_wakeup 0.35 ± 4% +0.6 0.95 ± 3% perf-profile.children.cycles-pp.ktime_get 0.11 ± 3% +0.6 0.74 ± 8% perf-profile.children.cycles-pp.___perf_sw_event 0.18 ± 21% +0.6 0.81 ± 14% perf-profile.children.cycles-pp.__ip_local_out 0.00 +0.7 0.65 ± 2% perf-profile.children.cycles-pp.check_preempt_curr 0.00 +0.7 0.67 ± 9% perf-profile.children.cycles-pp.put_prev_entity 0.45 ± 12% +0.7 1.13 ± 2% perf-profile.children.cycles-pp.__fget_light 0.20 ± 5% +0.7 0.89 ± 5% perf-profile.children.cycles-pp.read_tsc 0.10 ± 15% +0.7 0.80 ± 3% perf-profile.children.cycles-pp.tcp_schedule_loss_probe 0.18 ± 19% +0.7 0.89 ± 10% perf-profile.children.cycles-pp.ip_local_out 0.00 +0.7 0.71 ± 4% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.60 ± 8% +0.7 1.33 ± 4% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.20 ± 16% +0.7 0.94 ± 5% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.7 0.75 ± 8% perf-profile.children.cycles-pp.available_idle_cpu 0.21 ± 7% +0.8 0.98 ± 7% perf-profile.children.cycles-pp.__tcp_send_ack 0.19 ± 14% +0.8 0.98 ± 3% perf-profile.children.cycles-pp.selinux_sock_rcv_skb_compat 0.00 +0.8 0.82 ± 2% perf-profile.children.cycles-pp.update_cfs_group 0.54 ± 11% +0.8 1.36 ± 3% perf-profile.children.cycles-pp.sockfd_lookup_light 0.20 ± 7% +0.8 1.04 ± 4% perf-profile.children.cycles-pp.__inet_lookup_established 0.22 ± 10% +0.9 1.10 ± 7% perf-profile.children.cycles-pp.lock_sock_nested 0.23 ± 4% +0.9 1.15 ± 3% perf-profile.children.cycles-pp.selinux_ip_postroute_compat 0.00 +0.9 0.93 ± 3% perf-profile.children.cycles-pp.set_next_entity 0.59 ± 5% +1.0 1.61 perf-profile.children.cycles-pp.entry_SYSCALL_64 0.07 ± 7% +1.0 1.11 ± 9% perf-profile.children.cycles-pp.update_load_avg 0.23 ± 17% +1.1 1.28 ± 9% perf-profile.children.cycles-pp.netif_rx_internal 0.24 ± 13% +1.1 1.30 ± 10% perf-profile.children.cycles-pp.netif_rx 0.29 ± 8% +1.1 1.40 perf-profile.children.cycles-pp.selinux_ip_postroute 0.31 ± 8% +1.2 1.49 ± 3% perf-profile.children.cycles-pp.selinux_socket_sock_rcv_skb 0.05 ± 60% +1.2 1.26 ± 3% perf-profile.children.cycles-pp.load_new_mm_cr3 0.09 ± 12% +1.2 1.31 perf-profile.children.cycles-pp.enqueue_entity 0.03 ±100% +1.2 1.26 perf-profile.children.cycles-pp.reweight_entity 0.34 ± 7% +1.3 1.67 ± 4% perf-profile.children.cycles-pp.security_sock_rcv_skb 0.14 ± 7% +1.4 1.53 ± 2% perf-profile.children.cycles-pp.__switch_to 0.09 ± 27% +1.4 1.52 ± 2% perf-profile.children.cycles-pp.dequeue_entity 0.35 ± 7% +1.5 1.87 ± 4% perf-profile.children.cycles-pp.sk_filter_trim_cap 0.34 ± 8% +1.6 1.94 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc_node 0.39 ± 9% +1.7 2.06 ± 4% perf-profile.children.cycles-pp.nf_hook_slow 0.04 ± 63% +1.7 1.78 ± 5% perf-profile.children.cycles-pp.select_idle_sibling 0.43 ± 8% +1.8 2.19 ± 5% perf-profile.children.cycles-pp.loopback_xmit 0.13 ± 21% +1.8 1.92 ± 3% perf-profile.children.cycles-pp.update_curr 1.05 ± 4% +1.9 2.91 perf-profile.children.cycles-pp.sk_stream_alloc_skb 0.11 ± 14% +2.0 2.15 ± 3% perf-profile.children.cycles-pp.select_task_rq_fair 0.85 ± 8% +2.1 2.91 ± 6% perf-profile.children.cycles-pp.tcp_clean_rtx_queue 0.48 ± 6% +2.1 2.54 ± 3% perf-profile.children.cycles-pp.dev_hard_start_xmit 0.17 ± 7% +2.3 2.48 ± 3% perf-profile.children.cycles-pp.preempt_schedule_common 1.19 ± 5% +2.4 3.54 perf-profile.children.cycles-pp.__alloc_skb 0.14 ± 15% +2.6 2.72 perf-profile.children.cycles-pp.exit_to_usermode_loop 0.29 ± 7% +2.6 2.88 ± 3% perf-profile.children.cycles-pp._cond_resched 0.18 ± 6% +2.8 2.98 perf-profile.children.cycles-pp.enqueue_task_fair 0.20 ± 7% +2.9 3.10 perf-profile.children.cycles-pp.ttwu_do_activate 1.15 ± 5% +2.9 4.08 ± 3% perf-profile.children.cycles-pp.tcp_ack 0.23 ± 9% +3.0 3.20 ± 3% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.11 ± 4% +3.1 3.20 ± 2% perf-profile.children.cycles-pp.pick_next_task_fair 0.69 ± 6% +3.1 3.79 ± 2% perf-profile.children.cycles-pp.__dev_queue_xmit 0.15 ± 14% +3.2 3.34 ± 4% perf-profile.children.cycles-pp.dequeue_task_fair 0.40 ± 9% +6.5 6.92 perf-profile.children.cycles-pp.try_to_wake_up 0.41 ± 6% +6.8 7.24 perf-profile.children.cycles-pp.__wake_up_common 0.42 ± 5% +7.2 7.57 perf-profile.children.cycles-pp.__wake_up_common_lock 0.57 ± 6% +7.8 8.40 ± 2% perf-profile.children.cycles-pp.schedule_timeout 0.04 ± 58% +7.9 7.91 perf-profile.children.cycles-pp.sock_def_readable 0.57 ± 6% +8.2 8.72 ± 3% perf-profile.children.cycles-pp.wait_woken 29.49 +8.8 38.25 perf-profile.children.cycles-pp.tcp_sendmsg_locked 5.74 +9.2 14.91 perf-profile.children.cycles-pp.tcp_v4_rcv 5.81 +9.5 15.29 perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 5.83 +9.6 15.39 perf-profile.children.cycles-pp.ip_local_deliver_finish 5.88 +9.7 15.59 perf-profile.children.cycles-pp.ip_local_deliver 0.00 +9.9 9.89 ± 3% perf-profile.children.cycles-pp.sk_wait_data 0.69 ± 2% +10.2 10.94 ± 2% perf-profile.children.cycles-pp.schedule 6.07 +10.4 16.51 perf-profile.children.cycles-pp.ip_rcv 1.59 ± 8% +10.5 12.10 perf-profile.children.cycles-pp.__release_sock 6.24 +10.9 17.18 perf-profile.children.cycles-pp.__netif_receive_skb_one_core 1.80 ± 7% +11.0 12.78 perf-profile.children.cycles-pp.release_sock 6.36 +11.7 18.06 perf-profile.children.cycles-pp.process_backlog 5.99 ± 2% +12.2 18.18 perf-profile.children.cycles-pp.tcp_rcv_established 6.46 +12.3 18.77 perf-profile.children.cycles-pp.net_rx_action 0.85 ± 3% +12.4 13.23 perf-profile.children.cycles-pp.__schedule 6.09 ± 2% +12.4 18.53 perf-profile.children.cycles-pp.tcp_v4_do_rcv 6.68 ± 2% +12.5 19.16 perf-profile.children.cycles-pp.__softirqentry_text_start 6.54 +12.7 19.28 perf-profile.children.cycles-pp.do_softirq_own_stack 6.62 +13.1 19.75 perf-profile.children.cycles-pp.do_softirq 6.72 +13.5 20.25 perf-profile.children.cycles-pp.__local_bh_enable_ip 3.59 ± 2% +16.4 19.99 perf-profile.children.cycles-pp.__tcp_push_pending_frames 7.12 +17.4 24.55 perf-profile.children.cycles-pp.ip_finish_output2 7.40 +19.5 26.87 perf-profile.children.cycles-pp.ip_output 7.60 +21.2 28.77 perf-profile.children.cycles-pp.__ip_queue_xmit 30.14 +21.2 51.31 perf-profile.children.cycles-pp.tcp_sendmsg 30.43 +21.4 51.88 perf-profile.children.cycles-pp.sock_sendmsg 31.05 +22.0 53.09 perf-profile.children.cycles-pp.__sys_sendto 3.56 ± 2% +22.1 25.68 perf-profile.children.cycles-pp.tcp_write_xmit 31.09 +22.2 53.24 perf-profile.children.cycles-pp.__x64_sys_sendto 7.92 +24.0 31.94 perf-profile.children.cycles-pp.__tcp_transmit_skb 70.78 -51.5 19.24 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 1.16 ± 3% -0.9 0.30 ± 10% perf-profile.self.cycles-pp.__free_pages_ok 2.25 ± 3% -0.6 1.63 ± 3% perf-profile.self.cycles-pp.tcp_sendmsg_locked 0.67 ± 4% -0.5 0.13 ± 9% perf-profile.self.cycles-pp.free_one_page 1.18 ± 5% -0.5 0.65 ± 8% perf-profile.self.cycles-pp.__check_object_size 0.57 ± 3% -0.5 0.07 ± 25% perf-profile.self.cycles-pp.skb_clone 0.80 ± 3% -0.5 0.34 ± 11% perf-profile.self.cycles-pp.get_page_from_freelist 0.27 ± 5% -0.2 0.04 ± 71% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.42 ± 2% -0.2 0.23 ± 12% perf-profile.self.cycles-pp.__skb_clone 0.41 ± 28% -0.1 0.30 ± 23% perf-profile.self.cycles-pp.io_serial_in 0.45 ± 4% -0.1 0.37 ± 5% perf-profile.self.cycles-pp.__skb_datagram_iter 0.36 ± 9% -0.1 0.28 ± 9% perf-profile.self.cycles-pp.__list_del_entry_valid 0.31 ± 13% -0.1 0.25 ± 7% perf-profile.self.cycles-pp.kfree 0.04 ± 58% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.get_task_policy 0.01 ±173% +0.0 0.06 ± 13% perf-profile.self.cycles-pp.sk_page_frag_refill 0.11 ± 4% +0.1 0.17 ± 2% perf-profile.self.cycles-pp.tcp_mstamp_refresh 0.03 ±100% +0.1 0.08 ± 20% perf-profile.self.cycles-pp.rb_erase 0.00 +0.1 0.06 ± 8% perf-profile.self.cycles-pp.__x86_indirect_thunk_r9 0.01 ±173% +0.1 0.07 ± 11% perf-profile.self.cycles-pp.tcp_send_mss 0.17 ± 10% +0.1 0.22 ± 11% perf-profile.self.cycles-pp.skb_entail 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.sk_reset_timer 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.rb_first 0.07 ± 17% +0.1 0.13 ± 14% perf-profile.self.cycles-pp.tcp_add_backlog 0.00 +0.1 0.06 ± 19% perf-profile.self.cycles-pp.ttwu_do_wakeup 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.perf_exclude_event 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.detach_if_pending 0.38 ± 7% +0.1 0.45 perf-profile.self.cycles-pp.__alloc_skb 0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.jiffies_to_usecs 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.__wake_up_common_lock 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.tcp_rate_gen 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.add_wait_queue 0.01 ±173% +0.1 0.08 ± 10% perf-profile.self.cycles-pp.eth_type_trans 0.09 ± 19% +0.1 0.16 ± 10% perf-profile.self.cycles-pp.sockfd_lookup_light 0.10 ± 12% +0.1 0.17 ± 4% perf-profile.self.cycles-pp.inet_sendmsg 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.rb_insert_color_cached 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.sched_clock_cpu 0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.tcp_chrono_stop 0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.__fdget 0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.tcp_chrono_start 0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.skb_release_head_state 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.16 ± 8% +0.1 0.24 ± 10% perf-profile.self.cycles-pp.kmem_cache_free 0.00 +0.1 0.08 ± 12% perf-profile.self.cycles-pp.activate_task 0.00 +0.1 0.08 ± 16% perf-profile.self.cycles-pp.__copy_skb_header 0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.copyin 0.09 ± 14% +0.1 0.17 ± 17% perf-profile.self.cycles-pp.__might_fault 0.00 +0.1 0.08 perf-profile.self.cycles-pp.selinux_xfrm_sock_rcv_skb 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.sock_put 0.16 ± 12% +0.1 0.24 ± 9% perf-profile.self.cycles-pp._copy_to_iter 0.00 +0.1 0.08 ± 20% perf-profile.self.cycles-pp.tcp_push 0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.netdev_pick_tx 0.17 ± 22% +0.1 0.25 ± 4% perf-profile.self.cycles-pp._copy_from_iter_full 0.00 +0.1 0.09 ± 14% perf-profile.self.cycles-pp.__raise_softirq_irqoff 0.00 +0.1 0.09 ± 5% perf-profile.self.cycles-pp.tcp_update_skb_after_send 0.00 +0.1 0.09 ± 10% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.00 +0.1 0.09 ± 14% perf-profile.self.cycles-pp.ip_local_deliver_finish 0.01 ±173% +0.1 0.10 ± 8% perf-profile.self.cycles-pp.tcp_stream_memory_free 0.00 +0.1 0.09 ± 18% perf-profile.self.cycles-pp.bictcp_cong_avoid 0.00 +0.1 0.09 ± 15% perf-profile.self.cycles-pp.__kfree_skb_flush 0.00 +0.1 0.09 ± 9% perf-profile.self.cycles-pp.tcp_update_pacing_rate 0.08 ± 62% +0.1 0.17 ± 4% perf-profile.self.cycles-pp.ip_send_check 0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.check_cfs_rq_runtime 0.00 +0.1 0.09 ± 10% perf-profile.self.cycles-pp.__netif_receive_skb_one_core 0.01 ±173% +0.1 0.11 ± 11% perf-profile.self.cycles-pp.check_stack_object 0.04 ± 57% +0.1 0.13 ± 3% perf-profile.self.cycles-pp.__tcp_push_pending_frames 0.03 ±100% +0.1 0.12 ± 13% perf-profile.self.cycles-pp.simple_copy_to_iter 0.00 +0.1 0.10 ± 12% perf-profile.self.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.10 ± 12% perf-profile.self.cycles-pp.tcp_rcv_space_adjust 0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.__sock_wfree 0.00 +0.1 0.10 ± 14% perf-profile.self.cycles-pp.tcp_v4_fill_cb 0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.tcp_send_delayed_ack 0.00 +0.1 0.10 ± 14% perf-profile.self.cycles-pp.tcp_queue_rcv 0.09 ± 17% +0.1 0.19 ± 10% perf-profile.self.cycles-pp.rcu_all_qs 0.07 ± 14% +0.1 0.18 ± 7% perf-profile.self.cycles-pp.__release_sock 0.00 +0.1 0.10 ± 9% perf-profile.self.cycles-pp.tcp_established_options 0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.deactivate_task 0.06 ± 14% +0.1 0.16 ± 12% perf-profile.self.cycles-pp.tcp_v4_do_rcv 0.01 ±173% +0.1 0.12 perf-profile.self.cycles-pp.sock_sendmsg 0.01 ±173% +0.1 0.12 ± 13% perf-profile.self.cycles-pp.__tcp_send_ack 0.01 ±173% +0.1 0.12 ± 13% perf-profile.self.cycles-pp.selinux_ipv4_postroute 0.16 ± 11% +0.1 0.27 ± 12% perf-profile.self.cycles-pp.tcp_current_mss 0.00 +0.1 0.11 ± 7% perf-profile.self.cycles-pp.bictcp_cwnd_event 0.00 +0.1 0.11 ± 14% perf-profile.self.cycles-pp.resched_curr 0.00 +0.1 0.11 ± 7% perf-profile.self.cycles-pp.ip_rcv_finish 0.00 +0.1 0.11 ± 4% perf-profile.self.cycles-pp.schedule_timeout 0.00 +0.1 0.11 ± 36% perf-profile.self.cycles-pp.tcp_rate_check_app_limited 0.15 ± 16% +0.1 0.27 ± 13% perf-profile.self.cycles-pp.ksize 0.18 ± 8% +0.1 0.29 ± 2% perf-profile.self.cycles-pp.ktime_get 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.lock_sock_nested 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.tcp_rate_skb_sent 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.selinux_ipv4_output 0.00 +0.1 0.12 ± 4% perf-profile.self.cycles-pp.skb_clone_tx_timestamp 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.bictcp_acked 0.00 +0.1 0.12 ± 22% perf-profile.self.cycles-pp.tcp_newly_delivered 0.09 ± 21% +0.1 0.20 ± 6% perf-profile.self.cycles-pp.import_single_range 0.00 +0.1 0.12 ± 29% perf-profile.self.cycles-pp.netlbl_enabled 0.00 +0.1 0.12 ± 18% perf-profile.self.cycles-pp.netif_skb_features 0.00 +0.1 0.12 ± 16% perf-profile.self.cycles-pp.__x64_sys_recvfrom 0.00 +0.1 0.13 ± 24% perf-profile.self.cycles-pp.tcp_event_data_recv 0.00 +0.1 0.13 ± 7% perf-profile.self.cycles-pp.selinux_netlbl_sock_rcv_skb 0.06 ± 13% +0.1 0.19 ± 4% perf-profile.self.cycles-pp.tcp_release_cb 0.00 +0.1 0.13 ± 16% perf-profile.self.cycles-pp.do_softirq_own_stack 0.00 +0.1 0.13 ± 6% perf-profile.self.cycles-pp.tcp_recv_timestamp 0.00 +0.1 0.13 ± 18% perf-profile.self.cycles-pp.sk_wait_data 0.00 +0.1 0.13 ± 9% perf-profile.self.cycles-pp.tcp_v4_send_check 0.01 ±173% +0.1 0.15 ± 19% perf-profile.self.cycles-pp.update_rq_clock 0.01 ±173% +0.1 0.15 ± 3% perf-profile.self.cycles-pp.raw_local_deliver 0.29 ± 3% +0.1 0.42 ± 5% perf-profile.self.cycles-pp.___might_sleep 0.00 +0.1 0.14 ± 20% perf-profile.self.cycles-pp.woken_wake_function 0.01 ±173% +0.1 0.15 ± 11% perf-profile.self.cycles-pp.__list_add_valid 0.00 +0.1 0.14 ± 25% perf-profile.self.cycles-pp.validate_xmit_skb 0.00 +0.1 0.14 ± 5% perf-profile.self.cycles-pp.ip_finish_output 0.03 ±100% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.__x64_sys_sendto 0.00 +0.1 0.14 ± 14% perf-profile.self.cycles-pp.__tcp_ack_snd_check 0.09 ± 14% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.skb_page_frag_refill 0.03 ±100% +0.1 0.17 ± 19% perf-profile.self.cycles-pp.tcp_wfree 0.01 ±173% +0.1 0.16 perf-profile.self.cycles-pp.rb_next 0.00 +0.1 0.15 ± 6% perf-profile.self.cycles-pp.__tcp_v4_send_check 0.05 ± 58% +0.2 0.20 ± 4% perf-profile.self.cycles-pp.ip_local_deliver 0.00 +0.2 0.15 ± 9% perf-profile.self.cycles-pp.__usecs_to_jiffies 0.04 ± 60% +0.2 0.19 ± 2% perf-profile.self.cycles-pp.__tcp_select_window 0.02 ±173% +0.2 0.17 ± 19% perf-profile.self.cycles-pp.release_sock 0.43 ± 19% +0.2 0.58 ± 6% perf-profile.self.cycles-pp.skb_release_data 0.00 +0.2 0.15 ± 15% perf-profile.self.cycles-pp.__check_heap_object 0.00 +0.2 0.16 ± 15% perf-profile.self.cycles-pp.__sk_dst_check 0.01 ±173% +0.2 0.18 ± 16% perf-profile.self.cycles-pp.inet_ehashfn 0.07 ± 5% +0.2 0.24 ± 17% perf-profile.self.cycles-pp.ksoftirqd_running 0.00 +0.2 0.17 ± 4% perf-profile.self.cycles-pp.__ip_local_out 0.00 +0.2 0.17 perf-profile.self.cycles-pp.__wake_up_common 0.06 ± 26% +0.2 0.23 ± 7% perf-profile.self.cycles-pp.tcp_event_new_data_sent 0.03 ±100% +0.2 0.20 ± 6% perf-profile.self.cycles-pp.tcp_sendmsg 0.01 ±173% +0.2 0.19 ± 12% perf-profile.self.cycles-pp.sk_stream_alloc_skb 0.00 +0.2 0.17 ± 7% perf-profile.self.cycles-pp.schedule 0.00 +0.2 0.18 ± 14% perf-profile.self.cycles-pp.security_sock_rcv_skb 0.00 +0.2 0.18 ± 11% perf-profile.self.cycles-pp.__enqueue_entity 0.16 ± 7% +0.2 0.34 ± 8% perf-profile.self.cycles-pp.sock_has_perm 0.00 +0.2 0.18 ± 13% perf-profile.self.cycles-pp.ktime_get_with_offset 0.00 +0.2 0.18 ± 4% perf-profile.self.cycles-pp.cpumask_next_wrap 0.00 +0.2 0.18 ± 10% perf-profile.self.cycles-pp.kmalloc_slab 0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.put_prev_entity 0.05 ± 60% +0.2 0.23 ± 7% perf-profile.self.cycles-pp.tcp_cleanup_rbuf 0.00 +0.2 0.19 ± 6% perf-profile.self.cycles-pp.set_next_entity 0.00 +0.2 0.20 ± 12% perf-profile.self.cycles-pp.set_next_buddy 0.00 +0.2 0.20 ± 20% perf-profile.self.cycles-pp.netif_rx_internal 0.00 +0.2 0.20 ± 14% perf-profile.self.cycles-pp._cond_resched 0.01 ±173% +0.2 0.21 ± 2% perf-profile.self.cycles-pp.inet_recvmsg 0.00 +0.2 0.20 ± 14% perf-profile.self.cycles-pp.tcp_ack_update_rtt 0.00 +0.2 0.20 ± 4% perf-profile.self.cycles-pp.ip_rcv 0.00 +0.2 0.20 ± 28% perf-profile.self.cycles-pp.tcp_rearm_rto 0.00 +0.2 0.20 ± 6% perf-profile.self.cycles-pp.find_next_bit 0.00 +0.2 0.21 perf-profile.self.cycles-pp.account_entity_enqueue 0.00 +0.2 0.21 ± 12% perf-profile.self.cycles-pp.enqueue_entity 0.00 +0.2 0.21 ± 4% perf-profile.self.cycles-pp.sk_filter_trim_cap 0.05 ± 67% +0.2 0.26 ± 10% perf-profile.self.cycles-pp.selinux_ip_postroute 0.01 ±173% +0.2 0.23 ± 12% perf-profile.self.cycles-pp.ip_protocol_deliver_rcu 0.00 +0.2 0.22 ± 13% perf-profile.self.cycles-pp.copy_user_generic_unrolled 0.00 +0.2 0.22 ± 11% perf-profile.self.cycles-pp.clear_buddies 0.14 ± 15% +0.2 0.36 ± 6% perf-profile.self.cycles-pp.mod_timer 0.00 +0.2 0.23 ± 3% perf-profile.self.cycles-pp.ip_rcv_finish_core 0.14 ± 18% +0.2 0.37 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.16 ± 18% +0.2 0.39 ± 4% perf-profile.self.cycles-pp.__sys_sendto 0.31 ± 19% +0.2 0.55 ± 7% perf-profile.self.cycles-pp.ipv4_mtu 0.00 +0.2 0.24 perf-profile.self.cycles-pp.do_softirq 0.00 +0.2 0.24 ± 7% perf-profile.self.cycles-pp.dequeue_entity 0.04 ± 58% +0.2 0.28 ± 7% perf-profile.self.cycles-pp.sock_def_readable 0.00 +0.2 0.25 ± 13% perf-profile.self.cycles-pp.native_load_tls 0.00 +0.3 0.25 ± 3% perf-profile.self.cycles-pp.rb_erase_cached 0.07 ± 12% +0.3 0.32 ± 8% perf-profile.self.cycles-pp.selinux_sock_rcv_skb_compat 0.11 ± 4% +0.3 0.37 ± 11% perf-profile.self.cycles-pp.ip_rcv_core 0.11 ± 11% +0.3 0.37 ± 7% perf-profile.self.cycles-pp.__might_sleep 0.00 +0.3 0.27 ± 16% perf-profile.self.cycles-pp.finish_task_switch 0.09 ± 19% +0.3 0.36 ± 8% perf-profile.self.cycles-pp.__sys_recvfrom 0.00 +0.3 0.27 ± 4% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.00 +0.3 0.29 ± 8% perf-profile.self.cycles-pp.pick_next_entity 0.00 +0.3 0.30 ± 23% perf-profile.self.cycles-pp.nf_hook_slow 0.07 ± 19% +0.3 0.37 ± 8% perf-profile.self.cycles-pp.__softirqentry_text_start 0.00 +0.3 0.31 ± 13% perf-profile.self.cycles-pp.native_sched_clock 0.04 ± 57% +0.3 0.35 ± 3% perf-profile.self.cycles-pp.select_task_rq_fair 0.00 +0.3 0.32 ± 15% perf-profile.self.cycles-pp.check_preempt_wakeup 0.00 +0.3 0.32 ± 6% perf-profile.self.cycles-pp.__calc_delta 0.90 ± 3% +0.3 1.22 ± 3% perf-profile.self.cycles-pp.tcp_write_xmit 0.00 +0.3 0.33 ± 11% perf-profile.self.cycles-pp.wait_woken 0.08 ± 15% +0.3 0.41 ± 3% perf-profile.self.cycles-pp.ip_output 0.00 +0.3 0.33 ± 16% perf-profile.self.cycles-pp.cpuacct_charge 0.05 ± 67% +0.3 0.38 ± 6% perf-profile.self.cycles-pp.loopback_xmit 0.01 ±173% +0.3 0.34 ± 9% perf-profile.self.cycles-pp.dev_hard_start_xmit 0.16 ± 7% +0.3 0.49 ± 9% perf-profile.self.cycles-pp.tcp_rcv_established 0.07 ± 15% +0.3 0.41 ± 9% perf-profile.self.cycles-pp.enqueue_to_backlog 0.00 +0.3 0.34 ± 9% perf-profile.self.cycles-pp.update_min_vruntime 0.01 ±173% +0.3 0.35 ± 4% perf-profile.self.cycles-pp.tcp_schedule_loss_probe 0.08 ± 17% +0.3 0.43 ± 10% perf-profile.self.cycles-pp.ipv4_dst_check 0.00 +0.4 0.36 ± 10% perf-profile.self.cycles-pp.try_to_wake_up 0.09 ± 14% +0.4 0.46 ± 2% perf-profile.self.cycles-pp.selinux_ip_postroute_compat 0.24 ± 12% +0.4 0.61 ± 12% perf-profile.self.cycles-pp.do_syscall_64 0.11 ± 4% +0.4 0.49 ± 4% perf-profile.self.cycles-pp.__local_bh_enable_ip 0.00 +0.4 0.38 ± 3% perf-profile.self.cycles-pp.dst_release 0.11 ± 19% +0.4 0.50 ± 3% perf-profile.self.cycles-pp.selinux_socket_sock_rcv_skb 0.00 +0.4 0.39 ± 7% perf-profile.self.cycles-pp.account_entity_dequeue 0.01 ±173% +0.4 0.40 ± 5% perf-profile.self.cycles-pp.__update_load_avg_se 0.00 +0.4 0.39 perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.17 ± 10% +0.4 0.57 ± 14% perf-profile.self.cycles-pp.__kmalloc_node_track_caller 0.32 ± 13% +0.4 0.73 ± 15% perf-profile.self.cycles-pp.__virt_addr_valid 0.14 ± 14% +0.4 0.56 ± 4% perf-profile.self.cycles-pp.avc_has_perm 0.14 ± 11% +0.4 0.57 ± 4% perf-profile.self.cycles-pp.__netif_receive_skb_core 0.11 ± 9% +0.4 0.54 ± 2% perf-profile.self.cycles-pp.tcp_clean_rtx_queue 0.01 ±173% +0.4 0.45 ± 9% perf-profile.self.cycles-pp.select_idle_sibling 0.07 +0.4 0.51 ± 4% perf-profile.self.cycles-pp.selinux_parse_skb 0.17 ± 10% +0.4 0.62 ± 11% perf-profile.self.cycles-pp.tcp_ack 0.15 ± 4% +0.5 0.61 ± 14% perf-profile.self.cycles-pp._raw_spin_lock_bh 0.14 ± 3% +0.5 0.60 ± 14% perf-profile.self.cycles-pp.__ip_queue_xmit 0.06 ± 13% +0.5 0.53 ± 3% perf-profile.self.cycles-pp.net_rx_action 0.21 ± 10% +0.5 0.70 ± 5% perf-profile.self.cycles-pp.kmem_cache_alloc_node 0.05 ± 9% +0.5 0.55 ± 7% perf-profile.self.cycles-pp.native_write_msr 0.07 ± 26% +0.5 0.57 ± 7% perf-profile.self.cycles-pp.enqueue_task_fair 0.10 ± 5% +0.5 0.61 ± 6% perf-profile.self.cycles-pp.process_backlog 0.00 +0.5 0.53 ± 4% perf-profile.self.cycles-pp.reweight_entity 0.20 ± 2% +0.5 0.74 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.01 ±173% +0.6 0.57 ± 7% perf-profile.self.cycles-pp.update_load_avg 0.10 ± 8% +0.6 0.65 ± 8% perf-profile.self.cycles-pp.___perf_sw_event 0.03 ±100% +0.6 0.60 ± 3% perf-profile.self.cycles-pp.__switch_to_asm 0.00 +0.6 0.59 ± 4% perf-profile.self.cycles-pp.dequeue_task_fair 0.21 ± 3% +0.6 0.80 ± 3% perf-profile.self.cycles-pp._raw_spin_lock 0.17 ± 9% +0.6 0.79 ± 6% perf-profile.self.cycles-pp.tcp_v4_rcv 0.12 ± 5% +0.6 0.75 ± 8% perf-profile.self.cycles-pp.__dev_queue_xmit 0.19 ± 6% +0.6 0.83 ± 6% perf-profile.self.cycles-pp.read_tsc 0.16 ± 7% +0.7 0.83 perf-profile.self.cycles-pp.__inet_lookup_established 0.44 ± 12% +0.7 1.12 ± 2% perf-profile.self.cycles-pp.__fget_light 0.15 ± 10% +0.7 0.83 ± 2% perf-profile.self.cycles-pp.ip_finish_output2 0.16 ± 15% +0.7 0.86 ± 5% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.60 ± 8% +0.7 1.33 ± 4% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.00 +0.7 0.74 ± 8% perf-profile.self.cycles-pp.available_idle_cpu 0.36 ± 18% +0.7 1.10 ± 6% perf-profile.self.cycles-pp.tcp_recvmsg 0.00 +0.8 0.79 ± 2% perf-profile.self.cycles-pp.update_cfs_group 0.07 ± 20% +0.8 0.92 ± 9% perf-profile.self.cycles-pp.update_curr 0.03 ±100% +0.9 0.90 ± 3% perf-profile.self.cycles-pp.pick_next_task_fair 0.59 ± 5% +1.0 1.61 perf-profile.self.cycles-pp.entry_SYSCALL_64 0.05 ± 60% +1.2 1.26 ± 3% perf-profile.self.cycles-pp.load_new_mm_cr3 0.14 ± 7% +1.4 1.50 perf-profile.self.cycles-pp.__switch_to 0.33 ± 9% +1.4 1.74 perf-profile.self.cycles-pp.__tcp_transmit_skb 0.17 ± 11% +1.6 1.78 ± 3% perf-profile.self.cycles-pp.__schedule 0.18 ± 10% +1.8 1.94 ± 6% perf-profile.self.cycles-pp.switch_mm_irqs_off *************************************************************************************************** lkp-bdw-ep3: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/process/50%/debian-x86_64-2018-04-03.cgz/lkp-bdw-ep3/hackbench/0xb00002e commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 153838 +98.7% 305708 ± 2% hackbench.throughput 4.148e+09 ± 3% -60.2% 1.65e+09 ± 3% hackbench.time.involuntary_context_switches 692334 ± 5% +98.3% 1372559 ± 2% hackbench.time.minor_page_faults 8748 -5.7% 8252 hackbench.time.percent_of_cpu_this_job_got 49209 ± 4% -7.4% 45588 hackbench.time.system_time 5159 ± 5% +19.3% 6155 hackbench.time.user_time 6.228e+09 ± 4% -49.6% 3.137e+09 ± 2% hackbench.time.voluntary_context_switches 9.768e+08 ± 4% +100.0% 1.954e+09 ± 2% hackbench.workload 0.72 ± 13% +5.2 5.90 ± 3% mpstat.cpu.all.idle% 8.79 +2.2 10.95 mpstat.cpu.all.usr% 23800610 ± 5% +580.4% 1.619e+08 ± 5% numa-numastat.node0.local_node 23809191 ± 5% +580.2% 1.62e+08 ± 5% numa-numastat.node0.numa_hit 25296092 ± 9% +553.7% 1.654e+08 ± 3% numa-numastat.node1.local_node 25316014 ± 9% +553.3% 1.654e+08 ± 3% numa-numastat.node1.numa_hit 90.00 -8.3% 82.50 vmstat.cpu.sy 8.00 +31.2% 10.50 ± 4% vmstat.cpu.us 880.00 +14.0% 1003 vmstat.procs.r 16631099 -49.8% 8354306 ± 2% vmstat.system.cs 1309416 -57.8% 553186 ± 3% vmstat.system.in 318920 ± 5% -23.9% 242632 ± 13% meminfo.DirectMap4k 77750 +12.4% 87416 meminfo.KReclaimable 77750 +12.4% 87416 meminfo.SReclaimable 202607 +13.5% 229915 meminfo.SUnreclaim 280358 +13.2% 317332 meminfo.Slab 4295 ± 3% -14.5% 3670 meminfo.max_used_kB 53732096 ± 5% +1921.9% 1.086e+09 ± 3% cpuidle.C1.time 4332030 ± 5% +3925.2% 1.744e+08 ± 2% cpuidle.C1.usage 24091351 ± 12% +711.3% 1.954e+08 ± 9% cpuidle.C1E.time 796456 ± 8% +3769.3% 30817532 ± 8% cpuidle.C1E.usage 1.074e+08 ± 90% +241.2% 3.665e+08 ± 29% cpuidle.C3.time 568722 ± 30% +7999.2% 46062089 ± 7% cpuidle.C3.usage 236953 ± 22% +201.3% 714057 ± 18% cpuidle.C6.usage 4933783 ± 12% +10643.7% 5.301e+08 ± 2% cpuidle.POLL.time 3632461 ± 10% +7610.7% 2.801e+08 ± 3% cpuidle.POLL.usage 2767 -2.6% 2694 turbostat.Avg_MHz 4330167 ± 5% +3926.9% 1.744e+08 ± 2% turbostat.C1 0.10 ± 4% +1.9 1.97 ± 3% turbostat.C1% 792579 ± 8% +3787.9% 30815070 ± 8% turbostat.C1E 0.04 ± 10% +0.3 0.35 ± 10% turbostat.C1E% 567785 ± 30% +8012.5% 46061622 ± 7% turbostat.C3 0.20 ± 91% +0.5 0.66 ± 30% turbostat.C3% 227729 ± 25% +209.6% 704946 ± 18% turbostat.C6 0.39 ± 26% +0.3 0.66 ± 19% turbostat.C6% 0.46 ± 18% +545.2% 3.00 ± 5% turbostat.CPU%c1 8.178e+08 ± 4% -57.4% 3.483e+08 ± 3% turbostat.IRQ 7.79 +5.2% 8.20 turbostat.RAMWatt 280450 ± 10% -24.4% 211962 ± 6% numa-meminfo.node0.Active 280266 ± 10% -24.4% 211778 ± 6% numa-meminfo.node0.Active(anon) 197677 ± 12% -20.3% 157578 ± 22% numa-meminfo.node0.AnonPages 6059 ± 98% +190.3% 17593 ± 5% numa-meminfo.node0.Inactive 5753 ±103% +200.7% 17301 ± 5% numa-meminfo.node0.Inactive(anon) 42122 ± 15% +21.6% 51234 ± 9% numa-meminfo.node0.KReclaimable 34470 -42.8% 19702 ± 60% numa-meminfo.node0.KernelStack 42122 ± 15% +21.6% 51234 ± 9% numa-meminfo.node0.SReclaimable 107913 ± 23% +53.9% 166077 ± 10% numa-meminfo.node1.Active 107913 ± 23% +53.9% 166077 ± 10% numa-meminfo.node1.Active(anon) 12833 ± 47% -85.1% 1906 ± 57% numa-meminfo.node1.Inactive 12832 ± 47% -85.2% 1901 ± 57% numa-meminfo.node1.Inactive(anon) 13491 ± 14% -26.9% 9859 numa-meminfo.node1.Mapped 819851 ± 3% +24.6% 1021638 ± 13% numa-meminfo.node1.MemUsed 1638 ± 20% +2194.8% 37600 ± 74% numa-meminfo.node1.PageTables 70076 ± 10% -24.5% 52936 ± 6% numa-vmstat.node0.nr_active_anon 49440 ± 12% -20.3% 39387 ± 22% numa-vmstat.node0.nr_anon_pages 1442 ±105% +200.2% 4329 ± 5% numa-vmstat.node0.nr_inactive_anon 34509 -42.9% 19696 ± 60% numa-vmstat.node0.nr_kernel_stack 10528 ± 15% +21.6% 12807 ± 9% numa-vmstat.node0.nr_slab_reclaimable 70076 ± 10% -24.5% 52936 ± 6% numa-vmstat.node0.nr_zone_active_anon 1442 ±105% +200.2% 4329 ± 5% numa-vmstat.node0.nr_zone_inactive_anon 12662621 ± 8% +546.2% 81827282 ± 5% numa-vmstat.node0.numa_hit 12653757 ± 8% +546.6% 81817254 ± 5% numa-vmstat.node0.numa_local 26980 ± 23% +53.9% 41522 ± 10% numa-vmstat.node1.nr_active_anon 3207 ± 47% -84.9% 483.00 ± 56% numa-vmstat.node1.nr_inactive_anon 408.75 ± 20% +2200.9% 9405 ± 74% numa-vmstat.node1.nr_page_table_pages 26980 ± 23% +53.9% 41522 ± 10% numa-vmstat.node1.nr_zone_active_anon 3207 ± 47% -84.9% 483.00 ± 56% numa-vmstat.node1.nr_zone_inactive_anon 13372184 ± 7% +527.0% 83845398 ± 3% numa-vmstat.node1.numa_hit 13205189 ± 7% +533.7% 83679281 ± 3% numa-vmstat.node1.numa_local 4651 +3.5% 4814 proc-vmstat.nr_inactive_anon 25957 ± 3% -9.0% 23632 ± 7% proc-vmstat.nr_shmem 19437 +12.4% 21855 proc-vmstat.nr_slab_reclaimable 50652 +13.5% 57479 proc-vmstat.nr_slab_unreclaimable 4651 +3.5% 4814 proc-vmstat.nr_zone_inactive_anon 75488 ± 4% +88.3% 142159 ± 4% proc-vmstat.numa_hint_faults 5427 ± 48% +665.7% 41558 ± 7% proc-vmstat.numa_hint_faults_local 49129540 ± 6% +566.3% 3.274e+08 ± 4% proc-vmstat.numa_hit 49101026 ± 6% +566.6% 3.273e+08 ± 4% proc-vmstat.numa_local 71713 ± 7% +47.1% 105471 ± 9% proc-vmstat.numa_pages_migrated 126971 ± 17% +63.8% 207920 ± 7% proc-vmstat.numa_pte_updates 22537 ± 5% -12.6% 19691 ± 10% proc-vmstat.pgactivate 49279250 ± 6% +564.8% 3.276e+08 ± 4% proc-vmstat.pgalloc_normal 1876510 ± 4% +49.9% 2813333 proc-vmstat.pgfault 49210824 ± 6% +565.5% 3.275e+08 ± 4% proc-vmstat.pgfree 71713 ± 7% +47.1% 105471 ± 9% proc-vmstat.pgmigrate_success 16776 ± 3% +41.4% 23720 ± 2% slabinfo.cred_jar.active_objs 400.00 ± 3% +41.1% 564.50 ± 2% slabinfo.cred_jar.active_slabs 16826 ± 3% +41.0% 23729 ± 2% slabinfo.cred_jar.num_objs 400.00 ± 3% +41.1% 564.50 ± 2% slabinfo.cred_jar.num_slabs 12896 ± 2% +55.7% 20085 ± 2% slabinfo.files_cache.active_objs 279.75 ± 2% +56.0% 436.50 ± 2% slabinfo.files_cache.active_slabs 12896 ± 2% +55.9% 20110 ± 2% slabinfo.files_cache.num_objs 279.75 ± 2% +56.0% 436.50 ± 2% slabinfo.files_cache.num_slabs 8841 ± 2% +41.3% 12494 ± 2% slabinfo.kmalloc-192.active_objs 8868 ± 2% +40.9% 12495 ± 2% slabinfo.kmalloc-192.num_objs 8409 ± 2% +33.4% 11218 ± 2% slabinfo.kmalloc-1k.active_objs 8500 +32.7% 11281 ± 2% slabinfo.kmalloc-1k.num_objs 55688 ± 2% +25.4% 69830 ± 2% slabinfo.kmalloc-32.active_objs 435.25 ± 2% +25.3% 545.25 ± 2% slabinfo.kmalloc-32.active_slabs 55794 ± 2% +25.2% 69861 ± 2% slabinfo.kmalloc-32.num_objs 435.25 ± 2% +25.3% 545.25 ± 2% slabinfo.kmalloc-32.num_slabs 50626 +14.3% 57854 slabinfo.kmalloc-64.active_objs 792.25 +14.0% 903.50 slabinfo.kmalloc-64.active_slabs 50725 +14.1% 57857 slabinfo.kmalloc-64.num_objs 792.25 +14.0% 903.50 slabinfo.kmalloc-64.num_slabs 33093 +21.4% 40168 ± 2% slabinfo.lsm_file_cache.active_objs 33093 +21.4% 40168 ± 2% slabinfo.lsm_file_cache.num_objs 10675 ± 2% +17.8% 12572 slabinfo.mm_struct.active_objs 10686 ± 2% +18.3% 12644 slabinfo.mm_struct.num_objs 150.25 ± 22% +86.4% 280.00 ± 7% slabinfo.nfs_read_data.active_objs 150.25 ± 22% +86.4% 280.00 ± 7% slabinfo.nfs_read_data.num_objs 12084 ± 4% +63.6% 19774 ± 2% slabinfo.pid.active_objs 377.50 ± 4% +63.6% 617.75 ± 2% slabinfo.pid.active_slabs 12091 ± 4% +63.5% 19774 ± 2% slabinfo.pid.num_objs 377.50 ± 4% +63.6% 617.75 ± 2% slabinfo.pid.num_slabs 18195 ± 3% +65.9% 30187 ± 2% slabinfo.proc_inode_cache.active_objs 420.00 ± 2% +49.2% 626.75 ± 2% slabinfo.proc_inode_cache.active_slabs 20602 ± 2% +49.2% 30742 ± 2% slabinfo.proc_inode_cache.num_objs 420.00 ± 2% +49.2% 626.75 ± 2% slabinfo.proc_inode_cache.num_slabs 5955 ± 3% +36.9% 8151 slabinfo.sighand_cache.active_objs 398.25 ± 3% +36.8% 545.00 slabinfo.sighand_cache.active_slabs 5980 ± 3% +36.8% 8184 slabinfo.sighand_cache.num_objs 398.25 ± 3% +36.8% 545.00 slabinfo.sighand_cache.num_slabs 8134 ± 2% +61.6% 13142 slabinfo.signal_cache.active_objs 271.50 ± 2% +62.0% 439.75 slabinfo.signal_cache.active_slabs 8156 ± 2% +62.0% 13211 slabinfo.signal_cache.num_objs 271.50 ± 2% +62.0% 439.75 slabinfo.signal_cache.num_slabs 587.00 ± 4% +22.4% 718.25 ± 7% slabinfo.skbuff_ext_cache.active_objs 299.50 ± 9% +37.6% 412.25 ± 10% slabinfo.skbuff_fclone_cache.active_objs 299.50 ± 9% +37.6% 412.25 ± 10% slabinfo.skbuff_fclone_cache.num_objs 14076 ± 2% +49.9% 21094 ± 2% slabinfo.task_delay_info.active_objs 275.50 ± 2% +49.9% 413.00 ± 2% slabinfo.task_delay_info.active_slabs 14076 ± 2% +49.8% 21094 ± 2% slabinfo.task_delay_info.num_objs 275.50 ± 2% +49.9% 413.00 ± 2% slabinfo.task_delay_info.num_slabs 14181 ±173% +5330.2% 770107 ± 19% sched_debug.cfs_rq:/.MIN_vruntime.avg 1248006 ±173% +3048.5% 39293144 ± 15% sched_debug.cfs_rq:/.MIN_vruntime.max 132279 ±173% +3913.7% 5309323 ± 17% sched_debug.cfs_rq:/.MIN_vruntime.stddev 11926 ± 4% +6.6% 12708 ± 3% sched_debug.cfs_rq:/.load.avg 985.53 ± 57% -100.0% 0.00 sched_debug.cfs_rq:/.load.min 17.27 ± 9% +16.5% 20.12 ± 3% sched_debug.cfs_rq:/.load_avg.avg 120.95 +32.7% 160.48 ± 3% sched_debug.cfs_rq:/.load_avg.max 4.19 ± 10% -100.0% 0.00 sched_debug.cfs_rq:/.load_avg.min 23.68 ± 13% +43.0% 33.85 ± 6% sched_debug.cfs_rq:/.load_avg.stddev 14181 ±173% +5330.2% 770107 ± 19% sched_debug.cfs_rq:/.max_vruntime.avg 1248006 ±173% +3048.5% 39293144 ± 15% sched_debug.cfs_rq:/.max_vruntime.max 132279 ±173% +3913.7% 5309323 ± 17% sched_debug.cfs_rq:/.max_vruntime.stddev 27609898 ± 4% +97.5% 54533868 sched_debug.cfs_rq:/.min_vruntime.avg 28871301 ± 4% +97.2% 56935960 sched_debug.cfs_rq:/.min_vruntime.max 26420823 ± 4% +98.1% 52335610 sched_debug.cfs_rq:/.min_vruntime.min 545662 ± 2% +68.8% 921032 ± 6% sched_debug.cfs_rq:/.min_vruntime.stddev 0.45 ± 29% -100.0% 0.00 sched_debug.cfs_rq:/.nr_running.min 0.09 ± 14% +160.7% 0.23 ± 7% sched_debug.cfs_rq:/.nr_running.stddev 10.09 +17.6% 11.87 ± 5% sched_debug.cfs_rq:/.runnable_load_avg.avg 26.37 ± 4% +155.5% 67.36 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.max 2.21 ± 21% -100.0% 0.00 sched_debug.cfs_rq:/.runnable_load_avg.min 3.93 ± 3% +279.2% 14.90 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.stddev 946.77 ± 40% -100.0% 0.00 sched_debug.cfs_rq:/.runnable_weight.min 1390582 ± 15% +99.8% 2778829 ± 11% sched_debug.cfs_rq:/.spread0.max 545094 ± 2% +68.9% 920449 ± 6% sched_debug.cfs_rq:/.spread0.stddev 1427 +33.4% 1903 ± 5% sched_debug.cfs_rq:/.util_avg.max 674.80 ± 2% -55.3% 301.89 ± 4% sched_debug.cfs_rq:/.util_avg.min 138.91 ± 2% +159.1% 359.88 ± 5% sched_debug.cfs_rq:/.util_avg.stddev 1104 ± 6% +65.0% 1822 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.max 147.53 ± 4% -99.8% 0.23 ±150% sched_debug.cfs_rq:/.util_est_enqueued.min 165.30 ± 5% +169.3% 445.20 ± 6% sched_debug.cfs_rq:/.util_est_enqueued.stddev 192846 ± 5% -49.3% 97859 ± 22% sched_debug.cpu.avg_idle.avg 804717 ± 7% -55.5% 357839 ± 19% sched_debug.cpu.avg_idle.max 219042 ± 9% -68.7% 68486 ± 30% sched_debug.cpu.avg_idle.stddev 77.05 -87.3% 9.80 ± 16% sched_debug.cpu.clock.stddev 77.05 -87.3% 9.80 ± 16% sched_debug.cpu.clock_task.stddev 15601 ± 4% +41.3% 22048 ± 8% sched_debug.cpu.curr->pid.avg 17105 ± 3% +52.2% 26041 sched_debug.cpu.curr->pid.max 13482 ± 13% -100.0% 0.00 sched_debug.cpu.curr->pid.min 669.86 ± 21% +771.1% 5834 ± 5% sched_debug.cpu.curr->pid.stddev 12064 ± 4% +7.0% 12903 sched_debug.cpu.load.avg 3844 ± 20% -100.0% 0.00 sched_debug.cpu.load.min 0.00 -49.5% 0.00 ± 2% sched_debug.cpu.next_balance.stddev 20.19 ± 7% +90.2% 38.41 ± 6% sched_debug.cpu.nr_running.max 2.78 ± 10% -100.0% 0.00 sched_debug.cpu.nr_running.min 2.83 ± 7% +244.4% 9.73 ± 8% sched_debug.cpu.nr_running.stddev 58589622 ± 3% -51.5% 28431003 sched_debug.cpu.nr_switches.avg 62934647 ± 4% -52.8% 29681852 sched_debug.cpu.nr_switches.max 55281901 ± 4% -50.6% 27315579 ± 2% sched_debug.cpu.nr_switches.min 1585559 ± 7% -66.4% 532561 ± 19% sched_debug.cpu.nr_switches.stddev 1.13 ± 6% -58.6% 0.47 ± 19% sched_debug.cpu.nr_uninterruptible.avg 835.68 ± 7% -18.9% 677.75 ± 9% sched_debug.cpu.nr_uninterruptible.max -839.98 -24.7% -632.18 sched_debug.cpu.nr_uninterruptible.min 341.82 ± 2% -26.2% 252.25 ± 2% sched_debug.cpu.nr_uninterruptible.stddev 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 13.59 -31.3% 9.34 perf-stat.i.MPKI 2.558e+10 +4.9% 2.683e+10 perf-stat.i.branch-instructions 1.68 -0.1 1.57 perf-stat.i.branch-miss-rate% 4.303e+08 -2.6% 4.192e+08 perf-stat.i.branch-misses 1.35 ± 13% +1.1 2.44 ± 3% perf-stat.i.cache-miss-rate% 22383328 ± 12% +37.6% 30794639 ± 3% perf-stat.i.cache-misses 1.742e+09 -27.2% 1.268e+09 perf-stat.i.cache-references 16711899 -49.8% 8386287 ± 2% perf-stat.i.context-switches 1.90 -8.6% 1.73 perf-stat.i.cpi 2.426e+11 -2.5% 2.366e+11 perf-stat.i.cpu-cycles 3690924 -31.3% 2535389 perf-stat.i.cpu-migrations 26463 ± 14% -68.7% 8292 ± 2% perf-stat.i.cycles-between-cache-misses 1.61 ± 2% -1.0 0.62 ± 4% perf-stat.i.dTLB-load-miss-rate% 6.218e+08 ± 2% -58.1% 2.605e+08 ± 4% perf-stat.i.dTLB-load-misses 3.784e+10 +10.7% 4.188e+10 perf-stat.i.dTLB-loads 0.23 ± 13% -0.1 0.09 ± 6% perf-stat.i.dTLB-store-miss-rate% 53212458 ± 13% -56.1% 23386017 ± 5% perf-stat.i.dTLB-store-misses 2.277e+10 +10.3% 2.512e+10 perf-stat.i.dTLB-stores 54.37 +4.9 59.28 perf-stat.i.iTLB-load-miss-rate% 1.464e+08 -21.2% 1.154e+08 perf-stat.i.iTLB-load-misses 1.234e+08 -35.7% 79364459 perf-stat.i.iTLB-loads 1.283e+11 +6.9% 1.372e+11 perf-stat.i.instructions 880.24 +35.5% 1192 perf-stat.i.instructions-per-iTLB-miss 0.53 +9.6% 0.58 perf-stat.i.ipc 2942 +49.5% 4399 perf-stat.i.minor-faults 31728 ± 13% +250.1% 111091 perf-stat.i.node-loads 60.95 ± 2% +4.4 65.30 perf-stat.i.node-store-miss-rate% 4426721 ± 11% +36.3% 6034367 ± 4% perf-stat.i.node-store-misses 2942 +49.5% 4399 perf-stat.i.page-faults 13.58 -32.0% 9.24 perf-stat.overall.MPKI 1.68 -0.1 1.56 perf-stat.overall.branch-miss-rate% 1.28 ± 12% +1.1 2.43 ± 3% perf-stat.overall.cache-miss-rate% 1.89 -8.8% 1.72 perf-stat.overall.cpi 11015 ± 12% -30.2% 7690 ± 3% perf-stat.overall.cycles-between-cache-misses 1.62 ± 2% -1.0 0.62 ± 4% perf-stat.overall.dTLB-load-miss-rate% 0.23 ± 13% -0.1 0.09 ± 6% perf-stat.overall.dTLB-store-miss-rate% 54.25 +5.0 59.25 perf-stat.overall.iTLB-load-miss-rate% 876.69 +35.7% 1189 perf-stat.overall.instructions-per-iTLB-miss 0.53 +9.7% 0.58 perf-stat.overall.ipc 59.73 +5.3 65.03 perf-stat.overall.node-store-miss-rate% 81575 -46.0% 44018 perf-stat.overall.path-length 2.554e+10 +4.9% 2.678e+10 perf-stat.ps.branch-instructions 4.296e+08 -2.6% 4.185e+08 perf-stat.ps.branch-misses 22352645 ± 12% +37.5% 30745597 ± 3% perf-stat.ps.cache-misses 1.739e+09 -27.2% 1.265e+09 perf-stat.ps.cache-references 16683950 -49.8% 8372624 ± 2% perf-stat.ps.context-switches 2.422e+11 -2.5% 2.362e+11 perf-stat.ps.cpu-cycles 3684773 -31.3% 2531256 perf-stat.ps.cpu-migrations 6.208e+08 ± 2% -58.1% 2.601e+08 ± 4% perf-stat.ps.dTLB-load-misses 3.777e+10 +10.7% 4.181e+10 perf-stat.ps.dTLB-loads 53123636 ± 13% -56.0% 23347990 ± 5% perf-stat.ps.dTLB-store-misses 2.273e+10 +10.3% 2.508e+10 perf-stat.ps.dTLB-stores 1.461e+08 -21.2% 1.152e+08 perf-stat.ps.iTLB-load-misses 1.232e+08 -35.7% 79234932 perf-stat.ps.iTLB-loads 1.281e+11 +6.9% 1.37e+11 perf-stat.ps.instructions 2941 +49.4% 4394 perf-stat.ps.minor-faults 31702 ± 13% +249.9% 110928 perf-stat.ps.node-loads 4420571 ± 11% +36.3% 6024719 ± 4% perf-stat.ps.node-store-misses 2941 +49.4% 4394 perf-stat.ps.page-faults 7.965e+13 ± 3% +7.9% 8.597e+13 perf-stat.total.instructions 7907192 ± 7% -65.3% 2744983 ± 5% interrupts.CPU0.RES:Rescheduling_interrupts 7879338 ± 4% -65.8% 2692484 ± 4% interrupts.CPU1.RES:Rescheduling_interrupts 8076515 ± 4% -67.3% 2639859 ± 5% interrupts.CPU10.RES:Rescheduling_interrupts 7968189 ± 3% -66.8% 2647952 ± 5% interrupts.CPU11.RES:Rescheduling_interrupts 8075928 ± 5% -66.8% 2677825 ± 5% interrupts.CPU12.RES:Rescheduling_interrupts 8075539 -67.5% 2624832 ± 5% interrupts.CPU13.RES:Rescheduling_interrupts 7723509 ± 6% -65.9% 2632327 ± 5% interrupts.CPU14.RES:Rescheduling_interrupts 7834428 ± 4% -65.9% 2673383 ± 5% interrupts.CPU15.RES:Rescheduling_interrupts 8049419 ± 2% -66.8% 2670225 ± 5% interrupts.CPU16.RES:Rescheduling_interrupts 8188249 ± 3% -67.1% 2691762 ± 5% interrupts.CPU17.RES:Rescheduling_interrupts 8245719 ± 4% -67.6% 2671587 ± 5% interrupts.CPU18.RES:Rescheduling_interrupts 7753225 ± 2% -65.6% 2668497 ± 4% interrupts.CPU19.RES:Rescheduling_interrupts 7996357 ± 6% -66.2% 2701426 ± 6% interrupts.CPU2.RES:Rescheduling_interrupts 7910 -38.3% 4879 ± 32% interrupts.CPU20.NMI:Non-maskable_interrupts 7910 -38.3% 4879 ± 32% interrupts.CPU20.PMI:Performance_monitoring_interrupts 7802096 ± 6% -65.4% 2696084 ± 4% interrupts.CPU20.RES:Rescheduling_interrupts 8164572 ± 6% -66.9% 2704626 ± 4% interrupts.CPU21.RES:Rescheduling_interrupts 7737892 ± 3% -66.1% 2626537 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts 8227605 ± 4% -67.4% 2680912 ± 6% interrupts.CPU23.RES:Rescheduling_interrupts 8107839 ± 4% -67.0% 2675843 ± 6% interrupts.CPU24.RES:Rescheduling_interrupts 8205331 ± 4% -67.5% 2666889 ± 6% interrupts.CPU25.RES:Rescheduling_interrupts 8184538 ± 4% -67.2% 2683667 ± 5% interrupts.CPU26.RES:Rescheduling_interrupts 8214878 ± 5% -67.4% 2678184 ± 5% interrupts.CPU27.RES:Rescheduling_interrupts 8066732 ± 3% -67.1% 2651527 ± 7% interrupts.CPU28.RES:Rescheduling_interrupts 7858555 ± 7% -66.1% 2662174 ± 5% interrupts.CPU29.RES:Rescheduling_interrupts 8216677 ± 4% -66.9% 2719353 ± 6% interrupts.CPU3.RES:Rescheduling_interrupts 8389827 ± 3% -68.1% 2677489 ± 7% interrupts.CPU30.RES:Rescheduling_interrupts 8190575 ± 3% -67.0% 2703788 ± 6% interrupts.CPU31.RES:Rescheduling_interrupts 8166540 ± 4% -66.9% 2700764 ± 5% interrupts.CPU32.RES:Rescheduling_interrupts 8262283 ± 6% -67.6% 2676297 ± 5% interrupts.CPU33.RES:Rescheduling_interrupts 8115476 ± 5% -67.4% 2644124 ± 6% interrupts.CPU34.RES:Rescheduling_interrupts 8364746 ± 4% -68.2% 2658800 ± 5% interrupts.CPU35.RES:Rescheduling_interrupts 8090220 ± 4% -67.4% 2635600 ± 6% interrupts.CPU36.RES:Rescheduling_interrupts 8075067 ± 5% -67.1% 2658923 ± 5% interrupts.CPU37.RES:Rescheduling_interrupts 8071398 ± 5% -67.5% 2626615 ± 6% interrupts.CPU38.RES:Rescheduling_interrupts 7982751 ± 5% -66.6% 2668407 ± 5% interrupts.CPU39.RES:Rescheduling_interrupts 7800603 ± 5% -65.6% 2686417 ± 6% interrupts.CPU4.RES:Rescheduling_interrupts 8203708 ± 4% -67.3% 2679908 ± 5% interrupts.CPU40.RES:Rescheduling_interrupts 8349146 ± 5% -68.2% 2652917 ± 6% interrupts.CPU41.RES:Rescheduling_interrupts 8098734 ± 4% -67.2% 2658123 ± 5% interrupts.CPU42.RES:Rescheduling_interrupts 7923066 ± 6% -66.6% 2648845 ± 4% interrupts.CPU43.RES:Rescheduling_interrupts 7900824 ± 3% -65.1% 2754062 ± 4% interrupts.CPU44.RES:Rescheduling_interrupts 7799516 ± 6% -65.1% 2725471 ± 4% interrupts.CPU45.RES:Rescheduling_interrupts 7919277 ± 3% -65.5% 2729511 ± 5% interrupts.CPU46.RES:Rescheduling_interrupts 8029186 ± 4% -66.0% 2732856 ± 6% interrupts.CPU47.RES:Rescheduling_interrupts 7944496 ± 3% -66.0% 2700632 ± 5% interrupts.CPU48.RES:Rescheduling_interrupts 7918948 ± 3% -65.8% 2708380 ± 5% interrupts.CPU49.RES:Rescheduling_interrupts 7933219 ± 5% -66.1% 2691056 ± 6% interrupts.CPU5.RES:Rescheduling_interrupts 7837676 ± 3% -65.6% 2694888 ± 5% interrupts.CPU50.RES:Rescheduling_interrupts 7813208 ± 5% -65.6% 2686475 ± 4% interrupts.CPU51.RES:Rescheduling_interrupts 8109743 ± 3% -67.1% 2665073 ± 5% interrupts.CPU52.RES:Rescheduling_interrupts 8079377 ± 6% -66.9% 2676582 ± 5% interrupts.CPU53.RES:Rescheduling_interrupts 8062209 ± 2% -66.8% 2676575 ± 5% interrupts.CPU54.RES:Rescheduling_interrupts 8076429 ± 2% -66.7% 2689929 ± 5% interrupts.CPU55.RES:Rescheduling_interrupts 8254255 ± 5% -67.5% 2678904 ± 5% interrupts.CPU56.RES:Rescheduling_interrupts 8036155 ± 3% -66.9% 2656186 ± 5% interrupts.CPU57.RES:Rescheduling_interrupts 7898524 ± 4% -66.0% 2682632 ± 6% interrupts.CPU58.RES:Rescheduling_interrupts 7858408 ± 3% -66.1% 2662168 ± 5% interrupts.CPU59.RES:Rescheduling_interrupts 7926533 ± 6% -66.3% 2673277 ± 5% interrupts.CPU6.RES:Rescheduling_interrupts 7810995 ± 3% -65.3% 2706538 ± 5% interrupts.CPU60.RES:Rescheduling_interrupts 7932530 ± 4% -65.7% 2723798 ± 5% interrupts.CPU61.RES:Rescheduling_interrupts 8241267 ± 4% -67.1% 2709828 ± 6% interrupts.CPU62.RES:Rescheduling_interrupts 7770742 -65.2% 2700894 ± 3% interrupts.CPU63.RES:Rescheduling_interrupts 7746078 ± 6% -64.7% 2732871 ± 5% interrupts.CPU64.RES:Rescheduling_interrupts 7740813 ± 5% -64.4% 2758010 ± 4% interrupts.CPU65.RES:Rescheduling_interrupts 7655999 ± 5% -65.7% 2629513 ± 5% interrupts.CPU66.RES:Rescheduling_interrupts 7985065 ± 4% -66.7% 2661104 ± 5% interrupts.CPU67.RES:Rescheduling_interrupts 7917249 ± 6% -66.2% 2677075 ± 6% interrupts.CPU68.RES:Rescheduling_interrupts 8150372 ± 5% -66.6% 2724488 ± 5% interrupts.CPU69.RES:Rescheduling_interrupts 7741434 ± 8% -65.4% 2677177 ± 4% interrupts.CPU7.RES:Rescheduling_interrupts 8268452 ± 3% -67.3% 2701071 ± 4% interrupts.CPU70.RES:Rescheduling_interrupts 8137427 ± 5% -66.8% 2700660 ± 5% interrupts.CPU71.RES:Rescheduling_interrupts 8115251 ± 3% -66.8% 2694771 ± 7% interrupts.CPU72.RES:Rescheduling_interrupts 7950079 ± 4% -66.3% 2681675 ± 6% interrupts.CPU73.RES:Rescheduling_interrupts 8264121 ± 4% -66.9% 2738999 ± 7% interrupts.CPU74.RES:Rescheduling_interrupts 8090436 ± 5% -66.1% 2744352 ± 5% interrupts.CPU75.RES:Rescheduling_interrupts 8033506 ± 6% -66.3% 2710454 ± 4% interrupts.CPU76.RES:Rescheduling_interrupts 8329143 ± 4% -67.2% 2733860 ± 6% interrupts.CPU77.RES:Rescheduling_interrupts 8057850 ± 6% -66.6% 2688605 ± 6% interrupts.CPU78.RES:Rescheduling_interrupts 8123715 ± 4% -66.9% 2692107 ± 6% interrupts.CPU79.RES:Rescheduling_interrupts 8095833 ± 4% -67.3% 2649671 ± 4% interrupts.CPU8.RES:Rescheduling_interrupts 7939186 ± 5% -66.6% 2648633 ± 5% interrupts.CPU80.RES:Rescheduling_interrupts 7911924 ± 6% -66.4% 2658161 ± 6% interrupts.CPU81.RES:Rescheduling_interrupts 7847920 ± 4% -66.0% 2669725 ± 6% interrupts.CPU82.RES:Rescheduling_interrupts 7934826 ± 3% -66.0% 2695904 ± 5% interrupts.CPU83.RES:Rescheduling_interrupts 8174869 ± 5% -66.9% 2705065 ± 6% interrupts.CPU84.RES:Rescheduling_interrupts 8190728 ± 5% -67.1% 2696060 ± 6% interrupts.CPU85.RES:Rescheduling_interrupts 73.00 ± 31% -68.8% 22.75 ± 47% interrupts.CPU85.TLB:TLB_shootdowns 8062738 ± 6% -66.9% 2668706 ± 5% interrupts.CPU86.RES:Rescheduling_interrupts 242.00 ± 44% -88.4% 28.00 ± 87% interrupts.CPU86.TLB:TLB_shootdowns 7949468 ± 4% -66.1% 2697234 ± 7% interrupts.CPU87.RES:Rescheduling_interrupts 535.25 ± 44% -89.4% 56.75 ± 83% interrupts.CPU87.TLB:TLB_shootdowns 8178249 ± 5% -67.5% 2656806 ± 5% interrupts.CPU9.RES:Rescheduling_interrupts 174.25 ± 4% -9.9% 157.00 ± 9% interrupts.IWI:IRQ_work_interrupts 662793 ± 4% -10.8% 591227 ± 10% interrupts.NMI:Non-maskable_interrupts 662793 ± 4% -10.8% 591227 ± 10% interrupts.PMI:Performance_monitoring_interrupts 7.064e+08 ± 4% -66.6% 2.362e+08 ± 5% interrupts.RES:Rescheduling_interrupts 92630 ± 3% -29.9% 64927 ± 23% softirqs.CPU0.RCU 12582 +498.1% 75255 ± 2% softirqs.CPU0.SCHED 94579 ± 3% -29.9% 66271 ± 22% softirqs.CPU1.RCU 8637 ± 4% +731.1% 71785 ± 3% softirqs.CPU1.SCHED 223774 ± 3% -10.5% 200274 softirqs.CPU1.TIMER 94771 ± 4% -31.6% 64792 ± 24% softirqs.CPU10.RCU 9558 ± 3% +646.1% 71312 softirqs.CPU10.SCHED 224397 ± 3% -11.6% 198376 softirqs.CPU10.TIMER 9327 ± 3% +662.5% 71125 softirqs.CPU11.SCHED 225873 ± 3% -11.3% 200325 softirqs.CPU11.TIMER 95406 ± 4% -31.1% 65778 ± 24% softirqs.CPU12.RCU 9529 ± 4% +651.8% 71639 ± 2% softirqs.CPU12.SCHED 94585 ± 4% -30.7% 65576 ± 23% softirqs.CPU13.RCU 9345 +664.6% 71456 softirqs.CPU13.SCHED 98217 ± 4% -32.3% 66501 ± 24% softirqs.CPU14.RCU 9269 ± 5% +672.3% 71583 ± 2% softirqs.CPU14.SCHED 101535 ± 4% -33.2% 67804 ± 23% softirqs.CPU15.RCU 9402 +667.7% 72179 ± 2% softirqs.CPU15.SCHED 227590 ± 3% -10.1% 204508 softirqs.CPU15.TIMER 100898 ± 3% -32.2% 68436 ± 22% softirqs.CPU16.RCU 9327 ± 5% +668.5% 71678 ± 2% softirqs.CPU16.SCHED 9657 ± 4% +638.0% 71269 softirqs.CPU17.SCHED 101164 ± 3% -33.1% 67669 ± 23% softirqs.CPU18.RCU 9780 ± 4% +634.2% 71814 softirqs.CPU18.SCHED 249003 ± 16% -18.8% 202264 softirqs.CPU18.TIMER 101023 ± 4% -32.4% 68322 ± 24% softirqs.CPU19.RCU 9395 ± 2% +664.7% 71841 softirqs.CPU19.SCHED 92515 ± 6% -29.0% 65661 ± 22% softirqs.CPU2.RCU 9330 ± 3% +667.8% 71635 softirqs.CPU2.SCHED 101586 ± 4% -30.4% 70686 ± 21% softirqs.CPU20.RCU 9026 ± 5% +696.7% 71913 softirqs.CPU20.SCHED 101045 ± 4% -31.9% 68824 ± 25% softirqs.CPU21.RCU 9061 ± 4% +695.8% 72108 softirqs.CPU21.SCHED 100812 ± 4% -33.4% 67167 ± 23% softirqs.CPU22.RCU 10450 ± 5% +583.6% 71444 softirqs.CPU22.SCHED 226398 ± 3% -12.6% 197925 softirqs.CPU22.TIMER 99442 ± 4% -32.5% 67129 ± 22% softirqs.CPU23.RCU 10094 ± 6% +609.6% 71627 softirqs.CPU23.SCHED 101730 ± 5% -31.4% 69795 ± 28% softirqs.CPU24.RCU 9923 ± 6% +625.9% 72032 softirqs.CPU24.SCHED 98882 ± 3% -32.4% 66886 ± 23% softirqs.CPU25.RCU 9768 ± 2% +633.8% 71677 softirqs.CPU25.SCHED 102432 ± 4% -32.2% 69419 ± 29% softirqs.CPU26.RCU 9867 ± 4% +625.8% 71612 softirqs.CPU26.SCHED 99190 ± 4% -32.8% 66636 ± 23% softirqs.CPU27.RCU 9679 ± 5% +643.3% 71945 softirqs.CPU27.SCHED 99670 ± 3% -33.2% 66622 ± 23% softirqs.CPU28.RCU 9928 ± 5% +626.3% 72102 softirqs.CPU28.SCHED 98783 ± 3% -29.9% 69256 ± 21% softirqs.CPU29.RCU 9613 ± 4% +649.9% 72088 softirqs.CPU29.SCHED 9317 ± 3% +660.7% 70876 ± 2% softirqs.CPU3.SCHED 103758 ± 8% -35.5% 66974 ± 23% softirqs.CPU30.RCU 9996 ± 4% +618.2% 71792 softirqs.CPU30.SCHED 104130 ± 8% -35.4% 67217 ± 23% softirqs.CPU31.RCU 9752 ± 5% +642.9% 72446 softirqs.CPU31.SCHED 9663 ± 7% +639.8% 71492 softirqs.CPU32.SCHED 100087 ± 3% -30.8% 69268 ± 20% softirqs.CPU33.RCU 9918 ± 4% +622.9% 71700 softirqs.CPU33.SCHED 100339 ± 4% -33.6% 66623 ± 23% softirqs.CPU34.RCU 9669 ± 6% +643.4% 71881 softirqs.CPU34.SCHED 99561 ± 4% -32.6% 67076 ± 22% softirqs.CPU35.RCU 9834 ± 5% +632.8% 72071 softirqs.CPU35.SCHED 100417 ± 4% -33.7% 66560 ± 23% softirqs.CPU36.RCU 9770 ± 5% +635.0% 71812 softirqs.CPU36.SCHED 100194 ± 4% -32.8% 67292 ± 21% softirqs.CPU37.RCU 9739 ± 5% +646.2% 72669 ± 2% softirqs.CPU37.SCHED 102351 ± 5% -32.8% 68804 ± 29% softirqs.CPU38.RCU 9605 ± 5% +642.9% 71364 softirqs.CPU38.SCHED 9546 ± 5% +648.4% 71452 softirqs.CPU39.SCHED 94151 ± 3% -30.6% 65375 ± 24% softirqs.CPU4.RCU 9047 ± 2% +688.2% 71307 softirqs.CPU4.SCHED 99771 ± 4% -33.3% 66534 ± 23% softirqs.CPU40.RCU 9737 ± 5% +642.0% 72251 softirqs.CPU40.SCHED 9719 ± 6% +637.5% 71680 softirqs.CPU41.SCHED 100231 ± 3% -33.6% 66546 ± 22% softirqs.CPU42.RCU 9676 ± 6% +644.9% 72080 softirqs.CPU42.SCHED 100667 ± 3% -33.7% 66747 ± 23% softirqs.CPU43.RCU 9574 ± 5% +653.3% 72125 softirqs.CPU43.SCHED 9181 ± 3% +685.1% 72085 softirqs.CPU44.SCHED 223876 ± 3% -9.2% 203365 ± 2% softirqs.CPU44.TIMER 9022 ± 3% +696.3% 71845 softirqs.CPU45.SCHED 9308 ± 6% +679.7% 72576 softirqs.CPU46.SCHED 93424 ± 4% -31.1% 64366 ± 23% softirqs.CPU47.RCU 9226 ± 3% +675.3% 71527 softirqs.CPU47.SCHED 223109 ± 3% -11.8% 196809 softirqs.CPU47.TIMER 93635 ± 4% -30.7% 64885 ± 24% softirqs.CPU48.RCU 9193 +673.4% 71103 softirqs.CPU48.SCHED 9290 ± 4% +670.0% 71536 softirqs.CPU49.SCHED 9369 ± 5% +660.9% 71288 softirqs.CPU5.SCHED 9378 ± 3% +663.2% 71575 ± 2% softirqs.CPU50.SCHED 95810 ± 4% -32.6% 64592 ± 23% softirqs.CPU51.RCU 9257 ± 7% +667.5% 71049 softirqs.CPU51.SCHED 95964 ± 6% -33.0% 64325 ± 23% softirqs.CPU52.RCU 9376 ± 4% +670.5% 72248 softirqs.CPU52.SCHED 96401 ± 9% -33.1% 64526 ± 23% softirqs.CPU53.RCU 9506 ± 3% +654.1% 71688 softirqs.CPU53.SCHED 94282 ± 4% -31.3% 64755 ± 23% softirqs.CPU54.RCU 9318 ± 3% +671.1% 71858 softirqs.CPU54.SCHED 93263 ± 5% -29.7% 65519 ± 23% softirqs.CPU55.RCU 9157 ± 2% +683.7% 71763 softirqs.CPU55.SCHED 249449 ± 17% -20.0% 199504 softirqs.CPU55.TIMER 94229 ± 4% -27.6% 68182 ± 21% softirqs.CPU56.RCU 9362 ± 4% +670.3% 72123 softirqs.CPU56.SCHED 9253 +672.7% 71494 softirqs.CPU57.SCHED 96183 ± 4% -31.1% 66313 ± 24% softirqs.CPU58.RCU 9246 ± 6% +685.5% 72630 softirqs.CPU58.SCHED 97126 ± 5% -32.1% 65911 ± 23% softirqs.CPU59.RCU 9211 ± 4% +682.5% 72082 softirqs.CPU59.SCHED 94256 ± 4% -31.0% 65003 ± 24% softirqs.CPU6.RCU 9399 ± 4% +658.1% 71263 softirqs.CPU6.SCHED 97371 -28.8% 69350 ± 21% softirqs.CPU60.RCU 9386 ± 4% +674.4% 72688 ± 2% softirqs.CPU60.SCHED 98321 ± 4% -32.1% 66758 ± 23% softirqs.CPU61.RCU 9556 ± 6% +651.0% 71763 softirqs.CPU61.SCHED 97098 ± 5% -31.5% 66505 ± 23% softirqs.CPU62.RCU 9622 ± 3% +650.6% 72224 softirqs.CPU62.SCHED 225671 ± 3% -10.8% 201399 softirqs.CPU62.TIMER 97749 ± 4% -32.1% 66409 ± 24% softirqs.CPU63.RCU 8916 ± 2% +706.1% 71871 softirqs.CPU63.SCHED 98285 ± 4% -29.3% 69493 ± 21% softirqs.CPU64.RCU 9102 ± 6% +697.1% 72551 softirqs.CPU64.SCHED 102312 ± 5% -35.1% 66364 ± 23% softirqs.CPU65.RCU 9487 ± 5% +666.2% 72689 softirqs.CPU65.SCHED 102612 ± 5% -33.4% 68343 ± 22% softirqs.CPU66.RCU 9647 ± 4% +637.8% 71178 softirqs.CPU66.SCHED 221993 ± 3% -11.0% 197633 softirqs.CPU66.TIMER 101938 ± 4% -33.4% 67844 ± 23% softirqs.CPU67.RCU 10046 ± 5% +620.7% 72409 softirqs.CPU67.SCHED 9816 ± 3% +640.5% 72686 softirqs.CPU68.SCHED 100438 ± 3% -32.7% 67626 ± 23% softirqs.CPU69.RCU 9722 ± 4% +641.5% 72092 softirqs.CPU69.SCHED 94007 ± 4% -31.0% 64901 ± 23% softirqs.CPU7.RCU 9322 ± 5% +657.1% 70585 softirqs.CPU7.SCHED 101201 ± 4% -32.8% 67967 ± 23% softirqs.CPU70.RCU 9676 ± 5% +641.3% 71731 softirqs.CPU70.SCHED 9766 ± 5% +639.5% 72225 softirqs.CPU71.SCHED 102196 ± 3% -33.3% 68126 ± 23% softirqs.CPU72.RCU 9890 ± 4% +631.5% 72352 softirqs.CPU72.SCHED 101042 ± 4% -33.1% 67566 ± 23% softirqs.CPU73.RCU 9602 ± 5% +647.8% 71803 softirqs.CPU73.SCHED 218286 ± 3% -10.8% 194675 softirqs.CPU73.TIMER 100551 ± 4% -32.7% 67664 ± 23% softirqs.CPU74.RCU 10061 ± 4% +625.2% 72970 softirqs.CPU74.SCHED 9649 ± 4% +653.4% 72696 softirqs.CPU75.SCHED 9771 ± 5% +633.6% 71679 softirqs.CPU76.SCHED 9781 ± 5% +638.8% 72263 softirqs.CPU77.SCHED 9662 ± 7% +644.0% 71887 softirqs.CPU78.SCHED 91380 ± 3% -31.1% 62973 ± 23% softirqs.CPU79.RCU 10295 ± 8% +602.6% 72328 softirqs.CPU79.SCHED 93799 ± 4% -30.5% 65185 ± 23% softirqs.CPU8.RCU 9402 ± 3% +663.1% 71747 softirqs.CPU8.SCHED 95342 ± 5% -33.3% 63626 ± 23% softirqs.CPU80.RCU 9880 ± 5% +634.7% 72596 softirqs.CPU80.SCHED 93608 ± 3% -31.7% 63926 ± 22% softirqs.CPU81.RCU 9858 ± 5% +642.7% 73217 softirqs.CPU81.SCHED 92997 ± 3% -31.3% 63907 ± 23% softirqs.CPU82.RCU 9511 ± 5% +663.4% 72606 softirqs.CPU82.SCHED 9608 ± 5% +652.6% 72312 softirqs.CPU83.SCHED 9722 ± 4% +646.8% 72601 softirqs.CPU84.SCHED 9969 ± 8% +623.3% 72106 ± 2% softirqs.CPU85.SCHED 92461 ± 3% -28.2% 66415 ± 21% softirqs.CPU86.RCU 9824 ± 4% +629.6% 71677 softirqs.CPU86.SCHED 9428 ± 5% +666.5% 72267 softirqs.CPU87.SCHED 94652 ± 4% -28.4% 67792 ± 21% softirqs.CPU9.RCU 9347 ± 5% +662.3% 71249 softirqs.CPU9.SCHED 8542415 ± 4% -31.1% 5883048 ± 24% softirqs.RCU 843538 ± 3% +650.5% 6330950 softirqs.SCHED 85.86 -27.7 58.20 ± 49% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 85.10 -27.5 57.58 ± 49% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 35.20 -12.8 22.37 ± 51% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 33.98 -12.8 21.23 ± 51% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 25.70 ± 3% -12.6 13.15 ± 8% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 24.98 ± 3% -12.4 12.63 ± 8% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 24.71 ± 3% -12.2 12.48 ± 8% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 28.25 ± 3% -11.6 16.66 ± 8% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 20.64 -11.2 9.48 ± 6% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 40.01 -10.5 29.46 ± 47% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 41.30 -10.3 31.05 ± 48% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 18.54 -10.0 8.49 ± 6% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read 18.26 -9.9 8.37 ± 7% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read 29.05 -9.0 20.01 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 29.74 -8.8 20.92 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.69 ± 3% -4.7 2.02 ± 57% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 36.24 -4.6 31.62 ± 2% perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 9.94 ± 4% -4.6 5.33 ± 8% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 6.55 ± 3% -4.6 1.97 ± 57% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.63 ± 4% -4.5 5.16 ± 9% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 36.82 -4.3 32.53 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.20 ± 3% -4.2 4.02 ± 5% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_wait.pipe_read 6.36 ± 3% -3.9 2.50 ± 3% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.13 ± 25% -3.4 2.76 ± 3% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 3.86 ± 6% -2.7 1.17 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 3.34 ± 8% -2.4 0.90 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common 4.36 ± 35% -2.3 2.10 ± 4% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 2.80 -1.8 1.00 ± 6% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.pipe_wait.pipe_read 4.03 ± 3% -1.5 2.54 ± 5% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 2.34 -1.4 0.91 ± 5% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read 2.29 ± 49% -1.4 0.93 ± 5% perf-profile.calltrace.cycles-pp.available_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 2.43 ± 10% -1.2 1.21 ± 15% perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_task_fair.__schedule.schedule.pipe_wait 1.99 ± 3% -1.2 0.77 ± 58% perf-profile.calltrace.cycles-pp.__switch_to 2.13 ± 3% -1.2 0.91 ± 3% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 2.00 ± 3% -1.2 0.79 ± 4% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 2.96 ± 2% -1.2 1.79 ± 4% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 2.37 ± 11% -1.1 1.24 ± 15% perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 1.14 ± 5% -0.7 0.41 ± 57% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule 1.21 ± 4% -0.7 0.51 ± 58% perf-profile.calltrace.cycles-pp.__switch_to_asm 1.02 ± 3% -0.6 0.41 ± 57% perf-profile.calltrace.cycles-pp.native_write_msr 1.17 ± 4% -0.4 0.77 ± 4% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule 0.60 ± 5% -0.1 0.54 ± 4% perf-profile.calltrace.cycles-pp.migrate_task_rq_fair.set_task_cpu.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.94 ± 3% +0.2 1.19 ± 9% perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.new_sync_read.vfs_read.ksys_read 0.58 ± 5% +0.2 0.83 ± 9% perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.new_sync_read.vfs_read 1.63 +0.3 1.90 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.pipe_read.new_sync_read 1.71 +0.3 2.05 ± 7% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read 0.66 +0.4 1.01 ± 7% perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.new_sync_write.vfs_write.ksys_write 0.59 ± 4% +0.4 1.01 ± 8% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read 0.99 ± 4% +0.4 1.41 ± 11% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.42 ± 57% +0.4 0.85 ± 9% perf-profile.calltrace.cycles-pp.avc_has_perm.file_has_perm.security_file_permission.vfs_read.ksys_read 0.58 +0.5 1.05 ± 3% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.59 ± 2% +0.5 2.07 ± 9% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.96 +0.5 1.45 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write 0.12 ±173% +0.5 0.62 ± 12% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.new_sync_read.vfs_read.ksys_read 1.06 ± 2% +0.6 1.62 ± 8% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 0.69 ± 3% +0.6 1.26 ± 9% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64 0.76 ± 7% +0.6 1.34 ± 8% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.00 +0.6 0.61 ± 6% perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_read.ksys_read 0.00 +0.6 0.64 ± 7% perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_write.ksys_write 1.27 ± 2% +0.7 1.98 ± 8% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 0.00 +0.7 0.72 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_read.new_sync_read.vfs_read.ksys_read 0.00 +0.7 0.72 ± 9% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_write.new_sync_write 0.00 +0.7 0.74 ± 9% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_write.new_sync_write.vfs_write 0.00 +0.8 0.78 ± 10% perf-profile.calltrace.cycles-pp.avc_has_perm.file_has_perm.security_file_permission.vfs_write.ksys_write 1.24 ± 5% +0.8 2.08 ± 9% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write 1.33 +0.8 2.17 ± 18% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write 0.00 +1.1 1.07 ± 10% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_write.new_sync_write.vfs_write.ksys_write 0.00 +1.1 1.08 ± 19% perf-profile.calltrace.cycles-pp.__mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write 2.91 +1.1 4.00 ± 7% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read 1.62 ± 2% +1.1 2.75 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 0.00 +1.2 1.20 ± 6% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 1.98 ± 2% +1.2 3.22 ± 8% perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 0.00 +1.3 1.25 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary 1.72 ± 5% +1.3 2.98 ± 8% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.new_sync_write.vfs_write.ksys_write 0.00 +1.3 1.27 ± 2% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 2.74 ± 2% +1.3 4.05 ± 8% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.09 ± 2% +1.4 3.49 ± 8% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.7 2.71 ± 12% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 0.00 +4.0 4.03 ± 7% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +6.3 6.28 ± 5% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +6.3 6.29 ± 5% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +6.3 6.29 ± 5% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 0.00 +6.4 6.37 ± 5% perf-profile.calltrace.cycles-pp.secondary_startup_64 25.16 -13.2 11.92 ± 5% perf-profile.children.cycles-pp.schedule 25.78 ± 3% -12.1 13.66 ± 7% perf-profile.children.cycles-pp.__wake_up_common 25.21 -12.0 13.18 ± 5% perf-profile.children.cycles-pp.__schedule 25.02 ± 3% -12.0 13.04 ± 7% perf-profile.children.cycles-pp.try_to_wake_up 25.01 ± 3% -11.9 13.11 ± 7% perf-profile.children.cycles-pp.autoremove_wake_function 28.71 ± 3% -11.3 17.44 ± 7% perf-profile.children.cycles-pp.__wake_up_common_lock 85.18 -11.2 74.01 perf-profile.children.cycles-pp.do_syscall_64 85.98 -11.1 74.89 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 20.73 -10.1 10.59 ± 5% perf-profile.children.cycles-pp.pipe_wait 29.11 -9.0 20.12 perf-profile.children.cycles-pp.pipe_read 29.77 -8.8 20.97 perf-profile.children.cycles-pp.new_sync_read 34.04 -6.7 27.37 perf-profile.children.cycles-pp.vfs_read 35.22 -6.5 28.75 perf-profile.children.cycles-pp.ksys_read 36.29 -4.6 31.73 ± 2% perf-profile.children.cycles-pp.pipe_write 36.85 -4.3 32.57 ± 2% perf-profile.children.cycles-pp.new_sync_write 9.98 ± 4% -4.2 5.73 ± 8% perf-profile.children.cycles-pp.ttwu_do_activate 9.69 ± 4% -4.1 5.60 ± 8% perf-profile.children.cycles-pp.enqueue_task_fair 6.71 ± 3% -4.0 2.73 ± 4% perf-profile.children.cycles-pp.exit_to_usermode_loop 8.25 ± 3% -3.7 4.50 ± 7% perf-profile.children.cycles-pp.dequeue_task_fair 5.85 ± 6% -3.5 2.37 ± 10% perf-profile.children.cycles-pp._raw_spin_lock 6.16 ± 25% -3.2 2.98 ± 5% perf-profile.children.cycles-pp.select_task_rq_fair 5.05 -2.7 2.38 ± 3% perf-profile.children.cycles-pp.switch_mm_irqs_off 4.60 -2.4 2.23 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair 40.06 -2.1 37.91 perf-profile.children.cycles-pp.vfs_write 4.44 ± 35% -2.1 2.31 ± 6% perf-profile.children.cycles-pp.select_idle_sibling 3.76 ± 2% -2.1 1.67 ± 4% perf-profile.children.cycles-pp.update_curr 6.06 ± 6% -2.0 4.08 ± 14% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 2.99 -1.8 1.18 ± 5% perf-profile.children.cycles-pp.reweight_entity 4.90 ± 10% -1.6 3.25 ± 15% perf-profile.children.cycles-pp.update_cfs_group 41.34 -1.5 39.88 perf-profile.children.cycles-pp.ksys_write 2.53 -1.3 1.19 ± 4% perf-profile.children.cycles-pp.load_new_mm_cr3 2.33 ± 49% -1.3 1.05 ± 9% perf-profile.children.cycles-pp.available_idle_cpu 4.08 ± 3% -1.2 2.84 ± 6% perf-profile.children.cycles-pp.enqueue_entity 2.08 ± 3% -1.0 1.08 ± 5% perf-profile.children.cycles-pp.__switch_to 3.00 ± 2% -1.0 1.99 ± 3% perf-profile.children.cycles-pp.dequeue_entity 1.53 -0.9 0.68 ± 4% perf-profile.children.cycles-pp.__update_load_avg_se 3.81 ± 3% -0.8 2.99 ± 8% perf-profile.children.cycles-pp.update_load_avg 1.40 -0.8 0.60 ± 6% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 1.64 ± 9% -0.8 0.85 ± 5% perf-profile.children.cycles-pp.___perf_sw_event 1.43 ± 7% -0.8 0.66 ± 3% perf-profile.children.cycles-pp.update_rq_clock 0.92 ± 2% -0.7 0.27 ± 5% perf-profile.children.cycles-pp.__enqueue_entity 1.44 ± 2% -0.6 0.84 ± 4% perf-profile.children.cycles-pp.set_next_entity 1.15 -0.6 0.55 ± 4% perf-profile.children.cycles-pp.ttwu_do_wakeup 1.08 -0.6 0.49 ± 5% perf-profile.children.cycles-pp.check_preempt_curr 1.32 ± 3% -0.6 0.74 ± 4% perf-profile.children.cycles-pp.__switch_to_asm 0.93 ± 3% -0.6 0.37 ± 6% perf-profile.children.cycles-pp.pick_next_entity 0.90 -0.6 0.35 ± 6% perf-profile.children.cycles-pp.check_preempt_wakeup 0.78 ± 6% -0.6 0.23 ± 7% perf-profile.children.cycles-pp.__mutex_unlock_slowpath 1.11 ± 3% -0.5 0.61 ± 3% perf-profile.children.cycles-pp.native_write_msr 0.79 ± 2% -0.5 0.30 ± 6% perf-profile.children.cycles-pp.account_entity_dequeue 1.37 -0.5 0.89 ± 3% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.86 ± 2% -0.5 0.38 ± 4% perf-profile.children.cycles-pp.put_prev_entity 0.75 -0.4 0.36 ± 7% perf-profile.children.cycles-pp.anon_pipe_buf_release 0.76 -0.4 0.38 ± 4% perf-profile.children.cycles-pp.__calc_delta 0.66 ± 2% -0.4 0.29 ± 5% perf-profile.children.cycles-pp.account_entity_enqueue 0.65 ± 43% -0.4 0.28 ± 7% perf-profile.children.cycles-pp.cpumask_next_wrap 0.51 ± 3% -0.3 0.20 ± 3% perf-profile.children.cycles-pp.update_min_vruntime 0.51 ± 4% -0.3 0.21 ± 3% perf-profile.children.cycles-pp.rb_erase_cached 0.33 ± 4% -0.2 0.10 ± 4% perf-profile.children.cycles-pp.wake_up_q 0.60 ± 4% -0.2 0.38 ± 4% perf-profile.children.cycles-pp.sched_clock_cpu 0.38 ± 2% -0.2 0.16 ± 10% perf-profile.children.cycles-pp.clear_buddies 0.53 ± 4% -0.2 0.33 ± 3% perf-profile.children.cycles-pp.sched_clock 0.50 ± 4% -0.2 0.32 ± 4% perf-profile.children.cycles-pp.native_sched_clock 0.28 ± 4% -0.2 0.11 ± 3% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.47 ± 7% -0.2 0.31 ± 11% perf-profile.children.cycles-pp.reschedule_interrupt 0.89 ± 4% -0.2 0.73 ± 4% perf-profile.children.cycles-pp.finish_task_switch 0.38 ± 9% -0.1 0.23 ± 6% perf-profile.children.cycles-pp.cpuacct_charge 0.23 -0.1 0.08 ± 5% perf-profile.children.cycles-pp.set_next_buddy 0.24 ± 7% -0.1 0.10 ± 11% perf-profile.children.cycles-pp.preempt_schedule_common 0.19 ± 6% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.wake_q_add 0.35 -0.1 0.22 ± 3% perf-profile.children.cycles-pp.__list_del_entry_valid 0.48 ± 24% -0.1 0.35 ± 5% perf-profile.children.cycles-pp.find_next_bit 0.26 ± 6% -0.1 0.13 ± 5% perf-profile.children.cycles-pp.native_load_tls 0.20 ± 5% -0.1 0.07 ± 10% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.23 ± 4% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.deactivate_task 0.33 ± 3% -0.1 0.20 ± 8% perf-profile.children.cycles-pp.cpus_share_cache 0.18 ± 5% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.rb_next 0.15 ± 3% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.native_irq_return_iret 0.47 ± 2% -0.1 0.40 ± 2% perf-profile.children.cycles-pp.prepare_to_wait 0.21 ± 4% -0.1 0.14 ± 6% perf-profile.children.cycles-pp.activate_task 0.15 ± 3% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.rb_insert_color_cached 0.13 ± 3% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.finish_wait 0.26 ± 6% -0.1 0.20 ± 9% perf-profile.children.cycles-pp.cpumask_next 0.14 -0.1 0.08 ± 5% perf-profile.children.cycles-pp.__list_add_valid 0.11 ± 4% -0.1 0.05 perf-profile.children.cycles-pp.check_cfs_rq_runtime 0.09 ± 7% -0.0 0.05 perf-profile.children.cycles-pp.perf_exclude_event 0.19 ± 2% -0.0 0.16 ± 7% perf-profile.children.cycles-pp.resched_curr 0.11 ± 9% -0.0 0.09 perf-profile.children.cycles-pp.generic_update_time 0.08 ± 12% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__mark_inode_dirty 0.03 ±100% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.__vfs_write 0.08 ± 5% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.kill_fasync 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.00 +0.1 0.06 perf-profile.children.cycles-pp.read_tsc 0.04 ± 57% +0.1 0.10 ± 8% perf-profile.children.cycles-pp.bpf_fd_pass 0.28 ± 3% +0.1 0.35 ± 8% perf-profile.children.cycles-pp.rw_verify_area 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.35 ± 4% +0.1 0.43 ± 6% perf-profile.children.cycles-pp.hrtimer_interrupt 0.13 ± 7% +0.1 0.21 ± 3% perf-profile.children.cycles-pp.iov_iter_init 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.ktime_get 0.40 ± 2% +0.1 0.48 ± 5% perf-profile.children.cycles-pp.__x64_sys_read 0.20 ± 4% +0.1 0.28 ± 6% perf-profile.children.cycles-pp.tick_sched_timer 0.12 ± 7% +0.1 0.20 ± 6% perf-profile.children.cycles-pp.task_tick_fair 0.26 +0.1 0.34 ± 8% perf-profile.children.cycles-pp.__sb_start_write 0.18 ± 4% +0.1 0.27 ± 6% perf-profile.children.cycles-pp.update_process_times 0.18 ± 3% +0.1 0.27 ± 7% perf-profile.children.cycles-pp.tick_sched_handle 0.13 ± 5% +0.1 0.22 ± 5% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.1 0.09 ± 8% perf-profile.children.cycles-pp.free_unref_page 0.26 ± 3% +0.1 0.35 ± 6% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.00 +0.1 0.10 ± 11% perf-profile.children.cycles-pp.get_page_from_freelist 0.00 +0.1 0.10 perf-profile.children.cycles-pp.pick_next_task_idle 0.14 ± 3% +0.1 0.25 ± 6% perf-profile.children.cycles-pp.__sb_end_write 0.00 +0.1 0.12 ± 3% perf-profile.children.cycles-pp.__next_timer_interrupt 0.00 +0.1 0.12 ± 8% perf-profile.children.cycles-pp.rebalance_domains 0.00 +0.1 0.13 ± 8% perf-profile.children.cycles-pp.load_balance 0.34 ± 2% +0.1 0.47 ± 5% perf-profile.children.cycles-pp.__x64_sys_write 0.00 +0.1 0.13 ± 9% perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.13 ± 12% +0.1 0.27 ± 3% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64 0.03 ±100% +0.1 0.17 ± 7% perf-profile.children.cycles-pp.irq_exit 0.00 +0.2 0.17 ± 6% perf-profile.children.cycles-pp.__softirqentry_text_start 0.04 ±107% +0.2 0.20 ± 12% perf-profile.children.cycles-pp.scheduler_ipi 0.23 ± 3% +0.2 0.40 ± 6% perf-profile.children.cycles-pp.generic_pipe_buf_confirm 0.15 ± 3% +0.2 0.32 ± 5% perf-profile.children.cycles-pp.timespec64_trunc 0.53 +0.2 0.71 ± 4% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.2 0.18 ± 4% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.18 ± 6% +0.2 0.38 ± 5% perf-profile.children.cycles-pp.inode_has_perm 0.00 +0.2 0.20 ± 6% perf-profile.children.cycles-pp.tick_nohz_next_event 0.42 ± 5% +0.2 0.63 ± 5% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.47 ± 6% +0.2 0.68 ± 5% perf-profile.children.cycles-pp.apic_timer_interrupt 0.01 ±173% +0.3 0.27 ± 15% perf-profile.children.cycles-pp.sched_ttwu_pending 0.30 ± 3% +0.3 0.56 ± 4% perf-profile.children.cycles-pp.rcu_all_qs 0.00 +0.3 0.27 ± 5% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.95 ± 3% +0.3 1.23 ± 7% perf-profile.children.cycles-pp.touch_atime 0.59 ± 5% +0.3 0.87 ± 6% perf-profile.children.cycles-pp.atime_needs_update 0.54 ± 4% +0.3 0.82 ± 7% perf-profile.children.cycles-pp.__fsnotify_parent 0.00 +0.3 0.29 ± 44% perf-profile.children.cycles-pp.osq_lock 0.79 ± 4% +0.3 1.14 ± 5% perf-profile.children.cycles-pp._cond_resched 0.11 ± 10% +0.4 0.46 ± 12% perf-profile.children.cycles-pp.mutex_spin_on_owner 0.68 +0.4 1.06 ± 4% perf-profile.children.cycles-pp.file_update_time 1.72 +0.4 2.12 ± 3% perf-profile.children.cycles-pp.copyout 1.84 ± 3% +0.4 2.27 ± 9% perf-profile.children.cycles-pp.__fget_light 0.54 ± 3% +0.4 0.98 ± 5% perf-profile.children.cycles-pp.__might_fault 0.00 +0.5 0.51 ± 4% perf-profile.children.cycles-pp.menu_select 1.94 ± 3% +0.5 2.46 ± 9% perf-profile.children.cycles-pp.__fdget_pos 0.57 ± 4% +0.5 1.10 ± 4% perf-profile.children.cycles-pp.current_time 0.72 ± 3% +0.6 1.28 ± 5% perf-profile.children.cycles-pp.__might_sleep 1.08 ± 2% +0.6 1.67 ± 5% perf-profile.children.cycles-pp.copyin 0.76 ± 4% +0.6 1.35 ± 3% perf-profile.children.cycles-pp.__inode_security_revalidate 0.98 ± 5% +0.7 1.68 ± 7% perf-profile.children.cycles-pp.avc_has_perm 0.86 +0.7 1.57 ± 2% perf-profile.children.cycles-pp.fsnotify 0.60 ± 7% +0.7 1.32 ± 16% perf-profile.children.cycles-pp.__mutex_lock 1.05 ± 3% +0.8 1.86 ± 5% perf-profile.children.cycles-pp.___might_sleep 2.84 +0.9 3.75 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 2.72 +0.9 3.65 ± 4% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 2.40 ± 3% +1.2 3.56 ± 4% perf-profile.children.cycles-pp.mutex_lock 0.00 +1.2 1.21 ± 6% perf-profile.children.cycles-pp.poll_idle 2.95 ± 2% +1.2 4.17 ± 4% perf-profile.children.cycles-pp.copy_page_to_iter 2.89 ± 2% +1.2 4.13 ± 6% perf-profile.children.cycles-pp.selinux_file_permission 1.48 ± 4% +1.2 2.73 ± 6% perf-profile.children.cycles-pp.file_has_perm 0.00 +1.3 1.29 ± 2% perf-profile.children.cycles-pp.schedule_idle 2.01 ± 2% +1.3 3.34 ± 6% perf-profile.children.cycles-pp.copy_page_from_iter 2.32 ± 4% +1.5 3.80 ± 4% perf-profile.children.cycles-pp.mutex_unlock 0.00 +2.7 2.74 ± 12% perf-profile.children.cycles-pp.intel_idle 4.86 ± 2% +2.9 7.72 ± 5% perf-profile.children.cycles-pp.security_file_permission 4.36 ± 2% +3.1 7.48 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64 4.64 ± 2% +3.5 8.14 ± 5% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.00 +4.1 4.08 ± 7% perf-profile.children.cycles-pp.cpuidle_enter_state 0.03 ±100% +6.3 6.29 ± 5% perf-profile.children.cycles-pp.start_secondary 0.03 ±100% +6.3 6.37 ± 5% perf-profile.children.cycles-pp.do_idle 0.03 ±100% +6.3 6.37 ± 5% perf-profile.children.cycles-pp.secondary_startup_64 0.03 ±100% +6.3 6.37 ± 5% perf-profile.children.cycles-pp.cpu_startup_entry 6.05 ± 6% -2.0 4.08 ± 14% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 4.87 ± 10% -1.6 3.24 ± 15% perf-profile.self.cycles-pp.update_cfs_group 2.53 -1.3 1.19 ± 2% perf-profile.self.cycles-pp.switch_mm_irqs_off 2.52 -1.3 1.19 ± 4% perf-profile.self.cycles-pp.load_new_mm_cr3 2.13 ± 2% -1.3 0.87 ± 4% perf-profile.self.cycles-pp.update_curr 2.30 ± 49% -1.3 1.04 ± 9% perf-profile.self.cycles-pp.available_idle_cpu 2.54 -1.1 1.46 ± 2% perf-profile.self.cycles-pp.__schedule 2.01 ± 3% -1.0 1.04 ± 5% perf-profile.self.cycles-pp.__switch_to 1.41 -0.9 0.54 ± 3% perf-profile.self.cycles-pp.select_task_rq_fair 1.50 -0.8 0.66 ± 5% perf-profile.self.cycles-pp.__update_load_avg_se 1.52 ± 9% -0.7 0.78 ± 5% perf-profile.self.cycles-pp.___perf_sw_event 1.31 -0.7 0.57 ± 6% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.91 ± 3% -0.6 0.27 ± 5% perf-profile.self.cycles-pp.__enqueue_entity 1.32 ± 3% -0.6 0.74 ± 4% perf-profile.self.cycles-pp.__switch_to_asm 1.03 ± 9% -0.6 0.46 ± 6% perf-profile.self.cycles-pp.update_rq_clock 1.06 -0.6 0.51 ± 4% perf-profile.self.cycles-pp.pick_next_task_fair 1.10 ± 3% -0.5 0.60 ± 3% perf-profile.self.cycles-pp.native_write_msr 0.91 -0.5 0.45 ± 6% perf-profile.self.cycles-pp.reweight_entity 1.07 -0.4 0.64 ± 5% perf-profile.self.cycles-pp._raw_spin_lock 0.75 -0.4 0.35 ± 4% perf-profile.self.cycles-pp.dequeue_task_fair 0.65 ± 2% -0.4 0.26 ± 6% perf-profile.self.cycles-pp.account_entity_dequeue 0.98 ± 2% -0.4 0.59 ± 3% perf-profile.self.cycles-pp.enqueue_task_fair 0.73 -0.4 0.35 ± 8% perf-profile.self.cycles-pp.anon_pipe_buf_release 0.76 -0.4 0.38 ± 4% perf-profile.self.cycles-pp.__calc_delta 0.60 ± 2% -0.3 0.26 ± 5% perf-profile.self.cycles-pp.account_entity_enqueue 0.73 -0.3 0.39 ± 5% perf-profile.self.cycles-pp.try_to_wake_up 0.65 -0.3 0.32 ± 3% perf-profile.self.cycles-pp.pipe_wait 0.49 ± 3% -0.3 0.19 ± 4% perf-profile.self.cycles-pp.update_min_vruntime 1.03 -0.3 0.74 ± 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.42 -0.3 0.16 ± 4% perf-profile.self.cycles-pp.check_preempt_wakeup 0.78 ± 20% -0.2 0.54 ± 4% perf-profile.self.cycles-pp.select_idle_sibling 0.43 ± 2% -0.2 0.20 ± 2% perf-profile.self.cycles-pp.pick_next_entity 0.38 ± 45% -0.2 0.16 ± 9% perf-profile.self.cycles-pp.cpumask_next_wrap 0.76 ± 2% -0.2 0.55 ± 3% perf-profile.self.cycles-pp.__wake_up_common 0.46 ± 3% -0.2 0.26 ± 9% perf-profile.self.cycles-pp.enqueue_entity 0.33 ± 3% -0.2 0.13 ± 11% perf-profile.self.cycles-pp.clear_buddies 0.33 ± 2% -0.2 0.15 ± 3% perf-profile.self.cycles-pp.rb_erase_cached 0.48 ± 4% -0.2 0.30 ± 4% perf-profile.self.cycles-pp.native_sched_clock 0.28 ± 2% -0.2 0.10 ± 4% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.32 ± 2% -0.2 0.15 ± 2% perf-profile.self.cycles-pp.schedule 0.18 ± 8% -0.2 0.03 ±100% perf-profile.self.cycles-pp.wake_q_add 0.38 ± 9% -0.1 0.23 ± 6% perf-profile.self.cycles-pp.cpuacct_charge 0.28 ± 2% -0.1 0.14 ± 6% perf-profile.self.cycles-pp.prepare_to_wait 0.21 ± 4% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.set_next_buddy 1.46 ± 2% -0.1 1.32 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.35 ± 2% -0.1 0.21 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid 0.44 -0.1 0.31 ± 6% perf-profile.self.cycles-pp.finish_task_switch 0.28 -0.1 0.15 ± 5% perf-profile.self.cycles-pp.dequeue_entity 0.25 ± 5% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.native_load_tls 0.18 ± 8% -0.1 0.06 ± 9% perf-profile.self.cycles-pp.__mutex_unlock_slowpath 0.44 ± 22% -0.1 0.32 ± 6% perf-profile.self.cycles-pp.find_next_bit 0.32 ± 4% -0.1 0.20 ± 6% perf-profile.self.cycles-pp.cpus_share_cache 0.22 ± 3% -0.1 0.10 ± 7% perf-profile.self.cycles-pp.deactivate_task 0.17 ± 6% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.rb_next 0.17 ± 8% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.18 -0.1 0.08 ± 6% perf-profile.self.cycles-pp.check_preempt_curr 0.15 ± 3% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.native_irq_return_iret 0.14 ± 3% -0.1 0.07 ± 10% perf-profile.self.cycles-pp.autoremove_wake_function 0.14 ± 6% -0.1 0.07 ± 13% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.20 ± 2% -0.1 0.13 ± 6% perf-profile.self.cycles-pp.activate_task 0.15 ± 3% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.rb_insert_color_cached 0.22 ± 3% -0.1 0.16 ± 2% perf-profile.self.cycles-pp.set_next_entity 0.13 ± 3% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.__list_add_valid 0.14 ± 3% -0.1 0.09 ± 4% perf-profile.self.cycles-pp.put_prev_entity 0.10 ± 4% -0.0 0.05 perf-profile.self.cycles-pp.finish_wait 0.08 ± 5% -0.0 0.05 perf-profile.self.cycles-pp.perf_exclude_event 0.18 ± 2% -0.0 0.15 ± 6% perf-profile.self.cycles-pp.resched_curr 0.07 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.sched_clock_cpu 0.08 ± 10% -0.0 0.06 perf-profile.self.cycles-pp.__mark_inode_dirty 0.07 ± 6% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.ttwu_do_wakeup 0.07 ± 7% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.kill_fasync 0.26 ± 4% +0.1 0.31 ± 8% perf-profile.self.cycles-pp.rw_verify_area 0.36 ± 2% +0.1 0.41 ± 4% perf-profile.self.cycles-pp.__x64_sys_read 0.26 ± 4% +0.1 0.31 ± 2% perf-profile.self.cycles-pp.__wake_up_common_lock 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.__next_timer_interrupt 0.00 +0.1 0.06 perf-profile.self.cycles-pp.read_tsc 0.12 ± 4% +0.1 0.19 perf-profile.self.cycles-pp.iov_iter_init 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.__vfs_write 0.17 ± 4% +0.1 0.25 ± 5% perf-profile.self.cycles-pp.__might_fault 0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.copyin 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.copyout 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.bpf_fd_pass 0.25 +0.1 0.33 ± 9% perf-profile.self.cycles-pp.__sb_start_write 0.12 +0.1 0.21 ± 5% perf-profile.self.cycles-pp.__fdget_pos 0.30 ± 2% +0.1 0.40 ± 5% perf-profile.self.cycles-pp.__x64_sys_write 0.00 +0.1 0.10 ± 7% perf-profile.self.cycles-pp.do_idle 0.64 +0.1 0.75 ± 6% perf-profile.self.cycles-pp.vfs_read 0.11 ± 13% +0.1 0.23 ± 3% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.13 ± 5% +0.1 0.24 ± 6% perf-profile.self.cycles-pp.__sb_end_write 0.88 ± 2% +0.1 1.00 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.30 ± 6% +0.1 0.43 ± 9% perf-profile.self.cycles-pp.__mutex_lock 0.20 ± 4% +0.1 0.35 ± 6% perf-profile.self.cycles-pp.generic_pipe_buf_confirm 0.13 ± 3% +0.2 0.28 ± 5% perf-profile.self.cycles-pp.timespec64_trunc 0.57 ± 4% +0.2 0.73 ± 7% perf-profile.self.cycles-pp.new_sync_read 0.24 +0.2 0.40 ± 6% perf-profile.self.cycles-pp.file_update_time 0.16 ± 5% +0.2 0.32 ± 4% perf-profile.self.cycles-pp.inode_has_perm 0.48 +0.2 0.65 ± 4% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 1.56 ± 3% +0.2 1.73 ± 5% perf-profile.self.cycles-pp.pipe_read 0.30 ± 4% +0.2 0.48 ± 3% perf-profile.self.cycles-pp.ksys_read 0.00 +0.2 0.19 ± 6% perf-profile.self.cycles-pp.menu_select 0.24 ± 4% +0.2 0.43 ± 5% perf-profile.self.cycles-pp.rcu_all_qs 0.25 ± 2% +0.2 0.46 ± 6% perf-profile.self.cycles-pp.ksys_write 0.24 ± 2% +0.2 0.46 ± 7% perf-profile.self.cycles-pp.__inode_security_revalidate 0.31 ± 3% +0.2 0.55 ± 6% perf-profile.self.cycles-pp.current_time 0.24 ± 4% +0.2 0.49 ± 5% perf-profile.self.cycles-pp._cond_resched 0.50 ± 4% +0.2 0.75 ± 7% perf-profile.self.cycles-pp.__fsnotify_parent 0.50 +0.3 0.75 ± 7% perf-profile.self.cycles-pp.new_sync_write 0.39 ± 5% +0.3 0.65 perf-profile.self.cycles-pp.security_file_permission 0.66 +0.3 0.94 ± 4% perf-profile.self.cycles-pp.copy_page_to_iter 0.00 +0.3 0.29 ± 43% perf-profile.self.cycles-pp.osq_lock 0.40 ± 4% +0.3 0.74 ± 6% perf-profile.self.cycles-pp.copy_page_from_iter 0.30 ± 4% +0.3 0.64 ± 5% perf-profile.self.cycles-pp.file_has_perm 0.11 ± 10% +0.3 0.46 ± 11% perf-profile.self.cycles-pp.mutex_spin_on_owner 0.37 ± 3% +0.4 0.73 ± 7% perf-profile.self.cycles-pp.vfs_write 1.79 ± 3% +0.4 2.20 ± 9% perf-profile.self.cycles-pp.__fget_light 1.05 ± 2% +0.4 1.48 ± 6% perf-profile.self.cycles-pp.do_syscall_64 0.64 ± 3% +0.5 1.12 ± 5% perf-profile.self.cycles-pp.__might_sleep 2.08 ± 2% +0.6 2.68 ± 7% perf-profile.self.cycles-pp.selinux_file_permission 0.83 +0.7 1.50 perf-profile.self.cycles-pp.fsnotify 0.97 ± 5% +0.7 1.66 ± 7% perf-profile.self.cycles-pp.avc_has_perm 1.51 ± 4% +0.7 2.23 ± 3% perf-profile.self.cycles-pp.mutex_lock 1.04 ± 3% +0.8 1.81 ± 5% perf-profile.self.cycles-pp.___might_sleep 2.69 +0.9 3.60 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.00 +1.1 1.13 ± 6% perf-profile.self.cycles-pp.poll_idle 1.02 ± 5% +1.2 2.21 ± 5% perf-profile.self.cycles-pp.pipe_write 2.28 ± 5% +1.5 3.73 ± 4% perf-profile.self.cycles-pp.mutex_unlock 0.00 +2.7 2.72 ± 12% perf-profile.self.cycles-pp.intel_idle 4.36 ± 2% +2.9 7.24 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64 4.64 ± 2% +3.5 8.12 ± 5% perf-profile.self.cycles-pp.syscall_return_via_sysret *************************************************************************************************** lkp-hsw-ep4: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode: gcc-7/performance/1SSD/8K/xfs/8/x86_64-rhel-7.6/16d/256fpd/32/debian-x86_64-2018-04-03.cgz/fsyncBeforeClose/lkp-hsw-ep4/50G/fsmark/0x3d commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x :4 25% 1:4 dmesg.WARNING:stack_recursion %stddev %change %stddev \ | \ 21213 +22.1% 25903 fsmark.files_per_sec 341.74 -15.2% 289.92 fsmark.time.elapsed_time 341.74 -15.2% 289.92 fsmark.time.elapsed_time.max 3281279 +28.9% 4228658 fsmark.time.involuntary_context_switches 193420 ± 33% -35.2% 125315 fsmark.time.minor_page_faults 283.50 +9.6% 310.75 fsmark.time.percent_of_cpu_this_job_got 914.23 -7.2% 848.84 ± 2% fsmark.time.system_time 56.38 -5.0% 53.54 ± 3% fsmark.time.user_time 21200 ± 18% -55.4% 9453 ±104% numa-numastat.node1.other_node 88.46 -1.1% 87.49 iostat.cpu.idle 6.73 ± 4% +7.3% 7.22 iostat.cpu.iowait 4.46 ± 2% +9.6% 4.89 ± 2% iostat.cpu.system 552865 +11.2% 615035 meminfo.Committed_AS 1898841 -13.4% 1643855 ± 2% meminfo.SUnreclaim 213495 +16.8% 249438 meminfo.max_used_kB 0.04 +0.0 0.06 ± 17% mpstat.cpu.all.soft% 4.44 ± 2% +0.4 4.86 ± 2% mpstat.cpu.all.sys% 0.34 +0.1 0.39 ± 4% mpstat.cpu.all.usr% 88.00 -1.1% 87.00 vmstat.cpu.id 352009 +20.2% 423162 vmstat.io.bo 277063 +17.2% 324816 vmstat.system.cs 162851 ± 14% +11.7% 181975 vmstat.system.in 9403188 ± 11% +54.5% 14529792 ± 2% cpuidle.C1.usage 1.051e+10 ± 23% -68.2% 3.34e+09 ± 70% cpuidle.C6.time 16469304 ± 13% -70.1% 4923804 ± 63% cpuidle.C6.usage 15587343 ± 19% +86.7% 29102711 cpuidle.POLL.time 4059501 ± 9% +118.9% 8886113 cpuidle.POLL.usage 150934 ± 29% -51.4% 73304 ± 9% numa-meminfo.node0.AnonHugePages 6783 ± 4% +17.0% 7936 numa-meminfo.node0.KernelStack 2289 ± 17% +36.8% 3130 ± 2% numa-meminfo.node0.PageTables 933571 -38.2% 576714 ± 31% numa-meminfo.node0.SUnreclaim 1871 -100.0% 0.00 numa-meminfo.node1.Active(file) 7094 ± 5% -13.8% 6114 numa-meminfo.node1.KernelStack 3330 ± 12% -26.6% 2445 ± 8% numa-meminfo.node1.PageTables 6784 ± 4% +17.0% 7935 numa-vmstat.node0.nr_kernel_stack 572.00 ± 17% +36.7% 781.75 ± 2% numa-vmstat.node0.nr_page_table_pages 233369 -38.2% 144171 ± 31% numa-vmstat.node0.nr_slab_unreclaimable 467.75 -100.0% 0.00 numa-vmstat.node1.nr_active_file 7093 ± 5% -13.8% 6115 numa-vmstat.node1.nr_kernel_stack 832.50 ± 12% -26.5% 611.50 ± 8% numa-vmstat.node1.nr_page_table_pages 467.75 -100.0% 0.00 numa-vmstat.node1.nr_zone_active_file 106.75 ± 7% -37.2% 67.00 ± 25% numa-vmstat.node1.nr_zone_write_pending 803807 -33.0% 538915 ± 2% slabinfo.kmalloc-1k.active_objs 25359 -32.8% 17050 ± 2% slabinfo.kmalloc-1k.active_slabs 811523 -32.8% 545627 ± 2% slabinfo.kmalloc-1k.num_objs 25359 -32.8% 17050 ± 2% slabinfo.kmalloc-1k.num_slabs 570.00 ± 16% -23.0% 439.00 ± 7% slabinfo.skbuff_fclone_cache.active_objs 570.00 ± 16% -23.0% 439.00 ± 7% slabinfo.skbuff_fclone_cache.num_objs 16997 -24.3% 12863 ± 5% slabinfo.xfs_buf_item.active_objs 17265 -22.2% 13432 ± 5% slabinfo.xfs_buf_item.num_objs 13876 +1.3% 14051 proc-vmstat.nr_kernel_stack 474714 -13.4% 410940 ± 2% proc-vmstat.nr_slab_unreclaimable 15871915 -1.1% 15699015 proc-vmstat.numa_hit 15848187 -1.1% 15675530 proc-vmstat.numa_local 23727 -1.0% 23484 proc-vmstat.numa_other 109149 ± 29% -63.7% 39642 ± 53% proc-vmstat.numa_pages_migrated 19171589 -1.5% 18889763 proc-vmstat.pgalloc_normal 1001796 ± 6% -18.3% 818819 proc-vmstat.pgfault 109149 ± 29% -63.7% 39642 ± 53% proc-vmstat.pgmigrate_success 1.214e+08 +2.2% 1.241e+08 proc-vmstat.pgpgout 203.50 +9.7% 223.25 turbostat.Avg_MHz 7.79 ± 2% +1.4 9.24 ± 2% turbostat.Busy% 9403172 ± 11% +54.5% 14529016 ± 2% turbostat.C1 3.42 ± 14% +1.0 4.40 ± 6% turbostat.C1% 35.59 ± 26% +25.3 60.88 ± 19% turbostat.C3% 16461065 ± 13% -70.1% 4917377 ± 63% turbostat.C6 42.48 ± 22% -26.4 16.06 ± 71% turbostat.C6% 13.52 ± 15% +141.7% 32.68 ± 4% turbostat.CPU%c3 17.55 ± 34% -69.4% 5.37 ± 82% turbostat.CPU%c6 56.75 ± 3% +32.6% 75.25 ± 12% turbostat.CoreTmp 6.16 ± 16% +292.5% 24.18 ± 10% turbostat.Pkg%pc2 0.10 ± 66% -92.1% 0.01 ±110% turbostat.Pkg%pc6 150.97 ± 2% -11.7% 133.37 ± 3% turbostat.PkgWatt 11.57 ± 2% -12.6% 10.12 turbostat.RAMWatt 51.77 ± 4% -7.0% 48.17 ± 2% perf-stat.i.MPKI 3.76 ± 5% -0.9 2.84 ± 11% perf-stat.i.branch-miss-rate% 6.29 ± 13% -3.2 3.10 ± 21% perf-stat.i.cache-miss-rate% 15211156 ± 5% -75.4% 3738357 ± 9% perf-stat.i.cache-misses 279523 +17.6% 328795 perf-stat.i.context-switches 8659 +173.8% 23705 perf-stat.i.cpu-migrations 1815 ± 39% +365.2% 8443 ± 6% perf-stat.i.cycles-between-cache-misses 90.13 -50.1 40.01 ± 7% perf-stat.i.node-load-miss-rate% 9300569 ± 3% -88.8% 1041802 ± 27% perf-stat.i.node-load-misses 51.87 -37.8 14.10 ± 18% perf-stat.i.node-store-miss-rate% 2460337 ± 6% -88.5% 281932 ± 29% perf-stat.i.node-store-misses 2296799 ± 4% -63.5% 837966 ± 10% perf-stat.i.node-stores 3.65 ± 7% -0.7 2.96 ± 11% perf-stat.overall.branch-miss-rate% 4.83 ± 2% -3.6 1.24 ± 13% perf-stat.overall.cache-miss-rate% 1016 +327.2% 4340 ± 11% perf-stat.overall.cycles-between-cache-misses 1749 ± 2% -10.5% 1565 ± 11% perf-stat.overall.instructions-per-iTLB-miss 88.24 -47.5 40.75 ± 27% perf-stat.overall.node-load-miss-rate% 51.69 -26.5 25.18 ± 29% perf-stat.overall.node-store-miss-rate% 15165350 ± 5% -75.4% 3725691 ± 9% perf-stat.ps.cache-misses 278683 +17.6% 327671 perf-stat.ps.context-switches 8633 +173.6% 23625 perf-stat.ps.cpu-migrations 9272598 ± 3% -88.8% 1038257 ± 27% perf-stat.ps.node-load-misses 2452947 ± 6% -88.5% 280886 ± 29% perf-stat.ps.node-store-misses 2289928 ± 4% -63.5% 835264 ± 10% perf-stat.ps.node-stores 122832 ± 85% +503.3% 741095 ± 13% sched_debug.cfs_rq:/.load.avg 961972 ± 92% +328.3% 4120557 ± 20% sched_debug.cfs_rq:/.load.stddev 2.79 ± 12% -100.0% 0.00 sched_debug.cfs_rq:/.load_avg.min 0.09 ± 9% +54.9% 0.14 ± 12% sched_debug.cfs_rq:/.nr_running.avg 0.29 ± 3% +20.9% 0.35 ± 6% sched_debug.cfs_rq:/.nr_running.stddev 4.49 ± 15% +275.1% 16.86 ± 25% sched_debug.cfs_rq:/.runnable_load_avg.avg 208.04 ± 20% +161.8% 544.67 ± 44% sched_debug.cfs_rq:/.runnable_load_avg.max 26.49 ± 19% +218.2% 84.28 ± 37% sched_debug.cfs_rq:/.runnable_load_avg.stddev 122294 ± 86% +505.9% 740991 ± 13% sched_debug.cfs_rq:/.runnable_weight.avg 960772 ± 92% +328.8% 4120202 ± 20% sched_debug.cfs_rq:/.runnable_weight.stddev -19999 -109.7% 1942 ±329% sched_debug.cfs_rq:/.spread0.avg -52984 -46.0% -28592 sched_debug.cfs_rq:/.spread0.min 128.72 ± 3% +27.6% 164.26 ± 5% sched_debug.cfs_rq:/.util_avg.avg 4.50 ± 20% -100.0% 0.00 sched_debug.cfs_rq:/.util_avg.min 112.93 ± 3% +27.5% 144.04 ± 5% sched_debug.cfs_rq:/.util_avg.stddev 9.19 ± 18% +54.6% 14.20 ± 13% sched_debug.cfs_rq:/.util_est_enqueued.avg 182.54 ± 14% +42.1% 259.35 ± 30% sched_debug.cfs_rq:/.util_est_enqueued.max 35.50 ± 13% +37.6% 48.84 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.stddev 489380 ± 11% +29.1% 631709 ± 4% sched_debug.cpu.avg_idle.avg 241820 ± 5% +37.1% 331628 ± 6% sched_debug.cpu.avg_idle.stddev 1353 ± 8% -23.1% 1040 ± 12% sched_debug.cpu.curr->pid.stddev 389123 -45.5% 211975 ± 31% sched_debug.cpu.nr_switches.min 136008 +108.0% 282837 ± 34% sched_debug.cpu.nr_switches.stddev 1171 ± 4% -70.4% 346.84 ± 16% sched_debug.cpu.nr_uninterruptible.max -1279 -60.4% -506.64 sched_debug.cpu.nr_uninterruptible.min 640.51 ± 4% -66.5% 214.45 ± 17% sched_debug.cpu.nr_uninterruptible.stddev 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 49309 ± 6% -18.7% 40096 ± 5% softirqs.CPU0.SCHED 52249 -21.0% 41259 softirqs.CPU1.SCHED 50368 -21.6% 39476 ± 2% softirqs.CPU10.SCHED 147614 ± 12% -25.5% 109968 ± 20% softirqs.CPU10.TIMER 49014 ± 3% -17.3% 40523 softirqs.CPU11.SCHED 49979 -18.5% 40750 softirqs.CPU12.SCHED 50117 -19.4% 40400 softirqs.CPU13.SCHED 49531 -20.9% 39185 ± 3% softirqs.CPU14.SCHED 74603 ± 5% -27.6% 53984 ± 6% softirqs.CPU15.RCU 49907 -19.7% 40064 softirqs.CPU15.SCHED 74990 ± 4% -24.3% 56771 ± 5% softirqs.CPU16.RCU 50053 -19.7% 40210 ± 2% softirqs.CPU16.SCHED 74481 ± 4% -26.3% 54910 ± 2% softirqs.CPU17.RCU 49500 -17.8% 40708 softirqs.CPU17.SCHED 146323 ± 12% -23.3% 112239 ± 19% softirqs.CPU17.TIMER 50341 ± 2% -14.2% 43201 ± 5% softirqs.CPU18.SCHED 87302 ± 8% -19.1% 70660 ± 12% softirqs.CPU19.RCU 50978 -14.6% 43533 ± 4% softirqs.CPU19.SCHED 82496 ± 6% -11.0% 73438 ± 6% softirqs.CPU2.RCU 50171 -19.4% 40445 ± 3% softirqs.CPU2.SCHED 49925 -15.5% 42164 ± 2% softirqs.CPU20.SCHED 50132 -14.8% 42706 ± 4% softirqs.CPU21.SCHED 88152 ± 6% -15.1% 74855 ± 8% softirqs.CPU22.RCU 49883 -14.1% 42865 ± 4% softirqs.CPU22.SCHED 89828 ± 5% -18.8% 72936 ± 8% softirqs.CPU23.RCU 50635 -13.9% 43608 ± 4% softirqs.CPU23.SCHED 86249 ± 5% -16.2% 72271 ± 5% softirqs.CPU24.RCU 49328 -14.6% 42143 ± 5% softirqs.CPU24.SCHED 85224 ± 6% -14.3% 73017 ± 6% softirqs.CPU25.RCU 49865 -14.2% 42774 ± 4% softirqs.CPU25.SCHED 84912 ± 5% -15.1% 72072 ± 7% softirqs.CPU26.RCU 49714 -14.3% 42595 ± 4% softirqs.CPU26.SCHED 85992 ± 6% -18.9% 69732 ± 4% softirqs.CPU27.RCU 49570 -15.9% 41704 ± 6% softirqs.CPU27.SCHED 85178 ± 6% -16.8% 70856 ± 5% softirqs.CPU28.RCU 49400 -13.6% 42678 ± 4% softirqs.CPU28.SCHED 50282 ± 2% -15.9% 42277 ± 4% softirqs.CPU29.SCHED 50972 ± 2% -19.9% 40817 softirqs.CPU3.SCHED 81672 ± 8% -22.0% 63680 ± 7% softirqs.CPU30.RCU 49828 -13.9% 42878 ± 4% softirqs.CPU30.SCHED 81864 ± 7% -23.5% 62657 ± 5% softirqs.CPU31.RCU 49707 -13.8% 42854 ± 4% softirqs.CPU31.SCHED 74705 ± 4% -20.6% 59340 ± 4% softirqs.CPU32.RCU 49561 -14.2% 42499 ± 4% softirqs.CPU32.SCHED 80684 ± 6% -23.8% 61512 ± 4% softirqs.CPU33.RCU 49831 -13.9% 42913 ± 4% softirqs.CPU33.SCHED 84266 ± 8% -26.5% 61956 ± 6% softirqs.CPU34.RCU 49955 -14.2% 42863 ± 4% softirqs.CPU34.SCHED 82109 ± 4% -23.7% 62613 ± 6% softirqs.CPU35.RCU 49876 -14.8% 42480 ± 4% softirqs.CPU35.SCHED 84864 ± 5% -22.7% 65600 ± 7% softirqs.CPU36.RCU 52414 -27.7% 37890 ± 4% softirqs.CPU36.SCHED 86232 ± 10% -18.7% 70075 ± 5% softirqs.CPU37.RCU 51096 -21.8% 39970 softirqs.CPU37.SCHED 81856 ± 5% -21.9% 63969 ± 6% softirqs.CPU38.RCU 52538 -24.1% 39852 ± 3% softirqs.CPU38.SCHED 82684 ± 9% -15.9% 69543 ± 2% softirqs.CPU39.RCU 50665 -20.1% 40482 softirqs.CPU39.SCHED 50233 -19.8% 40305 softirqs.CPU4.SCHED 84026 ± 4% -15.5% 70979 ± 3% softirqs.CPU40.RCU 52776 -23.3% 40488 softirqs.CPU40.SCHED 88484 ± 4% -19.7% 71041 softirqs.CPU41.RCU 50907 -20.8% 40313 softirqs.CPU41.SCHED 82291 ± 7% -16.5% 68716 ± 3% softirqs.CPU42.RCU 52739 -26.3% 38868 ± 3% softirqs.CPU42.SCHED 81408 ± 5% -17.0% 67586 ± 6% softirqs.CPU43.RCU 49997 -20.7% 39624 ± 2% softirqs.CPU43.SCHED 80917 ± 6% -14.6% 69141 ± 4% softirqs.CPU44.RCU 52401 -23.7% 39992 softirqs.CPU44.SCHED 79723 ± 5% -20.6% 63296 ± 5% softirqs.CPU45.RCU 49908 ± 2% -21.3% 39270 ± 4% softirqs.CPU45.SCHED 77980 ± 5% -17.2% 64595 ± 4% softirqs.CPU46.RCU 52903 -25.5% 39387 ± 3% softirqs.CPU46.SCHED 85498 ± 5% -15.9% 71881 ± 2% softirqs.CPU47.RCU 50522 -19.8% 40531 softirqs.CPU47.SCHED 84453 ± 4% -16.1% 70897 softirqs.CPU48.RCU 54170 -25.3% 40439 softirqs.CPU48.SCHED 83871 ± 5% -14.7% 71576 softirqs.CPU49.RCU 53961 -24.8% 40579 softirqs.CPU49.SCHED 50771 -20.3% 40449 softirqs.CPU5.SCHED 77331 ± 7% -17.0% 64198 ± 3% softirqs.CPU50.RCU 53553 -26.4% 39430 ± 3% softirqs.CPU50.SCHED 85401 ± 4% -18.2% 69828 softirqs.CPU51.RCU 53710 -25.0% 40276 softirqs.CPU51.SCHED 86122 ± 3% -15.6% 72685 ± 2% softirqs.CPU52.RCU 53929 -24.4% 40767 softirqs.CPU52.SCHED 83419 ± 3% -16.1% 69975 softirqs.CPU53.RCU 52530 ± 3% -22.0% 40993 softirqs.CPU53.SCHED 83043 ± 4% -25.6% 61776 ± 7% softirqs.CPU54.RCU 53436 -19.6% 42989 ± 4% softirqs.CPU54.SCHED 84898 ± 3% -25.7% 63065 ± 6% softirqs.CPU55.RCU 50636 -15.0% 43025 ± 4% softirqs.CPU55.SCHED 78234 ± 5% -22.6% 60534 ± 7% softirqs.CPU56.RCU 52159 -19.9% 41768 ± 3% softirqs.CPU56.SCHED 80037 ± 3% -24.1% 60719 ± 8% softirqs.CPU57.RCU 50122 -14.8% 42691 ± 4% softirqs.CPU57.SCHED 80052 ± 7% -22.6% 61984 ± 5% softirqs.CPU58.RCU 52497 -18.5% 42788 ± 4% softirqs.CPU58.SCHED 81910 ± 8% -26.1% 60498 ± 9% softirqs.CPU59.RCU 51021 -15.1% 43330 ± 4% softirqs.CPU59.SCHED 85907 ± 6% -11.3% 76167 ± 5% softirqs.CPU6.RCU 50317 ± 2% -22.4% 39063 ± 4% softirqs.CPU6.SCHED 78818 ± 5% -11.4% 69806 ± 6% softirqs.CPU60.RCU 52183 -18.5% 42515 ± 5% softirqs.CPU60.SCHED 79135 ± 7% -12.0% 69648 ± 6% softirqs.CPU61.RCU 50048 -15.0% 42541 ± 4% softirqs.CPU61.SCHED 77666 ± 4% -10.8% 69259 ± 7% softirqs.CPU62.RCU 53868 -20.4% 42904 ± 4% softirqs.CPU62.SCHED 79282 ± 6% -12.8% 69161 ± 6% softirqs.CPU63.RCU 53523 -20.3% 42680 ± 4% softirqs.CPU63.SCHED 78932 ± 6% -9.8% 71189 ± 6% softirqs.CPU64.RCU 53279 -19.7% 42805 ± 4% softirqs.CPU64.SCHED 53701 -19.9% 43005 ± 4% softirqs.CPU65.SCHED 83994 ± 7% -11.5% 74344 ± 8% softirqs.CPU66.RCU 53514 -19.4% 43157 ± 4% softirqs.CPU66.SCHED 83267 ± 8% -11.5% 73723 ± 8% softirqs.CPU67.RCU 53387 -19.3% 43095 ± 4% softirqs.CPU67.SCHED 52930 -19.4% 42663 ± 4% softirqs.CPU68.SCHED 53164 -18.9% 43096 ± 4% softirqs.CPU69.SCHED 49583 -19.3% 40012 ± 3% softirqs.CPU7.SCHED 53810 -19.9% 43078 ± 4% softirqs.CPU70.SCHED 83169 ± 7% -11.8% 73349 ± 6% softirqs.CPU71.RCU 53193 ± 2% -23.2% 40837 ± 3% softirqs.CPU71.SCHED 49783 -19.6% 40047 softirqs.CPU8.SCHED 49908 ± 2% -19.8% 40046 ± 5% softirqs.CPU9.SCHED 11576 ± 3% -8.9% 10551 ± 3% softirqs.NET_RX 5953330 ± 6% -15.5% 5030569 ± 5% softirqs.RCU 3687811 -19.2% 2980752 softirqs.SCHED 9641423 ± 3% -14.4% 8254862 ± 3% softirqs.TIMER 3.56 ± 10% -1.3 2.30 ± 5% perf-profile.calltrace.cycles-pp.xfs_log_force_lsn.xfs_file_fsync.do_fsync.__x64_sys_fsync.do_syscall_64 1.37 ± 20% -0.9 0.51 ± 58% perf-profile.calltrace.cycles-pp.schedule.worker_thread.kthread.ret_from_fork 1.35 ± 20% -0.9 0.49 ± 58% perf-profile.calltrace.cycles-pp.__schedule.schedule.worker_thread.kthread.ret_from_fork 1.78 ± 10% -0.8 1.02 ± 9% perf-profile.calltrace.cycles-pp.xlog_cil_force_lsn.xfs_log_force_lsn.xfs_file_fsync.do_fsync.__x64_sys_fsync 2.10 ± 8% -0.7 1.45 ± 3% perf-profile.calltrace.cycles-pp.__xfs_log_force_lsn.xfs_file_fsync.do_fsync.__x64_sys_fsync.do_syscall_64 1.75 ± 9% -0.5 1.25 ± 4% perf-profile.calltrace.cycles-pp.__xfs_log_force_lsn.xfs_log_force_lsn.xfs_file_fsync.do_fsync.__x64_sys_fsync 1.16 ± 9% -0.4 0.72 ± 7% perf-profile.calltrace.cycles-pp.__flush_work.xlog_cil_force_lsn.xfs_log_force_lsn.xfs_file_fsync.do_fsync 0.65 ± 12% -0.4 0.28 ±100% perf-profile.calltrace.cycles-pp.xfs_trans_read_buf_map.xfs_read_agi.xfs_ialloc_read_agi.xfs_dialloc.xfs_ialloc 1.23 ± 10% -0.3 0.90 ± 4% perf-profile.calltrace.cycles-pp.xlog_wait.__xfs_log_force_lsn.xfs_log_force_lsn.xfs_file_fsync.do_fsync 0.71 ± 11% -0.3 0.45 ± 58% perf-profile.calltrace.cycles-pp.xfs_ialloc_read_agi.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create 0.68 ± 11% -0.3 0.41 ± 58% perf-profile.calltrace.cycles-pp.xfs_read_agi.xfs_ialloc_read_agi.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc 0.76 ± 8% -0.2 0.60 ± 6% perf-profile.calltrace.cycles-pp.remove_wait_queue.__xfs_log_force_lsn.xfs_file_fsync.do_fsync.__x64_sys_fsync 0.74 ± 9% -0.1 0.59 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.remove_wait_queue.__xfs_log_force_lsn.xfs_file_fsync.do_fsync 0.71 ± 8% -0.1 0.57 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.remove_wait_queue.__xfs_log_force_lsn.xfs_file_fsync 0.61 ± 13% +0.2 0.78 ± 6% perf-profile.calltrace.cycles-pp.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range 1.70 ± 7% +0.2 1.93 ± 3% perf-profile.calltrace.cycles-pp.xfs_dir2_node_addname.xfs_dir_createname.xfs_create.xfs_generic_create.path_openat 1.82 ± 7% +0.2 2.06 ± 2% perf-profile.calltrace.cycles-pp.xfs_dir_createname.xfs_create.xfs_generic_create.path_openat.do_filp_open 0.41 ± 57% +0.3 0.70 ± 9% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.64 ± 11% +0.3 0.95 ± 9% perf-profile.calltrace.cycles-pp.__mark_inode_dirty.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply 0.58 ± 9% +0.3 0.89 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.locked_inode_to_wb_and_lock_list.__mark_inode_dirty.iomap_set_page_dirty 0.73 ± 11% +0.3 1.04 ± 7% perf-profile.calltrace.cycles-pp.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 0.61 ± 10% +0.3 0.92 ± 9% perf-profile.calltrace.cycles-pp.locked_inode_to_wb_and_lock_list.__mark_inode_dirty.iomap_set_page_dirty.iomap_write_end.iomap_write_actor 0.59 ± 11% +0.3 0.91 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock.locked_inode_to_wb_and_lock_list.__mark_inode_dirty.iomap_set_page_dirty.iomap_write_end 0.84 ± 10% +0.3 1.17 ± 6% perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 1.91 ± 4% +0.3 2.25 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.26 ±100% +0.4 0.61 ± 6% perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_addname.xfs_dir_createname.xfs_create.xfs_generic_create 1.81 ± 9% +0.5 2.28 ± 4% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 0.17 ±173% +0.5 0.66 ± 7% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages 0.17 ±173% +0.5 0.67 ± 7% perf-profile.calltrace.cycles-pp.submit_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range 0.00 +0.5 0.54 ± 5% perf-profile.calltrace.cycles-pp.__percpu_counter_compare.xfs_mod_ifree.xfs_trans_unreserve_and_mod_sb.xfs_log_commit_cil.__xfs_trans_commit 2.09 ± 9% +0.6 2.65 ± 4% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write 2.10 ± 9% +0.6 2.66 ± 4% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 2.23 ± 8% +0.6 2.80 ± 4% perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 0.13 ±173% +0.6 0.72 ± 15% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 2.26 ± 8% +0.6 2.85 ± 4% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.32 ± 8% +0.6 2.93 ± 4% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.34 ± 8% +0.6 2.95 ± 4% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.09 ± 7% +0.8 5.85 ± 7% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry 0.00 +1.0 1.03 ± 7% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 4.49 -1.9 2.58 ± 6% perf-profile.children.cycles-pp.schedule 5.77 -1.8 3.94 ± 8% perf-profile.children.cycles-pp.__schedule 3.23 ± 4% -1.8 1.45 ± 8% perf-profile.children.cycles-pp.pick_next_task_fair 2.76 ± 5% -1.7 1.03 ± 6% perf-profile.children.cycles-pp.load_balance 2.38 ± 5% -1.5 0.86 ± 6% perf-profile.children.cycles-pp.find_busiest_group 2.30 ± 6% -1.5 0.82 ± 5% perf-profile.children.cycles-pp.update_sd_lb_stats 3.56 ± 10% -1.3 2.30 ± 5% perf-profile.children.cycles-pp.xfs_log_force_lsn 3.85 ± 8% -1.2 2.69 ± 2% perf-profile.children.cycles-pp.__xfs_log_force_lsn 1.78 ± 10% -0.8 1.02 ± 9% perf-profile.children.cycles-pp.xlog_cil_force_lsn 1.17 ± 9% -0.4 0.72 ± 7% perf-profile.children.cycles-pp.__flush_work 3.47 ± 4% -0.4 3.04 ± 4% perf-profile.children.cycles-pp._raw_spin_lock 1.13 ± 11% -0.4 0.71 ± 8% perf-profile.children.cycles-pp.schedule_timeout 1.66 ± 9% -0.3 1.32 ± 3% perf-profile.children.cycles-pp.remove_wait_queue 1.23 ± 10% -0.3 0.90 ± 4% perf-profile.children.cycles-pp.xlog_wait 0.80 ± 10% -0.3 0.46 ± 5% perf-profile.children.cycles-pp.wait_for_completion 2.36 ± 7% -0.3 2.03 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.47 ± 7% -0.2 0.22 ± 8% perf-profile.children.cycles-pp.idle_cpu 0.50 ± 23% -0.2 0.31 ± 10% perf-profile.children.cycles-pp.update_blocked_averages 0.52 ± 10% -0.2 0.33 ± 17% perf-profile.children.cycles-pp.down_read 0.39 ± 9% -0.2 0.23 ± 15% perf-profile.children.cycles-pp.call_rwsem_down_read_failed 0.38 ± 8% -0.2 0.23 ± 15% perf-profile.children.cycles-pp.rwsem_down_read_failed 0.68 ± 11% -0.2 0.52 ± 10% perf-profile.children.cycles-pp.xfs_read_agi 0.72 ± 9% -0.1 0.57 ± 10% perf-profile.children.cycles-pp.memcpy_erms 0.71 ± 11% -0.1 0.57 ± 10% perf-profile.children.cycles-pp.xfs_ialloc_read_agi 0.47 ± 3% -0.1 0.34 ± 10% perf-profile.children.cycles-pp.update_rq_clock 0.24 ± 5% -0.1 0.11 ± 10% perf-profile.children.cycles-pp.cpumask_next_and 0.46 ± 13% -0.1 0.34 ± 12% perf-profile.children.cycles-pp.xfs_buf_lock 0.43 ± 14% -0.1 0.32 ± 13% perf-profile.children.cycles-pp.__down 0.29 ± 11% -0.1 0.17 ± 21% perf-profile.children.cycles-pp.__update_load_avg_se 0.43 ± 13% -0.1 0.32 ± 14% perf-profile.children.cycles-pp.down 0.35 ± 7% -0.1 0.24 ± 24% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.38 ± 11% -0.1 0.28 ± 4% perf-profile.children.cycles-pp.xfs_cil_prepare_item 0.18 ± 8% -0.1 0.09 ± 9% perf-profile.children.cycles-pp.find_next_and_bit 0.53 ± 9% -0.1 0.44 ± 5% perf-profile.children.cycles-pp.io_schedule 0.26 ± 11% -0.1 0.18 ± 5% perf-profile.children.cycles-pp.xfs_buf_item_pin 0.38 ± 5% -0.1 0.31 ± 9% perf-profile.children.cycles-pp.update_curr 0.19 ± 16% -0.1 0.12 ± 15% perf-profile.children.cycles-pp.switch_mm 0.18 ± 6% -0.1 0.13 ± 11% perf-profile.children.cycles-pp.__list_add_valid 0.12 ± 8% -0.1 0.07 ± 58% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.10 ± 8% -0.0 0.05 ± 58% perf-profile.children.cycles-pp.cpuacct_charge 0.14 ± 20% -0.0 0.10 ± 27% perf-profile.children.cycles-pp.account_entity_enqueue 0.17 ± 18% -0.0 0.13 ± 3% perf-profile.children.cycles-pp.xfs_verify_agbno 0.10 ± 15% -0.0 0.06 ± 20% perf-profile.children.cycles-pp.xfs_buf_reverify 0.07 ± 5% -0.0 0.05 ± 9% perf-profile.children.cycles-pp.xfs_iext_get_extent 0.07 ± 17% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.security_d_instantiate 0.09 ± 7% +0.0 0.11 ± 7% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.08 ± 8% +0.0 0.11 ± 12% perf-profile.children.cycles-pp.blk_mq_get_request 0.04 ± 57% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.xfs_bmap_longest_free_extent 0.11 ± 9% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.xfs_trans_brelse 0.11 ± 9% +0.0 0.14 ± 7% perf-profile.children.cycles-pp.entry_SYSCALL_64 0.07 ± 11% +0.0 0.10 ± 10% perf-profile.children.cycles-pp.xfs_buf_item_put 0.07 ± 13% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.08 ± 8% +0.0 0.11 ± 9% perf-profile.children.cycles-pp.xfs_fs_inode_init_once 0.26 ± 8% +0.0 0.29 ± 2% perf-profile.children.cycles-pp.native_irq_return_iret 0.10 ± 15% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.__might_sleep 0.10 ± 11% +0.0 0.14 ± 11% perf-profile.children.cycles-pp.rcu_eqs_enter 0.07 ± 22% +0.0 0.11 ± 20% perf-profile.children.cycles-pp.xlog_ungrant_log_space 0.04 ± 63% +0.0 0.08 ± 21% perf-profile.children.cycles-pp.d_lru_add 0.08 ± 15% +0.0 0.12 ± 12% perf-profile.children.cycles-pp.resched_curr 0.10 ± 8% +0.0 0.15 ± 7% perf-profile.children.cycles-pp.xfs_dir3_free_bests_p 0.15 ± 7% +0.0 0.19 ± 9% perf-profile.children.cycles-pp.xfs_dir3_free_hdr_from_disk 0.01 ±173% +0.0 0.06 ± 14% perf-profile.children.cycles-pp.deactivate_task 0.16 ± 10% +0.0 0.21 ± 10% perf-profile.children.cycles-pp.nr_iowait_cpu 0.07 ± 26% +0.0 0.12 ± 11% perf-profile.children.cycles-pp._raw_spin_trylock 0.07 ± 14% +0.0 0.12 ± 20% perf-profile.children.cycles-pp.__d_lookup 0.14 ± 25% +0.0 0.19 ± 6% perf-profile.children.cycles-pp.native_apic_msr_eoi_write 0.09 ± 14% +0.0 0.14 ± 16% perf-profile.children.cycles-pp.d_lookup 0.19 ± 14% +0.0 0.24 ± 10% perf-profile.children.cycles-pp.update_ts_time_stats 0.25 ± 10% +0.1 0.30 ± 8% perf-profile.children.cycles-pp.native_sched_clock 0.01 ±173% +0.1 0.07 ± 23% perf-profile.children.cycles-pp.calc_global_load_tick 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.complete_walk 0.26 ± 12% +0.1 0.31 ± 8% perf-profile.children.cycles-pp.sched_clock 0.16 ± 6% +0.1 0.22 ± 13% perf-profile.children.cycles-pp._cond_resched 0.04 ±100% +0.1 0.09 ± 17% perf-profile.children.cycles-pp.xfs_iflush_int 0.04 ± 58% +0.1 0.10 ± 13% perf-profile.children.cycles-pp.available_idle_cpu 0.29 ± 13% +0.1 0.35 ± 10% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly 0.31 ± 9% +0.1 0.37 ± 5% perf-profile.children.cycles-pp.sched_clock_cpu 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.xfs_allocbt_init_cursor 0.01 ±173% +0.1 0.08 ± 14% perf-profile.children.cycles-pp.list_lru_add 0.15 ± 7% +0.1 0.22 ± 20% perf-profile.children.cycles-pp.__next_timer_interrupt 0.07 ± 10% +0.1 0.13 ± 13% perf-profile.children.cycles-pp.pm_qos_request 0.38 ± 6% +0.1 0.45 perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.13 ± 11% +0.1 0.20 ± 13% perf-profile.children.cycles-pp.find_next_bit 0.01 ±173% +0.1 0.08 ± 8% perf-profile.children.cycles-pp.cpumask_next 0.01 ±173% +0.1 0.08 ± 5% perf-profile.children.cycles-pp.xfs_buf_delwri_submit_buffers 0.48 ± 3% +0.1 0.55 ± 4% perf-profile.children.cycles-pp.__percpu_counter_sum 0.70 ± 7% +0.1 0.78 ± 6% perf-profile.children.cycles-pp.xfs_da3_node_read 0.27 ± 14% +0.1 0.35 ± 6% perf-profile.children.cycles-pp._xfs_buf_ioapply 0.28 ± 5% +0.1 0.36 ± 14% perf-profile.children.cycles-pp.set_next_entity 0.50 ± 3% +0.1 0.58 ± 4% perf-profile.children.cycles-pp.__percpu_counter_compare 0.30 ± 12% +0.1 0.38 ± 6% perf-profile.children.cycles-pp.__xfs_buf_submit 0.65 ± 5% +0.1 0.73 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc 0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.set_task_cpu 0.41 ± 9% +0.1 0.50 ± 3% perf-profile.children.cycles-pp.kmem_zone_alloc 0.30 ± 13% +0.1 0.40 ± 10% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.31 ± 13% +0.1 0.41 ± 11% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic 0.30 ± 14% +0.1 0.40 ± 10% perf-profile.children.cycles-pp.copyin 0.25 ± 5% +0.1 0.36 ± 25% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 0.34 ± 16% +0.1 0.46 ± 4% perf-profile.children.cycles-pp.tick_irq_enter 0.13 ± 43% +0.1 0.25 ± 11% perf-profile.children.cycles-pp.xfsaild 0.08 ± 6% +0.1 0.20 ± 15% perf-profile.children.cycles-pp.select_idle_sibling 0.22 ± 5% +0.1 0.37 ± 17% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.48 ± 9% +0.1 0.63 ± 10% perf-profile.children.cycles-pp.blk_mq_make_request 1.25 ± 9% +0.2 1.40 ± 4% perf-profile.children.cycles-pp.xfs_da3_node_lookup_int 0.42 ± 14% +0.2 0.59 ± 5% perf-profile.children.cycles-pp.irq_enter 0.38 ± 7% +0.2 0.54 ± 11% perf-profile.children.cycles-pp.tick_nohz_next_event 0.70 ± 12% +0.2 0.87 ± 6% perf-profile.children.cycles-pp.generic_make_request 0.61 ± 13% +0.2 0.78 ± 6% perf-profile.children.cycles-pp.xfs_submit_ioend 0.71 ± 12% +0.2 0.88 ± 6% perf-profile.children.cycles-pp.submit_bio 0.53 ± 6% +0.2 0.72 ± 11% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 1.70 ± 7% +0.2 1.93 ± 3% perf-profile.children.cycles-pp.xfs_dir2_node_addname 1.82 ± 7% +0.2 2.06 ± 2% perf-profile.children.cycles-pp.xfs_dir_createname 0.47 ± 14% +0.3 0.77 ± 16% perf-profile.children.cycles-pp.clockevents_program_event 0.73 ± 11% +0.3 1.04 ± 7% perf-profile.children.cycles-pp.iomap_set_page_dirty 0.63 ± 7% +0.3 0.94 ± 9% perf-profile.children.cycles-pp.locked_inode_to_wb_and_lock_list 0.65 ± 10% +0.3 0.97 ± 9% perf-profile.children.cycles-pp.__mark_inode_dirty 0.84 ± 10% +0.3 1.17 ± 6% perf-profile.children.cycles-pp.iomap_write_end 1.94 ± 4% +0.4 2.31 ± 7% perf-profile.children.cycles-pp.menu_select 0.65 ± 7% +0.4 1.07 ± 14% perf-profile.children.cycles-pp.ktime_get 1.81 ± 9% +0.5 2.28 ± 4% perf-profile.children.cycles-pp.iomap_write_actor 2.09 ± 9% +0.6 2.65 ± 4% perf-profile.children.cycles-pp.iomap_apply 2.10 ± 9% +0.6 2.66 ± 4% perf-profile.children.cycles-pp.iomap_file_buffered_write 2.23 ± 8% +0.6 2.80 ± 4% perf-profile.children.cycles-pp.xfs_file_buffered_aio_write 2.26 ± 9% +0.6 2.86 ± 4% perf-profile.children.cycles-pp.new_sync_write 2.33 ± 8% +0.6 2.94 ± 4% perf-profile.children.cycles-pp.vfs_write 2.35 ± 8% +0.6 2.96 ± 4% perf-profile.children.cycles-pp.ksys_write 0.42 ± 21% +0.6 1.04 ± 7% perf-profile.children.cycles-pp.poll_idle 5.46 ± 9% +0.8 6.25 ± 7% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 6.03 ± 7% +0.8 6.86 ± 7% perf-profile.children.cycles-pp.apic_timer_interrupt 1.70 ± 5% -1.1 0.57 ± 5% perf-profile.self.cycles-pp.update_sd_lb_stats 0.45 ± 8% -0.2 0.22 ± 9% perf-profile.self.cycles-pp.idle_cpu 1.31 -0.2 1.09 ± 3% perf-profile.self.cycles-pp._raw_spin_lock 0.37 ± 8% -0.2 0.17 ± 26% perf-profile.self.cycles-pp.try_to_wake_up 0.71 ± 8% -0.2 0.54 ± 6% perf-profile.self.cycles-pp.memcpy_erms 0.39 ± 2% -0.2 0.24 ± 12% perf-profile.self.cycles-pp.update_rq_clock 0.23 ± 11% -0.1 0.11 ± 6% perf-profile.self.cycles-pp.load_balance 0.27 ± 12% -0.1 0.16 ± 23% perf-profile.self.cycles-pp.__update_load_avg_se 0.33 ± 8% -0.1 0.23 ± 26% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.29 ± 12% -0.1 0.19 ± 16% perf-profile.self.cycles-pp.xlog_write 0.17 ± 8% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.find_next_and_bit 0.18 ± 29% -0.1 0.10 ± 14% perf-profile.self.cycles-pp.update_blocked_averages 0.25 ± 10% -0.1 0.18 ± 6% perf-profile.self.cycles-pp.xfs_buf_item_pin 0.39 ± 8% -0.1 0.32 ± 9% perf-profile.self.cycles-pp.do_idle 0.67 ± 4% -0.1 0.60 ± 11% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.09 ± 21% -0.1 0.03 ±100% perf-profile.self.cycles-pp.find_busiest_group 0.10 ± 14% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.xlog_cil_force_lsn 0.18 ± 7% -0.1 0.12 ± 11% perf-profile.self.cycles-pp.__list_add_valid 0.12 ± 8% -0.1 0.07 ± 58% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.10 ± 11% -0.0 0.05 ± 58% perf-profile.self.cycles-pp.cpuacct_charge 0.14 ± 20% -0.0 0.10 ± 27% perf-profile.self.cycles-pp.account_entity_enqueue 0.22 ± 8% -0.0 0.18 ± 15% perf-profile.self.cycles-pp.pick_next_task_fair 0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.__flush_work 0.10 ± 15% -0.0 0.06 ± 20% perf-profile.self.cycles-pp.xfs_buf_reverify 0.15 ± 11% -0.0 0.12 ± 5% perf-profile.self.cycles-pp.__xfs_log_force_lsn 0.07 ± 12% -0.0 0.05 perf-profile.self.cycles-pp.xfs_iext_get_extent 0.08 ± 8% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.percpu_counter_add_batch 0.04 ± 58% +0.0 0.07 perf-profile.self.cycles-pp.rcu_core 0.04 ± 58% +0.0 0.07 ± 10% perf-profile.self.cycles-pp.rcu_idle_exit 0.11 ± 11% +0.0 0.14 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64 0.07 ± 17% +0.0 0.10 ± 15% perf-profile.self.cycles-pp.__next_timer_interrupt 0.04 ± 58% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.cpuidle_governor_latency_req 0.08 ± 15% +0.0 0.11 ± 17% perf-profile.self.cycles-pp.tick_nohz_next_event 0.08 ± 13% +0.0 0.12 ± 11% perf-profile.self.cycles-pp.xfs_dir3_free_bests_p 0.12 ± 5% +0.0 0.15 ± 7% perf-profile.self.cycles-pp.xfs_dir3_free_hdr_from_disk 0.09 ± 8% +0.0 0.13 ± 13% perf-profile.self.cycles-pp.rcu_eqs_enter 0.04 ± 58% +0.0 0.08 ± 15% perf-profile.self.cycles-pp.note_gp_changes 0.11 ± 9% +0.0 0.15 ± 14% perf-profile.self.cycles-pp.set_next_entity 0.07 ± 19% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.__might_sleep 0.16 ± 9% +0.0 0.20 ± 9% perf-profile.self.cycles-pp.nr_iowait_cpu 0.07 ± 26% +0.0 0.11 ± 9% perf-profile.self.cycles-pp._raw_spin_trylock 0.08 ± 19% +0.0 0.12 ± 12% perf-profile.self.cycles-pp.resched_curr 0.01 ±173% +0.0 0.06 ± 14% perf-profile.self.cycles-pp.deactivate_task 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.xfs_buf_item_unlock 0.12 ± 10% +0.1 0.17 ± 16% perf-profile.self.cycles-pp.find_next_bit 0.04 ± 58% +0.1 0.10 ± 13% perf-profile.self.cycles-pp.available_idle_cpu 0.24 ± 12% +0.1 0.29 ± 9% perf-profile.self.cycles-pp.native_sched_clock 0.36 ± 7% +0.1 0.42 perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.07 ± 6% +0.1 0.13 ± 11% perf-profile.self.cycles-pp.pm_qos_request 0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.calc_global_load_tick 0.30 ± 13% +0.1 0.38 ± 10% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.83 ± 7% +0.1 0.92 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state 0.30 ± 3% +0.4 0.70 ± 21% perf-profile.self.cycles-pp.ktime_get 0.33 ± 18% +0.6 0.91 ± 8% perf-profile.self.cycles-pp.poll_idle 422504 ± 8% -42.9% 241213 ± 52% interrupts.189:IR-PCI-MSI.67633153-edge.nvme0q1 430891 -47.1% 228051 ± 49% interrupts.192:IR-PCI-MSI.67633156-edge.nvme0q4 247370 -45.1% 135845 ± 46% interrupts.201:IR-PCI-MSI.67633165-edge.nvme0q13 260793 ± 3% +51.2% 394197 ± 20% interrupts.212:IR-PCI-MSI.67633176-edge.nvme0q24 261144 ± 3% +47.5% 385242 ± 18% interrupts.216:IR-PCI-MSI.67633180-edge.nvme0q28 268.00 ± 42% -34.0% 176.75 ± 11% interrupts.38:IR-PCI-MSI.1572868-edge.eth0-TxRx-4 438.00 ± 55% -58.3% 182.75 ± 8% interrupts.47:IR-PCI-MSI.1572877-edge.eth0-TxRx-13 253.25 ± 37% +47.7% 374.00 ± 22% interrupts.49:IR-PCI-MSI.1572879-edge.eth0-TxRx-15 167.75 -12.8% 146.25 ± 2% interrupts.50:IR-PCI-MSI.1572880-edge.eth0-TxRx-16 167.75 -12.8% 146.25 ± 3% interrupts.51:IR-PCI-MSI.1572881-edge.eth0-TxRx-17 216.25 ± 37% -34.1% 142.50 interrupts.52:IR-PCI-MSI.1572882-edge.eth0-TxRx-18 194.75 ± 19% -26.8% 142.50 interrupts.53:IR-PCI-MSI.1572883-edge.eth0-TxRx-19 172.25 -17.3% 142.50 interrupts.54:IR-PCI-MSI.1572884-edge.eth0-TxRx-20 169.00 -14.9% 143.75 interrupts.55:IR-PCI-MSI.1572885-edge.eth0-TxRx-21 206.75 ± 29% -31.1% 142.50 interrupts.56:IR-PCI-MSI.1572886-edge.eth0-TxRx-22 181.00 ± 9% -21.3% 142.50 interrupts.57:IR-PCI-MSI.1572887-edge.eth0-TxRx-23 168.75 -15.6% 142.50 interrupts.58:IR-PCI-MSI.1572888-edge.eth0-TxRx-24 178.25 ± 7% -20.1% 142.50 interrupts.59:IR-PCI-MSI.1572889-edge.eth0-TxRx-25 187.25 ± 6% -23.8% 142.75 interrupts.60:IR-PCI-MSI.1572890-edge.eth0-TxRx-26 178.50 ± 4% -20.2% 142.50 interrupts.61:IR-PCI-MSI.1572891-edge.eth0-TxRx-27 176.00 ± 2% -19.0% 142.50 interrupts.62:IR-PCI-MSI.1572892-edge.eth0-TxRx-28 169.25 -15.7% 142.75 interrupts.63:IR-PCI-MSI.1572893-edge.eth0-TxRx-29 168.75 -15.6% 142.50 interrupts.64:IR-PCI-MSI.1572894-edge.eth0-TxRx-30 176.50 ± 3% -19.1% 142.75 interrupts.65:IR-PCI-MSI.1572895-edge.eth0-TxRx-31 168.50 -15.4% 142.50 interrupts.66:IR-PCI-MSI.1572896-edge.eth0-TxRx-32 178.25 ± 10% -20.1% 142.50 interrupts.67:IR-PCI-MSI.1572897-edge.eth0-TxRx-33 182.00 ± 13% -21.7% 142.50 interrupts.68:IR-PCI-MSI.1572898-edge.eth0-TxRx-34 167.75 -15.1% 142.50 interrupts.69:IR-PCI-MSI.1572899-edge.eth0-TxRx-35 167.75 -14.0% 144.25 interrupts.71:IR-PCI-MSI.1572901-edge.eth0-TxRx-37 167.75 -12.8% 146.25 ± 3% interrupts.74:IR-PCI-MSI.1572902-edge.eth0-TxRx-38 170.25 -14.8% 145.00 interrupts.75:IR-PCI-MSI.1572903-edge.eth0-TxRx-39 167.75 -14.0% 144.25 ± 2% interrupts.76:IR-PCI-MSI.1572904-edge.eth0-TxRx-40 167.75 -13.1% 145.75 interrupts.77:IR-PCI-MSI.1572905-edge.eth0-TxRx-41 167.75 -12.5% 146.75 ± 4% interrupts.78:IR-PCI-MSI.1572906-edge.eth0-TxRx-42 176.25 ± 5% -17.6% 145.25 interrupts.80:IR-PCI-MSI.1572908-edge.eth0-TxRx-44 170.50 -14.2% 146.25 ± 2% interrupts.81:IR-PCI-MSI.1572909-edge.eth0-TxRx-45 168.25 -14.3% 144.25 ± 2% interrupts.84:IR-PCI-MSI.1572912-edge.eth0-TxRx-48 170.50 ± 2% -15.4% 144.25 ± 2% interrupts.85:IR-PCI-MSI.1572913-edge.eth0-TxRx-49 171.25 ± 3% -13.7% 147.75 ± 5% interrupts.87:IR-PCI-MSI.1572915-edge.eth0-TxRx-51 169.75 ± 2% -12.1% 149.25 ± 6% interrupts.88:IR-PCI-MSI.1572916-edge.eth0-TxRx-52 167.75 -10.6% 150.00 ± 6% interrupts.89:IR-PCI-MSI.1572917-edge.eth0-TxRx-53 178.75 ± 9% -20.3% 142.50 interrupts.90:IR-PCI-MSI.1572918-edge.eth0-TxRx-54 171.50 ± 2% -16.9% 142.50 interrupts.91:IR-PCI-MSI.1572919-edge.eth0-TxRx-55 172.75 ± 4% -17.5% 142.50 interrupts.92:IR-PCI-MSI.1572920-edge.eth0-TxRx-56 168.25 -15.3% 142.50 interrupts.93:IR-PCI-MSI.1572921-edge.eth0-TxRx-57 228.00 ± 44% -37.5% 142.50 interrupts.94:IR-PCI-MSI.1572922-edge.eth0-TxRx-58 169.00 -15.7% 142.50 interrupts.95:IR-PCI-MSI.1572923-edge.eth0-TxRx-59 171.00 ± 2% -16.7% 142.50 interrupts.96:IR-PCI-MSI.1572924-edge.eth0-TxRx-60 170.00 -16.2% 142.50 interrupts.97:IR-PCI-MSI.1572925-edge.eth0-TxRx-61 168.50 -15.4% 142.50 interrupts.98:IR-PCI-MSI.1572926-edge.eth0-TxRx-62 229718 ± 7% -15.7% 193607 ± 2% interrupts.CAL:Function_call_interrupts 3235 ± 11% -16.4% 2705 ± 4% interrupts.CPU0.CAL:Function_call_interrupts 26590 ± 12% -60.1% 10610 ± 52% interrupts.CPU0.RES:Rescheduling_interrupts 22410 ± 4% -62.3% 8442 ± 46% interrupts.CPU1.RES:Rescheduling_interrupts 101.25 ± 21% -76.8% 23.50 ± 55% interrupts.CPU1.TLB:TLB_shootdowns 3227 ± 12% -14.6% 2755 ± 4% interrupts.CPU10.CAL:Function_call_interrupts 816.50 ± 36% -69.0% 253.00 ± 69% interrupts.CPU10.NMI:Non-maskable_interrupts 816.50 ± 36% -69.0% 253.00 ± 69% interrupts.CPU10.PMI:Performance_monitoring_interrupts 21079 ± 3% -69.2% 6484 ± 50% interrupts.CPU10.RES:Rescheduling_interrupts 3201 ± 10% -13.9% 2755 ± 5% interrupts.CPU11.CAL:Function_call_interrupts 18901 ± 7% -68.6% 5942 ± 48% interrupts.CPU11.RES:Rescheduling_interrupts 20101 ± 2% -67.7% 6491 ± 55% interrupts.CPU12.RES:Rescheduling_interrupts 438.00 ± 55% -58.3% 182.75 ± 8% interrupts.CPU13.47:IR-PCI-MSI.1572877-edge.eth0-TxRx-13 3117 ± 13% -16.7% 2597 ± 8% interrupts.CPU13.CAL:Function_call_interrupts 19615 ± 3% -71.3% 5627 ± 50% interrupts.CPU13.RES:Rescheduling_interrupts 3174 ± 6% -17.9% 2605 ± 2% interrupts.CPU14.CAL:Function_call_interrupts 20369 ± 2% -71.9% 5713 ± 49% interrupts.CPU14.RES:Rescheduling_interrupts 253.25 ± 37% +47.7% 374.00 ± 22% interrupts.CPU15.49:IR-PCI-MSI.1572879-edge.eth0-TxRx-15 3243 ± 11% -15.0% 2755 ± 3% interrupts.CPU15.CAL:Function_call_interrupts 20403 ± 3% -71.5% 5814 ± 47% interrupts.CPU15.RES:Rescheduling_interrupts 167.75 -12.8% 146.25 ± 2% interrupts.CPU16.50:IR-PCI-MSI.1572880-edge.eth0-TxRx-16 3226 ± 11% -16.7% 2687 ± 4% interrupts.CPU16.CAL:Function_call_interrupts 20912 ± 4% -73.5% 5540 ± 49% interrupts.CPU16.RES:Rescheduling_interrupts 167.75 -12.8% 146.25 ± 3% interrupts.CPU17.51:IR-PCI-MSI.1572881-edge.eth0-TxRx-17 3176 ± 11% -19.9% 2545 ± 10% interrupts.CPU17.CAL:Function_call_interrupts 21361 ± 6% -72.6% 5844 ± 54% interrupts.CPU17.RES:Rescheduling_interrupts 216.25 ± 37% -34.1% 142.50 interrupts.CPU18.52:IR-PCI-MSI.1572882-edge.eth0-TxRx-18 3179 ± 10% -19.5% 2559 ± 3% interrupts.CPU18.CAL:Function_call_interrupts 194.75 ± 19% -26.8% 142.50 interrupts.CPU19.53:IR-PCI-MSI.1572883-edge.eth0-TxRx-19 3514 ± 6% -23.0% 2704 ± 3% interrupts.CPU19.CAL:Function_call_interrupts 23250 ± 5% -62.0% 8828 ± 49% interrupts.CPU2.RES:Rescheduling_interrupts 172.25 -17.3% 142.50 interrupts.CPU20.54:IR-PCI-MSI.1572884-edge.eth0-TxRx-20 3222 ± 5% -16.9% 2677 ± 3% interrupts.CPU20.CAL:Function_call_interrupts 169.00 -14.9% 143.75 interrupts.CPU21.55:IR-PCI-MSI.1572885-edge.eth0-TxRx-21 3226 ± 10% -18.4% 2632 ± 3% interrupts.CPU21.CAL:Function_call_interrupts 206.75 ± 29% -31.1% 142.50 interrupts.CPU22.56:IR-PCI-MSI.1572886-edge.eth0-TxRx-22 3155 ± 2% -17.4% 2606 ± 5% interrupts.CPU22.CAL:Function_call_interrupts 181.00 ± 9% -21.3% 142.50 interrupts.CPU23.57:IR-PCI-MSI.1572887-edge.eth0-TxRx-23 3228 ± 8% -13.9% 2779 ± 4% interrupts.CPU23.CAL:Function_call_interrupts 168.75 -15.6% 142.50 interrupts.CPU24.58:IR-PCI-MSI.1572888-edge.eth0-TxRx-24 3077 ± 6% -14.8% 2621 ± 3% interrupts.CPU24.CAL:Function_call_interrupts 178.25 ± 7% -20.1% 142.50 interrupts.CPU25.59:IR-PCI-MSI.1572889-edge.eth0-TxRx-25 3081 ± 7% -14.0% 2649 ± 3% interrupts.CPU25.CAL:Function_call_interrupts 20741 ± 2% -19.1% 16783 ± 21% interrupts.CPU25.RES:Rescheduling_interrupts 187.25 ± 6% -23.8% 142.75 interrupts.CPU26.60:IR-PCI-MSI.1572890-edge.eth0-TxRx-26 3183 ± 6% -14.0% 2739 ± 3% interrupts.CPU26.CAL:Function_call_interrupts 21304 ± 3% -21.7% 16671 ± 19% interrupts.CPU26.RES:Rescheduling_interrupts 178.50 ± 4% -20.2% 142.50 interrupts.CPU27.61:IR-PCI-MSI.1572891-edge.eth0-TxRx-27 20098 ± 2% -23.2% 15432 ± 26% interrupts.CPU27.RES:Rescheduling_interrupts 176.00 ± 2% -19.0% 142.50 interrupts.CPU28.62:IR-PCI-MSI.1572892-edge.eth0-TxRx-28 20653 ± 2% -23.6% 15784 ± 18% interrupts.CPU28.RES:Rescheduling_interrupts 169.25 -15.7% 142.75 interrupts.CPU29.63:IR-PCI-MSI.1572893-edge.eth0-TxRx-29 3174 ± 6% -15.3% 2687 ± 4% interrupts.CPU29.CAL:Function_call_interrupts 20427 ± 6% -25.6% 15189 ± 19% interrupts.CPU29.RES:Rescheduling_interrupts 3329 ± 8% -16.5% 2779 ± 7% interrupts.CPU3.CAL:Function_call_interrupts 1115 ± 23% -64.0% 401.75 ± 67% interrupts.CPU3.NMI:Non-maskable_interrupts 1115 ± 23% -64.0% 401.75 ± 67% interrupts.CPU3.PMI:Performance_monitoring_interrupts 23625 ± 3% -67.6% 7653 ± 43% interrupts.CPU3.RES:Rescheduling_interrupts 168.75 -15.6% 142.50 interrupts.CPU30.64:IR-PCI-MSI.1572894-edge.eth0-TxRx-30 3273 ± 9% -17.8% 2690 ± 4% interrupts.CPU30.CAL:Function_call_interrupts 21141 ± 5% -28.7% 15072 ± 18% interrupts.CPU30.RES:Rescheduling_interrupts 176.50 ± 3% -19.1% 142.75 interrupts.CPU31.65:IR-PCI-MSI.1572895-edge.eth0-TxRx-31 18825 ± 3% -22.2% 14637 ± 20% interrupts.CPU31.RES:Rescheduling_interrupts 168.50 -15.4% 142.50 interrupts.CPU32.66:IR-PCI-MSI.1572896-edge.eth0-TxRx-32 3079 ± 7% -14.5% 2631 ± 4% interrupts.CPU32.CAL:Function_call_interrupts 19548 ± 5% -25.7% 14528 ± 24% interrupts.CPU32.RES:Rescheduling_interrupts 178.25 ± 10% -20.1% 142.50 interrupts.CPU33.67:IR-PCI-MSI.1572897-edge.eth0-TxRx-33 3112 ± 10% -18.6% 2534 ± 2% interrupts.CPU33.CAL:Function_call_interrupts 19961 ± 4% -30.9% 13802 ± 19% interrupts.CPU33.RES:Rescheduling_interrupts 182.00 ± 13% -21.7% 142.50 interrupts.CPU34.68:IR-PCI-MSI.1572898-edge.eth0-TxRx-34 21207 ± 2% -31.7% 14495 ± 18% interrupts.CPU34.RES:Rescheduling_interrupts 167.75 -15.1% 142.50 interrupts.CPU35.69:IR-PCI-MSI.1572899-edge.eth0-TxRx-35 3208 ± 3% -18.6% 2611 ± 4% interrupts.CPU35.CAL:Function_call_interrupts 22498 ± 3% -37.1% 14146 ± 22% interrupts.CPU35.RES:Rescheduling_interrupts 422504 ± 8% -42.9% 241213 ± 52% interrupts.CPU36.189:IR-PCI-MSI.67633153-edge.nvme0q1 167.75 -14.0% 144.25 interrupts.CPU37.71:IR-PCI-MSI.1572901-edge.eth0-TxRx-37 3392 ± 9% -20.4% 2701 ± 4% interrupts.CPU37.CAL:Function_call_interrupts 24259 ± 4% -73.4% 6454 ± 50% interrupts.CPU37.RES:Rescheduling_interrupts 96.25 ± 6% -61.3% 37.25 ± 58% interrupts.CPU37.TLB:TLB_shootdowns 167.75 -12.8% 146.25 ± 3% interrupts.CPU38.74:IR-PCI-MSI.1572902-edge.eth0-TxRx-38 247370 -45.1% 135845 ± 46% interrupts.CPU39.201:IR-PCI-MSI.67633165-edge.nvme0q13 170.25 -14.8% 145.00 interrupts.CPU39.75:IR-PCI-MSI.1572903-edge.eth0-TxRx-39 268.00 ± 42% -34.0% 176.75 ± 11% interrupts.CPU4.38:IR-PCI-MSI.1572868-edge.eth0-TxRx-4 3342 ± 9% -14.6% 2853 ± 2% interrupts.CPU4.CAL:Function_call_interrupts 22865 ± 3% -65.6% 7868 ± 51% interrupts.CPU4.RES:Rescheduling_interrupts 167.75 -14.0% 144.25 ± 2% interrupts.CPU40.76:IR-PCI-MSI.1572904-edge.eth0-TxRx-40 167.75 -13.1% 145.75 interrupts.CPU41.77:IR-PCI-MSI.1572905-edge.eth0-TxRx-41 3146 ± 8% -10.3% 2822 ± 2% interrupts.CPU41.CAL:Function_call_interrupts 25503 ± 5% -66.3% 8586 ± 48% interrupts.CPU41.RES:Rescheduling_interrupts 430891 -47.1% 228051 ± 49% interrupts.CPU42.192:IR-PCI-MSI.67633156-edge.nvme0q4 167.75 -12.5% 146.75 ± 4% interrupts.CPU42.78:IR-PCI-MSI.1572906-edge.eth0-TxRx-42 3229 ± 9% -14.7% 2755 ± 2% interrupts.CPU42.CAL:Function_call_interrupts 176.25 ± 5% -17.6% 145.25 interrupts.CPU44.80:IR-PCI-MSI.1572908-edge.eth0-TxRx-44 3143 ± 7% -10.8% 2803 ± 3% interrupts.CPU44.CAL:Function_call_interrupts 170.50 -14.2% 146.25 ± 2% interrupts.CPU45.81:IR-PCI-MSI.1572909-edge.eth0-TxRx-45 3366 ± 4% -18.2% 2754 ± 5% interrupts.CPU45.CAL:Function_call_interrupts 27232 ± 3% -65.8% 9319 ± 50% interrupts.CPU45.RES:Rescheduling_interrupts 3189 ± 8% -17.7% 2624 ± 3% interrupts.CPU47.CAL:Function_call_interrupts 168.25 -14.3% 144.25 ± 2% interrupts.CPU48.84:IR-PCI-MSI.1572912-edge.eth0-TxRx-48 3190 ± 7% -18.8% 2590 ± 2% interrupts.CPU48.CAL:Function_call_interrupts 170.50 ± 2% -15.4% 144.25 ± 2% interrupts.CPU49.85:IR-PCI-MSI.1572913-edge.eth0-TxRx-49 3107 ± 9% -12.3% 2725 ± 4% interrupts.CPU49.CAL:Function_call_interrupts 3496 ± 7% -18.5% 2848 ± 4% interrupts.CPU5.CAL:Function_call_interrupts 1330 ± 23% -73.7% 349.75 ± 64% interrupts.CPU5.NMI:Non-maskable_interrupts 1330 ± 23% -73.7% 349.75 ± 64% interrupts.CPU5.PMI:Performance_monitoring_interrupts 20995 ± 2% -67.5% 6822 ± 46% interrupts.CPU5.RES:Rescheduling_interrupts 117.50 ± 12% -68.1% 37.50 ± 65% interrupts.CPU5.TLB:TLB_shootdowns 171.25 ± 3% -13.7% 147.75 ± 5% interrupts.CPU51.87:IR-PCI-MSI.1572915-edge.eth0-TxRx-51 3110 ± 8% -18.7% 2530 ± 5% interrupts.CPU51.CAL:Function_call_interrupts 169.75 ± 2% -12.1% 149.25 ± 6% interrupts.CPU52.88:IR-PCI-MSI.1572916-edge.eth0-TxRx-52 3134 ± 5% -13.5% 2712 ± 4% interrupts.CPU52.CAL:Function_call_interrupts 167.75 -10.6% 150.00 ± 6% interrupts.CPU53.89:IR-PCI-MSI.1572917-edge.eth0-TxRx-53 178.75 ± 9% -20.3% 142.50 interrupts.CPU54.90:IR-PCI-MSI.1572918-edge.eth0-TxRx-54 3131 ± 3% -10.8% 2793 interrupts.CPU54.CAL:Function_call_interrupts 5984 ± 2% +45.7% 8718 ± 17% interrupts.CPU54.RES:Rescheduling_interrupts 171.50 ± 2% -16.9% 142.50 interrupts.CPU55.91:IR-PCI-MSI.1572919-edge.eth0-TxRx-55 3175 ± 6% -14.2% 2723 ± 7% interrupts.CPU55.CAL:Function_call_interrupts 23559 ± 3% -32.2% 15973 ± 20% interrupts.CPU55.RES:Rescheduling_interrupts 172.75 ± 4% -17.5% 142.50 interrupts.CPU56.92:IR-PCI-MSI.1572920-edge.eth0-TxRx-56 3116 ± 6% -13.7% 2688 ± 2% interrupts.CPU56.CAL:Function_call_interrupts 319.75 ±173% +203.8% 971.50 ± 79% interrupts.CPU56.NMI:Non-maskable_interrupts 319.75 ±173% +203.8% 971.50 ± 79% interrupts.CPU56.PMI:Performance_monitoring_interrupts 7140 ± 4% +93.6% 13823 ± 19% interrupts.CPU56.RES:Rescheduling_interrupts 168.25 -15.3% 142.50 interrupts.CPU57.93:IR-PCI-MSI.1572921-edge.eth0-TxRx-57 3114 ± 6% -12.2% 2733 interrupts.CPU57.CAL:Function_call_interrupts 169.50 ±149% +397.1% 842.50 ± 62% interrupts.CPU57.NMI:Non-maskable_interrupts 169.50 ±149% +397.1% 842.50 ± 62% interrupts.CPU57.PMI:Performance_monitoring_interrupts 8056 ± 5% +86.4% 15014 ± 18% interrupts.CPU57.RES:Rescheduling_interrupts 228.00 ± 44% -37.5% 142.50 interrupts.CPU58.94:IR-PCI-MSI.1572922-edge.eth0-TxRx-58 3274 ± 8% -18.4% 2670 ± 2% interrupts.CPU58.CAL:Function_call_interrupts 10108 ± 4% +131.8% 23428 ± 19% interrupts.CPU58.RES:Rescheduling_interrupts 169.00 -15.7% 142.50 interrupts.CPU59.95:IR-PCI-MSI.1572923-edge.eth0-TxRx-59 3393 ± 7% -18.5% 2766 interrupts.CPU59.CAL:Function_call_interrupts 27478 -26.8% 20104 ± 19% interrupts.CPU59.RES:Rescheduling_interrupts 3244 ± 6% -15.8% 2733 ± 6% interrupts.CPU6.CAL:Function_call_interrupts 21726 ± 5% -68.1% 6938 ± 47% interrupts.CPU6.RES:Rescheduling_interrupts 171.00 ± 2% -16.7% 142.50 interrupts.CPU60.96:IR-PCI-MSI.1572924-edge.eth0-TxRx-60 3293 ± 8% -16.4% 2754 ± 3% interrupts.CPU60.CAL:Function_call_interrupts 8316 ± 4% +172.6% 22668 ± 19% interrupts.CPU60.RES:Rescheduling_interrupts 170.00 -16.2% 142.50 interrupts.CPU61.97:IR-PCI-MSI.1572925-edge.eth0-TxRx-61 3304 ± 7% -17.0% 2743 ± 2% interrupts.CPU61.CAL:Function_call_interrupts 9087 ± 3% +135.1% 21368 ± 18% interrupts.CPU61.RES:Rescheduling_interrupts 168.50 -15.4% 142.50 interrupts.CPU62.98:IR-PCI-MSI.1572926-edge.eth0-TxRx-62 3175 ± 10% -17.0% 2635 ± 4% interrupts.CPU62.CAL:Function_call_interrupts 9738 ± 5% +146.8% 24030 ± 20% interrupts.CPU62.RES:Rescheduling_interrupts 3326 ± 6% -18.9% 2698 interrupts.CPU63.CAL:Function_call_interrupts 10613 ± 4% +132.6% 24686 ± 23% interrupts.CPU63.RES:Rescheduling_interrupts 3243 ± 9% -17.2% 2685 ± 5% interrupts.CPU64.CAL:Function_call_interrupts 11144 ± 6% +140.1% 26755 ± 20% interrupts.CPU64.RES:Rescheduling_interrupts 3191 ± 9% -15.8% 2686 ± 5% interrupts.CPU65.CAL:Function_call_interrupts 11358 ± 3% +136.3% 26837 ± 19% interrupts.CPU65.RES:Rescheduling_interrupts 260793 ± 3% +51.2% 394197 ± 20% interrupts.CPU66.212:IR-PCI-MSI.67633176-edge.nvme0q24 3096 ± 7% -12.0% 2726 interrupts.CPU66.CAL:Function_call_interrupts 11325 +145.8% 27837 ± 16% interrupts.CPU66.RES:Rescheduling_interrupts 3354 ± 5% -18.0% 2751 ± 5% interrupts.CPU67.CAL:Function_call_interrupts 12209 ± 4% +134.1% 28578 ± 18% interrupts.CPU67.RES:Rescheduling_interrupts 3223 ± 3% -14.8% 2747 ± 2% interrupts.CPU68.CAL:Function_call_interrupts 11952 ± 4% +141.6% 28870 ± 18% interrupts.CPU68.RES:Rescheduling_interrupts 3182 ± 4% -10.6% 2845 ± 3% interrupts.CPU69.CAL:Function_call_interrupts 12156 ± 2% +146.5% 29970 ± 19% interrupts.CPU69.RES:Rescheduling_interrupts 3230 ± 11% -18.0% 2649 ± 4% interrupts.CPU7.CAL:Function_call_interrupts 20915 ± 4% -68.6% 6561 ± 49% interrupts.CPU7.RES:Rescheduling_interrupts 261144 ± 3% +47.5% 385242 ± 18% interrupts.CPU70.216:IR-PCI-MSI.67633180-edge.nvme0q28 3264 ± 9% -18.2% 2669 ± 5% interrupts.CPU70.CAL:Function_call_interrupts 12011 ± 6% +138.9% 28690 ± 20% interrupts.CPU70.RES:Rescheduling_interrupts 10586 ± 4% +160.7% 27601 ± 20% interrupts.CPU71.RES:Rescheduling_interrupts 3230 ± 11% -37.5% 2018 ± 36% interrupts.CPU8.CAL:Function_call_interrupts 21120 ± 3% -69.5% 6444 ± 50% interrupts.CPU8.RES:Rescheduling_interrupts 3077 ± 3% -12.1% 2706 ± 2% interrupts.CPU9.CAL:Function_call_interrupts 18321 ± 4% -61.6% 7044 ± 66% interrupts.CPU9.RES:Rescheduling_interrupts 113.50 ± 6% -70.0% 34.00 ± 75% interrupts.CPU9.TLB:TLB_shootdowns 1200165 -15.3% 1016492 interrupts.RES:Rescheduling_interrupts 1416 ± 3% -33.2% 945.75 ± 18% interrupts.TLB:TLB_shootdowns *************************************************************************************************** lkp-knm01: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory ========================================================================================= compiler/cpufreq_governor/kconfig/rootfs/runtime/size/tbox_group/test/testcase: gcc-7/performance/x86_64-rhel-7.6/debian-x86_64-2018-04-03.cgz/300s/8T/lkp-knm01/anon-w-seq-hugetlb/vm-scalability commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at_ip___perf_sw_event/0x %stddev %change %stddev \ | \ 0.00 +21.6% 0.00 ± 2% vm-scalability.free_time 51195 +19.5% 61178 vm-scalability.median 15102040 +29.1% 19503134 ± 2% vm-scalability.throughput 278769 ± 3% +12.5% 313677 ± 2% vm-scalability.time.involuntary_context_switches 2078369 +25.7% 2612360 vm-scalability.time.minor_page_faults 26114 -7.7% 24114 vm-scalability.time.percent_of_cpu_this_job_got 43024 -8.5% 39385 vm-scalability.time.system_time 35999 -6.3% 33725 vm-scalability.time.user_time 41677 ± 2% +25.9% 52453 vm-scalability.time.voluntary_context_switches 2.917e+09 +25.8% 3.67e+09 vm-scalability.workload 10.90 +4.6 15.54 mpstat.cpu.all.idle% 356341 +11.2% 396100 numa-meminfo.node0.SUnreclaim 89060 +11.2% 99073 numa-vmstat.node0.nr_slab_unreclaimable 370738 +10.9% 411308 meminfo.SUnreclaim 199457 -14.0% 171496 meminfo.max_used_kB 2631381 +22.1% 3213144 numa-numastat.node0.local_node 2631352 +22.1% 3213111 numa-numastat.node0.numa_hit 3.65 ± 65% +182.8% 10.34 ± 23% turbostat.CPU%c1 109.28 ± 57% +35.9% 148.50 turbostat.PkgWatt 9.24 ± 57% +59.2% 14.71 turbostat.RAMWatt 11.75 ± 3% +36.2% 16.00 vmstat.cpu.id 293.75 -8.9% 267.50 vmstat.procs.r 3821 +13.7% 4345 vmstat.system.cs 1270080 +25.8% 1597680 proc-vmstat.htlb_buddy_alloc_success 141.25 +4.8% 148.00 proc-vmstat.nr_dirtied 316.25 +1.1% 319.75 proc-vmstat.nr_inactive_file 29411 +1.2% 29774 proc-vmstat.nr_slab_reclaimable 92697 +11.0% 102867 proc-vmstat.nr_slab_unreclaimable 130.00 +4.4% 135.75 proc-vmstat.nr_written 316.25 +1.1% 319.75 proc-vmstat.nr_zone_inactive_file 2647832 +22.1% 3232944 proc-vmstat.numa_hit 2647831 +22.1% 3232943 proc-vmstat.numa_local 6.518e+08 +25.8% 8.198e+08 proc-vmstat.pgalloc_normal 2624497 +24.1% 3256212 proc-vmstat.pgfault 6.499e+08 ± 2% +26.1% 8.191e+08 proc-vmstat.pgfree 9858 ± 18% +31.5% 12964 ± 6% softirqs.CPU0.SCHED 8707 ± 17% -23.5% 6664 ± 4% softirqs.CPU1.RCU 8672 ± 13% -26.1% 6409 ± 14% softirqs.CPU17.RCU 8191 ± 15% -27.1% 5970 ± 5% softirqs.CPU21.RCU 3485 ± 10% +89.2% 6595 ± 33% softirqs.CPU214.SCHED 8401 ± 13% -28.5% 6010 ± 9% softirqs.CPU26.RCU 8066 ± 14% -23.0% 6213 ± 4% softirqs.CPU28.RCU 8001 ± 16% -26.9% 5850 ± 4% softirqs.CPU31.RCU 8038 ± 17% -27.8% 5805 ± 5% softirqs.CPU35.RCU 8397 ± 20% -32.9% 5636 softirqs.CPU37.RCU 9617 ± 25% -35.7% 6185 ± 9% softirqs.CPU7.RCU 1800740 ± 2% -21.7% 1409793 ± 3% softirqs.RCU 1147345 ± 2% +42.2% 1631093 ± 2% softirqs.SCHED 5614313 ± 46% -79.8% 1133067 ± 70% sched_debug.cfs_rq:/.MIN_vruntime.avg 34152262 ± 14% -24.3% 25869445 sched_debug.cfs_rq:/.MIN_vruntime.max 11427518 ± 29% -58.5% 4747222 ± 31% sched_debug.cfs_rq:/.MIN_vruntime.stddev 134195 ± 43% -66.5% 44951 ± 74% sched_debug.cfs_rq:/.load.avg 272770 ± 23% -39.7% 164588 ± 32% sched_debug.cfs_rq:/.load.stddev 154.27 ± 42% -66.2% 52.07 ± 68% sched_debug.cfs_rq:/.load_avg.avg 249.52 ± 24% -36.5% 158.56 ± 27% sched_debug.cfs_rq:/.load_avg.stddev 5614313 ± 46% -79.8% 1133067 ± 70% sched_debug.cfs_rq:/.max_vruntime.avg 34152262 ± 14% -24.3% 25869445 sched_debug.cfs_rq:/.max_vruntime.max 11427518 ± 29% -58.5% 4747222 ± 31% sched_debug.cfs_rq:/.max_vruntime.stddev 33144200 ± 14% -23.9% 25210231 sched_debug.cfs_rq:/.min_vruntime.avg 34475816 ± 14% -22.9% 26567356 sched_debug.cfs_rq:/.min_vruntime.max 28107704 ± 10% -29.2% 19891252 ± 4% sched_debug.cfs_rq:/.min_vruntime.min 1073074 ± 19% -33.3% 715299 ± 2% sched_debug.cfs_rq:/.min_vruntime.stddev 0.60 ± 18% -33.5% 0.40 ± 19% sched_debug.cfs_rq:/.nr_running.avg 0.56 ± 9% -16.1% 0.47 ± 9% sched_debug.cfs_rq:/.nr_running.stddev 113.98 ± 45% -66.3% 38.37 ± 72% sched_debug.cfs_rq:/.runnable_load_avg.avg 238.30 ± 25% -39.1% 145.17 ± 32% sched_debug.cfs_rq:/.runnable_load_avg.stddev 134191 ± 43% -66.5% 44947 ± 74% sched_debug.cfs_rq:/.runnable_weight.avg 272773 ± 23% -39.7% 164589 ± 32% sched_debug.cfs_rq:/.runnable_weight.stddev 1018241 ± 19% -31.0% 702601 ± 2% sched_debug.cfs_rq:/.spread0.stddev 318095 ± 30% +123.5% 710875 ± 13% sched_debug.cpu.avg_idle.min 168685 ± 9% -10.7% 150671 sched_debug.cpu.clock.avg 169274 ± 9% -10.7% 151137 sched_debug.cpu.clock.max 167437 ± 9% -10.6% 149634 sched_debug.cpu.clock.min 168685 ± 9% -10.7% 150671 sched_debug.cpu.clock_task.avg 169274 ± 9% -10.7% 151137 sched_debug.cpu.clock_task.max 167437 ± 9% -10.6% 149634 sched_debug.cpu.clock_task.min 134070 ± 43% -66.4% 45071 ± 73% sched_debug.cpu.load.avg 272544 ± 23% -38.5% 167632 ± 30% sched_debug.cpu.load.stddev 500000 +8.4% 541899 ± 3% sched_debug.cpu.max_idle_balance_cost.min 656.17 ± 8% +15.6% 758.50 ± 3% sched_debug.cpu.nr_switches.min 1821 ± 5% -14.5% 1557 sched_debug.cpu.nr_switches.stddev -9.81 +1719.1% -178.50 sched_debug.cpu.nr_uninterruptible.min 13.55 +54.2% 20.89 ± 8% sched_debug.cpu.nr_uninterruptible.stddev 167411 ± 9% -10.6% 149613 sched_debug.cpu_clk 163384 ± 9% -10.9% 145585 sched_debug.ktime 167855 ± 9% -10.6% 150003 sched_debug.sched_clk 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 8.15 +8.1% 8.80 perf-stat.i.MPKI 1.441e+10 +13.5% 1.636e+10 perf-stat.i.branch-instructions 1.64 ± 3% +0.2 1.80 ± 2% perf-stat.i.branch-miss-rate% 2.574e+08 ± 4% +17.1% 3.013e+08 ± 3% perf-stat.i.branch-misses 18.07 ± 3% -4.9 13.19 perf-stat.i.cache-miss-rate% 69094895 -5.6% 65226608 perf-stat.i.cache-misses 4.232e+08 +14.7% 4.852e+08 perf-stat.i.cache-references 3836 +10.8% 4252 perf-stat.i.context-switches 8.85 -22.8% 6.83 perf-stat.i.cpi 4.182e+11 -9.6% 3.782e+11 perf-stat.i.cpu-cycles 220.74 ± 4% +93.1% 426.28 perf-stat.i.cpu-migrations 6788 -11.7% 5991 perf-stat.i.cycles-between-cache-misses 0.08 -0.0 0.07 ± 10% perf-stat.i.iTLB-load-miss-rate% 4.788e+10 +12.4% 5.381e+10 perf-stat.i.iTLB-loads 4.937e+10 +10.9% 5.475e+10 perf-stat.i.instructions 1307 +15.3% 1507 ± 11% perf-stat.i.instructions-per-iTLB-miss 0.12 +29.6% 0.15 perf-stat.i.ipc 8591 +23.7% 10625 perf-stat.i.minor-faults 596817 -1.1% 590330 perf-stat.i.msec 8705 +22.8% 10693 perf-stat.i.page-faults 8.57 +3.6% 8.88 perf-stat.overall.MPKI 16.69 -3.2 13.50 perf-stat.overall.cache-miss-rate% 8.64 -19.9% 6.92 perf-stat.overall.cpi 6037 -4.4% 5770 perf-stat.overall.cycles-between-cache-misses 0.08 -0.0 0.07 ± 11% perf-stat.overall.iTLB-load-miss-rate% 1289 +16.7% 1504 ± 11% perf-stat.overall.instructions-per-iTLB-miss 0.12 +24.8% 0.14 perf-stat.overall.ipc 4498 -7.8% 4148 perf-stat.overall.path-length 1.321e+10 +17.5% 1.552e+10 perf-stat.ps.branch-instructions 2.291e+08 ± 4% +22.8% 2.813e+08 ± 2% perf-stat.ps.branch-misses 63807021 -3.1% 61833841 perf-stat.ps.cache-misses 3.825e+08 +19.7% 4.58e+08 perf-stat.ps.cache-references 3550 +17.2% 4160 perf-stat.ps.context-switches 3.852e+11 -7.4% 3.568e+11 perf-stat.ps.cpu-cycles 206.87 ± 4% +106.5% 427.25 perf-stat.ps.cpu-migrations 4.431e+10 +15.8% 5.131e+10 perf-stat.ps.iTLB-loads 4.461e+10 +15.6% 5.156e+10 perf-stat.ps.instructions 8508 +24.6% 10601 perf-stat.ps.minor-faults 8507 +24.6% 10599 perf-stat.ps.page-faults 1.312e+13 +16.0% 1.523e+13 perf-stat.total.instructions 3023 ± 4% +12.1% 3389 ± 2% slabinfo.UNIX.active_objs 3023 ± 4% +12.1% 3389 ± 2% slabinfo.UNIX.num_objs 118600 +19.7% 141908 slabinfo.anon_vma.active_objs 2578 +19.7% 3085 slabinfo.anon_vma.active_slabs 118639 +19.6% 141950 slabinfo.anon_vma.num_objs 2578 +19.7% 3085 slabinfo.anon_vma.num_slabs 218385 +13.7% 248282 slabinfo.anon_vma_chain.active_objs 3413 +13.7% 3880 slabinfo.anon_vma_chain.active_slabs 218481 +13.7% 248378 slabinfo.anon_vma_chain.num_objs 3413 +13.7% 3880 slabinfo.anon_vma_chain.num_slabs 26842 ± 2% +9.4% 29375 ± 2% slabinfo.cred_jar.active_objs 26842 ± 2% +9.4% 29375 ± 2% slabinfo.cred_jar.num_objs 1668 ± 5% +23.5% 2060 ± 9% slabinfo.file_lock_cache.active_objs 1668 ± 5% +23.5% 2060 ± 9% slabinfo.file_lock_cache.num_objs 20356 +15.0% 23405 slabinfo.files_cache.active_objs 20362 +14.9% 23405 slabinfo.files_cache.num_objs 8912 ± 4% +39.5% 12435 ± 6% slabinfo.kernfs_iattrs_cache.active_objs 8912 ± 4% +39.5% 12435 ± 6% slabinfo.kernfs_iattrs_cache.num_objs 14955 +19.7% 17904 slabinfo.mm_struct.active_objs 14973 +19.6% 17911 slabinfo.mm_struct.num_objs 1046 +17.1% 1224 slabinfo.mnt_cache.active_objs 1046 +17.1% 1224 slabinfo.mnt_cache.num_objs 9488 +54.9% 14694 slabinfo.sighand_cache.active_objs 632.75 +54.8% 979.75 slabinfo.sighand_cache.active_slabs 9498 +54.8% 14706 slabinfo.sighand_cache.num_objs 632.75 +54.8% 979.75 slabinfo.sighand_cache.num_slabs 16194 ± 2% +23.8% 20042 slabinfo.signal_cache.active_objs 539.50 ± 2% +23.8% 668.00 slabinfo.signal_cache.active_slabs 16205 ± 2% +23.7% 20048 slabinfo.signal_cache.num_objs 539.50 ± 2% +23.8% 668.00 slabinfo.signal_cache.num_slabs 2160 ± 3% +26.2% 2726 ± 3% slabinfo.skbuff_ext_cache.active_objs 2160 ± 3% +26.2% 2726 ± 3% slabinfo.skbuff_ext_cache.num_objs 20347 ± 2% -12.9% 17721 ± 3% slabinfo.skbuff_head_cache.active_objs 20347 ± 2% -12.9% 17721 ± 3% slabinfo.skbuff_head_cache.num_objs 6729 ± 2% +13.4% 7630 ± 2% slabinfo.sock_inode_cache.active_objs 6729 ± 2% +13.4% 7630 ± 2% slabinfo.sock_inode_cache.num_objs 4359 +25.4% 5469 slabinfo.task_struct.active_objs 1093 +25.4% 1370 slabinfo.task_struct.active_slabs 4374 +25.4% 5483 slabinfo.task_struct.num_objs 1093 +25.4% 1370 slabinfo.task_struct.num_slabs 158886 ± 2% +10.2% 175056 slabinfo.vm_area_struct.active_objs 3972 ± 2% +10.2% 4377 slabinfo.vm_area_struct.active_slabs 158927 ± 2% +10.2% 175111 slabinfo.vm_area_struct.num_objs 3972 ± 2% +10.2% 4377 slabinfo.vm_area_struct.num_slabs 0.19 ±173% +0.6 0.81 ± 22% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 0.14 ±173% +0.8 0.92 ± 8% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.33 ±103% +0.9 1.23 ± 8% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle 0.00 +1.0 1.02 ± 21% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.prep_new_huge_page.alloc_fresh_huge_page.alloc_surplus_huge_page 0.00 +1.0 1.03 ± 22% perf-profile.calltrace.cycles-pp._raw_spin_lock.prep_new_huge_page.alloc_fresh_huge_page.alloc_surplus_huge_page.hugetlb_acct_memory 0.00 +1.0 1.04 ± 21% perf-profile.calltrace.cycles-pp.prep_new_huge_page.alloc_fresh_huge_page.alloc_surplus_huge_page.hugetlb_acct_memory.hugetlb_reserve_pages 0.46 ±101% +1.2 1.62 ± 11% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.native_queued_spin_lock_slowpath 0.00 +1.5 1.52 ± 21% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_huge_page 0.54 ±103% +1.6 2.10 ± 7% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry 0.00 +1.7 1.68 ± 19% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_huge_page.hugetlb_no_page 0.58 ±103% +1.7 2.26 ± 7% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 0.56 ±101% +1.7 2.27 ± 16% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.native_queued_spin_lock_slowpath._raw_spin_lock 0.00 +1.9 1.86 ± 17% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_surplus_huge_page.hugetlb_acct_memory.hugetlb_reserve_pages 0.00 +1.9 1.89 ± 18% perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_surplus_huge_page.hugetlb_acct_memory.hugetlb_reserve_pages.hugetlbfs_file_mmap 0.91 ±106% +2.4 3.28 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.11 ±105% +2.9 4.02 ± 7% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.11 ±105% +2.9 4.03 ± 7% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 1.11 ±105% +2.9 4.03 ± 7% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 1.12 ±105% +3.0 4.08 ± 7% perf-profile.calltrace.cycles-pp.secondary_startup_64 1.57 ±100% +3.1 4.63 ± 33% perf-profile.calltrace.cycles-pp.alloc_fresh_huge_page.alloc_surplus_huge_page.hugetlb_acct_memory.hugetlb_reserve_pages.hugetlbfs_file_mmap 1.68 ±100% +4.1 5.79 ± 16% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.mmap64 1.68 ±100% +4.1 5.79 ± 16% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64 1.68 ±100% +4.1 5.79 ± 16% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64 1.68 ±100% +4.1 5.79 ± 16% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64 1.69 ±100% +4.1 5.80 ± 16% perf-profile.calltrace.cycles-pp.mmap64 1.64 ±100% +4.9 6.54 ± 27% perf-profile.calltrace.cycles-pp.alloc_surplus_huge_page.hugetlb_acct_memory.hugetlb_reserve_pages.hugetlbfs_file_mmap.mmap_region 1.67 ±100% +5.0 6.66 ± 26% perf-profile.calltrace.cycles-pp.hugetlb_acct_memory.hugetlb_reserve_pages.hugetlbfs_file_mmap.mmap_region.do_mmap 1.67 ±100% +5.0 6.66 ± 26% perf-profile.calltrace.cycles-pp.hugetlbfs_file_mmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 1.67 ±100% +5.0 6.66 ± 26% perf-profile.calltrace.cycles-pp.hugetlb_reserve_pages.hugetlbfs_file_mmap.mmap_region.do_mmap.vm_mmap_pgoff 1.68 ±100% +5.0 6.67 ± 27% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 1.68 ±100% +5.0 6.68 ± 27% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.38 ±100% +8.5 10.89 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_huge_page.hugetlb_no_page.hugetlb_fault 2.40 ±100% +8.6 10.99 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_huge_page.hugetlb_no_page.hugetlb_fault.handle_mm_fault 2.50 ±100% +8.7 11.20 ± 5% perf-profile.calltrace.cycles-pp.alloc_huge_page.hugetlb_no_page.hugetlb_fault.handle_mm_fault.__do_page_fault 6.85 ±100% +9.4 16.29 ± 11% perf-profile.calltrace.cycles-pp.do_rw_once 15.44 ±100% +19.0 34.40 ± 6% perf-profile.calltrace.cycles-pp.hugetlb_no_page.hugetlb_fault.handle_mm_fault.__do_page_fault.do_page_fault 15.71 ±100% +19.3 34.98 ± 7% perf-profile.calltrace.cycles-pp.hugetlb_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 0.03 ±100% +0.1 0.08 ± 5% perf-profile.children.cycles-pp.__free_pages_ok 0.00 +0.1 0.05 perf-profile.children.cycles-pp.try_to_wake_up 0.04 ±100% +0.1 0.09 ± 13% perf-profile.children.cycles-pp.perf_read 0.01 ±173% +0.1 0.07 ± 6% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.new_sync_read 0.04 ±100% +0.1 0.10 ± 8% perf-profile.children.cycles-pp.update_and_free_page 0.05 ±100% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.cmd_stat 0.05 ±100% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.__run_perf_stat 0.05 ±100% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.process_interval 0.05 ±100% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.read_counters 0.04 ±100% +0.1 0.12 ± 15% perf-profile.children.cycles-pp.pick_next_task_fair 0.06 ±112% +0.1 0.14 ± 29% perf-profile.children.cycles-pp.reweight_entity 0.04 ±113% +0.1 0.12 ± 20% perf-profile.children.cycles-pp.calc_global_load_tick 0.08 ±109% +0.1 0.17 ± 29% perf-profile.children.cycles-pp.hrtimer_active 0.04 ±107% +0.1 0.12 ± 14% perf-profile.children.cycles-pp.tick_nohz_next_event 0.01 ±173% +0.1 0.11 ± 19% perf-profile.children.cycles-pp.run_rebalance_domains 0.00 +0.1 0.11 ± 21% perf-profile.children.cycles-pp.update_blocked_averages 0.04 ±108% +0.1 0.16 ± 9% perf-profile.children.cycles-pp.tick_irq_enter 0.05 ±108% +0.1 0.17 ± 10% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.07 ±100% +0.1 0.19 ± 35% perf-profile.children.cycles-pp.x86_pmu_disable 0.04 ±100% +0.1 0.17 ± 11% perf-profile.children.cycles-pp.update_sd_lb_stats 0.10 ±100% +0.1 0.23 ± 6% perf-profile.children.cycles-pp.__schedule 0.04 ±100% +0.1 0.18 ± 10% perf-profile.children.cycles-pp.find_busiest_group 0.04 ±100% +0.1 0.18 ± 17% perf-profile.children.cycles-pp.rebalance_domains 0.13 ±100% +0.1 0.28 ± 5% perf-profile.children.cycles-pp.vfs_read 0.06 ±116% +0.1 0.21 ± 16% perf-profile.children.cycles-pp.ksoftirqd_running 0.06 ±100% +0.2 0.24 ± 10% perf-profile.children.cycles-pp.load_balance 0.05 ±100% +0.2 0.24 ± 57% perf-profile.children.cycles-pp.__strcspn_sse42 0.05 ±100% +0.2 0.24 ± 57% perf-profile.children.cycles-pp.generic_start_main 0.05 ±100% +0.2 0.24 ± 57% perf-profile.children.cycles-pp.main 0.05 ±100% +0.2 0.24 ± 57% perf-profile.children.cycles-pp.run_builtin 0.11 ±105% +0.3 0.39 ± 3% perf-profile.children.cycles-pp.menu_select 0.27 ±115% +0.5 0.82 ± 21% perf-profile.children.cycles-pp.intel_idle 0.32 ±111% +0.6 0.96 ± 6% perf-profile.children.cycles-pp.__softirqentry_text_start 0.51 ±108% +0.9 1.43 ± 4% perf-profile.children.cycles-pp.irq_exit 0.04 ±104% +1.0 1.04 ± 22% perf-profile.children.cycles-pp.prep_new_huge_page 0.96 ±105% +2.5 3.49 ± 8% perf-profile.children.cycles-pp.cpuidle_enter_state 1.11 ±105% +2.9 4.03 ± 7% perf-profile.children.cycles-pp.start_secondary 1.12 ±105% +3.0 4.08 ± 7% perf-profile.children.cycles-pp.secondary_startup_64 1.12 ±105% +3.0 4.08 ± 7% perf-profile.children.cycles-pp.cpu_startup_entry 1.12 ±105% +3.0 4.08 ± 7% perf-profile.children.cycles-pp.do_idle 1.57 ±100% +3.1 4.63 ± 33% perf-profile.children.cycles-pp.alloc_fresh_huge_page 1.69 ±100% +4.1 5.80 ± 16% perf-profile.children.cycles-pp.mmap64 1.64 ±100% +4.9 6.54 ± 27% perf-profile.children.cycles-pp.alloc_surplus_huge_page 1.67 ±100% +5.0 6.66 ± 26% perf-profile.children.cycles-pp.hugetlbfs_file_mmap 1.67 ±100% +5.0 6.66 ± 26% perf-profile.children.cycles-pp.hugetlb_reserve_pages 1.69 ±100% +5.0 6.69 ± 26% perf-profile.children.cycles-pp.mmap_region 1.69 ±100% +5.0 6.69 ± 26% perf-profile.children.cycles-pp.ksys_mmap_pgoff 1.69 ±100% +5.0 6.69 ± 26% perf-profile.children.cycles-pp.do_mmap 1.69 ±100% +5.0 6.70 ± 26% perf-profile.children.cycles-pp.vm_mmap_pgoff 1.75 ±100% +5.0 6.80 ± 26% perf-profile.children.cycles-pp.hugetlb_acct_memory 2.50 ±100% +8.7 11.20 ± 5% perf-profile.children.cycles-pp.alloc_huge_page 15.70 ±100% +17.5 33.20 ± 5% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 15.44 ±100% +19.0 34.40 ± 6% perf-profile.children.cycles-pp.hugetlb_no_page 15.71 ±100% +19.3 34.97 ± 7% perf-profile.children.cycles-pp.hugetlb_fault 15.80 ±100% +19.3 35.14 ± 7% perf-profile.children.cycles-pp.handle_mm_fault 15.91 ±100% +19.4 35.32 ± 7% perf-profile.children.cycles-pp.__do_page_fault 15.93 ±100% +19.4 35.38 ± 7% perf-profile.children.cycles-pp.do_page_fault 15.95 ±100% +19.4 35.39 ± 7% perf-profile.children.cycles-pp.page_fault 0.04 ±100% +0.1 0.09 ± 7% perf-profile.self.cycles-pp.update_and_free_page 0.04 ±113% +0.1 0.12 ± 20% perf-profile.self.cycles-pp.calc_global_load_tick 0.05 ±102% +0.1 0.15 ± 10% perf-profile.self.cycles-pp.menu_select 0.03 ±100% +0.1 0.14 ± 11% perf-profile.self.cycles-pp.update_sd_lb_stats 0.07 ±100% +0.1 0.19 ± 35% perf-profile.self.cycles-pp.x86_pmu_disable 0.06 ±114% +0.2 0.21 ± 16% perf-profile.self.cycles-pp.ksoftirqd_running 0.07 ±106% +0.2 0.29 ± 7% perf-profile.self.cycles-pp.cpuidle_enter_state 0.16 ±100% +0.2 0.39 ± 7% perf-profile.self.cycles-pp.mutex_spin_on_owner 0.27 ±115% +0.5 0.81 ± 21% perf-profile.self.cycles-pp.intel_idle 308.00 ± 26% +86.4% 574.00 ± 18% interrupts.31:IR-PCI-MSI.2097154-edge.eth0-TxRx-1 859140 +10.7% 950914 interrupts.CAL:Function_call_interrupts 2988 +9.6% 3275 ± 2% interrupts.CPU0.CAL:Function_call_interrupts 4125 ± 77% -56.0% 1816 ± 22% interrupts.CPU0.RES:Rescheduling_interrupts 2976 +13.2% 3370 ± 4% interrupts.CPU1.CAL:Function_call_interrupts 2964 +12.5% 3333 interrupts.CPU100.CAL:Function_call_interrupts 3007 +9.3% 3287 interrupts.CPU101.CAL:Function_call_interrupts 2972 +11.4% 3311 interrupts.CPU102.CAL:Function_call_interrupts 2992 +10.5% 3306 interrupts.CPU103.CAL:Function_call_interrupts 2997 +9.8% 3292 interrupts.CPU104.CAL:Function_call_interrupts 2999 +10.6% 3316 interrupts.CPU105.CAL:Function_call_interrupts 2965 +10.2% 3267 ± 2% interrupts.CPU106.CAL:Function_call_interrupts 110.25 ± 41% +90.9% 210.50 ± 18% interrupts.CPU107.RES:Rescheduling_interrupts 2984 +10.8% 3305 interrupts.CPU108.CAL:Function_call_interrupts 2965 +11.4% 3304 interrupts.CPU109.CAL:Function_call_interrupts 308.00 ± 26% +86.4% 574.00 ± 18% interrupts.CPU11.31:IR-PCI-MSI.2097154-edge.eth0-TxRx-1 2962 +12.4% 3328 interrupts.CPU11.CAL:Function_call_interrupts 2993 +9.5% 3279 interrupts.CPU110.CAL:Function_call_interrupts 2942 +12.0% 3296 interrupts.CPU111.CAL:Function_call_interrupts 2981 +10.4% 3293 interrupts.CPU112.CAL:Function_call_interrupts 2967 +10.7% 3284 interrupts.CPU113.CAL:Function_call_interrupts 2996 +10.7% 3316 interrupts.CPU114.CAL:Function_call_interrupts 2995 +10.0% 3295 interrupts.CPU116.CAL:Function_call_interrupts 2852 ± 8% +15.6% 3296 interrupts.CPU117.CAL:Function_call_interrupts 2999 +10.5% 3314 interrupts.CPU118.CAL:Function_call_interrupts 2979 +10.8% 3301 ± 2% interrupts.CPU119.CAL:Function_call_interrupts 2960 +10.3% 3264 interrupts.CPU12.CAL:Function_call_interrupts 2966 +10.9% 3289 ± 2% interrupts.CPU120.CAL:Function_call_interrupts 2968 +11.2% 3301 interrupts.CPU121.CAL:Function_call_interrupts 3162 ± 28% +66.3% 5258 ± 5% interrupts.CPU122.NMI:Non-maskable_interrupts 3162 ± 28% +66.3% 5258 ± 5% interrupts.CPU122.PMI:Performance_monitoring_interrupts 3001 +10.6% 3319 interrupts.CPU123.CAL:Function_call_interrupts 2983 +10.5% 3295 interrupts.CPU124.CAL:Function_call_interrupts 2957 +9.5% 3238 ± 2% interrupts.CPU126.CAL:Function_call_interrupts 2984 +10.1% 3284 ± 2% interrupts.CPU127.CAL:Function_call_interrupts 3005 +10.1% 3307 interrupts.CPU128.CAL:Function_call_interrupts 2577 ± 3% +59.0% 4099 ± 35% interrupts.CPU129.NMI:Non-maskable_interrupts 2577 ± 3% +59.0% 4099 ± 35% interrupts.CPU129.PMI:Performance_monitoring_interrupts 2984 +11.6% 3330 interrupts.CPU130.CAL:Function_call_interrupts 2976 ± 2% +11.4% 3315 interrupts.CPU131.CAL:Function_call_interrupts 2972 +11.2% 3305 ± 2% interrupts.CPU132.CAL:Function_call_interrupts 2548 ± 5% +28.6% 3278 ± 24% interrupts.CPU132.NMI:Non-maskable_interrupts 2548 ± 5% +28.6% 3278 ± 24% interrupts.CPU132.PMI:Performance_monitoring_interrupts 3001 +10.4% 3311 interrupts.CPU134.CAL:Function_call_interrupts 2841 ± 9% +16.8% 3318 interrupts.CPU135.CAL:Function_call_interrupts 2986 +10.6% 3302 ± 2% interrupts.CPU136.CAL:Function_call_interrupts 3005 +10.4% 3317 interrupts.CPU137.CAL:Function_call_interrupts 315.75 ± 72% -59.2% 128.75 ± 15% interrupts.CPU138.RES:Rescheduling_interrupts 2986 +11.0% 3315 interrupts.CPU139.CAL:Function_call_interrupts 3187 ± 30% +40.5% 4477 ± 20% interrupts.CPU139.NMI:Non-maskable_interrupts 3187 ± 30% +40.5% 4477 ± 20% interrupts.CPU139.PMI:Performance_monitoring_interrupts 2992 +10.6% 3309 interrupts.CPU14.CAL:Function_call_interrupts 2992 +10.3% 3301 interrupts.CPU140.CAL:Function_call_interrupts 2989 +11.2% 3324 interrupts.CPU141.CAL:Function_call_interrupts 2975 +11.8% 3325 interrupts.CPU142.CAL:Function_call_interrupts 2983 +10.4% 3294 interrupts.CPU143.CAL:Function_call_interrupts 2977 +11.4% 3316 interrupts.CPU145.CAL:Function_call_interrupts 2985 +10.2% 3291 interrupts.CPU146.CAL:Function_call_interrupts 2960 +11.8% 3309 ± 2% interrupts.CPU147.CAL:Function_call_interrupts 2984 +11.5% 3326 interrupts.CPU148.CAL:Function_call_interrupts 2983 +10.3% 3289 interrupts.CPU149.CAL:Function_call_interrupts 3007 +10.0% 3308 interrupts.CPU15.CAL:Function_call_interrupts 2996 +10.4% 3308 interrupts.CPU150.CAL:Function_call_interrupts 3266 ± 35% +44.8% 4731 ± 24% interrupts.CPU150.NMI:Non-maskable_interrupts 3266 ± 35% +44.8% 4731 ± 24% interrupts.CPU150.PMI:Performance_monitoring_interrupts 2988 +10.6% 3304 ± 2% interrupts.CPU151.CAL:Function_call_interrupts 118.75 ± 24% +1795.6% 2251 ±157% interrupts.CPU151.RES:Rescheduling_interrupts 2955 +12.2% 3315 interrupts.CPU152.CAL:Function_call_interrupts 2978 ± 2% +11.6% 3325 interrupts.CPU153.CAL:Function_call_interrupts 3009 +10.3% 3319 interrupts.CPU154.CAL:Function_call_interrupts 2997 +10.5% 3310 interrupts.CPU155.CAL:Function_call_interrupts 102.00 ± 39% +121.6% 226.00 ± 52% interrupts.CPU155.RES:Rescheduling_interrupts 2985 +10.8% 3307 interrupts.CPU157.CAL:Function_call_interrupts 2999 +11.1% 3332 interrupts.CPU158.CAL:Function_call_interrupts 2992 +11.3% 3329 interrupts.CPU159.CAL:Function_call_interrupts 2985 +11.0% 3313 interrupts.CPU16.CAL:Function_call_interrupts 2984 +10.9% 3309 interrupts.CPU160.CAL:Function_call_interrupts 3002 +10.8% 3326 interrupts.CPU162.CAL:Function_call_interrupts 3002 +10.2% 3309 ± 2% interrupts.CPU163.CAL:Function_call_interrupts 2986 +10.5% 3298 ± 2% interrupts.CPU165.CAL:Function_call_interrupts 2997 +9.7% 3288 interrupts.CPU166.CAL:Function_call_interrupts 2968 +12.0% 3325 interrupts.CPU167.CAL:Function_call_interrupts 2996 +13.2% 3391 ± 5% interrupts.CPU168.CAL:Function_call_interrupts 6.00 ±163% +1604.2% 102.25 ±155% interrupts.CPU168.TLB:TLB_shootdowns 2990 +9.9% 3287 interrupts.CPU169.CAL:Function_call_interrupts 2998 +10.9% 3324 interrupts.CPU17.CAL:Function_call_interrupts 2981 +11.5% 3324 interrupts.CPU170.CAL:Function_call_interrupts 3003 +10.8% 3328 interrupts.CPU171.CAL:Function_call_interrupts 2603 ± 5% +54.7% 4026 ± 28% interrupts.CPU172.NMI:Non-maskable_interrupts 2603 ± 5% +54.7% 4026 ± 28% interrupts.CPU172.PMI:Performance_monitoring_interrupts 2976 +11.7% 3325 interrupts.CPU173.CAL:Function_call_interrupts 2947 +12.5% 3315 interrupts.CPU174.CAL:Function_call_interrupts 2983 ± 2% +10.8% 3305 interrupts.CPU175.CAL:Function_call_interrupts 100.50 ± 27% +106.2% 207.25 ± 32% interrupts.CPU175.RES:Rescheduling_interrupts 2982 +11.2% 3316 interrupts.CPU176.CAL:Function_call_interrupts 2984 +10.9% 3310 ± 2% interrupts.CPU177.CAL:Function_call_interrupts 3003 +10.1% 3307 ± 2% interrupts.CPU178.CAL:Function_call_interrupts 3015 +10.0% 3317 interrupts.CPU179.CAL:Function_call_interrupts 2857 ± 8% +16.6% 3333 interrupts.CPU18.CAL:Function_call_interrupts 2982 +11.0% 3310 interrupts.CPU180.CAL:Function_call_interrupts 2998 +10.5% 3313 interrupts.CPU181.CAL:Function_call_interrupts 2999 +10.9% 3326 interrupts.CPU182.CAL:Function_call_interrupts 2975 +11.8% 3327 interrupts.CPU183.CAL:Function_call_interrupts 2976 +11.5% 3319 interrupts.CPU184.CAL:Function_call_interrupts 2985 +10.0% 3284 ± 2% interrupts.CPU185.CAL:Function_call_interrupts 2999 +11.1% 3331 interrupts.CPU186.CAL:Function_call_interrupts 2983 +11.0% 3311 interrupts.CPU187.CAL:Function_call_interrupts 2995 +11.0% 3323 interrupts.CPU188.CAL:Function_call_interrupts 2949 +12.4% 3315 interrupts.CPU189.CAL:Function_call_interrupts 5071 ± 4% -36.3% 3232 ± 28% interrupts.CPU189.NMI:Non-maskable_interrupts 5071 ± 4% -36.3% 3232 ± 28% interrupts.CPU189.PMI:Performance_monitoring_interrupts 2991 +10.6% 3307 interrupts.CPU19.CAL:Function_call_interrupts 2989 +10.3% 3297 interrupts.CPU190.CAL:Function_call_interrupts 2992 +13.6% 3398 ± 4% interrupts.CPU191.CAL:Function_call_interrupts 2964 +11.6% 3309 interrupts.CPU192.CAL:Function_call_interrupts 3005 +9.8% 3299 interrupts.CPU193.CAL:Function_call_interrupts 2989 +10.2% 3294 interrupts.CPU194.CAL:Function_call_interrupts 2989 +11.1% 3322 interrupts.CPU195.CAL:Function_call_interrupts 2990 +10.5% 3303 ± 2% interrupts.CPU196.CAL:Function_call_interrupts 2989 +10.7% 3308 interrupts.CPU197.CAL:Function_call_interrupts 99.25 ± 14% +56.2% 155.00 ± 26% interrupts.CPU197.RES:Rescheduling_interrupts 2982 +10.9% 3307 ± 2% interrupts.CPU198.CAL:Function_call_interrupts 5062 ± 4% -35.6% 3261 ± 28% interrupts.CPU198.NMI:Non-maskable_interrupts 5062 ± 4% -35.6% 3261 ± 28% interrupts.CPU198.PMI:Performance_monitoring_interrupts 2998 +10.5% 3313 interrupts.CPU199.CAL:Function_call_interrupts 2986 +11.9% 3341 interrupts.CPU2.CAL:Function_call_interrupts 2995 +10.7% 3315 interrupts.CPU20.CAL:Function_call_interrupts 2834 ± 9% +17.5% 3331 interrupts.CPU200.CAL:Function_call_interrupts 2992 +11.2% 3327 interrupts.CPU201.CAL:Function_call_interrupts 3007 +10.7% 3329 interrupts.CPU202.CAL:Function_call_interrupts 2989 +10.4% 3300 ± 2% interrupts.CPU203.CAL:Function_call_interrupts 2955 +12.0% 3310 ± 2% interrupts.CPU204.CAL:Function_call_interrupts 2994 +13.2% 3390 ± 3% interrupts.CPU206.CAL:Function_call_interrupts 2975 +10.8% 3296 interrupts.CPU207.CAL:Function_call_interrupts 2981 +11.0% 3310 interrupts.CPU208.CAL:Function_call_interrupts 2989 +11.5% 3334 interrupts.CPU209.CAL:Function_call_interrupts 3009 +9.9% 3307 interrupts.CPU211.CAL:Function_call_interrupts 2990 +10.0% 3288 interrupts.CPU212.CAL:Function_call_interrupts 96.75 ± 29% +139.8% 232.00 ± 69% interrupts.CPU213.RES:Rescheduling_interrupts 2988 +10.9% 3315 interrupts.CPU214.CAL:Function_call_interrupts 2969 +11.8% 3319 interrupts.CPU215.CAL:Function_call_interrupts 2989 +10.3% 3297 ± 2% interrupts.CPU216.CAL:Function_call_interrupts 2995 +11.1% 3326 interrupts.CPU217.CAL:Function_call_interrupts 3009 +9.2% 3285 interrupts.CPU218.CAL:Function_call_interrupts 2680 ± 4% +75.2% 4695 ± 25% interrupts.CPU218.NMI:Non-maskable_interrupts 2680 ± 4% +75.2% 4695 ± 25% interrupts.CPU218.PMI:Performance_monitoring_interrupts 2508 ± 12% +61.6% 4054 ± 27% interrupts.CPU22.NMI:Non-maskable_interrupts 2508 ± 12% +61.6% 4054 ± 27% interrupts.CPU22.PMI:Performance_monitoring_interrupts 2958 +11.7% 3305 interrupts.CPU220.CAL:Function_call_interrupts 2993 +10.4% 3303 interrupts.CPU222.CAL:Function_call_interrupts 2991 +10.8% 3313 interrupts.CPU223.CAL:Function_call_interrupts 2588 ± 5% +75.9% 4552 ± 24% interrupts.CPU223.NMI:Non-maskable_interrupts 2588 ± 5% +75.9% 4552 ± 24% interrupts.CPU223.PMI:Performance_monitoring_interrupts 2959 +11.5% 3300 interrupts.CPU224.CAL:Function_call_interrupts 2969 +11.0% 3296 interrupts.CPU225.CAL:Function_call_interrupts 2968 +11.8% 3319 interrupts.CPU226.CAL:Function_call_interrupts 2902 ± 6% +14.8% 3330 interrupts.CPU227.CAL:Function_call_interrupts 2859 ± 8% +15.5% 3300 interrupts.CPU228.CAL:Function_call_interrupts 172.75 ± 13% +22.6% 211.75 ± 18% interrupts.CPU228.RES:Rescheduling_interrupts 2951 +11.6% 3293 interrupts.CPU229.CAL:Function_call_interrupts 2991 +10.1% 3294 interrupts.CPU23.CAL:Function_call_interrupts 2384 ± 15% +71.9% 4097 ± 31% interrupts.CPU23.NMI:Non-maskable_interrupts 2384 ± 15% +71.9% 4097 ± 31% interrupts.CPU23.PMI:Performance_monitoring_interrupts 3001 +10.4% 3312 interrupts.CPU231.CAL:Function_call_interrupts 2995 +10.7% 3316 interrupts.CPU232.CAL:Function_call_interrupts 3000 +10.2% 3306 ± 2% interrupts.CPU233.CAL:Function_call_interrupts 2505 ± 5% +32.8% 3325 ± 33% interrupts.CPU233.NMI:Non-maskable_interrupts 2505 ± 5% +32.8% 3325 ± 33% interrupts.CPU233.PMI:Performance_monitoring_interrupts 2996 ± 4% +10.8% 3321 interrupts.CPU234.CAL:Function_call_interrupts 2981 +11.8% 3332 interrupts.CPU235.CAL:Function_call_interrupts 2984 +10.1% 3284 ± 2% interrupts.CPU236.CAL:Function_call_interrupts 3002 +9.6% 3290 interrupts.CPU237.CAL:Function_call_interrupts 110.75 ± 36% +74.0% 192.75 ± 32% interrupts.CPU237.RES:Rescheduling_interrupts 2991 +10.8% 3315 interrupts.CPU238.CAL:Function_call_interrupts 2990 +11.5% 3332 interrupts.CPU239.CAL:Function_call_interrupts 2983 +10.5% 3297 ± 2% interrupts.CPU24.CAL:Function_call_interrupts 2959 +10.7% 3275 interrupts.CPU240.CAL:Function_call_interrupts 2976 +11.4% 3317 interrupts.CPU241.CAL:Function_call_interrupts 2972 +10.7% 3291 interrupts.CPU242.CAL:Function_call_interrupts 3003 +9.3% 3283 ± 2% interrupts.CPU244.CAL:Function_call_interrupts 97.75 ± 29% +63.7% 160.00 ± 18% interrupts.CPU244.RES:Rescheduling_interrupts 3002 +10.9% 3329 interrupts.CPU245.CAL:Function_call_interrupts 2971 +10.2% 3275 ± 2% interrupts.CPU246.CAL:Function_call_interrupts 2939 +13.1% 3324 interrupts.CPU247.CAL:Function_call_interrupts 2965 +12.0% 3321 interrupts.CPU249.CAL:Function_call_interrupts 3000 +9.5% 3285 interrupts.CPU25.CAL:Function_call_interrupts 2526 ± 9% +62.7% 4110 ± 33% interrupts.CPU25.NMI:Non-maskable_interrupts 2526 ± 9% +62.7% 4110 ± 33% interrupts.CPU25.PMI:Performance_monitoring_interrupts 3006 +10.0% 3305 interrupts.CPU250.CAL:Function_call_interrupts 2955 +11.8% 3303 interrupts.CPU251.CAL:Function_call_interrupts 2982 +11.4% 3322 interrupts.CPU253.CAL:Function_call_interrupts 2969 +11.0% 3296 interrupts.CPU254.CAL:Function_call_interrupts 3000 +10.7% 3320 interrupts.CPU256.CAL:Function_call_interrupts 2987 +10.4% 3297 interrupts.CPU257.CAL:Function_call_interrupts 2967 +11.1% 3296 interrupts.CPU258.CAL:Function_call_interrupts 2962 +11.2% 3293 interrupts.CPU259.CAL:Function_call_interrupts 2980 +10.3% 3287 interrupts.CPU260.CAL:Function_call_interrupts 2974 +11.7% 3323 interrupts.CPU261.CAL:Function_call_interrupts 2991 +10.7% 3311 interrupts.CPU262.CAL:Function_call_interrupts 2837 ± 8% +15.8% 3286 interrupts.CPU263.CAL:Function_call_interrupts 114.50 ± 27% +134.5% 268.50 ± 71% interrupts.CPU263.RES:Rescheduling_interrupts 2963 +11.7% 3309 interrupts.CPU264.CAL:Function_call_interrupts 2979 +10.4% 3290 interrupts.CPU265.CAL:Function_call_interrupts 2992 +9.7% 3282 ± 2% interrupts.CPU266.CAL:Function_call_interrupts 2980 ± 2% +10.5% 3293 ± 2% interrupts.CPU267.CAL:Function_call_interrupts 2995 +10.1% 3298 interrupts.CPU268.CAL:Function_call_interrupts 113.00 ± 45% +434.5% 604.00 ±125% interrupts.CPU269.RES:Rescheduling_interrupts 2959 +11.5% 3300 interrupts.CPU27.CAL:Function_call_interrupts 3001 +9.6% 3290 ± 2% interrupts.CPU270.CAL:Function_call_interrupts 98.00 ± 15% +36.2% 133.50 ± 6% interrupts.CPU270.RES:Rescheduling_interrupts 2999 +10.4% 3310 interrupts.CPU271.CAL:Function_call_interrupts 2976 +11.1% 3305 interrupts.CPU272.CAL:Function_call_interrupts 2969 +11.6% 3314 ± 2% interrupts.CPU274.CAL:Function_call_interrupts 3005 +10.1% 3309 interrupts.CPU275.CAL:Function_call_interrupts 2566 ± 5% +49.3% 3831 ± 28% interrupts.CPU275.NMI:Non-maskable_interrupts 2566 ± 5% +49.3% 3831 ± 28% interrupts.CPU275.PMI:Performance_monitoring_interrupts 3002 +9.7% 3293 interrupts.CPU278.CAL:Function_call_interrupts 2997 +10.7% 3318 interrupts.CPU279.CAL:Function_call_interrupts 2973 +10.6% 3288 ± 2% interrupts.CPU28.CAL:Function_call_interrupts 2477 ± 6% +62.5% 4024 ± 27% interrupts.CPU281.NMI:Non-maskable_interrupts 2477 ± 6% +62.5% 4024 ± 27% interrupts.CPU281.PMI:Performance_monitoring_interrupts 3002 +9.2% 3279 ± 2% interrupts.CPU282.CAL:Function_call_interrupts 2982 +11.0% 3309 interrupts.CPU284.CAL:Function_call_interrupts 2995 +10.3% 3302 interrupts.CPU285.CAL:Function_call_interrupts 2989 +11.0% 3319 interrupts.CPU286.CAL:Function_call_interrupts 3000 +9.9% 3296 interrupts.CPU287.CAL:Function_call_interrupts 2985 +10.1% 3286 ± 3% interrupts.CPU29.CAL:Function_call_interrupts 3011 +10.8% 3336 interrupts.CPU3.CAL:Function_call_interrupts 3001 +9.7% 3293 ± 2% interrupts.CPU30.CAL:Function_call_interrupts 2987 +10.5% 3302 interrupts.CPU31.CAL:Function_call_interrupts 0.75 ±110% +15000.0% 113.25 ±160% interrupts.CPU31.TLB:TLB_shootdowns 2961 +12.5% 3332 interrupts.CPU32.CAL:Function_call_interrupts 2996 +10.1% 3298 interrupts.CPU33.CAL:Function_call_interrupts 2959 +12.3% 3324 interrupts.CPU34.CAL:Function_call_interrupts 2970 +11.7% 3317 interrupts.CPU35.CAL:Function_call_interrupts 2991 +11.4% 3332 interrupts.CPU36.CAL:Function_call_interrupts 2983 +10.1% 3283 ± 2% interrupts.CPU37.CAL:Function_call_interrupts 2974 +14.0% 3390 ± 2% interrupts.CPU4.CAL:Function_call_interrupts 4299 ± 19% -37.1% 2702 ± 4% interrupts.CPU4.NMI:Non-maskable_interrupts 4299 ± 19% -37.1% 2702 ± 4% interrupts.CPU4.PMI:Performance_monitoring_interrupts 3004 +9.6% 3293 interrupts.CPU40.CAL:Function_call_interrupts 2982 +10.8% 3305 interrupts.CPU41.CAL:Function_call_interrupts 3000 +10.2% 3306 interrupts.CPU42.CAL:Function_call_interrupts 2962 +12.4% 3330 interrupts.CPU43.CAL:Function_call_interrupts 2961 +12.0% 3317 interrupts.CPU44.CAL:Function_call_interrupts 2559 ± 13% +86.4% 4771 ± 24% interrupts.CPU45.NMI:Non-maskable_interrupts 2559 ± 13% +86.4% 4771 ± 24% interrupts.CPU45.PMI:Performance_monitoring_interrupts 3003 +10.6% 3323 interrupts.CPU46.CAL:Function_call_interrupts 3007 +11.0% 3337 interrupts.CPU47.CAL:Function_call_interrupts 2997 +11.1% 3328 interrupts.CPU48.CAL:Function_call_interrupts 2983 +11.1% 3314 interrupts.CPU49.CAL:Function_call_interrupts 2972 +11.0% 3300 interrupts.CPU51.CAL:Function_call_interrupts 319.50 ± 19% -40.7% 189.50 ± 11% interrupts.CPU51.RES:Rescheduling_interrupts 2998 +10.6% 3317 ± 2% interrupts.CPU52.CAL:Function_call_interrupts 2988 +9.7% 3277 interrupts.CPU53.CAL:Function_call_interrupts 2985 +11.3% 3322 interrupts.CPU54.CAL:Function_call_interrupts 2994 +10.6% 3310 interrupts.CPU55.CAL:Function_call_interrupts 2981 +10.6% 3296 interrupts.CPU56.CAL:Function_call_interrupts 455.25 ± 73% -64.1% 163.50 ± 18% interrupts.CPU56.RES:Rescheduling_interrupts 2993 +11.2% 3327 interrupts.CPU57.CAL:Function_call_interrupts 3000 +10.2% 3306 interrupts.CPU59.CAL:Function_call_interrupts 2990 +10.7% 3310 interrupts.CPU6.CAL:Function_call_interrupts 150.25 ± 43% +197.2% 446.50 ± 54% interrupts.CPU6.RES:Rescheduling_interrupts 2998 +11.1% 3331 interrupts.CPU60.CAL:Function_call_interrupts 2670 ± 7% +53.0% 4085 ± 27% interrupts.CPU60.NMI:Non-maskable_interrupts 2670 ± 7% +53.0% 4085 ± 27% interrupts.CPU60.PMI:Performance_monitoring_interrupts 2955 +11.8% 3305 interrupts.CPU61.CAL:Function_call_interrupts 618.25 ± 60% -72.2% 172.00 ± 25% interrupts.CPU61.RES:Rescheduling_interrupts 2980 +10.9% 3304 ± 2% interrupts.CPU62.CAL:Function_call_interrupts 2988 +10.6% 3305 interrupts.CPU63.CAL:Function_call_interrupts 168.75 ± 59% +489.0% 994.00 ±130% interrupts.CPU63.RES:Rescheduling_interrupts 2962 +11.0% 3288 interrupts.CPU64.CAL:Function_call_interrupts 3008 +10.5% 3325 interrupts.CPU65.CAL:Function_call_interrupts 2988 +11.2% 3323 interrupts.CPU66.CAL:Function_call_interrupts 188.00 ± 33% +87.9% 353.25 ± 43% interrupts.CPU66.RES:Rescheduling_interrupts 2965 +11.7% 3312 interrupts.CPU68.CAL:Function_call_interrupts 3000 +9.8% 3295 interrupts.CPU69.CAL:Function_call_interrupts 125.75 ± 28% +301.4% 504.75 ± 84% interrupts.CPU69.RES:Rescheduling_interrupts 2997 +10.3% 3307 interrupts.CPU7.CAL:Function_call_interrupts 2935 +11.6% 3276 interrupts.CPU71.CAL:Function_call_interrupts 2978 ± 2% +10.8% 3301 interrupts.CPU74.CAL:Function_call_interrupts 2624 ± 10% +62.8% 4273 ± 31% interrupts.CPU74.NMI:Non-maskable_interrupts 2624 ± 10% +62.8% 4273 ± 31% interrupts.CPU74.PMI:Performance_monitoring_interrupts 3015 +10.2% 3323 interrupts.CPU76.CAL:Function_call_interrupts 237.00 ± 25% -33.3% 158.00 ± 14% interrupts.CPU76.RES:Rescheduling_interrupts 2950 +12.5% 3320 interrupts.CPU77.CAL:Function_call_interrupts 3005 +10.4% 3316 interrupts.CPU78.CAL:Function_call_interrupts 2997 +9.8% 3291 ± 2% interrupts.CPU79.CAL:Function_call_interrupts 3182 ± 29% +55.7% 4953 ± 24% interrupts.CPU8.NMI:Non-maskable_interrupts 3182 ± 29% +55.7% 4953 ± 24% interrupts.CPU8.PMI:Performance_monitoring_interrupts 2979 +11.6% 3324 interrupts.CPU80.CAL:Function_call_interrupts 2994 +10.7% 3315 interrupts.CPU81.CAL:Function_call_interrupts 2983 +11.5% 3325 interrupts.CPU83.CAL:Function_call_interrupts 3000 +9.4% 3283 interrupts.CPU85.CAL:Function_call_interrupts 2999 +10.5% 3314 interrupts.CPU86.CAL:Function_call_interrupts 2997 +10.7% 3318 interrupts.CPU87.CAL:Function_call_interrupts 2966 +12.0% 3320 interrupts.CPU88.CAL:Function_call_interrupts 2996 +10.8% 3320 interrupts.CPU89.CAL:Function_call_interrupts 2979 +11.6% 3326 interrupts.CPU9.CAL:Function_call_interrupts 2966 +12.2% 3327 interrupts.CPU90.CAL:Function_call_interrupts 2982 +11.7% 3329 interrupts.CPU91.CAL:Function_call_interrupts 3009 +9.7% 3300 interrupts.CPU92.CAL:Function_call_interrupts 3285 ± 29% +39.3% 4574 ± 26% interrupts.CPU92.NMI:Non-maskable_interrupts 3285 ± 29% +39.3% 4574 ± 26% interrupts.CPU92.PMI:Performance_monitoring_interrupts 3000 +9.8% 3295 ± 2% interrupts.CPU93.CAL:Function_call_interrupts 2962 ± 2% +11.5% 3303 ± 2% interrupts.CPU95.CAL:Function_call_interrupts 2979 +10.9% 3303 interrupts.CPU96.CAL:Function_call_interrupts 2984 +11.0% 3311 interrupts.CPU97.CAL:Function_call_interrupts 2993 +9.9% 3290 interrupts.CPU99.CAL:Function_call_interrupts 161.50 ± 76% +432.4% 859.75 ±110% interrupts.CPU99.RES:Rescheduling_interrupts 539.75 ± 17% +695.1% 4291 ±113% interrupts.TLB:TLB_shootdowns *************************************************************************************************** lkp-ivb-ep01: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase: gcc-7/performance/1BRD_48G/xfs/x86_64-rhel-7.6/3000/debian-x86_64-2018-04-03.cgz/lkp-ivb-ep01/disk_wrt/aim7 commit: f622e64e2f ("sched: Remove rq->cpu_load[] update code") 07cf623c04 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") f622e64e2f16c79c 07cf623c04048316ec3c273fd0c ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 190330 +69.7% 323084 ± 5% aim7.jobs-per-min 95.00 -40.9% 56.12 ± 5% aim7.time.elapsed_time 95.00 -40.9% 56.12 ± 5% aim7.time.elapsed_time.max 3249 +309.3% 13299 ± 4% aim7.time.involuntary_context_switches 150258 -4.1% 144115 ± 2% aim7.time.minor_page_faults 1196 -42.6% 686.38 ± 6% aim7.time.system_time 102.79 -48.5% 52.92 ± 5% aim7.time.user_time 1092869 -20.1% 872904 aim7.time.voluntary_context_switches 2.85 -0.3 2.59 mpstat.cpu.all.usr% 50600 ± 20% -23.6% 38676 ± 8% numa-meminfo.node1.AnonHugePages 9664 ± 35% +1384.0% 143421 ± 4% numa-vmstat.node0.numa_other 168657 ± 2% -79.4% 34755 ± 18% numa-vmstat.node1.numa_other 9236 ± 23% +21.0% 11177 ± 4% slabinfo.filp.active_objs 9393 ± 23% +22.3% 11488 ± 5% slabinfo.filp.num_objs 66.00 +2.3% 67.50 vmstat.cpu.id 23508 +31.7% 30963 ± 2% vmstat.system.cs 41.83 ± 3% -4.1% 40.10 boot-time.boot 26.02 -2.1% 25.47 boot-time.dhcp 1478 ± 4% -4.5% 1411 boot-time.idle 1.939e+09 ± 9% -39.1% 1.18e+09 ± 4% cpuidle.C6.time 2800954 -38.0% 1735348 ± 24% cpuidle.C6.usage 43476 ± 2% -54.4% 19835 ± 5% cpuidle.POLL.time 66.40 +2.0% 67.75 iostat.cpu.idle 30.79 -3.5% 29.72 iostat.cpu.system 2.80 -9.8% 2.53 iostat.cpu.user 88670 -35.5% 57169 ± 4% meminfo.AnonHugePages 6565 -12.4% 5754 ± 4% meminfo.Dirty 8219 -9.6% 7431 ± 2% meminfo.Inactive(file) 24380 +69.4% 41311 ± 5% meminfo.max_used_kB 87692 -2.6% 85426 proc-vmstat.nr_active_anon 85566 -2.2% 83656 proc-vmstat.nr_anon_pages 1647 ± 2% -12.5% 1441 ± 3% proc-vmstat.nr_dirty 4841 +1.4% 4910 proc-vmstat.nr_inactive_anon 2053 -9.3% 1863 ± 2% proc-vmstat.nr_inactive_file 6092 +1.8% 6200 proc-vmstat.nr_mapped 23024 -5.4% 21771 proc-vmstat.nr_slab_reclaimable 87692 -2.6% 85426 proc-vmstat.nr_zone_active_anon 4841 +1.4% 4910 proc-vmstat.nr_zone_inactive_anon 2054 -9.3% 1863 ± 2% proc-vmstat.nr_zone_inactive_file 1506 ± 2% -6.4% 1409 ± 4% proc-vmstat.nr_zone_write_pending 389550 ± 2% -23.6% 297450 ± 4% proc-vmstat.pgfault 1710 ± 2% -6.9% 1591 proc-vmstat.unevictable_pgs_culled 442.50 +97.9% 875.75 ± 4% turbostat.Avg_MHz 1212 +101.3% 2440 ± 5% turbostat.Bzy_MHz 2797672 -38.1% 1732842 ± 24% turbostat.C6 43.52 ± 5% -37.6% 27.15 ± 21% turbostat.CPU%c1 19.21 ± 18% +73.3% 33.31 ± 23% turbostat.CPU%c6 39.53 +70.2% 67.27 ± 4% turbostat.CorWatt 58.00 ± 2% +19.8% 69.50 ± 2% turbostat.CoreTmp 7932315 -40.9% 4690927 ± 4% turbostat.IRQ 3.74 ± 15% +627.7% 27.20 ± 16% turbostat.Pkg%pc2 58.00 ± 2% +20.3% 69.75 turbostat.PkgTmp 65.47 +42.6% 93.37 ± 3% turbostat.PkgWatt 29.84 -1.4% 29.42 turbostat.RAMWatt 7830 -41.4% 4586 ± 4% turbostat.SMI 10.89 ± 2% +28.1% 13.94 ± 14% perf-stat.i.MPKI 2.959e+09 +56.8% 4.64e+09 ± 8% perf-stat.i.branch-instructions 2.52 ± 7% +0.7 3.23 ± 5% perf-stat.i.branch-miss-rate% 50498490 ± 3% +43.9% 72679553 ± 7% perf-stat.i.branch-misses 1.137e+08 +57.9% 1.796e+08 ± 7% perf-stat.i.cache-references 23951 +32.7% 31778 ± 3% perf-stat.i.context-switches 1.59 ± 2% +32.3% 2.10 ± 8% perf-stat.i.cpi 1.755e+10 +86.3% 3.27e+10 ± 8% perf-stat.i.cpu-cycles 657.40 +274.2% 2459 ± 3% perf-stat.i.cpu-migrations 3319 +82.3% 6051 ± 18% perf-stat.i.cycles-between-cache-misses 61442009 ± 13% +108.7% 1.283e+08 ± 25% perf-stat.i.dTLB-load-misses 4.525e+09 +57.4% 7.121e+09 ± 8% perf-stat.i.dTLB-loads 2.935e+09 +58.0% 4.639e+09 ± 8% perf-stat.i.dTLB-stores 1.491e+10 +56.8% 2.338e+10 ± 8% perf-stat.i.instructions 2786 ± 5% +32.7% 3698 ± 7% perf-stat.i.instructions-per-iTLB-miss 0.80 -19.0% 0.65 ± 2% perf-stat.i.ipc 3829 +26.2% 4832 ± 2% perf-stat.i.minor-faults 44.42 -23.2 21.23 ± 6% perf-stat.i.node-load-miss-rate% 1502106 -87.0% 194663 ± 12% perf-stat.i.node-load-misses 1823866 -50.6% 900788 ± 5% perf-stat.i.node-loads 39.25 -27.7 11.58 ± 9% perf-stat.i.node-store-miss-rate% 866273 -86.9% 113254 ± 11% perf-stat.i.node-store-misses 1283613 ± 2% -32.3% 868619 ± 5% perf-stat.i.node-stores 3829 +26.2% 4832 ± 2% perf-stat.i.page-faults 1.71 ± 2% -0.1 1.57 ± 3% perf-stat.overall.branch-miss-rate% 4.78 -1.4 3.36 ± 19% perf-stat.overall.cache-miss-rate% 1.18 +18.9% 1.40 perf-stat.overall.cpi 3225 +74.1% 5616 ± 18% perf-stat.overall.cycles-between-cache-misses 2765 +43.2% 3958 ± 3% perf-stat.overall.instructions-per-iTLB-miss 0.85 -15.9% 0.71 perf-stat.overall.ipc 45.16 -27.4 17.74 ± 10% perf-stat.overall.node-load-miss-rate% 40.30 -28.8 11.50 ± 7% perf-stat.overall.node-store-miss-rate% 2.928e+09 +55.6% 4.555e+09 ± 8% perf-stat.ps.branch-instructions 49979575 ± 3% +42.8% 71367590 ± 7% perf-stat.ps.branch-misses 1.126e+08 +56.7% 1.764e+08 ± 7% perf-stat.ps.cache-references 23700 +31.6% 31200 ± 3% perf-stat.ps.context-switches 1.737e+10 +84.8% 3.211e+10 ± 8% perf-stat.ps.cpu-cycles 650.62 +271.2% 2415 ± 2% perf-stat.ps.cpu-migrations 60798469 ± 13% +107.1% 1.259e+08 ± 25% perf-stat.ps.dTLB-load-misses 4.478e+09 +56.1% 6.991e+09 ± 8% perf-stat.ps.dTLB-loads 2.905e+09 +56.8% 4.554e+09 ± 8% perf-stat.ps.dTLB-stores 1.476e+10 +55.5% 2.295e+10 ± 8% perf-stat.ps.instructions 3793 +25.2% 4750 ± 2% perf-stat.ps.minor-faults 1486398 -87.1% 191161 ± 12% perf-stat.ps.node-load-misses 1804836 -51.0% 884411 ± 4% perf-stat.ps.node-loads 857233 -87.0% 111233 ± 11% perf-stat.ps.node-store-misses 1270431 ± 3% -32.8% 853281 ± 5% perf-stat.ps.node-stores 3793 +25.2% 4750 ± 2% perf-stat.ps.page-faults 1.429e+12 -9.8% 1.289e+12 ± 3% perf-stat.total.instructions 16831 ± 15% -43.7% 9474 ± 54% sched_debug.cfs_rq:/.load.avg 22212 ± 3% -37.5% 13874 ± 27% sched_debug.cfs_rq:/.load.stddev 169393 -94.8% 8797 ± 15% sched_debug.cfs_rq:/.min_vruntime.avg 272607 ± 7% -90.2% 26667 ± 7% sched_debug.cfs_rq:/.min_vruntime.max 154234 -97.3% 4213 ± 32% sched_debug.cfs_rq:/.min_vruntime.min 19456 ± 16% -80.0% 3882 ± 9% sched_debug.cfs_rq:/.min_vruntime.stddev 22.37 ± 47% +210.1% 69.37 ± 30% sched_debug.cfs_rq:/.removed.load_avg.avg 511.88 +98.6% 1016 sched_debug.cfs_rq:/.removed.load_avg.max 101.46 ± 22% +148.4% 252.04 ± 13% sched_debug.cfs_rq:/.removed.load_avg.stddev 1028 ± 47% +210.7% 3196 ± 30% sched_debug.cfs_rq:/.removed.runnable_sum.avg 23594 +98.6% 46851 sched_debug.cfs_rq:/.removed.runnable_sum.max 4662 ± 23% +149.0% 11606 ± 14% sched_debug.cfs_rq:/.removed.runnable_sum.stddev 7.23 ± 73% +204.5% 22.03 ± 30% sched_debug.cfs_rq:/.removed.util_avg.avg 161.38 ± 41% +148.8% 401.50 ± 16% sched_debug.cfs_rq:/.removed.util_avg.max 30.90 ± 54% +168.1% 82.85 ± 17% sched_debug.cfs_rq:/.removed.util_avg.stddev 50.00 ± 23% -59.0% 20.50 ± 32% sched_debug.cfs_rq:/.runnable_load_avg.max 11.74 ± 11% -40.8% 6.96 ± 17% sched_debug.cfs_rq:/.runnable_load_avg.stddev 15326 ± 17% -63.0% 5666 ± 39% sched_debug.cfs_rq:/.runnable_weight.avg 49945 ± 26% -64.9% 17523 ± 2% sched_debug.cfs_rq:/.runnable_weight.max 18578 ± 4% -59.6% 7497 ± 6% sched_debug.cfs_rq:/.runnable_weight.stddev 8409 ± 31% -76.7% 1957 ±148% sched_debug.cfs_rq:/.spread0.avg 111574 ± 18% -82.2% 19830 ± 15% sched_debug.cfs_rq:/.spread0.max 19452 ± 16% -80.0% 3882 ± 9% sched_debug.cfs_rq:/.spread0.stddev 511.75 ± 4% +28.4% 657.24 ± 3% sched_debug.cfs_rq:/.util_avg.avg 1142 ± 19% +64.1% 1874 ± 15% sched_debug.cfs_rq:/.util_avg.max 224.31 ± 13% +57.3% 352.88 ± 12% sched_debug.cfs_rq:/.util_avg.stddev 402.25 ± 6% +82.8% 735.50 ± 39% sched_debug.cfs_rq:/.util_est_enqueued.max 77474 -40.9% 45783 sched_debug.cpu.clock.avg 77488 -40.9% 45785 sched_debug.cpu.clock.max 77459 -40.9% 45782 sched_debug.cpu.clock.min 8.70 ± 7% -88.8% 0.97 ± 20% sched_debug.cpu.clock.stddev 77474 -40.9% 45783 sched_debug.cpu.clock_task.avg 77488 -40.9% 45785 sched_debug.cpu.clock_task.max 77459 -40.9% 45782 sched_debug.cpu.clock_task.min 8.70 ± 7% -88.8% 0.97 ± 19% sched_debug.cpu.clock_task.stddev 915.80 ± 10% -51.4% 445.02 ± 47% sched_debug.cpu.curr->pid.avg 3861 -61.4% 1491 sched_debug.cpu.curr->pid.max 1217 ± 4% -50.5% 602.25 ± 10% sched_debug.cpu.curr->pid.stddev 16323 ± 15% -44.2% 9109 ± 59% sched_debug.cpu.load.avg 21622 ± 4% -37.7% 13475 ± 30% sched_debug.cpu.load.stddev 0.00 -20.4% 0.00 ± 9% sched_debug.cpu.next_balance.stddev 18548 -90.5% 1754 sched_debug.cpu.nr_switches.avg 28918 ± 13% -68.0% 9245 ± 13% sched_debug.cpu.nr_switches.max 16063 -97.5% 393.75 ± 18% sched_debug.cpu.nr_switches.min 2732 ± 19% -28.6% 1949 ± 4% sched_debug.cpu.nr_switches.stddev 37.33 -99.9% 0.04 ± 47% sched_debug.cpu.nr_uninterruptible.avg 65.88 ± 4% -78.7% 14.00 ± 19% sched_debug.cpu.nr_uninterruptible.max 0.38 ±1163% -3300.0% -12.00 sched_debug.cpu.nr_uninterruptible.min 13.99 ± 5% -62.9% 5.19 ± 18% sched_debug.cpu.nr_uninterruptible.stddev 77458 -40.9% 45782 sched_debug.cpu_clk 73890 -42.9% 42214 sched_debug.ktime 77902 -40.7% 46230 sched_debug.sched_clk 4118075 -50.0% 2059067 sched_debug.sysctl_sched.sysctl_sched_features 82.50 ± 26% -56.7% 35.75 ± 8% interrupts.46:IR-PCI-MSI.524296-edge.eth0-TxRx-7 53735 ± 12% -38.0% 33311 ± 18% interrupts.CAL:Function_call_interrupts 1332 ± 17% -40.6% 792.00 ± 6% interrupts.CPU0.CAL:Function_call_interrupts 194871 -41.5% 114092 ± 5% interrupts.CPU0.LOC:Local_timer_interrupts 1238 ± 22% -31.7% 845.50 ± 19% interrupts.CPU1.CAL:Function_call_interrupts 194825 -41.5% 113996 ± 5% interrupts.CPU1.LOC:Local_timer_interrupts 1407 ± 13% -54.2% 644.75 ± 56% interrupts.CPU10.CAL:Function_call_interrupts 194623 -41.5% 113842 ± 5% interrupts.CPU10.LOC:Local_timer_interrupts 1374 ± 11% -44.7% 759.25 ± 34% interrupts.CPU11.CAL:Function_call_interrupts 194412 -41.4% 113933 ± 5% interrupts.CPU11.LOC:Local_timer_interrupts 1328 ± 11% -37.5% 830.50 ± 20% interrupts.CPU12.CAL:Function_call_interrupts 194595 -41.5% 113779 ± 5% interrupts.CPU12.LOC:Local_timer_interrupts 1343 ± 13% -38.1% 831.50 ± 17% interrupts.CPU13.CAL:Function_call_interrupts 194303 -41.4% 113905 ± 5% interrupts.CPU13.LOC:Local_timer_interrupts 1368 ± 13% -40.1% 819.50 ± 24% interrupts.CPU14.CAL:Function_call_interrupts 194467 -41.5% 113778 ± 5% interrupts.CPU14.LOC:Local_timer_interrupts 1321 ± 12% -36.2% 842.75 ± 17% interrupts.CPU15.CAL:Function_call_interrupts 194381 -41.4% 113837 ± 5% interrupts.CPU15.LOC:Local_timer_interrupts 0.25 ±173% +3e+05% 758.50 ±135% interrupts.CPU15.NMI:Non-maskable_interrupts 0.25 ±173% +3e+05% 758.50 ±135% interrupts.CPU15.PMI:Performance_monitoring_interrupts 1392 ± 11% -38.8% 853.00 ± 21% interrupts.CPU16.CAL:Function_call_interrupts 194459 -41.6% 113628 ± 5% interrupts.CPU16.LOC:Local_timer_interrupts 1342 ± 13% -36.9% 847.25 ± 22% interrupts.CPU17.CAL:Function_call_interrupts 194550 -41.4% 114039 ± 5% interrupts.CPU17.LOC:Local_timer_interrupts 1384 ± 11% -39.5% 838.00 ± 23% interrupts.CPU18.CAL:Function_call_interrupts 194763 -41.7% 113644 ± 5% interrupts.CPU18.LOC:Local_timer_interrupts 1313 ± 14% -38.4% 809.25 ± 20% interrupts.CPU19.CAL:Function_call_interrupts 194423 -41.5% 113805 ± 5% interrupts.CPU19.LOC:Local_timer_interrupts 1321 ± 16% -40.7% 783.50 ± 6% interrupts.CPU2.CAL:Function_call_interrupts 194631 -41.5% 113909 ± 5% interrupts.CPU2.LOC:Local_timer_interrupts 1343 ± 13% -38.5% 826.00 ± 20% interrupts.CPU20.CAL:Function_call_interrupts 194623 -41.6% 113580 ± 5% interrupts.CPU20.LOC:Local_timer_interrupts 1359 ± 10% -39.0% 829.00 ± 20% interrupts.CPU21.CAL:Function_call_interrupts 194239 -41.5% 113601 ± 5% interrupts.CPU21.LOC:Local_timer_interrupts 1342 ± 10% -35.6% 864.75 ± 19% interrupts.CPU22.CAL:Function_call_interrupts 194576 -41.6% 113638 ± 5% interrupts.CPU22.LOC:Local_timer_interrupts 1266 ± 15% -33.7% 839.75 ± 19% interrupts.CPU23.CAL:Function_call_interrupts 194697 -41.5% 113967 ± 5% interrupts.CPU23.LOC:Local_timer_interrupts 1347 ± 9% -38.4% 829.25 ± 18% interrupts.CPU24.CAL:Function_call_interrupts 194727 -41.6% 113754 ± 5% interrupts.CPU24.LOC:Local_timer_interrupts 1365 ± 10% -37.5% 853.00 ± 19% interrupts.CPU25.CAL:Function_call_interrupts 194528 -41.7% 113506 ± 5% interrupts.CPU25.LOC:Local_timer_interrupts 1373 ± 13% -39.4% 832.00 ± 18% interrupts.CPU26.CAL:Function_call_interrupts 194512 -41.6% 113661 ± 5% interrupts.CPU26.LOC:Local_timer_interrupts 1296 ± 9% -34.6% 847.75 ± 20% interrupts.CPU27.CAL:Function_call_interrupts 194614 -41.6% 113595 ± 5% interrupts.CPU27.LOC:Local_timer_interrupts 1365 ± 14% -37.6% 851.25 ± 17% interrupts.CPU28.CAL:Function_call_interrupts 194549 -41.5% 113820 ± 5% interrupts.CPU28.LOC:Local_timer_interrupts 1337 ± 13% -35.7% 859.75 ± 20% interrupts.CPU29.CAL:Function_call_interrupts 194031 -41.5% 113597 ± 5% interrupts.CPU29.LOC:Local_timer_interrupts 1396 ± 13% -37.2% 877.50 ± 17% interrupts.CPU3.CAL:Function_call_interrupts 194664 -41.5% 113892 ± 5% interrupts.CPU3.LOC:Local_timer_interrupts 1330 ± 16% -37.4% 832.75 ± 20% interrupts.CPU30.CAL:Function_call_interrupts 194570 -41.6% 113635 ± 5% interrupts.CPU30.LOC:Local_timer_interrupts 1383 ± 11% -38.3% 854.25 ± 20% interrupts.CPU31.CAL:Function_call_interrupts 194286 -41.3% 113951 ± 5% interrupts.CPU31.LOC:Local_timer_interrupts 1387 ± 14% -37.7% 864.25 ± 19% interrupts.CPU32.CAL:Function_call_interrupts 194533 -41.5% 113746 ± 5% interrupts.CPU32.LOC:Local_timer_interrupts 1394 ± 11% -37.5% 871.25 ± 18% interrupts.CPU33.CAL:Function_call_interrupts 194217 -41.3% 113930 ± 5% interrupts.CPU33.LOC:Local_timer_interrupts 1336 ± 13% -35.7% 859.00 ± 17% interrupts.CPU34.CAL:Function_call_interrupts 194473 -41.6% 113476 ± 5% interrupts.CPU34.LOC:Local_timer_interrupts 1418 ± 12% -46.2% 763.50 interrupts.CPU35.CAL:Function_call_interrupts 193683 -41.1% 114008 ± 5% interrupts.CPU35.LOC:Local_timer_interrupts 1327 ± 14% -37.1% 834.50 ± 19% interrupts.CPU36.CAL:Function_call_interrupts 194371 -41.4% 113856 ± 5% interrupts.CPU36.LOC:Local_timer_interrupts 1416 ± 12% -38.8% 866.25 ± 16% interrupts.CPU37.CAL:Function_call_interrupts 194608 -41.6% 113567 ± 5% interrupts.CPU37.LOC:Local_timer_interrupts 1248 ± 15% -32.1% 847.00 ± 18% interrupts.CPU38.CAL:Function_call_interrupts 194605 -41.6% 113710 ± 4% interrupts.CPU38.LOC:Local_timer_interrupts 1383 ± 12% -36.5% 879.00 ± 16% interrupts.CPU39.CAL:Function_call_interrupts 194202 -41.4% 113771 ± 4% interrupts.CPU39.LOC:Local_timer_interrupts 194948 -41.4% 114147 ± 5% interrupts.CPU4.LOC:Local_timer_interrupts 1372 ± 15% -40.1% 821.75 ± 12% interrupts.CPU5.CAL:Function_call_interrupts 194497 -41.4% 113935 ± 4% interrupts.CPU5.LOC:Local_timer_interrupts 82.50 ± 26% -56.7% 35.75 ± 8% interrupts.CPU6.46:IR-PCI-MSI.524296-edge.eth0-TxRx-7 1311 ± 16% -35.8% 841.25 ± 19% interrupts.CPU6.CAL:Function_call_interrupts 194664 -41.6% 113681 ± 5% interrupts.CPU6.LOC:Local_timer_interrupts 1369 ± 15% -41.9% 795.25 ± 25% interrupts.CPU7.CAL:Function_call_interrupts 194564 -41.9% 113071 ± 5% interrupts.CPU7.LOC:Local_timer_interrupts 1157 ± 8% -25.3% 864.50 ± 20% interrupts.CPU8.CAL:Function_call_interrupts 194149 ± 2% -41.5% 113655 ± 5% interrupts.CPU8.LOC:Local_timer_interrupts 1375 ± 12% -38.7% 843.00 ± 18% interrupts.CPU9.CAL:Function_call_interrupts 194395 -41.5% 113680 ± 5% interrupts.CPU9.LOC:Local_timer_interrupts 7779842 -41.5% 4550633 ± 5% interrupts.LOC:Local_timer_interrupts 25675 ± 7% -21.0% 20272 ± 9% interrupts.RES:Rescheduling_interrupts 451.00 ± 8% -88.1% 53.50 ± 17% interrupts.TLB:TLB_shootdowns 19946 ± 7% -40.9% 11790 ± 20% softirqs.CPU0.RCU 19817 ± 2% -29.8% 13910 ± 10% softirqs.CPU0.SCHED 43197 ± 8% -21.7% 33827 ± 11% softirqs.CPU0.TIMER 18688 ± 3% -30.7% 12947 ± 21% softirqs.CPU1.RCU 16685 ± 11% -29.6% 11751 ± 9% softirqs.CPU1.SCHED 44256 ± 8% -25.2% 33089 ± 8% softirqs.CPU1.TIMER 19996 ± 9% -39.0% 12204 ± 27% softirqs.CPU10.RCU 15913 ± 2% -30.2% 11105 ± 8% softirqs.CPU10.SCHED 40129 ± 10% -17.0% 33322 ± 13% softirqs.CPU10.TIMER 16202 ± 2% -32.2% 10990 ± 10% softirqs.CPU11.SCHED 21689 ± 14% -41.8% 12626 ± 23% softirqs.CPU12.RCU 16379 -31.7% 11184 ± 9% softirqs.CPU12.SCHED 42920 ± 11% -21.9% 33536 ± 13% softirqs.CPU12.TIMER 20122 ± 11% -33.2% 13434 ± 22% softirqs.CPU13.RCU 16068 -27.9% 11577 ± 13% softirqs.CPU13.SCHED 39693 ± 7% -19.8% 31847 ± 16% softirqs.CPU13.TIMER 19764 ± 7% -36.7% 12514 ± 24% softirqs.CPU14.RCU 16255 -31.3% 11166 ± 9% softirqs.CPU14.SCHED 42132 ± 8% -20.0% 33710 ± 14% softirqs.CPU14.TIMER 18945 ± 11% -35.7% 12181 ± 19% softirqs.CPU15.RCU 16018 -29.6% 11281 ± 11% softirqs.CPU15.SCHED 41548 ± 8% -23.7% 31715 ± 12% softirqs.CPU15.TIMER 18599 ± 10% -37.4% 11642 ± 22% softirqs.CPU16.RCU 16171 -30.8% 11194 ± 8% softirqs.CPU16.SCHED 41697 ± 9% -20.0% 33341 ± 14% softirqs.CPU16.TIMER 18572 ± 9% -35.8% 11914 ± 20% softirqs.CPU17.RCU 16078 -31.0% 11097 ± 10% softirqs.CPU17.SCHED 41818 ± 8% -24.6% 31542 ± 12% softirqs.CPU17.TIMER 19529 ± 11% -31.8% 13321 ± 20% softirqs.CPU18.RCU 16299 -32.0% 11088 ± 9% softirqs.CPU18.SCHED 41973 ± 9% -13.7% 36226 ± 4% softirqs.CPU18.TIMER 19155 ± 14% -37.2% 12030 ± 18% softirqs.CPU19.RCU 15933 -31.2% 10960 ± 10% softirqs.CPU19.SCHED 41328 ± 8% -24.3% 31272 ± 13% softirqs.CPU19.TIMER 19380 ± 8% -38.3% 11966 ± 21% softirqs.CPU2.RCU 15843 -30.7% 10972 ± 8% softirqs.CPU2.SCHED 39786 ± 8% -18.4% 32480 ± 12% softirqs.CPU2.TIMER 19291 ± 6% -38.1% 11938 ± 27% softirqs.CPU20.RCU 15901 -30.8% 11000 ± 9% softirqs.CPU20.SCHED 42458 ± 10% -22.0% 33120 ± 11% softirqs.CPU20.TIMER 18429 ± 9% -37.6% 11502 ± 23% softirqs.CPU21.RCU 15630 -31.2% 10751 ± 10% softirqs.CPU21.SCHED 45924 ± 14% -26.0% 33990 ± 15% softirqs.CPU21.TIMER 20068 ± 15% -40.4% 11966 ± 20% softirqs.CPU22.RCU 16223 -28.1% 11661 ± 10% softirqs.CPU22.SCHED 42617 ± 7% -19.7% 34214 ± 12% softirqs.CPU22.TIMER 18960 ± 11% -37.3% 11888 ± 19% softirqs.CPU23.RCU 15935 -30.9% 11011 ± 10% softirqs.CPU23.SCHED 41194 ± 8% -23.1% 31659 ± 13% softirqs.CPU23.TIMER 18558 ± 5% -29.2% 13132 ± 20% softirqs.CPU24.RCU 15951 -24.4% 12062 ± 10% softirqs.CPU24.SCHED 18797 ± 5% -34.2% 12369 ± 20% softirqs.CPU25.RCU 15844 ± 2% -30.9% 10942 ± 10% softirqs.CPU25.SCHED 41061 ± 8% -24.0% 31214 ± 13% softirqs.CPU25.TIMER 18513 ± 5% -32.0% 12587 ± 15% softirqs.CPU26.RCU 15963 -33.2% 10656 ± 13% softirqs.CPU26.SCHED 40830 ± 8% -18.0% 33465 ± 11% softirqs.CPU26.TIMER 19599 ± 4% -37.8% 12193 ± 17% softirqs.CPU27.RCU 15971 -32.0% 10867 ± 11% softirqs.CPU27.SCHED 41102 ± 8% -24.6% 30994 ± 14% softirqs.CPU27.TIMER 18702 ± 5% -32.2% 12680 ± 24% softirqs.CPU28.RCU 15917 -30.1% 11133 ± 9% softirqs.CPU28.SCHED 19030 ± 6% -29.0% 13502 ± 12% softirqs.CPU29.RCU 15760 -34.2% 10364 ± 10% softirqs.CPU29.SCHED 40750 ± 7% -27.9% 29389 ± 16% softirqs.CPU29.TIMER 18537 ± 7% -36.3% 11810 ± 21% softirqs.CPU3.RCU 16046 -26.5% 11794 ± 14% softirqs.CPU3.SCHED 41710 ± 7% -20.8% 33037 ± 13% softirqs.CPU3.TIMER 19472 ± 3% -35.8% 12505 ± 29% softirqs.CPU30.RCU 16393 ± 10% -30.1% 11454 ± 7% softirqs.CPU30.SCHED 41400 ± 12% -19.8% 33212 ± 13% softirqs.CPU30.TIMER 19359 ± 11% -27.3% 14072 ± 35% softirqs.CPU31.RCU 15934 -31.5% 10919 ± 9% softirqs.CPU31.SCHED 40819 ± 7% -21.3% 32137 ± 9% softirqs.CPU31.TIMER 16093 ± 3% -28.0% 11593 ± 15% softirqs.CPU32.RCU 16246 -31.3% 11155 ± 8% softirqs.CPU32.SCHED 47985 ± 25% -30.6% 33324 ± 14% softirqs.CPU32.TIMER 15827 -30.7% 10971 ± 10% softirqs.CPU33.SCHED 46245 ± 24% -33.3% 30843 ± 15% softirqs.CPU33.TIMER 15699 ± 4% -24.7% 11814 ± 19% softirqs.CPU34.RCU 16555 ± 3% -32.9% 11104 ± 8% softirqs.CPU34.SCHED 42829 ± 11% -22.5% 33173 ± 14% softirqs.CPU34.TIMER 16117 ± 10% -20.7% 12777 ± 17% softirqs.CPU35.RCU 15805 -28.4% 11316 ± 8% softirqs.CPU35.SCHED 40683 ± 8% -16.3% 34055 ± 6% softirqs.CPU35.TIMER 16589 ± 10% -31.5% 11370 ± 22% softirqs.CPU36.RCU 16144 -30.1% 11288 ± 10% softirqs.CPU36.SCHED 42962 ± 7% -22.4% 33333 ± 14% softirqs.CPU36.TIMER 15331 ± 6% -30.6% 10639 ± 19% softirqs.CPU37.RCU 15952 -31.4% 10947 ± 10% softirqs.CPU37.SCHED 41421 ± 8% -25.1% 31043 ± 13% softirqs.CPU37.TIMER 16505 ± 2% -27.5% 11964 ± 11% softirqs.CPU38.RCU 16148 -30.9% 11154 ± 9% softirqs.CPU38.SCHED 42112 ± 9% -14.6% 35964 ± 4% softirqs.CPU38.TIMER 16093 ± 10% -28.3% 11545 ± 18% softirqs.CPU39.RCU 15663 ± 2% -29.6% 11019 ± 10% softirqs.CPU39.SCHED 41200 ± 8% -24.3% 31177 ± 13% softirqs.CPU39.TIMER 19221 ± 9% -30.8% 13308 ± 18% softirqs.CPU4.RCU 16202 -30.1% 11324 ± 9% softirqs.CPU4.SCHED 41555 ± 7% -16.8% 34581 ± 13% softirqs.CPU4.TIMER 19280 ± 7% -37.2% 12116 ± 18% softirqs.CPU5.RCU 16022 -30.9% 11078 ± 9% softirqs.CPU5.SCHED 41331 ± 7% -23.7% 31525 ± 13% softirqs.CPU5.TIMER 18571 ± 5% -35.0% 12077 ± 18% softirqs.CPU6.RCU 16260 -31.8% 11089 ± 9% softirqs.CPU6.SCHED 41622 ± 7% -19.5% 33490 ± 11% softirqs.CPU6.TIMER 20088 ± 12% -33.5% 13366 ± 21% softirqs.CPU7.RCU 15954 -31.4% 10938 ± 9% softirqs.CPU7.SCHED 41204 ± 7% -24.8% 31005 ± 14% softirqs.CPU7.TIMER 20245 ± 15% -39.4% 12265 ± 16% softirqs.CPU8.RCU 16899 ± 8% -33.9% 11171 ± 9% softirqs.CPU8.SCHED 43299 ± 8% -23.1% 33315 ± 12% softirqs.CPU8.TIMER 18595 ± 9% -35.5% 12003 ± 19% softirqs.CPU9.RCU 15926 -36.4% 10121 ± 12% softirqs.CPU9.SCHED 40671 ± 8% -28.2% 29193 ± 14% softirqs.CPU9.TIMER 743548 ± 6% -33.4% 495313 ± 2% softirqs.RCU 646757 -30.8% 447589 ± 3% softirqs.SCHED 1685003 ± 7% -21.9% 1315155 ± 5% softirqs.TIMER 40.35 -20.7 19.69 ± 19% perf-profile.calltrace.cycles-pp.secondary_startup_64 38.36 ± 2% -20.5 17.82 ± 16% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 36.32 ± 2% -20.4 15.89 ± 16% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 39.57 ± 2% -20.3 19.22 ± 17% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 39.57 ± 2% -20.3 19.22 ± 17% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 39.55 ± 2% -20.3 19.20 ± 17% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.63 ± 5% +0.1 0.71 ± 5% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.path_openat 1.00 ± 4% +0.1 1.10 ± 2% perf-profile.calltrace.cycles-pp.down_write.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 0.99 ± 4% +0.1 1.10 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.99 ± 4% +0.1 1.10 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.do_unlinkat.do_syscall_64 0.86 ± 4% +0.1 0.98 ± 3% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.do_unlinkat 0.64 ± 4% +0.1 0.77 ± 4% perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat 0.64 ± 4% +0.1 0.77 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open 0.56 ± 5% +0.1 0.70 ± 4% perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create 0.67 ± 11% +0.2 0.85 ± 7% perf-profile.calltrace.cycles-pp.__cancel_dirty_page.truncate_cleanup_page.truncate_inode_pages_range.evict.__dentry_kill 0.59 ± 5% +0.2 0.77 perf-profile.calltrace.cycles-pp.iov_iter_fault_in_readable.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 0.66 ± 11% +0.2 0.85 ± 6% perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode.__dentry_kill 0.63 ± 3% +0.2 0.83 ± 5% perf-profile.calltrace.cycles-pp.__pagevec_lru_add_fn.pagevec_lru_move_fn.__lru_cache_add.add_to_page_cache_lru.pagecache_get_page 0.90 ± 7% +0.2 1.13 ± 4% perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode.__dentry_kill.dentry_kill 0.60 ± 2% +0.3 0.85 ± 5% perf-profile.calltrace.cycles-pp.xfs_break_layouts.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write.vfs_write 0.63 ± 10% +0.3 0.88 ± 8% perf-profile.calltrace.cycles-pp.down_write.xfs_ilock.xfs_file_buffered_aio_write.new_sync_write.vfs_write 0.81 ± 8% +0.3 1.08 ± 9% perf-profile.calltrace.cycles-pp.truncate_cleanup_page.truncate_inode_pages_range.evict.__dentry_kill.dentry_kill 0.81 ± 7% +0.3 1.07 ± 7% perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 1.11 ± 8% +0.3 1.39 ± 4% perf-profile.calltrace.cycles-pp.xfs_fs_destroy_inode.__dentry_kill.dentry_kill.dput.__fput 1.10 ± 8% +0.3 1.38 ± 4% perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_fs_destroy_inode.__dentry_kill.dentry_kill.dput 1.46 ± 4% +0.3 1.74 ± 6% perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_open.do_syscall_64 1.41 ± 3% +0.3 1.70 ± 6% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_open 0.66 ± 5% +0.3 0.97 ± 12% perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 0.79 ± 7% +0.3 1.12 ± 5% perf-profile.calltrace.cycles-pp.down_write.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply 0.92 ± 3% +0.4 1.29 ± 8% perf-profile.calltrace.cycles-pp.__set_page_dirty.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply 2.77 ± 3% +0.4 3.15 ± 3% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 0.96 ± 5% +0.4 1.33 ± 7% perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write 0.90 ± 2% +0.4 1.28 ± 8% perf-profile.calltrace.cycles-pp.delete_from_page_cache_batch.truncate_inode_pages_range.evict.__dentry_kill.dentry_kill 2.77 ± 3% +0.4 3.15 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat 2.77 ± 3% +0.4 3.15 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 2.72 ± 3% +0.4 3.10 ± 3% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 2.81 ± 2% +0.4 3.20 ± 3% perf-profile.calltrace.cycles-pp.creat 2.71 ± 3% +0.4 3.10 ± 3% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ± 6% +0.4 1.20 ± 9% perf-profile.calltrace.cycles-pp.xfs_file_iomap_end.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 0.70 ± 2% +0.4 1.11 ± 8% perf-profile.calltrace.cycles-pp.free_unref_page_list.release_pages.__pagevec_release.truncate_inode_pages_range.evict 0.68 ± 2% +0.4 1.09 ± 5% perf-profile.calltrace.cycles-pp.__mark_inode_dirty.__generic_write_end.iomap_write_end.iomap_write_actor.iomap_apply 0.13 ±173% +0.5 0.58 ± 5% perf-profile.calltrace.cycles-pp.xfs_iunlock.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 0.95 +0.5 1.42 ± 4% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin 0.13 ±173% +0.5 0.61 ± 4% perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode 0.13 ±173% +0.5 0.61 ± 5% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create 0.15 ±173% +0.5 0.65 ± 8% perf-profile.calltrace.cycles-pp.balance_dirty_pages_ratelimited.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 1.09 +0.5 1.60 ± 4% perf-profile.calltrace.cycles-pp.__lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 0.12 ±173% +0.5 0.65 ± 8% perf-profile.calltrace.cycles-pp.__list_del_entry_valid.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.grab_cache_page_write_begin 2.24 +0.6 2.80 ± 4% perf-profile.calltrace.cycles-pp.iomap_read_page_sync.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.49 ± 3% +0.6 2.05 ± 4% perf-profile.calltrace.cycles-pp.memset_erms.iomap_read_page_sync.iomap_write_begin.iomap_write_actor.iomap_apply 1.43 ± 3% +0.6 1.99 ± 3% perf-profile.calltrace.cycles-pp.__generic_write_end.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 0.13 ±173% +0.6 0.69 ± 10% perf-profile.calltrace.cycles-pp.xas_store.delete_from_page_cache_batch.truncate_inode_pages_range.evict.__dentry_kill 1.10 ± 32% +0.6 1.67 ± 9% perf-profile.calltrace.cycles-pp.xfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 1.55 ± 5% +0.6 2.14 ± 7% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 1.59 ± 3% +0.6 2.19 ± 6% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 0.00 +0.6 0.60 ± 7% perf-profile.calltrace.cycles-pp.iov_iter_advance.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 0.00 +0.6 0.61 ± 10% perf-profile.calltrace.cycles-pp.xfs_iunlock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write 0.00 +0.6 0.62 ± 7% perf-profile.calltrace.cycles-pp.generic_write_checks.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write.vfs_write 3.15 ± 4% +0.7 3.80 ± 5% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.write 0.00 +0.7 0.67 ± 5% perf-profile.calltrace.cycles-pp.xas_store.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin 1.86 ± 3% +0.7 2.54 ± 5% perf-profile.calltrace.cycles-pp.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.70 ± 4% +0.7 2.40 ± 4% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 1.50 ± 2% +0.7 2.22 ± 7% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 0.00 +0.7 0.73 ± 8% perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page_list.release_pages.__pagevec_release.truncate_inode_pages_range 1.67 ± 5% +0.7 2.41 ± 10% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply 0.48 ± 65% +0.7 1.22 ± 13% perf-profile.calltrace.cycles-pp.xfs_bmbt_to_iomap.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write 1.77 ± 5% +0.7 2.51 ± 10% perf-profile.calltrace.cycles-pp.copyin.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write 2.95 ± 4% +0.8 3.71 ± 6% perf-profile.calltrace.cycles-pp.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 1.34 ± 3% +0.9 2.19 ± 8% perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill 1.38 ± 3% +0.9 2.25 ± 8% perf-profile.calltrace.cycles-pp.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill.dentry_kill 1.94 ± 4% +0.9 2.82 ± 6% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.93 ± 3% +1.0 2.89 ± 6% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 2.17 ± 3% +1.0 3.15 ± 8% perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 2.90 ± 2% +1.2 4.14 ± 4% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 4.06 +1.3 5.40 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.write 4.48 ± 2% +1.4 5.91 ± 3% perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 3.66 ± 2% +1.7 5.35 ± 8% perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dentry_kill.dput.__fput 3.62 ± 2% +1.7 5.32 ± 8% perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.__dentry_kill.dentry_kill.dput 4.84 ± 2% +2.0 6.83 ± 7% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64 4.83 ± 3% +2.0 6.81 ± 7% perf-profile.calltrace.cycles-pp.dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop 4.88 ± 2% +2.0 6.87 ± 7% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 4.82 ± 2% +2.0 6.81 ± 7% perf-profile.calltrace.cycles-pp.__dentry_kill.dentry_kill.dput.__fput.task_work_run 4.90 ± 2% +2.0 6.89 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 4.86 ± 2% +2.0 6.86 ± 7% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.90 ± 2% +2.0 6.90 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.close 4.88 ± 2% +2.0 6.88 ± 7% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 4.99 ± 2% +2.0 6.99 ± 6% perf-profile.calltrace.cycles-pp.close 4.00 ± 4% +2.1 6.13 ± 6% perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 4.58 ± 4% +2.6 7.20 ± 6% perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 7.26 +3.2 10.44 ± 4% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply 7.59 +3.4 10.97 ± 5% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 10.32 +4.3 14.59 ± 4% perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 19.30 +7.9 27.20 ± 4% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 25.45 +11.3 36.77 ± 4% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write 25.66 +11.4 37.04 ± 4% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 30.90 +13.0 43.92 ± 4% perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 32.50 +13.9 46.39 ± 4% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 37.04 +15.5 52.50 ± 4% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 38.13 +15.9 54.04 ± 4% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 39.69 +16.3 56.01 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 40.00 +16.5 56.50 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 47.72 +18.3 66.03 ± 5% perf-profile.calltrace.cycles-pp.write 39.21 -20.9 18.33 ± 18% perf-profile.children.cycles-pp.cpuidle_enter_state 37.05 -20.8 16.28 ± 17% perf-profile.children.cycles-pp.intel_idle 40.35 -20.7 19.69 ± 19% perf-profile.children.cycles-pp.secondary_startup_64 40.35 -20.7 19.69 ± 19% perf-profile.children.cycles-pp.cpu_startup_entry 40.35 -20.7 19.70 ± 19% perf-profile.children.cycles-pp.do_idle 39.57 ± 2% -20.3 19.22 ± 17% perf-profile.children.cycles-pp.start_secondary 0.69 ± 8% -0.4 0.32 ± 19% perf-profile.children.cycles-pp.xfs_vn_update_time 1.43 ± 2% -0.2 1.21 ± 6% perf-profile.children.cycles-pp.__xfs_trans_commit 1.34 ± 2% -0.2 1.13 ± 5% perf-profile.children.cycles-pp.xfs_log_commit_cil 0.33 ± 11% -0.1 0.22 ± 15% perf-profile.children.cycles-pp.xfs_trans_alloc 0.24 ± 9% -0.1 0.15 ± 20% perf-profile.children.cycles-pp.task_tick_fair 0.27 ± 7% -0.1 0.18 ± 21% perf-profile.children.cycles-pp.ktime_get 0.24 ± 11% -0.1 0.17 ± 20% perf-profile.children.cycles-pp.xfs_trans_reserve 0.22 ± 14% -0.1 0.15 ± 18% perf-profile.children.cycles-pp.xfs_log_reserve 0.35 ± 7% -0.1 0.29 ± 8% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.15 ± 14% -0.1 0.09 ± 9% perf-profile.children.cycles-pp.update_load_avg 0.10 ± 15% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.xfs_log_done 0.17 ± 7% -0.0 0.13 ± 14% perf-profile.children.cycles-pp.schedule_idle 0.14 ± 6% -0.0 0.10 ± 10% perf-profile.children.cycles-pp.ttwu_do_activate 0.13 ± 6% -0.0 0.09 ± 14% perf-profile.children.cycles-pp.enqueue_task_fair 0.10 ± 10% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.enqueue_entity 0.10 ± 5% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.memcpy_erms 0.08 ± 13% +0.0 0.10 ± 10% perf-profile.children.cycles-pp.xfs_verify_agino 0.09 ± 12% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.__x86_indirect_thunk_r10 0.07 ± 5% +0.0 0.10 ± 21% perf-profile.children.cycles-pp.vfprintf 0.08 ± 14% +0.0 0.10 ± 15% perf-profile.children.cycles-pp.iomap_page_create 0.12 ± 8% +0.0 0.15 ± 7% perf-profile.children.cycles-pp.xfs_buf_unlock 0.11 ± 10% +0.0 0.14 ± 10% perf-profile.children.cycles-pp.up 0.06 ± 11% +0.0 0.09 ± 14% perf-profile.children.cycles-pp.xas_find 0.10 ± 14% +0.0 0.14 ± 10% perf-profile.children.cycles-pp.times 0.06 ± 15% +0.0 0.09 ± 20% perf-profile.children.cycles-pp.__x86_indirect_thunk_r15 0.23 ± 2% +0.0 0.26 ± 6% perf-profile.children.cycles-pp.try_to_wake_up 0.19 +0.0 0.23 ± 8% perf-profile.children.cycles-pp.xfs_dir_ino_validate 0.10 ± 14% +0.0 0.15 ± 7% perf-profile.children.cycles-pp.node_page_state 0.20 ± 15% +0.0 0.24 ± 9% perf-profile.children.cycles-pp.xfs_inactive_truncate 0.19 ± 13% +0.0 0.24 ± 11% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.09 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.xfs_isilocked 0.13 ± 14% +0.0 0.18 ± 12% perf-profile.children.cycles-pp.xas_clear_mark 0.05 ± 59% +0.0 0.10 ± 14% perf-profile.children.cycles-pp.mem_cgroup_update_lru_size 0.09 ± 8% +0.0 0.14 ± 8% perf-profile.children.cycles-pp.__mod_zone_page_state 0.10 ± 4% +0.0 0.15 ± 15% perf-profile.children.cycles-pp.xfs_dir3_leaf_check_int 0.04 ± 58% +0.0 0.09 ± 20% perf-profile.children.cycles-pp.free_unref_page_prepare 0.34 ± 5% +0.0 0.39 ± 7% perf-profile.children.cycles-pp.xfs_buf_get_map 0.23 ± 10% +0.1 0.28 ± 5% perf-profile.children.cycles-pp.xfs_btree_get_rec 0.32 ± 5% +0.1 0.37 ± 9% perf-profile.children.cycles-pp.disk_wrt 0.07 ± 23% +0.1 0.12 ± 11% perf-profile.children.cycles-pp.iov_iter_init 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp._IO_vsprintf 0.41 ± 6% +0.1 0.47 ± 6% perf-profile.children.cycles-pp.unlock_page 0.31 ± 3% +0.1 0.37 ± 8% perf-profile.children.cycles-pp.xfs_buf_find 0.15 ± 9% +0.1 0.21 ± 3% perf-profile.children.cycles-pp.__list_add_valid 0.66 ± 2% +0.1 0.72 ± 5% perf-profile.children.cycles-pp.xfs_dir3_data_check 0.66 ± 2% +0.1 0.72 ± 5% perf-profile.children.cycles-pp.__xfs_dir3_data_check 0.24 ± 7% +0.1 0.31 ± 17% perf-profile.children.cycles-pp.xfs_da_read_buf 0.11 ± 10% +0.1 0.17 ± 18% perf-profile.children.cycles-pp.xas_create 0.00 +0.1 0.07 ± 30% perf-profile.children.cycles-pp.__vfs_write 0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.get_task_policy 0.14 ± 23% +0.1 0.21 ± 14% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm 0.34 ± 5% +0.1 0.41 ± 11% perf-profile.children.cycles-pp.rw_verify_area 0.08 ± 14% +0.1 0.15 ± 23% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64 0.07 ± 7% +0.1 0.14 ± 26% perf-profile.children.cycles-pp.iomap_adjust_read_range 0.17 ± 6% +0.1 0.24 ± 9% perf-profile.children.cycles-pp.unaccount_page_cache_page 0.11 ± 9% +0.1 0.19 ± 7% perf-profile.children.cycles-pp.free_unref_page_commit 0.23 ± 8% +0.1 0.31 ± 4% perf-profile.children.cycles-pp.workingset_update_node 0.19 ± 12% +0.1 0.26 ± 10% perf-profile.children.cycles-pp.xfs_btree_lookup 0.05 ± 62% +0.1 0.13 ± 26% perf-profile.children.cycles-pp.xfs_find_daxdev_for_inode 0.19 ± 9% +0.1 0.27 ± 21% perf-profile.children.cycles-pp.__mod_node_page_state 0.16 ± 13% +0.1 0.24 ± 13% perf-profile.children.cycles-pp.xas_init_marks 0.11 ± 11% +0.1 0.19 ± 9% perf-profile.children.cycles-pp.timespec64_trunc 0.21 ± 5% +0.1 0.30 ± 5% perf-profile.children.cycles-pp.xfs_btree_increment 0.17 ± 18% +0.1 0.25 ± 16% perf-profile.children.cycles-pp.xfs_get_extsz_hint 0.04 ± 58% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.xas_set_mark 0.01 ±173% +0.1 0.10 ± 41% perf-profile.children.cycles-pp.find_next_bit 0.49 ± 5% +0.1 0.58 ± 7% perf-profile.children.cycles-pp.xfs_trans_read_buf_map 0.38 ± 2% +0.1 0.48 ± 5% perf-profile.children.cycles-pp.xfs_inobt_get_rec 0.39 ± 9% +0.1 0.50 ± 3% perf-profile.children.cycles-pp.mem_cgroup_commit_charge 0.34 ± 4% +0.1 0.45 ± 3% perf-profile.children.cycles-pp.__x64_sys_write 0.33 ± 10% +0.1 0.44 ± 3% perf-profile.children.cycles-pp.page_mapping 0.33 ± 10% +0.1 0.43 ± 16% perf-profile.children.cycles-pp.xfs_dir_createname 0.12 ± 12% +0.1 0.23 ± 12% perf-profile.children.cycles-pp.alloc_pages_current 0.03 ±100% +0.1 0.15 ± 43% perf-profile.children.cycles-pp.__next_timer_interrupt 0.25 ± 7% +0.1 0.37 ± 12% perf-profile.children.cycles-pp.mem_cgroup_try_charge 0.48 ± 5% +0.1 0.61 ± 5% perf-profile.children.cycles-pp.xfs_dialloc_ag 0.64 ± 4% +0.1 0.77 ± 4% perf-profile.children.cycles-pp.xfs_ialloc 0.64 ± 4% +0.1 0.77 ± 4% perf-profile.children.cycles-pp.xfs_dir_ialloc 0.29 ± 10% +0.1 0.43 ± 11% perf-profile.children.cycles-pp.find_get_entries 0.39 ± 6% +0.1 0.52 ± 3% perf-profile.children.cycles-pp.xfs_break_leased_layouts 0.37 ± 9% +0.1 0.51 ± 3% perf-profile.children.cycles-pp.xfs_difree_inobt 0.56 ± 5% +0.1 0.70 ± 4% perf-profile.children.cycles-pp.xfs_dialloc 0.29 ± 10% +0.1 0.43 ± 11% perf-profile.children.cycles-pp.pagevec_lookup_entries 0.47 ± 7% +0.1 0.61 ± 4% perf-profile.children.cycles-pp.xfs_difree 0.30 ± 4% +0.1 0.45 ± 7% perf-profile.children.cycles-pp.node_dirty_ok 0.16 ± 32% +0.1 0.31 ± 10% perf-profile.children.cycles-pp.__sb_end_write 1.72 +0.2 1.88 ± 3% perf-profile.children.cycles-pp.call_rwsem_down_write_failed 1.72 +0.2 1.88 ± 3% perf-profile.children.cycles-pp.rwsem_down_write_failed 0.05 ± 59% +0.2 0.21 ± 43% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.80 ± 10% +0.2 0.96 ± 10% perf-profile.children.cycles-pp._raw_spin_lock 0.68 ± 11% +0.2 0.86 ± 7% perf-profile.children.cycles-pp.__cancel_dirty_page 0.18 ± 11% +0.2 0.36 ± 4% perf-profile.children.cycles-pp.__xa_set_mark 0.59 ± 5% +0.2 0.78 perf-profile.children.cycles-pp.iov_iter_fault_in_readable 0.66 ± 11% +0.2 0.85 ± 6% perf-profile.children.cycles-pp.xfs_ifree 0.24 ± 27% +0.2 0.43 ± 7% perf-profile.children.cycles-pp.generic_write_check_limits 0.31 ± 11% +0.2 0.50 ± 6% perf-profile.children.cycles-pp.rcu_all_qs 0.11 ± 25% +0.2 0.31 ± 43% perf-profile.children.cycles-pp.tick_nohz_next_event 0.20 ± 37% +0.2 0.40 ± 40% perf-profile.children.cycles-pp.wait_for_stable_page 1.49 +0.2 1.69 ± 4% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.80 ± 3% +0.2 1.01 perf-profile.children.cycles-pp.up_write 0.65 ± 3% +0.2 0.85 ± 4% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.46 ± 20% +0.2 0.67 ± 7% perf-profile.children.cycles-pp.balance_dirty_pages_ratelimited 0.72 ± 5% +0.2 0.93 ± 6% perf-profile.children.cycles-pp.__might_sleep 0.38 ± 2% +0.2 0.60 ± 13% perf-profile.children.cycles-pp.xas_start 0.56 ± 10% +0.2 0.79 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid 0.41 ± 16% +0.2 0.64 ± 6% perf-profile.children.cycles-pp.generic_write_checks 0.32 ± 7% +0.2 0.55 ± 9% perf-profile.children.cycles-pp.current_time 0.90 ± 7% +0.2 1.13 ± 4% perf-profile.children.cycles-pp.xfs_inactive_ifree 0.72 ± 5% +0.2 0.96 ± 2% perf-profile.children.cycles-pp.xfs_check_agi_freecount 0.16 ± 21% +0.3 0.41 ± 44% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.62 ± 4% +0.3 0.88 ± 5% perf-profile.children.cycles-pp.xfs_break_layouts 0.82 ± 8% +0.3 1.08 ± 10% perf-profile.children.cycles-pp.truncate_cleanup_page 1.16 ± 4% +0.3 1.42 ± 4% perf-profile.children.cycles-pp.___might_sleep 0.47 +0.3 0.74 ± 8% perf-profile.children.cycles-pp.free_pcppages_bulk 0.46 ± 4% +0.3 0.73 ± 9% perf-profile.children.cycles-pp.xfs_errortag_test 1.11 ± 8% +0.3 1.39 ± 4% perf-profile.children.cycles-pp.xfs_fs_destroy_inode 1.11 ± 8% +0.3 1.38 ± 4% perf-profile.children.cycles-pp.xfs_inactive 1.46 ± 4% +0.3 1.74 ± 6% perf-profile.children.cycles-pp.xfs_generic_create 0.54 ± 10% +0.3 0.82 ± 7% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 1.41 ± 3% +0.3 1.70 ± 6% perf-profile.children.cycles-pp.xfs_create 0.21 ± 10% +0.3 0.50 ± 12% perf-profile.children.cycles-pp.xfs_fs_dirty_inode 0.96 ± 8% +0.3 1.28 ± 3% perf-profile.children.cycles-pp.xfs_iunlock 0.29 ± 8% +0.3 0.61 ± 6% perf-profile.children.cycles-pp.iov_iter_advance 0.23 ± 53% +0.3 0.58 ± 12% perf-profile.children.cycles-pp.xfs_find_bdev_for_inode 0.93 ± 3% +0.4 1.30 ± 9% perf-profile.children.cycles-pp.__set_page_dirty 0.62 ± 5% +0.4 0.99 ± 3% perf-profile.children.cycles-pp._cond_resched 2.79 ± 3% +0.4 3.16 ± 3% perf-profile.children.cycles-pp.do_sys_open 0.91 +0.4 1.28 ± 8% perf-profile.children.cycles-pp.delete_from_page_cache_batch 2.73 ± 3% +0.4 3.11 ± 3% perf-profile.children.cycles-pp.do_filp_open 0.51 ± 10% +0.4 0.88 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 2.73 ± 3% +0.4 3.10 ± 3% perf-profile.children.cycles-pp.path_openat 2.81 ± 2% +0.4 3.20 ± 3% perf-profile.children.cycles-pp.creat 0.84 ± 5% +0.4 1.24 ± 9% perf-profile.children.cycles-pp.xfs_file_iomap_end 0.73 ± 3% +0.4 1.16 ± 8% perf-profile.children.cycles-pp.free_unref_page_list 0.41 ± 9% +0.4 0.85 ± 12% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.81 +0.5 1.26 ± 3% perf-profile.children.cycles-pp.__mark_inode_dirty 0.91 ± 3% +0.5 1.39 ± 7% perf-profile.children.cycles-pp.xas_store 0.98 +0.5 1.46 ± 4% perf-profile.children.cycles-pp.pagevec_lru_move_fn 1.10 +0.5 1.60 ± 4% perf-profile.children.cycles-pp.__lru_cache_add 0.92 ± 2% +0.5 1.46 ± 8% perf-profile.children.cycles-pp.xas_load 2.24 +0.6 2.80 ± 4% perf-profile.children.cycles-pp.iomap_read_page_sync 1.44 ± 2% +0.6 2.00 ± 3% perf-profile.children.cycles-pp.__generic_write_end 1.51 ± 3% +0.6 2.08 ± 3% perf-profile.children.cycles-pp.memset_erms 1.11 ± 33% +0.6 1.68 ± 9% perf-profile.children.cycles-pp.xfs_file_write_iter 1.57 ± 5% +0.6 2.17 ± 7% perf-profile.children.cycles-pp.selinux_file_permission 1.62 ± 3% +0.6 2.23 ± 6% perf-profile.children.cycles-pp.find_get_entry 0.63 ± 25% +0.6 1.25 ± 13% perf-profile.children.cycles-pp.xfs_bmbt_to_iomap 1.87 ± 2% +0.7 2.54 ± 6% perf-profile.children.cycles-pp.xfs_ilock 1.91 ± 3% +0.7 2.60 ± 5% perf-profile.children.cycles-pp.iomap_set_page_dirty 3.63 ± 3% +0.7 4.34 ± 6% perf-profile.children.cycles-pp.syscall_return_via_sysret 1.73 ± 4% +0.7 2.45 ± 4% perf-profile.children.cycles-pp.__add_to_page_cache_locked 1.53 ± 2% +0.7 2.25 ± 7% perf-profile.children.cycles-pp.get_page_from_freelist 1.69 ± 5% +0.7 2.43 ± 10% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 3.23 +0.7 3.97 ± 4% perf-profile.children.cycles-pp.down_write 1.79 ± 5% +0.8 2.54 ± 10% perf-profile.children.cycles-pp.copyin 2.97 ± 4% +0.8 3.75 ± 6% perf-profile.children.cycles-pp.xfs_file_aio_write_checks 4.10 +0.8 4.91 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64 1.48 ± 3% +0.9 2.34 ± 8% perf-profile.children.cycles-pp.release_pages 1.38 ± 3% +0.9 2.25 ± 8% perf-profile.children.cycles-pp.__pagevec_release 1.96 ± 4% +0.9 2.84 ± 5% perf-profile.children.cycles-pp.security_file_permission 1.96 ± 3% +1.0 2.93 ± 6% perf-profile.children.cycles-pp.__alloc_pages_nodemask 2.19 ± 3% +1.0 3.17 ± 8% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic 2.91 ± 2% +1.2 4.15 ± 4% perf-profile.children.cycles-pp.add_to_page_cache_lru 4.50 ± 2% +1.4 5.95 ± 3% perf-profile.children.cycles-pp.iomap_write_end 3.66 ± 2% +1.7 5.36 ± 8% perf-profile.children.cycles-pp.evict 3.63 ± 2% +1.7 5.33 ± 8% perf-profile.children.cycles-pp.truncate_inode_pages_range 4.88 ± 2% +2.0 6.87 ± 7% perf-profile.children.cycles-pp.task_work_run 4.85 ± 2% +2.0 6.84 ± 7% perf-profile.children.cycles-pp.dput 4.83 ± 3% +2.0 6.82 ± 6% perf-profile.children.cycles-pp.dentry_kill 4.83 ± 3% +2.0 6.81 ± 6% perf-profile.children.cycles-pp.__dentry_kill 4.87 ± 2% +2.0 6.86 ± 7% perf-profile.children.cycles-pp.__fput 4.88 ± 2% +2.0 6.88 ± 7% perf-profile.children.cycles-pp.exit_to_usermode_loop 4.99 ± 2% +2.0 6.99 ± 6% perf-profile.children.cycles-pp.close 4.06 ± 4% +2.1 6.20 ± 6% perf-profile.children.cycles-pp.xfs_file_iomap_begin_delay 4.64 ± 4% +2.6 7.27 ± 6% perf-profile.children.cycles-pp.xfs_file_iomap_begin 7.31 +3.2 10.52 ± 4% perf-profile.children.cycles-pp.pagecache_get_page 7.62 +3.4 11.01 ± 5% perf-profile.children.cycles-pp.grab_cache_page_write_begin 10.34 +4.3 14.62 ± 4% perf-profile.children.cycles-pp.iomap_write_begin 19.39 +8.0 27.36 ± 4% perf-profile.children.cycles-pp.iomap_write_actor 25.48 +11.3 36.80 ± 4% perf-profile.children.cycles-pp.iomap_apply 25.67 +11.4 37.07 ± 4% perf-profile.children.cycles-pp.iomap_file_buffered_write 30.94 +13.1 44.00 ± 4% perf-profile.children.cycles-pp.xfs_file_buffered_aio_write 32.51 +13.9 46.41 ± 4% perf-profile.children.cycles-pp.new_sync_write 37.09 +15.5 52.60 ± 4% perf-profile.children.cycles-pp.vfs_write 38.15 +15.9 54.08 ± 4% perf-profile.children.cycles-pp.ksys_write 48.29 +18.2 66.47 ± 5% perf-profile.children.cycles-pp.write 50.28 +18.7 69.02 ± 4% perf-profile.children.cycles-pp.do_syscall_64 50.58 +18.9 69.51 ± 4% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 37.02 -20.8 16.25 ± 17% perf-profile.self.cycles-pp.intel_idle 0.16 ± 17% -0.1 0.08 ± 10% perf-profile.self.cycles-pp.ktime_get 0.17 ± 6% -0.1 0.10 ± 11% perf-profile.self.cycles-pp.xfs_log_commit_cil 0.09 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.07 ± 12% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.__schedule 0.09 ± 4% -0.0 0.07 ± 12% perf-profile.self.cycles-pp.memcpy_erms 0.07 ± 16% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.page_cache_free_page 0.06 ± 15% +0.0 0.08 ± 11% perf-profile.self.cycles-pp.__set_page_dirty 0.07 ± 16% +0.0 0.09 ± 11% perf-profile.self.cycles-pp.iomap_page_create 0.09 ± 13% +0.0 0.12 ± 7% perf-profile.self.cycles-pp.mem_cgroup_try_charge 0.06 ± 7% +0.0 0.09 ± 17% perf-profile.self.cycles-pp.vfprintf 0.20 ± 9% +0.0 0.23 ± 7% perf-profile.self.cycles-pp.__inode_security_revalidate 0.09 ± 11% +0.0 0.13 ± 5% perf-profile.self.cycles-pp.node_page_state 0.13 ± 11% +0.0 0.17 ± 9% perf-profile.self.cycles-pp.__lru_cache_add 0.04 ± 60% +0.0 0.08 ± 13% perf-profile.self.cycles-pp.xfs_btree_increment 0.12 ± 12% +0.0 0.17 ± 9% perf-profile.self.cycles-pp.xas_clear_mark 0.08 ± 10% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.xfs_isilocked 0.08 ± 10% +0.0 0.13 ± 10% perf-profile.self.cycles-pp.__mod_zone_page_state 0.15 ± 16% +0.0 0.20 ± 5% perf-profile.self.cycles-pp.truncate_inode_pages_range 0.08 ± 6% +0.0 0.12 ± 5% perf-profile.self.cycles-pp.unaccount_page_cache_page 0.03 ±100% +0.0 0.07 ± 10% perf-profile.self.cycles-pp.xfs_buf_item_format 0.09 ± 8% +0.0 0.14 ± 12% perf-profile.self.cycles-pp.xfs_dir3_leaf_check_int 0.08 ± 19% +0.0 0.13 ± 18% perf-profile.self.cycles-pp.xas_create 0.14 ± 6% +0.0 0.18 ± 14% perf-profile.self.cycles-pp.delete_from_page_cache_batch 0.15 ± 11% +0.0 0.20 ± 4% perf-profile.self.cycles-pp.__list_add_valid 0.40 ± 6% +0.1 0.46 ± 5% perf-profile.self.cycles-pp.unlock_page 0.05 ± 60% +0.1 0.10 ± 10% perf-profile.self.cycles-pp.pagevec_lru_move_fn 0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.xfs_btree_lookup 0.03 ±100% +0.1 0.09 ± 19% perf-profile.self.cycles-pp.free_unref_page_prepare 0.18 ± 10% +0.1 0.24 ± 9% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.07 ± 6% +0.1 0.13 ± 15% perf-profile.self.cycles-pp.alloc_pages_current 0.09 ± 17% +0.1 0.15 ± 7% perf-profile.self.cycles-pp.free_unref_page_commit 0.01 ±173% +0.1 0.07 ± 24% perf-profile.self.cycles-pp.xas_init_marks 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.get_task_policy 0.53 ± 10% +0.1 0.59 ± 4% perf-profile.self.cycles-pp._raw_spin_lock 0.04 ±100% +0.1 0.10 ± 14% perf-profile.self.cycles-pp.iov_iter_init 0.01 ±173% +0.1 0.08 ± 15% perf-profile.self.cycles-pp.xfs_inobt_get_rec 0.07 ± 17% +0.1 0.14 ± 25% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.00 +0.1 0.07 ± 30% perf-profile.self.cycles-pp.__vfs_write 0.21 ± 7% +0.1 0.28 ± 6% perf-profile.self.cycles-pp.workingset_update_node 0.13 ± 8% +0.1 0.20 ± 4% perf-profile.self.cycles-pp.mem_cgroup_commit_charge 0.18 ± 11% +0.1 0.26 ± 20% perf-profile.self.cycles-pp.__mod_node_page_state 0.04 ± 58% +0.1 0.11 ± 9% perf-profile.self.cycles-pp.xas_set_mark 0.13 ± 13% +0.1 0.21 ± 23% perf-profile.self.cycles-pp.__fdget_pos 0.10 ± 10% +0.1 0.18 ± 9% perf-profile.self.cycles-pp.timespec64_trunc 0.06 ± 7% +0.1 0.13 ± 24% perf-profile.self.cycles-pp.iomap_adjust_read_range 0.13 ± 26% +0.1 0.21 ± 14% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm 0.12 ± 12% +0.1 0.20 ± 16% perf-profile.self.cycles-pp.xfs_get_extsz_hint 0.18 ± 9% +0.1 0.26 ± 6% perf-profile.self.cycles-pp.iomap_file_buffered_write 0.04 ±100% +0.1 0.12 ± 23% perf-profile.self.cycles-pp.xfs_find_daxdev_for_inode 0.13 ± 9% +0.1 0.22 ± 11% perf-profile.self.cycles-pp.current_time 0.00 +0.1 0.09 ± 45% perf-profile.self.cycles-pp.find_next_bit 0.28 ± 6% +0.1 0.38 ± 4% perf-profile.self.cycles-pp.__x64_sys_write 0.24 ± 12% +0.1 0.33 ± 8% perf-profile.self.cycles-pp.account_page_cleaned 0.30 ± 13% +0.1 0.39 ± 3% perf-profile.self.cycles-pp.ksys_write 0.17 ± 2% +0.1 0.27 ± 12% perf-profile.self.cycles-pp.xfs_break_layouts 0.20 ± 5% +0.1 0.30 ± 10% perf-profile.self.cycles-pp.node_dirty_ok 0.31 ± 5% +0.1 0.42 ± 8% perf-profile.self.cycles-pp.free_pcppages_bulk 0.41 ± 4% +0.1 0.51 ± 6% perf-profile.self.cycles-pp.__generic_write_end 0.33 ± 9% +0.1 0.43 ± 3% perf-profile.self.cycles-pp.page_mapping 0.17 ± 8% +0.1 0.29 ± 7% perf-profile.self.cycles-pp.iomap_write_end 0.24 ± 12% +0.1 0.36 ± 13% perf-profile.self.cycles-pp.find_get_entries 0.36 ± 5% +0.1 0.49 ± 3% perf-profile.self.cycles-pp.xfs_break_leased_layouts 0.64 ± 2% +0.1 0.78 ± 6% perf-profile.self.cycles-pp.write 0.38 ± 7% +0.1 0.51 ± 12% perf-profile.self.cycles-pp.xfs_ilock 0.45 +0.1 0.58 ± 6% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.26 ± 5% +0.1 0.40 ± 22% perf-profile.self.cycles-pp.account_page_dirtied 0.15 ± 32% +0.1 0.29 ± 10% perf-profile.self.cycles-pp.__sb_end_write 0.30 ± 4% +0.1 0.44 ± 3% perf-profile.self.cycles-pp.__add_to_page_cache_locked 0.31 ± 17% +0.1 0.46 ± 8% perf-profile.self.cycles-pp.xfs_iunlock 0.24 ± 14% +0.1 0.39 ± 6% perf-profile.self.cycles-pp.rcu_all_qs 0.33 ± 10% +0.2 0.49 ± 13% perf-profile.self.cycles-pp.release_pages 0.28 ± 14% +0.2 0.44 ± 12% perf-profile.self.cycles-pp.file_update_time 0.57 ± 6% +0.2 0.74 perf-profile.self.cycles-pp.iov_iter_fault_in_readable 0.62 ± 5% +0.2 0.79 ± 2% perf-profile.self.cycles-pp.up_write 0.57 ± 4% +0.2 0.75 perf-profile.self.cycles-pp.__mark_inode_dirty 0.29 ± 10% +0.2 0.46 ± 10% perf-profile.self.cycles-pp.__alloc_pages_nodemask 0.63 ± 5% +0.2 0.81 ± 5% perf-profile.self.cycles-pp.__might_sleep 0.23 ± 27% +0.2 0.41 ± 8% perf-profile.self.cycles-pp.generic_write_check_limits 0.31 ± 7% +0.2 0.50 ± 8% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.35 ± 2% +0.2 0.55 ± 16% perf-profile.self.cycles-pp.xas_start 0.42 ± 20% +0.2 0.62 ± 7% perf-profile.self.cycles-pp.balance_dirty_pages_ratelimited 0.29 ± 5% +0.2 0.49 ± 3% perf-profile.self.cycles-pp._cond_resched 0.55 ± 9% +0.2 0.77 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid 0.47 ± 5% +0.2 0.69 ± 4% perf-profile.self.cycles-pp.pagecache_get_page 1.46 ± 2% +0.2 1.68 ± 4% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.65 ± 2% +0.2 0.87 ± 6% perf-profile.self.cycles-pp.down_write 0.33 ± 9% +0.2 0.56 ± 15% perf-profile.self.cycles-pp.xfs_bmbt_to_iomap 0.61 ± 6% +0.2 0.84 ± 8% perf-profile.self.cycles-pp.xfs_file_iomap_end 0.38 ± 8% +0.2 0.60 ± 19% perf-profile.self.cycles-pp.iov_iter_copy_from_user_atomic 0.60 ± 8% +0.2 0.82 ± 5% perf-profile.self.cycles-pp.get_page_from_freelist 0.39 ± 3% +0.2 0.61 ± 8% perf-profile.self.cycles-pp.xas_store 0.36 ± 7% +0.2 0.59 ± 9% perf-profile.self.cycles-pp.iomap_write_begin 0.34 ± 8% +0.2 0.57 ± 11% perf-profile.self.cycles-pp.new_sync_write 0.35 ± 3% +0.2 0.59 ± 4% perf-profile.self.cycles-pp.xfs_file_aio_write_checks 0.44 ± 5% +0.2 0.67 ± 10% perf-profile.self.cycles-pp.vfs_write 0.93 ± 3% +0.2 1.17 ± 4% perf-profile.self.cycles-pp.find_get_entry 0.48 ± 11% +0.3 0.73 ± 7% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.37 ± 11% +0.3 0.63 ± 5% perf-profile.self.cycles-pp.security_file_permission 1.11 ± 3% +0.3 1.37 ± 5% perf-profile.self.cycles-pp.___might_sleep 0.42 ± 7% +0.3 0.68 ± 9% perf-profile.self.cycles-pp.xfs_errortag_test 0.19 ± 13% +0.3 0.46 ± 13% perf-profile.self.cycles-pp.xfs_fs_dirty_inode 0.27 ± 7% +0.3 0.58 ± 6% perf-profile.self.cycles-pp.iov_iter_advance 1.15 ± 5% +0.3 1.47 ± 6% perf-profile.self.cycles-pp.do_syscall_64 0.58 ± 8% +0.3 0.90 ± 7% perf-profile.self.cycles-pp.iomap_apply 0.53 ± 4% +0.3 0.87 ± 8% perf-profile.self.cycles-pp.xas_load 0.21 ± 55% +0.3 0.55 ± 13% perf-profile.self.cycles-pp.xfs_find_bdev_for_inode 0.63 ± 13% +0.4 1.00 ± 21% perf-profile.self.cycles-pp.xfs_iext_lookup_extent 0.51 ± 5% +0.4 0.88 ± 8% perf-profile.self.cycles-pp.xfs_file_iomap_begin 0.75 ± 12% +0.4 1.18 ± 4% perf-profile.self.cycles-pp.iomap_write_actor 0.79 ± 5% +0.4 1.22 ± 8% perf-profile.self.cycles-pp.xfs_file_iomap_begin_delay 0.41 ± 9% +0.4 0.85 ± 12% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 1.02 ± 3% +0.5 1.48 ± 4% perf-profile.self.cycles-pp.xfs_file_buffered_aio_write 0.91 ± 11% +0.5 1.40 ± 16% perf-profile.self.cycles-pp.selinux_file_permission 1.05 ± 32% +0.5 1.59 ± 8% perf-profile.self.cycles-pp.xfs_file_write_iter 1.48 ± 3% +0.5 2.02 ± 5% perf-profile.self.cycles-pp.memset_erms 3.66 +0.7 4.36 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64 3.63 ± 4% +0.7 4.33 ± 6% perf-profile.self.cycles-pp.syscall_return_via_sysret 1.63 ± 5% +0.8 2.39 ± 10% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

2 years, 6 months

1
0
0 / 0

[drm/bochs] a3232987fd: WARNING:at_drivers/gpu/drm/ttm/ttm_bo.c:#ttm_bo_validate[ttm]

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: a3232987fdbf0bede92a9d7c7e2db99a5084d31b ("drm/bochs: Convert bochs driver to |struct drm_gem_vram_object|") git://anongit.freedesktop.org/drm/drm-misc drm-misc-next in testcase: locktorture with following parameters: runtime: 300s test: default test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors. test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------------------------------+------------+------------+ | | 3f87330e50 | a3232987fd | +-----------------------------------------------------------------------------+------------+------------+ | boot_successes | 16 | 0 | | boot_failures | 0 | 16 | | WARNING:at_drivers/gpu/drm/ttm/ttm_bo.c:#ttm_bo_validate[ttm] | 0 | 16 | | RIP:ttm_bo_validate[ttm] | 0 | 16 | | WARNING:at_drivers/dma-buf/reservation.c:#reservation_object_reserve_shared | 0 | 16 | | RIP:reservation_object_reserve_shared | 0 | 16 | | WARNING:suspicious_RCU_usage | 0 | 16 | | include/linux/reservation.h:#suspicious_rcu_dereference_protected()usage | 0 | 16 | | WARNING:at_drivers/dma-buf/reservation.c:#reservation_object_add_excl_fence | 0 | 16 | | RIP:reservation_object_add_excl_fence | 0 | 16 | +-----------------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 9.999183] WARNING: CPU: 1 PID: 351 at drivers/gpu/drm/ttm/ttm_bo.c:1161 ttm_bo_validate+0x41/0x141 [ttm] [ 10.000494] Modules linked in: crct10dif_pclmul(+) bochs_drm(+) crc32c_intel drm_vram_helper ttm ghash_clmulni_intel drm_kms_helper drm parport_pc drm_panel_orientation_quirks fb_sys_fops syscopyarea sysfillrect psmouse sysimgblt cfbfillrect cfbimgblt cfbcopyarea fb i2c_piix4(+) fbdev virtio_pci(+) i2c_core parport button [ 10.003662] CPU: 1 PID: 351 Comm: systemd-udevd Tainted: G T 5.1.0-rc5-01639-ga3232987 #23 [ 10.004734] RIP: 0010:ttm_bo_validate+0x41/0x141 [ttm] [ 10.005322] Code: 00 00 00 48 89 44 24 70 31 c0 83 3d 8e 92 4f e2 00 74 19 48 8b 87 00 02 00 00 83 ce ff 48 8d 78 70 e8 2e 39 ed e0 85 c0 75 02 <0f> 0b 48 8d 73 30 4c 89 e7 48 8d 54 24 0c e8 25 e4 ff ff 84 c0 0f [ 10.007416] RSP: 0018:ffffc900006d3928 EFLAGS: 00010246 [ 10.008004] RAX: 0000000000000000 RBX: ffff88807d60b238 RCX: 0000000000000000 [ 10.008805] RDX: 0000000000000246 RSI: ffff88807d60b4b0 RDI: ffff88807e9263b8 [ 10.009607] RBP: ffffc900006d39c0 R08: 00000000de9be681 R09: 0000000000000004 [ 10.010406] R10: 0000000000000000 R11: ffff88807daac838 R12: ffff88807d60b5f8 [ 10.011208] R13: 0000000000000300 R14: 0000000000000400 R15: 0000000034325258 [ 10.012007] FS: 00007f35dce728c0(0000) GS:ffff888075400000(0000) knlGS:0000000000000000 [ 10.013787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 LKP: HOSTNAME vm [ 10.015669] ? kvm_sched_clock_read+0x5/0xd [ 10.016157] ? get_lock_stats+0x11/0x3f [ 10.016607] drm_gem_vram_pin+0x77/0xa2 [drm_vram_helper] [ 10.017229] drm_gem_vram_driver_gem_prime_vmap+0xe/0x39 [drm_vram_helper] [ 10.018015] drm_gem_vmap+0x36/0x43 [drm] [ 10.018491] drm_client_framebuffer_create+0xc6/0x1ca [drm] [ 10.019143] drm_fb_helper_generic_probe+0x4c/0x157 [drm_kms_helper] [ 10.019864] __drm_fb_helper_initial_config_and_unlock+0x307/0x442 [drm_kms_helper] [ 10.020739] drm_fbdev_client_hotplug+0xc8/0x115 [drm_kms_helper] [ 10.021442] drm_fbdev_generic_setup+0xc4/0xf1 [drm_kms_helper] [ 10.022120] bochs_pci_probe+0x123/0x143 [bochs_drm] [ 10.022688] local_pci_probe+0x34/0x75 [ 10.023127] pci_device_probe+0xf8/0x150 [ 10.023585] really_probe+0x199/0x360 [ 10.024009] driver_probe_device+0xcf/0xff [ 10.024483] device_driver_attach+0x38/0x4f [ 10.024964] __driver_attach+0x105/0x10d [ 10.032000] ? device_driver_attach+0x4f/0x4f [ 10.032560] bus_for_each_dev+0x6c/0x9e [ 10.033006] bus_add_driver+0x125/0x1d4 [ 10.033454] ? 0xffffffffa024e000 [ 10.033839] driver_register+0x94/0xc6 [ 10.034279] ? 0xffffffffa024e000 [ 10.034650] do_one_initcall+0x10e/0x297 [ 10.035091] ? rcu_read_lock_sched_held+0x58/0x5e [ 10.035638] ? kmem_cache_alloc_trace+0x21b/0x25b [ 10.036184] do_init_module+0x59/0x491 [ 10.036616] load_module+0x1178/0x138a [ 10.037040] ? vfs_read+0x115/0x121 [ 10.037456] ? __se_sys_finit_module+0xaf/0xd5 [ 10.037966] __se_sys_finit_module+0xaf/0xd5 [ 10.038468] do_syscall_64+0x78/0x188 [ 10.038893] entry_SYSCALL_64_after_hwframe+0x49/0xbe [ 10.039471] RIP: 0033:0x7f35dbcef229 [ 10.039871] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 3f 4c 2b 00 f7 d8 64 89 01 48 [ 10.047091] RSP: 002b:00007ffef4fddd48 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 10.048100] RAX: ffffffffffffffda RBX: 0000561f5bb7db80 RCX: 00007f35dbcef229 [ 10.048957] RDX: 0000000000000000 RSI: 00007f35dc608265 RDI: 000000000000001d [ 10.050498] RBP: 00007f35dc608265 R08: 0000000000000000 R09: 00007ffef4fde2c0 [ 10.051303] R10: 000000000000001d R11: 0000000000000246 R12: 0000000000000000 [ 10.052106] R13: 0000561f5bb70d70 R14: 0000000000020000 R15: 0000561f5bb40cbc [ 10.052917] irq event stamp: 22742 [ 10.053315] hardirqs last enabled at (22741): [<ffffffff811ad400>] kmem_cache_alloc_trace+0x133/0x25b [ 10.054358] hardirqs last disabled at (22742): [<ffffffff81001621>] trace_hardirqs_off_thunk+0x1a/0x1c [ 10.055402] softirqs last enabled at (22728): [<ffffffff81c003cf>] __do_softirq+0x3cf/0x411 [ 10.056350] softirqs last disabled at (22721): [<ffffffff8107de91>] irq_exit+0x66/0xe1 [ 10.057251] ---[ end trace c03d531d529a8736 ]--- To reproduce: # build kernel cd linux cp config-5.1.0-rc5-01639-ga3232987 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, Rong Chen

2 years, 6 months

1
0
0 / 0

[mm] e0ee0e7107: reaim.jobs_per_min -9.7% regression

by kernel test robot

Greeting, FYI, we noticed a -9.7% regression of reaim.jobs_per_min due to commit: commit: e0ee0e71078abbcadd4cbc38fb8570551fccc103 ("mm: memcontrol: track LRU counts in the vmstats array") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: reaim on test machine: 256 threads Knights Landing with 96G memory with following parameters: runtime: 300s nr_task: 100% test: shared cpufreq_governor: performance test-description: REAIM is an updated and improved version of AIM 7 benchmark. test-url: https://sourceforge.net/projects/re-aim-7/ In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------+ | testcase: change | reaim: reaim.jobs_per_min -6.4% regression | | test machine | 256 threads Knights Landing with 96G memory | | test parameters | cpufreq_governor=performance | | | nr_task=100% | | | runtime=300s | | | test=custom | +------------------+---------------------------------------------+ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase: gcc-7/performance/x86_64-kexec/100%/debian-x86_64-2018-04-03.cgz/300s/lkp-knl-f1/shared/reaim commit: 132bb8cfc9 ("mm/vmscan: add tracepoints for node reclaim") e0ee0e7107 ("mm: memcontrol: track LRU counts in the vmstats array") 132bb8cfc9e08123 e0ee0e71078abbcadd4cbc38fb8 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at_ip___perf_sw_event/0x 1:4 -25% :4 dmesg.WARNING:at_ip_perf_event_mmap_output/0x 1:4 -14% 0:4 perf-profile.children.cycles-pp.error_entry 0:4 -7% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 354.75 +51.5% 537.30 reaim.child_systime 846.05 -1.5% 833.57 reaim.child_utime 258457 -9.7% 233491 reaim.jobs_per_min 1009 -9.7% 912.08 reaim.jobs_per_min_child 271636 -10.2% 243888 reaim.max_jobs_per_min 5.77 +10.7% 6.39 reaim.parent_time 3.48 -4.0% 3.34 reaim.std_dev_percent 0.18 +6.9% 0.19 reaim.std_dev_time 1.571e+08 -6.5% 1.469e+08 reaim.time.minor_page_faults 15125 +5.9% 16024 reaim.time.percent_of_cpu_this_job_got 13607 +41.4% 19246 reaim.time.system_time 32376 -7.9% 29814 reaim.time.user_time 3686835 -3.5% 3558535 reaim.time.voluntary_context_switches 979200 -6.5% 915200 reaim.workload 8183 ± 4% -5.0% 7772 boot-time.idle 855.50 +5.3% 901.25 turbostat.Avg_MHz 0.06 ± 12% +0.0 0.07 ± 6% mpstat.cpu.all.soft% 19.22 +6.5 25.75 mpstat.cpu.all.sys% 39.25 -8.3% 36.00 vmstat.cpu.id 40.25 -8.1% 37.00 vmstat.cpu.us 41194 -10.1% 37034 vmstat.system.cs 84717 +2.0% 86446 proc-vmstat.nr_anon_pages 36962 +1.3% 37432 proc-vmstat.nr_kernel_stack 4004 +6.2% 4254 proc-vmstat.nr_page_table_pages 112276 -1.0% 111112 proc-vmstat.nr_unevictable 112276 -1.0% 111112 proc-vmstat.nr_zone_unevictable 1.392e+08 -6.5% 1.301e+08 proc-vmstat.numa_hit 1.392e+08 -6.5% 1.301e+08 proc-vmstat.numa_local 1.435e+08 -6.5% 1.341e+08 proc-vmstat.pgalloc_normal 1.581e+08 -6.5% 1.479e+08 proc-vmstat.pgfault 1.433e+08 -6.5% 1.34e+08 proc-vmstat.pgfree 16.78 -4.8% 15.97 perf-stat.i.MPKI 6.825e+09 +9.8% 7.492e+09 perf-stat.i.branch-instructions 5.27 -0.5 4.80 perf-stat.i.branch-miss-rate% 3.543e+08 -4.0% 3.401e+08 perf-stat.i.branch-misses 1.982e+08 -9.5% 1.793e+08 perf-stat.i.cache-misses 8.335e+08 -9.9% 7.513e+08 perf-stat.i.cache-references 41018 -11.3% 36372 perf-stat.i.context-switches 4.05 +5.3% 4.26 perf-stat.i.cpi 2.153e+11 +4.2% 2.244e+11 perf-stat.i.cpu-cycles 10767 -1.7% 10583 perf-stat.i.cpu-migrations 1168 +9.5% 1279 perf-stat.i.cycles-between-cache-misses 0.41 ± 3% -0.0 0.39 ± 2% perf-stat.i.iTLB-load-miss-rate% 1.49e+08 -9.3% 1.351e+08 perf-stat.i.iTLB-load-misses 5.884e+10 -2.2% 5.757e+10 perf-stat.i.iTLB-loads 5.891e+10 -2.1% 5.765e+10 perf-stat.i.instructions 345.23 +6.4% 367.49 perf-stat.i.instructions-per-iTLB-miss 0.27 -4.4% 0.26 perf-stat.i.ipc 505400 -8.3% 463221 perf-stat.i.minor-faults 505782 -8.2% 464301 perf-stat.i.page-faults 14.24 -7.0% 13.24 perf-stat.overall.MPKI 5.19 -0.7 4.51 perf-stat.overall.branch-miss-rate% 3.67 +7.3% 3.93 perf-stat.overall.cpi 1083 +15.0% 1245 perf-stat.overall.cycles-between-cache-misses 0.25 -0.0 0.23 perf-stat.overall.iTLB-load-miss-rate% 394.61 +7.7% 425.12 perf-stat.overall.instructions-per-iTLB-miss 0.27 -6.8% 0.25 perf-stat.overall.ipc 18168438 +5.6% 19180280 perf-stat.overall.path-length 6.885e+09 +11.8% 7.696e+09 perf-stat.ps.branch-instructions 3.573e+08 -2.8% 3.472e+08 perf-stat.ps.branch-misses 2.002e+08 -8.2% 1.838e+08 perf-stat.ps.cache-misses 8.42e+08 -8.5% 7.704e+08 perf-stat.ps.cache-references 41367 -10.1% 37187 perf-stat.ps.context-switches 2.168e+11 +5.6% 2.289e+11 perf-stat.ps.cpu-cycles 1.498e+08 -8.7% 1.369e+08 perf-stat.ps.iTLB-load-misses 5.907e+10 -1.6% 5.813e+10 perf-stat.ps.iTLB-loads 5.913e+10 -1.6% 5.818e+10 perf-stat.ps.instructions 509899 -7.0% 474333 perf-stat.ps.minor-faults 510054 -7.0% 474504 perf-stat.ps.page-faults 4217 ± 23% -54.4% 1922 ± 50% sched_debug.cfs_rq:/.MIN_vruntime.avg 19262 ± 16% -39.4% 11671 ± 43% sched_debug.cfs_rq:/.MIN_vruntime.stddev 714672 ± 4% -65.5% 246257 ± 54% sched_debug.cfs_rq:/.load.avg 2193271 ± 4% -33.9% 1450530 ± 12% sched_debug.cfs_rq:/.load.max 363196 ± 5% -46.6% 193839 ± 19% sched_debug.cfs_rq:/.load.stddev 807.18 ± 2% -64.1% 289.75 ± 54% sched_debug.cfs_rq:/.load_avg.avg 2746 ± 4% -46.3% 1474 ± 17% sched_debug.cfs_rq:/.load_avg.max 429.01 ± 6% -51.6% 207.43 ± 27% sched_debug.cfs_rq:/.load_avg.stddev 4217 ± 23% -54.4% 1922 ± 50% sched_debug.cfs_rq:/.max_vruntime.avg 19262 ± 16% -39.4% 11671 ± 43% sched_debug.cfs_rq:/.max_vruntime.stddev 106211 ± 10% +12.6% 119612 ± 9% sched_debug.cfs_rq:/.min_vruntime.avg 4309 ± 12% +57.2% 6774 ± 17% sched_debug.cfs_rq:/.min_vruntime.stddev 0.68 ± 4% -65.6% 0.23 ± 54% sched_debug.cfs_rq:/.nr_running.avg 2.09 ± 4% -33.9% 1.38 ± 12% sched_debug.cfs_rq:/.nr_running.max 0.35 ± 5% -46.5% 0.19 ± 19% sched_debug.cfs_rq:/.nr_running.stddev 26.92 ± 12% -66.9% 8.91 ± 64% sched_debug.cfs_rq:/.removed.load_avg.avg 903.40 ± 13% -59.1% 369.11 ± 34% sched_debug.cfs_rq:/.removed.load_avg.max 135.87 ± 10% -65.6% 46.79 ± 49% sched_debug.cfs_rq:/.removed.load_avg.stddev 1242 ± 12% -66.9% 411.23 ± 64% sched_debug.cfs_rq:/.removed.runnable_sum.avg 42017 ± 13% -59.3% 17080 ± 34% sched_debug.cfs_rq:/.removed.runnable_sum.max 6273 ± 10% -65.6% 2159 ± 49% sched_debug.cfs_rq:/.removed.runnable_sum.stddev 9.52 ± 18% -65.3% 3.30 ± 65% sched_debug.cfs_rq:/.removed.util_avg.avg 477.28 ± 26% -60.5% 188.61 ± 35% sched_debug.cfs_rq:/.removed.util_avg.max 52.24 ± 20% -62.9% 19.36 ± 47% sched_debug.cfs_rq:/.removed.util_avg.stddev 599.76 ± 4% -66.0% 203.73 ± 55% sched_debug.cfs_rq:/.runnable_load_avg.avg 1853 ± 10% -36.3% 1180 ± 11% sched_debug.cfs_rq:/.runnable_load_avg.max 327.58 ± 6% -50.4% 162.60 ± 25% sched_debug.cfs_rq:/.runnable_load_avg.stddev 714331 ± 4% -65.6% 246087 ± 54% sched_debug.cfs_rq:/.runnable_weight.avg 2193271 ± 4% -33.9% 1450530 ± 12% sched_debug.cfs_rq:/.runnable_weight.max 363491 ± 5% -46.6% 194117 ± 19% sched_debug.cfs_rq:/.runnable_weight.stddev 0.02 ± 27% -74.6% 0.00 ±173% sched_debug.cfs_rq:/.spread.avg 3.72 ± 24% -73.1% 1.00 ±173% sched_debug.cfs_rq:/.spread.max 0.23 ± 25% -73.3% 0.06 ±173% sched_debug.cfs_rq:/.spread.stddev 4322 ± 12% +56.8% 6778 ± 17% sched_debug.cfs_rq:/.spread0.stddev 588.53 ± 5% -65.5% 203.04 ± 54% sched_debug.cfs_rq:/.util_avg.avg 1526 ± 3% -25.6% 1135 ± 6% sched_debug.cfs_rq:/.util_avg.max 261.05 ± 10% -43.5% 147.41 ± 23% sched_debug.cfs_rq:/.util_avg.stddev 264.02 ± 7% -74.8% 66.65 ± 57% sched_debug.cfs_rq:/.util_est_enqueued.avg 995.26 ± 4% -52.0% 478.00 ± 45% sched_debug.cfs_rq:/.util_est_enqueued.max 243.52 ± 7% -64.7% 85.98 ± 53% sched_debug.cfs_rq:/.util_est_enqueued.stddev 390455 ± 20% -57.3% 166866 ± 36% sched_debug.cpu.avg_idle.min 226.75 ± 2% -25.5% 168.89 ± 12% sched_debug.cpu.clock.stddev 226.75 ± 2% -25.5% 168.90 ± 12% sched_debug.cpu.clock_task.stddev 613.49 ± 5% -66.7% 204.24 ± 55% sched_debug.cpu.cpu_load[0].avg 1916 ± 8% -31.4% 1315 ± 13% sched_debug.cpu.cpu_load[0].max 322.12 ± 9% -49.0% 164.31 ± 26% sched_debug.cpu.cpu_load[0].stddev 612.63 ± 4% -66.7% 204.28 ± 55% sched_debug.cpu.cpu_load[1].avg 1448 ± 6% -20.3% 1154 ± 7% sched_debug.cpu.cpu_load[1].max 51.78 ± 45% -90.2% 5.08 ±104% sched_debug.cpu.cpu_load[1].min 250.21 ± 9% -43.8% 140.58 ± 23% sched_debug.cpu.cpu_load[1].stddev 611.42 ± 4% -66.7% 203.50 ± 55% sched_debug.cpu.cpu_load[2].avg 1252 ± 5% -15.2% 1062 ± 3% sched_debug.cpu.cpu_load[2].max 135.63 ± 18% -82.0% 24.42 ± 81% sched_debug.cpu.cpu_load[2].min 215.74 ± 11% -40.6% 128.23 ± 21% sched_debug.cpu.cpu_load[2].stddev 609.77 ± 4% -66.8% 202.56 ± 55% sched_debug.cpu.cpu_load[3].avg 1151 ± 3% -12.2% 1011 ± 4% sched_debug.cpu.cpu_load[3].max 205.74 ± 15% -75.6% 50.25 ± 79% sched_debug.cpu.cpu_load[3].min 190.83 ± 13% -37.8% 118.60 ± 20% sched_debug.cpu.cpu_load[3].stddev 607.50 ± 4% -67.0% 200.70 ± 55% sched_debug.cpu.cpu_load[4].avg 1089 -10.0% 980.43 ± 4% sched_debug.cpu.cpu_load[4].max 256.25 ± 18% -67.6% 83.04 ± 73% sched_debug.cpu.cpu_load[4].min 167.61 ± 15% -35.3% 108.38 ± 19% sched_debug.cpu.cpu_load[4].stddev 70051 ± 6% -54.1% 32128 ± 57% sched_debug.cpu.curr->pid.avg 110232 ± 11% +21.5% 133898 ± 2% sched_debug.cpu.curr->pid.max 25722 ± 11% -28.5% 18384 ± 31% sched_debug.cpu.curr->pid.stddev 717007 ± 4% -65.9% 244497 ± 54% sched_debug.cpu.load.avg 2202009 ± 8% -32.1% 1494220 ± 16% sched_debug.cpu.load.max 362781 ± 6% -46.5% 193973 ± 21% sched_debug.cpu.load.stddev 1560619 ± 10% -16.2% 1308544 ± 9% sched_debug.cpu.max_idle_balance_cost.max 27189 ± 9% +12.5% 30587 ± 8% sched_debug.cpu.nr_load_updates.avg 32217 ± 6% +10.8% 35703 ± 6% sched_debug.cpu.nr_load_updates.max 0.69 ± 4% -65.8% 0.23 ± 54% sched_debug.cpu.nr_running.avg 2.14 ± 7% -25.3% 1.60 ± 14% sched_debug.cpu.nr_running.max 0.35 ± 4% -44.7% 0.19 ± 19% sched_debug.cpu.nr_running.stddev 0.07 ± 33% -64.9% 0.02 ± 64% sched_debug.cpu.nr_uninterruptible.avg -50.05 -20.8% -39.62 sched_debug.cpu.nr_uninterruptible.min 15965 ± 13% -17.7% 13134 ± 2% softirqs.CPU0.RCU 14739 ± 2% -7.2% 13674 ± 2% softirqs.CPU10.RCU 14520 ± 2% -10.5% 12992 softirqs.CPU101.RCU 14419 ± 4% -9.0% 13118 ± 2% softirqs.CPU102.RCU 14295 -9.3% 12973 ± 4% softirqs.CPU105.RCU 14450 ± 2% -9.1% 13132 ± 3% softirqs.CPU107.RCU 14557 -10.2% 13079 ± 3% softirqs.CPU117.RCU 15307 ± 3% -13.0% 13310 softirqs.CPU12.RCU 14527 ± 2% -11.5% 12854 ± 3% softirqs.CPU120.RCU 14528 ± 2% -10.1% 13064 softirqs.CPU124.RCU 13801 ± 4% -7.8% 12720 ± 4% softirqs.CPU126.RCU 16009 ± 11% -18.8% 13006 ± 2% softirqs.CPU128.RCU 14451 ± 2% -11.0% 12863 ± 2% softirqs.CPU132.RCU 14587 ± 2% -11.5% 12909 softirqs.CPU133.RCU 14456 ± 2% -8.9% 13176 softirqs.CPU134.RCU 14647 ± 3% -10.7% 13083 ± 3% softirqs.CPU137.RCU 14962 ± 4% -13.1% 13006 softirqs.CPU138.RCU 15605 ± 2% -11.7% 13787 ± 2% softirqs.CPU14.RCU 14723 ± 6% -12.2% 12924 ± 4% softirqs.CPU141.RCU 14650 ± 2% -11.3% 13001 ± 3% softirqs.CPU143.RCU 14291 ± 2% -7.5% 13216 ± 4% softirqs.CPU145.RCU 14868 -12.6% 12995 softirqs.CPU146.RCU 14472 ± 2% -10.5% 12949 ± 3% softirqs.CPU149.RCU 14753 ± 4% -13.4% 12781 ± 3% softirqs.CPU150.RCU 14562 -12.0% 12822 ± 2% softirqs.CPU161.RCU 14278 ± 3% -9.7% 12891 softirqs.CPU162.RCU 14449 ± 3% -10.2% 12979 ± 4% softirqs.CPU164.RCU 14495 ± 3% -9.9% 13062 ± 3% softirqs.CPU165.RCU 14399 ± 2% -10.2% 12924 ± 2% softirqs.CPU166.RCU 14401 ± 2% -9.3% 13057 ± 3% softirqs.CPU172.RCU 14401 ± 2% -9.5% 13035 ± 3% softirqs.CPU174.RCU 14463 ± 2% -11.9% 12744 ± 3% softirqs.CPU175.RCU 14662 ± 3% -15.0% 12470 ± 3% softirqs.CPU176.RCU 14217 ± 2% -10.3% 12747 softirqs.CPU177.RCU 14353 -12.2% 12609 ± 2% softirqs.CPU178.RCU 14584 ± 4% -9.7% 13176 ± 2% softirqs.CPU180.RCU 14634 ± 4% -11.4% 12959 softirqs.CPU181.RCU 14266 ± 2% -10.1% 12829 softirqs.CPU182.RCU 14132 ± 2% -9.6% 12775 softirqs.CPU187.RCU 14422 ± 2% -9.0% 13117 softirqs.CPU189.RCU 14897 -10.4% 13354 ± 2% softirqs.CPU19.RCU 14188 ± 3% -8.7% 12960 ± 3% softirqs.CPU192.RCU 14661 ± 2% -11.9% 12915 softirqs.CPU193.RCU 14273 ± 3% -12.8% 12447 ± 3% softirqs.CPU195.RCU 14598 ± 4% -11.1% 12982 ± 2% softirqs.CPU196.RCU 14317 -8.7% 13072 ± 2% softirqs.CPU197.RCU 14935 ± 4% -11.1% 13276 ± 3% softirqs.CPU2.RCU 14713 ± 3% -11.0% 13091 softirqs.CPU20.RCU 14969 ± 8% -13.2% 12995 softirqs.CPU202.RCU 14035 ± 2% -10.0% 12635 ± 5% softirqs.CPU204.RCU 14391 -9.3% 13057 softirqs.CPU205.RCU 14269 ± 2% -9.6% 12901 ± 2% softirqs.CPU210.RCU 13875 ± 2% -8.6% 12688 ± 3% softirqs.CPU212.RCU 14473 ± 3% -11.8% 12762 ± 3% softirqs.CPU215.RCU 14018 ± 3% -8.3% 12857 ± 2% softirqs.CPU217.RCU 14293 -10.7% 12763 ± 2% softirqs.CPU218.RCU 15547 ± 5% -12.7% 13574 ± 2% softirqs.CPU22.RCU 14565 ± 4% -12.9% 12684 softirqs.CPU220.RCU 14330 -9.1% 13019 ± 4% softirqs.CPU222.RCU 14243 ± 2% -11.9% 12553 ± 2% softirqs.CPU224.RCU 14285 -9.9% 12877 softirqs.CPU225.RCU 14166 ± 3% -10.9% 12618 softirqs.CPU226.RCU 14706 ± 3% -9.4% 13327 ± 3% softirqs.CPU23.RCU 14274 ± 3% -10.6% 12757 ± 2% softirqs.CPU233.RCU 14493 ± 5% -9.6% 13107 ± 5% softirqs.CPU234.RCU 14461 -10.1% 13004 ± 4% softirqs.CPU235.RCU 14364 ± 3% -10.9% 12796 ± 2% softirqs.CPU240.RCU 14362 -11.6% 12697 ± 3% softirqs.CPU243.RCU 14230 -10.0% 12808 ± 2% softirqs.CPU252.RCU 14329 -9.7% 12940 softirqs.CPU253.RCU 14219 ± 2% -8.4% 13025 ± 2% softirqs.CPU254.RCU 14329 ± 3% -10.0% 12893 ± 2% softirqs.CPU255.RCU 14655 -9.5% 13256 ± 3% softirqs.CPU27.RCU 15363 ± 4% -14.5% 13133 softirqs.CPU28.RCU 14860 ± 3% -9.8% 13411 ± 2% softirqs.CPU29.RCU 15220 ± 2% -13.0% 13240 ± 2% softirqs.CPU30.RCU 14560 -9.0% 13256 softirqs.CPU34.RCU 14936 ± 4% -11.6% 13200 softirqs.CPU39.RCU 14911 -11.8% 13153 ± 2% softirqs.CPU4.RCU 14799 ± 2% -10.8% 13205 ± 5% softirqs.CPU40.RCU 14690 ± 3% -9.8% 13253 softirqs.CPU43.RCU 14774 ± 3% -12.9% 12866 softirqs.CPU47.RCU 14891 ± 3% -9.4% 13499 ± 2% softirqs.CPU49.RCU 14584 -9.7% 13166 ± 3% softirqs.CPU54.RCU 15391 ± 6% -15.7% 12967 ± 3% softirqs.CPU56.RCU 14426 ± 3% -7.7% 13317 ± 2% softirqs.CPU57.RCU 14552 ± 2% -10.0% 13096 softirqs.CPU59.RCU 14506 ± 2% -9.9% 13070 softirqs.CPU60.RCU 15038 ± 7% -12.6% 13149 ± 3% softirqs.CPU61.RCU 14664 ± 3% -9.0% 13348 ± 2% softirqs.CPU68.RCU 14879 ± 3% -10.9% 13253 ± 4% softirqs.CPU69.RCU 14654 -7.9% 13490 ± 3% softirqs.CPU7.RCU 14834 ± 6% -11.6% 13110 softirqs.CPU72.RCU 14535 ± 4% -9.9% 13101 ± 3% softirqs.CPU81.RCU 14696 -12.4% 12877 ± 5% softirqs.CPU83.RCU 14985 ± 3% -11.4% 13271 ± 3% softirqs.CPU9.RCU 14731 ± 2% -10.4% 13202 softirqs.CPU90.RCU 14256 ± 3% -8.7% 13011 ± 3% softirqs.CPU92.RCU 14459 ± 6% -10.3% 12975 softirqs.CPU95.RCU 14365 ± 2% -10.4% 12875 ± 3% softirqs.CPU97.RCU 14698 -9.4% 13321 ± 2% softirqs.CPU98.RCU 1709728 -4.0% 1641546 interrupts.CAL:Function_call_interrupts 2081 ± 9% +69.5% 3527 ± 32% interrupts.CPU0.NMI:Non-maskable_interrupts 2081 ± 9% +69.5% 3527 ± 32% interrupts.CPU0.PMI:Performance_monitoring_interrupts 716.25 ± 6% -16.9% 595.25 ± 4% interrupts.CPU0.TLB:TLB_shootdowns 2086 ± 6% +41.2% 2946 ± 34% interrupts.CPU1.NMI:Non-maskable_interrupts 2086 ± 6% +41.2% 2946 ± 34% interrupts.CPU1.PMI:Performance_monitoring_interrupts 727.50 ± 7% -13.7% 628.00 ± 6% interrupts.CPU1.TLB:TLB_shootdowns 750.25 -20.2% 599.00 ± 6% interrupts.CPU100.TLB:TLB_shootdowns 769.25 ± 5% -19.5% 619.00 interrupts.CPU101.TLB:TLB_shootdowns 742.75 ± 9% -14.0% 638.75 ± 2% interrupts.CPU102.TLB:TLB_shootdowns 777.50 ± 2% -24.8% 584.75 ± 3% interrupts.CPU103.TLB:TLB_shootdowns 738.00 -17.9% 605.75 interrupts.CPU104.TLB:TLB_shootdowns 724.75 ± 2% -15.3% 614.00 ± 8% interrupts.CPU105.TLB:TLB_shootdowns 759.00 ± 7% -20.0% 607.00 ± 4% interrupts.CPU106.TLB:TLB_shootdowns 784.75 -21.9% 612.50 ± 6% interrupts.CPU108.TLB:TLB_shootdowns 723.25 ± 2% -16.6% 603.50 ± 7% interrupts.CPU109.TLB:TLB_shootdowns 4237 ± 4% +8.3% 4591 ± 4% interrupts.CPU11.RES:Rescheduling_interrupts 723.00 ± 7% -14.1% 621.00 ± 2% interrupts.CPU11.TLB:TLB_shootdowns 744.50 -18.8% 604.75 ± 6% interrupts.CPU110.TLB:TLB_shootdowns 749.50 ± 2% -21.5% 588.00 ± 4% interrupts.CPU111.TLB:TLB_shootdowns 747.50 ± 3% -18.1% 612.25 ± 8% interrupts.CPU112.TLB:TLB_shootdowns 746.00 ± 7% -19.1% 603.75 ± 4% interrupts.CPU113.TLB:TLB_shootdowns 737.00 ± 8% -13.3% 638.75 ± 4% interrupts.CPU114.TLB:TLB_shootdowns 775.25 ± 2% -21.2% 611.00 ± 5% interrupts.CPU115.TLB:TLB_shootdowns 756.50 ± 4% -20.5% 601.75 interrupts.CPU116.TLB:TLB_shootdowns 781.50 ± 3% -23.4% 599.00 ± 7% interrupts.CPU117.TLB:TLB_shootdowns 744.25 ± 5% -14.7% 634.75 ± 4% interrupts.CPU118.TLB:TLB_shootdowns 767.50 ± 4% -15.8% 646.50 ± 7% interrupts.CPU119.TLB:TLB_shootdowns 742.25 -15.3% 628.75 ± 3% interrupts.CPU12.TLB:TLB_shootdowns 2085 ± 6% +41.4% 2949 ± 38% interrupts.CPU120.NMI:Non-maskable_interrupts 2085 ± 6% +41.4% 2949 ± 38% interrupts.CPU120.PMI:Performance_monitoring_interrupts 781.25 -24.5% 589.75 ± 4% interrupts.CPU120.TLB:TLB_shootdowns 748.25 -16.2% 626.75 ± 3% interrupts.CPU121.TLB:TLB_shootdowns 746.00 ± 3% -19.5% 600.50 ± 9% interrupts.CPU122.TLB:TLB_shootdowns 2083 ± 6% +67.9% 3497 ± 36% interrupts.CPU123.NMI:Non-maskable_interrupts 2083 ± 6% +67.9% 3497 ± 36% interrupts.CPU123.PMI:Performance_monitoring_interrupts 727.25 ± 4% -18.0% 596.25 ± 6% interrupts.CPU123.TLB:TLB_shootdowns 2098 ± 8% +65.8% 3480 ± 34% interrupts.CPU124.NMI:Non-maskable_interrupts 2098 ± 8% +65.8% 3480 ± 34% interrupts.CPU124.PMI:Performance_monitoring_interrupts 775.25 ± 2% -19.0% 628.00 ± 7% interrupts.CPU124.TLB:TLB_shootdowns 2061 ± 8% +101.9% 4162 ± 27% interrupts.CPU125.NMI:Non-maskable_interrupts 2061 ± 8% +101.9% 4162 ± 27% interrupts.CPU125.PMI:Performance_monitoring_interrupts 756.00 ± 2% -19.4% 609.00 ± 4% interrupts.CPU125.TLB:TLB_shootdowns 2076 ± 5% +67.4% 3475 ± 35% interrupts.CPU126.NMI:Non-maskable_interrupts 2076 ± 5% +67.4% 3475 ± 35% interrupts.CPU126.PMI:Performance_monitoring_interrupts 718.25 ± 2% -16.0% 603.25 ± 3% interrupts.CPU126.TLB:TLB_shootdowns 2057 ± 4% +66.9% 3434 ± 33% interrupts.CPU127.NMI:Non-maskable_interrupts 2057 ± 4% +66.9% 3434 ± 33% interrupts.CPU127.PMI:Performance_monitoring_interrupts 762.25 ± 8% -11.3% 676.25 ± 7% interrupts.CPU127.TLB:TLB_shootdowns 2097 ± 7% +65.7% 3474 ± 34% interrupts.CPU128.NMI:Non-maskable_interrupts 2097 ± 7% +65.7% 3474 ± 34% interrupts.CPU128.PMI:Performance_monitoring_interrupts 758.75 ± 5% -17.1% 629.00 ± 2% interrupts.CPU128.TLB:TLB_shootdowns 2077 ± 5% +72.4% 3580 ± 33% interrupts.CPU129.NMI:Non-maskable_interrupts 2077 ± 5% +72.4% 3580 ± 33% interrupts.CPU129.PMI:Performance_monitoring_interrupts 760.75 ± 4% -23.1% 585.25 interrupts.CPU129.TLB:TLB_shootdowns 730.50 ± 2% -13.2% 634.00 ± 3% interrupts.CPU13.TLB:TLB_shootdowns 2081 ± 7% +71.6% 3570 ± 33% interrupts.CPU130.NMI:Non-maskable_interrupts 2081 ± 7% +71.6% 3570 ± 33% interrupts.CPU130.PMI:Performance_monitoring_interrupts 703.50 ± 6% -13.1% 611.50 ± 3% interrupts.CPU130.TLB:TLB_shootdowns 2084 ± 5% +69.4% 3531 ± 34% interrupts.CPU131.NMI:Non-maskable_interrupts 2084 ± 5% +69.4% 3531 ± 34% interrupts.CPU131.PMI:Performance_monitoring_interrupts 760.75 ± 5% -19.8% 609.75 ± 2% interrupts.CPU131.TLB:TLB_shootdowns 745.50 ± 4% -19.8% 597.75 ± 6% interrupts.CPU132.TLB:TLB_shootdowns 2062 ± 8% +41.4% 2917 ± 36% interrupts.CPU133.NMI:Non-maskable_interrupts 2062 ± 8% +41.4% 2917 ± 36% interrupts.CPU133.PMI:Performance_monitoring_interrupts 744.25 ± 2% -19.5% 598.75 ± 2% interrupts.CPU133.TLB:TLB_shootdowns 766.75 ± 3% -15.6% 647.50 ± 5% interrupts.CPU134.TLB:TLB_shootdowns 778.50 ± 8% -23.8% 593.25 ± 10% interrupts.CPU135.TLB:TLB_shootdowns 2065 ± 5% +43.5% 2963 ± 35% interrupts.CPU136.NMI:Non-maskable_interrupts 2065 ± 5% +43.5% 2963 ± 35% interrupts.CPU136.PMI:Performance_monitoring_interrupts 766.25 -22.0% 597.75 ± 5% interrupts.CPU136.TLB:TLB_shootdowns 721.75 ± 6% -11.8% 636.25 ± 7% interrupts.CPU137.TLB:TLB_shootdowns 2132 ± 5% +10.4% 2355 ± 2% interrupts.CPU138.NMI:Non-maskable_interrupts 2132 ± 5% +10.4% 2355 ± 2% interrupts.CPU138.PMI:Performance_monitoring_interrupts 753.75 ± 7% -21.0% 595.75 ± 6% interrupts.CPU138.TLB:TLB_shootdowns 2054 ± 6% +16.0% 2384 interrupts.CPU139.NMI:Non-maskable_interrupts 2054 ± 6% +16.0% 2384 interrupts.CPU139.PMI:Performance_monitoring_interrupts 744.50 ± 7% -17.4% 614.75 ± 6% interrupts.CPU139.TLB:TLB_shootdowns 812.50 ± 7% -24.5% 613.50 ± 5% interrupts.CPU14.TLB:TLB_shootdowns 2093 ± 3% +10.2% 2307 ± 4% interrupts.CPU140.NMI:Non-maskable_interrupts 2093 ± 3% +10.2% 2307 ± 4% interrupts.CPU140.PMI:Performance_monitoring_interrupts 736.25 ± 2% -18.0% 604.00 ± 12% interrupts.CPU140.TLB:TLB_shootdowns 4098 ± 4% +8.0% 4425 ± 4% interrupts.CPU141.RES:Rescheduling_interrupts 724.50 -18.5% 590.75 ± 4% interrupts.CPU141.TLB:TLB_shootdowns 720.00 ± 3% -14.8% 613.75 ± 3% interrupts.CPU142.TLB:TLB_shootdowns 2096 ± 8% +65.1% 3461 ± 33% interrupts.CPU143.NMI:Non-maskable_interrupts 2096 ± 8% +65.1% 3461 ± 33% interrupts.CPU143.PMI:Performance_monitoring_interrupts 762.25 ± 4% -16.2% 638.75 ± 4% interrupts.CPU143.TLB:TLB_shootdowns 752.25 ± 2% -20.2% 600.00 ± 11% interrupts.CPU144.TLB:TLB_shootdowns 4290 ± 4% +7.1% 4593 ± 4% interrupts.CPU145.RES:Rescheduling_interrupts 757.00 ± 4% -21.3% 595.50 ± 5% interrupts.CPU145.TLB:TLB_shootdowns 2080 ± 4% +43.0% 2976 ± 32% interrupts.CPU146.NMI:Non-maskable_interrupts 2080 ± 4% +43.0% 2976 ± 32% interrupts.CPU146.PMI:Performance_monitoring_interrupts 4138 ± 3% +12.3% 4647 interrupts.CPU147.RES:Rescheduling_interrupts 748.50 ± 6% -21.2% 589.75 ± 7% interrupts.CPU147.TLB:TLB_shootdowns 2095 ± 6% +41.0% 2956 ± 35% interrupts.CPU148.NMI:Non-maskable_interrupts 2095 ± 6% +41.0% 2956 ± 35% interrupts.CPU148.PMI:Performance_monitoring_interrupts 705.00 ± 5% -16.1% 591.75 ± 2% interrupts.CPU148.TLB:TLB_shootdowns 810.50 ± 3% -23.5% 620.00 ± 6% interrupts.CPU149.TLB:TLB_shootdowns 766.50 ± 3% -22.8% 592.00 ± 5% interrupts.CPU15.TLB:TLB_shootdowns 2053 ± 7% +42.4% 2925 ± 34% interrupts.CPU150.NMI:Non-maskable_interrupts 2053 ± 7% +42.4% 2925 ± 34% interrupts.CPU150.PMI:Performance_monitoring_interrupts 786.25 -24.5% 593.25 ± 7% interrupts.CPU150.TLB:TLB_shootdowns 762.00 ± 4% -22.0% 594.25 ± 7% interrupts.CPU151.TLB:TLB_shootdowns 741.50 ± 4% -16.6% 618.75 ± 6% interrupts.CPU152.TLB:TLB_shootdowns 2095 ± 5% +41.5% 2965 ± 36% interrupts.CPU153.NMI:Non-maskable_interrupts 2095 ± 5% +41.5% 2965 ± 36% interrupts.CPU153.PMI:Performance_monitoring_interrupts 737.00 ± 7% -20.9% 583.25 ± 10% interrupts.CPU153.TLB:TLB_shootdowns 2105 ± 2% +39.0% 2926 ± 35% interrupts.CPU154.NMI:Non-maskable_interrupts 2105 ± 2% +39.0% 2926 ± 35% interrupts.CPU154.PMI:Performance_monitoring_interrupts 729.75 ± 3% -17.7% 600.75 ± 5% interrupts.CPU154.TLB:TLB_shootdowns 2051 ± 6% +41.9% 2911 ± 34% interrupts.CPU155.NMI:Non-maskable_interrupts 2051 ± 6% +41.9% 2911 ± 34% interrupts.CPU155.PMI:Performance_monitoring_interrupts 745.00 ± 3% -21.3% 586.00 ± 2% interrupts.CPU155.TLB:TLB_shootdowns 719.50 ± 3% -17.2% 595.75 ± 4% interrupts.CPU156.TLB:TLB_shootdowns 2089 ± 6% +40.3% 2931 ± 37% interrupts.CPU157.NMI:Non-maskable_interrupts 2089 ± 6% +40.3% 2931 ± 37% interrupts.CPU157.PMI:Performance_monitoring_interrupts 767.50 ± 4% -17.7% 632.00 ± 2% interrupts.CPU157.TLB:TLB_shootdowns 734.00 ± 7% -17.4% 606.25 ± 8% interrupts.CPU158.TLB:TLB_shootdowns 731.50 -15.5% 618.00 ± 4% interrupts.CPU159.TLB:TLB_shootdowns 2093 ± 6% +13.1% 2368 ± 2% interrupts.CPU16.NMI:Non-maskable_interrupts 2093 ± 6% +13.1% 2368 ± 2% interrupts.CPU16.PMI:Performance_monitoring_interrupts 725.50 ± 5% -15.5% 612.75 ± 9% interrupts.CPU16.TLB:TLB_shootdowns 2049 ± 6% +41.8% 2906 ± 36% interrupts.CPU161.NMI:Non-maskable_interrupts 2049 ± 6% +41.8% 2906 ± 36% interrupts.CPU161.PMI:Performance_monitoring_interrupts 760.00 ± 3% -19.5% 612.00 ± 2% interrupts.CPU161.TLB:TLB_shootdowns 2137 ± 5% +62.2% 3466 ± 32% interrupts.CPU162.NMI:Non-maskable_interrupts 2137 ± 5% +62.2% 3466 ± 32% interrupts.CPU162.PMI:Performance_monitoring_interrupts 724.75 ± 5% -12.6% 633.75 ± 5% interrupts.CPU162.TLB:TLB_shootdowns 744.75 ± 4% -17.3% 615.75 interrupts.CPU163.TLB:TLB_shootdowns 2056 ± 8% +40.0% 2879 ± 31% interrupts.CPU164.NMI:Non-maskable_interrupts 2056 ± 8% +40.0% 2879 ± 31% interrupts.CPU164.PMI:Performance_monitoring_interrupts 745.50 ± 2% -17.0% 618.75 ± 3% interrupts.CPU164.TLB:TLB_shootdowns 761.50 ± 9% -17.3% 629.50 ± 7% interrupts.CPU165.TLB:TLB_shootdowns 776.25 ± 5% -20.4% 618.00 ± 4% interrupts.CPU166.TLB:TLB_shootdowns 2069 ± 6% +40.2% 2901 ± 33% interrupts.CPU167.NMI:Non-maskable_interrupts 2069 ± 6% +40.2% 2901 ± 33% interrupts.CPU167.PMI:Performance_monitoring_interrupts 757.75 ± 5% -21.0% 599.00 ± 2% interrupts.CPU167.TLB:TLB_shootdowns 2085 ± 6% +68.4% 3511 ± 31% interrupts.CPU168.NMI:Non-maskable_interrupts 2085 ± 6% +68.4% 3511 ± 31% interrupts.CPU168.PMI:Performance_monitoring_interrupts 752.00 ± 2% -21.0% 594.25 ± 4% interrupts.CPU168.TLB:TLB_shootdowns 695.50 ± 2% -16.5% 580.50 ± 7% interrupts.CPU169.TLB:TLB_shootdowns 745.00 ± 6% -16.8% 619.75 ± 3% interrupts.CPU17.TLB:TLB_shootdowns 2084 ± 5% +66.7% 3475 ± 31% interrupts.CPU170.NMI:Non-maskable_interrupts 2084 ± 5% +66.7% 3475 ± 31% interrupts.CPU170.PMI:Performance_monitoring_interrupts 706.75 -16.6% 589.75 ± 5% interrupts.CPU170.TLB:TLB_shootdowns 2107 ± 6% +65.0% 3478 ± 29% interrupts.CPU171.NMI:Non-maskable_interrupts 2107 ± 6% +65.0% 3478 ± 29% interrupts.CPU171.PMI:Performance_monitoring_interrupts 715.75 ± 5% -13.6% 618.75 ± 2% interrupts.CPU171.TLB:TLB_shootdowns 2065 ± 5% +63.8% 3383 ± 30% interrupts.CPU172.NMI:Non-maskable_interrupts 2065 ± 5% +63.8% 3383 ± 30% interrupts.CPU172.PMI:Performance_monitoring_interrupts 737.00 ± 6% -11.1% 655.00 ± 4% interrupts.CPU172.TLB:TLB_shootdowns 2057 ± 6% +67.5% 3445 ± 31% interrupts.CPU173.NMI:Non-maskable_interrupts 2057 ± 6% +67.5% 3445 ± 31% interrupts.CPU173.PMI:Performance_monitoring_interrupts 751.75 ± 3% -18.4% 613.75 ± 5% interrupts.CPU173.TLB:TLB_shootdowns 2083 ± 8% +67.2% 3483 ± 32% interrupts.CPU174.NMI:Non-maskable_interrupts 2083 ± 8% +67.2% 3483 ± 32% interrupts.CPU174.PMI:Performance_monitoring_interrupts 741.25 ± 4% -17.4% 612.00 ± 4% interrupts.CPU174.TLB:TLB_shootdowns 2067 ± 3% +67.7% 3466 ± 33% interrupts.CPU175.NMI:Non-maskable_interrupts 2067 ± 3% +67.7% 3466 ± 33% interrupts.CPU175.PMI:Performance_monitoring_interrupts 747.00 ± 4% -21.4% 587.50 ± 6% interrupts.CPU175.TLB:TLB_shootdowns 2071 ± 7% +67.9% 3478 ± 32% interrupts.CPU176.NMI:Non-maskable_interrupts 2071 ± 7% +67.9% 3478 ± 32% interrupts.CPU176.PMI:Performance_monitoring_interrupts 788.75 ± 4% -29.3% 557.50 ± 3% interrupts.CPU176.TLB:TLB_shootdowns 2117 ± 9% +63.0% 3450 ± 33% interrupts.CPU177.NMI:Non-maskable_interrupts 2117 ± 9% +63.0% 3450 ± 33% interrupts.CPU177.PMI:Performance_monitoring_interrupts 763.25 ± 5% -18.3% 623.25 ± 2% interrupts.CPU177.TLB:TLB_shootdowns 2081 ± 8% +67.6% 3488 ± 31% interrupts.CPU178.NMI:Non-maskable_interrupts 2081 ± 8% +67.6% 3488 ± 31% interrupts.CPU178.PMI:Performance_monitoring_interrupts 768.25 -22.1% 598.25 ± 3% interrupts.CPU178.TLB:TLB_shootdowns 2104 ± 6% +66.3% 3500 ± 33% interrupts.CPU179.NMI:Non-maskable_interrupts 2104 ± 6% +66.3% 3500 ± 33% interrupts.CPU179.PMI:Performance_monitoring_interrupts 716.00 ± 3% -14.4% 613.25 ± 4% interrupts.CPU179.TLB:TLB_shootdowns 746.50 ± 8% -18.3% 610.00 ± 6% interrupts.CPU18.TLB:TLB_shootdowns 2130 ± 7% +64.4% 3501 ± 32% interrupts.CPU180.NMI:Non-maskable_interrupts 2130 ± 7% +64.4% 3501 ± 32% interrupts.CPU180.PMI:Performance_monitoring_interrupts 2078 ± 8% +63.9% 3406 ± 29% interrupts.CPU181.NMI:Non-maskable_interrupts 2078 ± 8% +63.9% 3406 ± 29% interrupts.CPU181.PMI:Performance_monitoring_interrupts 795.50 -24.6% 600.00 ± 4% interrupts.CPU181.TLB:TLB_shootdowns 2094 ± 9% +66.3% 3483 ± 31% interrupts.CPU182.NMI:Non-maskable_interrupts 2094 ± 9% +66.3% 3483 ± 31% interrupts.CPU182.PMI:Performance_monitoring_interrupts 757.00 ± 5% -20.4% 602.75 ± 8% interrupts.CPU182.TLB:TLB_shootdowns 763.00 ± 4% -16.6% 636.50 ± 5% interrupts.CPU183.TLB:TLB_shootdowns 2544 ± 25% +40.6% 3576 ± 34% interrupts.CPU184.NMI:Non-maskable_interrupts 2544 ± 25% +40.6% 3576 ± 34% interrupts.CPU184.PMI:Performance_monitoring_interrupts 772.25 ± 3% -22.1% 601.75 ± 6% interrupts.CPU184.TLB:TLB_shootdowns 745.75 ± 4% -18.0% 611.75 ± 3% interrupts.CPU185.TLB:TLB_shootdowns 764.75 ± 3% -16.8% 636.50 ± 2% interrupts.CPU186.TLB:TLB_shootdowns 712.00 ± 6% -14.3% 610.00 ± 9% interrupts.CPU188.TLB:TLB_shootdowns 771.50 ± 2% -19.0% 624.75 ± 6% interrupts.CPU189.TLB:TLB_shootdowns 763.00 ± 4% -16.5% 636.75 ± 4% interrupts.CPU19.TLB:TLB_shootdowns 719.25 ± 3% -18.1% 588.75 ± 6% interrupts.CPU190.TLB:TLB_shootdowns 758.00 -20.3% 604.25 ± 11% interrupts.CPU191.TLB:TLB_shootdowns 745.00 ± 4% -24.1% 565.50 ± 6% interrupts.CPU193.TLB:TLB_shootdowns 713.00 ± 3% -14.8% 607.25 ± 6% interrupts.CPU194.TLB:TLB_shootdowns 717.00 ± 2% -14.3% 614.75 ± 5% interrupts.CPU196.TLB:TLB_shootdowns 722.50 ± 4% -14.7% 616.50 ± 5% interrupts.CPU197.TLB:TLB_shootdowns 833.75 ± 8% -25.7% 619.25 ± 7% interrupts.CPU2.TLB:TLB_shootdowns 748.75 ± 2% -16.3% 626.75 ± 2% interrupts.CPU20.TLB:TLB_shootdowns 719.00 ± 3% -14.8% 612.25 ± 5% interrupts.CPU200.TLB:TLB_shootdowns 753.50 ± 4% -20.7% 597.25 ± 6% interrupts.CPU201.TLB:TLB_shootdowns 752.50 ± 3% -17.9% 617.50 ± 5% interrupts.CPU202.TLB:TLB_shootdowns 747.00 ± 4% -24.4% 565.00 ± 4% interrupts.CPU203.TLB:TLB_shootdowns 725.75 ± 6% -20.6% 576.00 ± 9% interrupts.CPU204.TLB:TLB_shootdowns 750.00 ± 3% -16.0% 629.75 ± 8% interrupts.CPU205.TLB:TLB_shootdowns 778.00 ± 2% -21.9% 607.25 ± 5% interrupts.CPU206.TLB:TLB_shootdowns 2554 ± 28% +34.4% 3432 ± 32% interrupts.CPU207.NMI:Non-maskable_interrupts 2554 ± 28% +34.4% 3432 ± 32% interrupts.CPU207.PMI:Performance_monitoring_interrupts 762.00 ± 4% -19.8% 611.50 ± 5% interrupts.CPU207.TLB:TLB_shootdowns 2611 ± 33% +34.7% 3517 ± 33% interrupts.CPU208.NMI:Non-maskable_interrupts 2611 ± 33% +34.7% 3517 ± 33% interrupts.CPU208.PMI:Performance_monitoring_interrupts 694.50 ± 7% -17.9% 570.50 ± 6% interrupts.CPU208.TLB:TLB_shootdowns 776.50 ± 5% -20.0% 621.25 ± 3% interrupts.CPU209.TLB:TLB_shootdowns 746.25 ± 6% -17.5% 616.00 ± 9% interrupts.CPU21.TLB:TLB_shootdowns 736.00 ± 6% -19.6% 592.00 ± 9% interrupts.CPU210.TLB:TLB_shootdowns 742.25 ± 3% -16.1% 622.75 ± 2% interrupts.CPU211.TLB:TLB_shootdowns 743.00 ± 3% -17.7% 611.75 ± 6% interrupts.CPU212.TLB:TLB_shootdowns 713.50 ± 4% -14.1% 612.75 interrupts.CPU213.TLB:TLB_shootdowns 716.00 ± 3% -15.9% 602.50 ± 10% interrupts.CPU214.TLB:TLB_shootdowns 782.00 -16.6% 652.25 interrupts.CPU215.TLB:TLB_shootdowns 746.50 ± 5% -10.0% 671.75 ± 5% interrupts.CPU216.TLB:TLB_shootdowns 728.25 ± 4% -15.2% 617.75 ± 4% interrupts.CPU218.TLB:TLB_shootdowns 771.75 -18.5% 629.25 ± 7% interrupts.CPU219.TLB:TLB_shootdowns 740.75 ± 7% -14.3% 634.75 ± 8% interrupts.CPU22.TLB:TLB_shootdowns 760.25 ± 5% -18.7% 618.00 ± 4% interrupts.CPU220.TLB:TLB_shootdowns 775.00 ± 2% -24.5% 584.75 ± 6% interrupts.CPU221.TLB:TLB_shootdowns 758.75 -17.9% 623.00 ± 4% interrupts.CPU222.TLB:TLB_shootdowns 775.00 ± 4% -22.5% 600.25 ± 5% interrupts.CPU223.TLB:TLB_shootdowns 712.75 ± 5% -19.0% 577.25 ± 7% interrupts.CPU224.TLB:TLB_shootdowns 728.25 ± 5% -15.8% 613.25 ± 6% interrupts.CPU225.TLB:TLB_shootdowns 2495 ± 32% +36.4% 3402 ± 31% interrupts.CPU226.NMI:Non-maskable_interrupts 2495 ± 32% +36.4% 3402 ± 31% interrupts.CPU226.PMI:Performance_monitoring_interrupts 782.25 ± 5% -23.0% 602.25 ± 3% interrupts.CPU226.TLB:TLB_shootdowns 737.25 ± 6% -17.0% 612.25 ± 3% interrupts.CPU227.TLB:TLB_shootdowns 780.25 ± 5% -20.0% 624.00 ± 8% interrupts.CPU228.TLB:TLB_shootdowns 750.50 ± 7% -18.1% 614.75 ± 4% interrupts.CPU229.TLB:TLB_shootdowns 786.75 ± 3% -20.7% 623.75 ± 3% interrupts.CPU23.TLB:TLB_shootdowns 768.25 ± 3% -16.7% 640.00 interrupts.CPU230.TLB:TLB_shootdowns 737.00 ± 5% -14.3% 631.75 ± 2% interrupts.CPU231.TLB:TLB_shootdowns 745.00 ± 6% -19.0% 603.50 ± 4% interrupts.CPU232.TLB:TLB_shootdowns 758.25 ± 3% -22.7% 586.50 ± 8% interrupts.CPU233.TLB:TLB_shootdowns 748.75 ± 4% -24.1% 568.50 ± 2% interrupts.CPU234.TLB:TLB_shootdowns 746.25 ± 3% -15.9% 627.25 ± 6% interrupts.CPU235.TLB:TLB_shootdowns 720.00 ± 2% -12.8% 628.00 ± 8% interrupts.CPU236.TLB:TLB_shootdowns 752.25 ± 7% -22.9% 579.75 ± 2% interrupts.CPU237.TLB:TLB_shootdowns 750.75 ± 3% -16.4% 628.00 interrupts.CPU238.TLB:TLB_shootdowns 708.75 ± 5% -15.3% 600.50 ± 5% interrupts.CPU239.TLB:TLB_shootdowns 759.50 ± 3% -19.5% 611.25 ± 3% interrupts.CPU24.TLB:TLB_shootdowns 729.00 ± 4% -15.7% 614.25 ± 2% interrupts.CPU240.TLB:TLB_shootdowns 769.50 ± 3% -22.4% 597.00 ± 3% interrupts.CPU241.TLB:TLB_shootdowns 757.25 ± 5% -15.5% 639.75 ± 6% interrupts.CPU242.TLB:TLB_shootdowns 733.25 ± 4% -19.5% 590.00 ± 4% interrupts.CPU243.TLB:TLB_shootdowns 743.75 ± 4% -20.2% 593.25 ± 4% interrupts.CPU244.TLB:TLB_shootdowns 744.00 ± 4% -16.5% 621.50 ± 6% interrupts.CPU245.TLB:TLB_shootdowns 739.00 ± 4% -19.8% 593.00 ± 6% interrupts.CPU246.TLB:TLB_shootdowns 779.25 ± 3% -22.2% 606.50 ± 4% interrupts.CPU247.TLB:TLB_shootdowns 4115 ± 5% +10.8% 4560 ± 2% interrupts.CPU248.RES:Rescheduling_interrupts 724.00 ± 4% -18.4% 591.00 ± 5% interrupts.CPU248.TLB:TLB_shootdowns 704.50 ± 3% -13.3% 611.00 ± 5% interrupts.CPU249.TLB:TLB_shootdowns 791.50 ± 5% -19.9% 633.75 ± 5% interrupts.CPU25.TLB:TLB_shootdowns 747.50 ± 3% -26.0% 553.00 ± 3% interrupts.CPU250.TLB:TLB_shootdowns 724.75 ± 2% -21.1% 572.00 ± 6% interrupts.CPU251.TLB:TLB_shootdowns 726.50 ± 7% -21.5% 570.25 ± 7% interrupts.CPU252.TLB:TLB_shootdowns 735.25 ± 4% -18.7% 597.50 ± 6% interrupts.CPU253.TLB:TLB_shootdowns 760.00 ± 5% -19.3% 613.50 ± 3% interrupts.CPU254.TLB:TLB_shootdowns 696.25 ± 4% -12.4% 609.75 ± 5% interrupts.CPU255.TLB:TLB_shootdowns 2191 ±112% -71.9% 616.50 ± 4% interrupts.CPU26.TLB:TLB_shootdowns 737.25 ± 2% -15.1% 625.75 ± 3% interrupts.CPU27.TLB:TLB_shootdowns 797.00 ± 5% -21.7% 624.25 ± 6% interrupts.CPU28.TLB:TLB_shootdowns 780.00 ± 4% -16.7% 650.00 ± 5% interrupts.CPU29.TLB:TLB_shootdowns 2042 ± 3% +41.1% 2881 ± 33% interrupts.CPU3.NMI:Non-maskable_interrupts 2042 ± 3% +41.1% 2881 ± 33% interrupts.CPU3.PMI:Performance_monitoring_interrupts 765.50 ± 2% -21.7% 599.25 ± 4% interrupts.CPU3.TLB:TLB_shootdowns 789.25 ± 3% -15.4% 667.50 ± 4% interrupts.CPU30.TLB:TLB_shootdowns 751.75 ± 3% -16.9% 624.50 ± 2% interrupts.CPU31.TLB:TLB_shootdowns 757.75 -15.5% 640.00 ± 6% interrupts.CPU32.TLB:TLB_shootdowns 746.00 ± 3% -16.3% 624.25 ± 4% interrupts.CPU35.TLB:TLB_shootdowns 771.00 ± 5% -22.6% 597.00 ± 6% interrupts.CPU36.TLB:TLB_shootdowns 752.50 ± 5% -21.5% 590.50 ± 7% interrupts.CPU37.TLB:TLB_shootdowns 757.00 ± 6% -21.8% 591.75 ± 7% interrupts.CPU38.TLB:TLB_shootdowns 2539 ± 33% +40.4% 3564 ± 33% interrupts.CPU39.NMI:Non-maskable_interrupts 2539 ± 33% +40.4% 3564 ± 33% interrupts.CPU39.PMI:Performance_monitoring_interrupts 761.50 -17.5% 628.50 ± 7% interrupts.CPU4.TLB:TLB_shootdowns 763.00 ± 5% -20.2% 609.00 ± 5% interrupts.CPU40.TLB:TLB_shootdowns 766.75 ± 3% -13.4% 664.00 ± 3% interrupts.CPU41.TLB:TLB_shootdowns 761.00 ± 3% -17.9% 624.75 ± 5% interrupts.CPU42.TLB:TLB_shootdowns 798.00 ± 2% -19.3% 644.25 ± 6% interrupts.CPU44.TLB:TLB_shootdowns 1631 ± 86% -62.5% 611.00 ± 6% interrupts.CPU45.TLB:TLB_shootdowns 775.25 ± 6% -18.8% 629.50 ± 3% interrupts.CPU46.TLB:TLB_shootdowns 810.75 ± 5% -27.4% 588.25 interrupts.CPU47.TLB:TLB_shootdowns 774.00 ± 5% -21.4% 608.75 ± 5% interrupts.CPU48.TLB:TLB_shootdowns 762.25 ± 7% -18.0% 624.75 ± 4% interrupts.CPU49.TLB:TLB_shootdowns 746.75 ± 4% -15.3% 632.25 ± 3% interrupts.CPU5.TLB:TLB_shootdowns 762.75 ± 4% -12.5% 667.25 ± 2% interrupts.CPU50.TLB:TLB_shootdowns 775.50 ± 6% -16.3% 648.75 ± 7% interrupts.CPU51.TLB:TLB_shootdowns 783.00 ± 4% -22.9% 604.00 ± 4% interrupts.CPU52.TLB:TLB_shootdowns 805.50 ± 6% -21.7% 630.50 ± 7% interrupts.CPU53.TLB:TLB_shootdowns 736.25 ± 6% -14.7% 628.25 ± 5% interrupts.CPU54.TLB:TLB_shootdowns 794.25 ± 8% -19.9% 636.50 ± 3% interrupts.CPU55.TLB:TLB_shootdowns 752.25 ± 4% -19.8% 603.25 ± 4% interrupts.CPU56.TLB:TLB_shootdowns 751.75 ± 4% -17.9% 617.00 ± 5% interrupts.CPU57.TLB:TLB_shootdowns 773.00 -21.6% 606.25 ± 6% interrupts.CPU59.TLB:TLB_shootdowns 763.75 ± 2% -14.4% 654.00 ± 4% interrupts.CPU6.TLB:TLB_shootdowns 767.50 ± 5% -18.0% 629.50 ± 5% interrupts.CPU60.TLB:TLB_shootdowns 770.50 ± 3% -21.3% 606.75 ± 7% interrupts.CPU61.TLB:TLB_shootdowns 761.25 ± 7% -22.2% 592.00 ± 2% interrupts.CPU62.TLB:TLB_shootdowns 759.50 ± 5% -14.4% 650.00 ± 4% interrupts.CPU63.TLB:TLB_shootdowns 720.50 ± 2% -18.3% 588.75 ± 4% interrupts.CPU64.TLB:TLB_shootdowns 732.50 ± 4% -12.5% 641.25 ± 10% interrupts.CPU65.TLB:TLB_shootdowns 784.00 -24.1% 594.75 ± 11% interrupts.CPU66.TLB:TLB_shootdowns 782.50 ± 7% -18.5% 637.75 ± 6% interrupts.CPU67.TLB:TLB_shootdowns 792.25 ± 6% -22.2% 616.00 ± 9% interrupts.CPU68.TLB:TLB_shootdowns 782.50 ± 4% -23.7% 597.25 ± 6% interrupts.CPU69.TLB:TLB_shootdowns 729.75 ± 2% -18.9% 591.50 ± 4% interrupts.CPU7.TLB:TLB_shootdowns 753.50 ± 4% -14.6% 643.50 ± 3% interrupts.CPU70.TLB:TLB_shootdowns 721.50 ± 5% -15.3% 610.75 ± 6% interrupts.CPU71.TLB:TLB_shootdowns 742.00 ± 2% -15.6% 626.25 ± 4% interrupts.CPU72.TLB:TLB_shootdowns 760.00 ± 5% -15.5% 642.25 ± 8% interrupts.CPU73.TLB:TLB_shootdowns 2106 ± 8% +40.2% 2953 ± 33% interrupts.CPU74.NMI:Non-maskable_interrupts 2106 ± 8% +40.2% 2953 ± 33% interrupts.CPU74.PMI:Performance_monitoring_interrupts 740.25 ± 3% -19.6% 595.25 ± 2% interrupts.CPU75.TLB:TLB_shootdowns 2074 ± 3% +38.4% 2871 ± 35% interrupts.CPU76.NMI:Non-maskable_interrupts 2074 ± 3% +38.4% 2871 ± 35% interrupts.CPU76.PMI:Performance_monitoring_interrupts 727.50 ± 6% -11.7% 642.25 ± 3% interrupts.CPU76.TLB:TLB_shootdowns 4049 ± 5% +12.4% 4551 ± 4% interrupts.CPU77.RES:Rescheduling_interrupts 2089 ± 7% +13.4% 2368 ± 3% interrupts.CPU78.NMI:Non-maskable_interrupts 2089 ± 7% +13.4% 2368 ± 3% interrupts.CPU78.PMI:Performance_monitoring_interrupts 736.75 ± 3% -16.9% 612.50 ± 6% interrupts.CPU78.TLB:TLB_shootdowns 727.50 ± 4% -13.3% 631.00 ± 8% interrupts.CPU79.TLB:TLB_shootdowns 3278 ±133% -81.1% 619.75 ± 8% interrupts.CPU8.TLB:TLB_shootdowns 751.50 ± 4% -20.2% 599.50 ± 2% interrupts.CPU80.TLB:TLB_shootdowns 762.75 ± 4% -23.3% 585.25 ± 4% interrupts.CPU81.TLB:TLB_shootdowns 772.25 -23.8% 588.25 ± 6% interrupts.CPU82.TLB:TLB_shootdowns 778.50 ± 5% -26.3% 573.50 ± 5% interrupts.CPU83.TLB:TLB_shootdowns 765.00 -25.1% 572.75 ± 3% interrupts.CPU84.TLB:TLB_shootdowns 707.25 ± 3% -15.1% 600.25 ± 3% interrupts.CPU85.TLB:TLB_shootdowns 711.50 ± 2% -17.8% 584.50 ± 3% interrupts.CPU86.TLB:TLB_shootdowns 734.75 ± 5% -14.2% 630.75 ± 8% interrupts.CPU87.TLB:TLB_shootdowns 754.75 ± 3% -18.6% 614.50 ± 5% interrupts.CPU88.TLB:TLB_shootdowns 792.00 ± 4% -21.8% 619.25 ± 4% interrupts.CPU89.TLB:TLB_shootdowns 796.25 ± 10% -20.6% 632.00 ± 11% interrupts.CPU90.TLB:TLB_shootdowns 742.50 ± 3% -18.4% 606.00 ± 5% interrupts.CPU91.TLB:TLB_shootdowns 742.75 ± 8% -15.8% 625.50 ± 6% interrupts.CPU92.TLB:TLB_shootdowns 785.00 ± 12% -19.9% 629.00 ± 3% interrupts.CPU93.TLB:TLB_shootdowns 771.00 ± 2% -20.7% 611.50 ± 4% interrupts.CPU94.TLB:TLB_shootdowns 754.25 ± 6% -16.2% 632.25 ± 7% interrupts.CPU95.TLB:TLB_shootdowns 717.25 ± 3% -16.9% 596.25 ± 5% interrupts.CPU96.TLB:TLB_shootdowns 724.25 ± 4% -18.5% 590.25 ± 6% interrupts.CPU97.TLB:TLB_shootdowns 763.75 ± 5% -20.1% 610.00 ± 6% interrupts.CPU98.TLB:TLB_shootdowns 753.75 ± 3% -20.8% 596.75 ± 6% interrupts.CPU99.TLB:TLB_shootdowns 198926 -17.7% 163726 ± 2% interrupts.TLB:TLB_shootdowns 48.69 ± 15% -24.0 24.74 ± 11% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 48.56 ± 15% -23.8 24.71 ± 11% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.90 ± 31% -6.9 0.00 perf-profile.calltrace.cycles-pp.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.62 ± 12% -4.9 4.72 ± 8% perf-profile.calltrace.cycles-pp.page_fault 9.28 ± 12% -4.7 4.57 ± 8% perf-profile.calltrace.cycles-pp.__do_page_fault.page_fault 21.08 ± 9% -4.3 16.76 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_parent.do_syscall_64.entry_SYSCALL_64_after_hwframe 21.08 ± 9% -4.3 16.76 ± 9% perf-profile.calltrace.cycles-pp.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64.entry_SYSCALL_64_after_hwframe 21.08 ± 9% -4.3 16.76 ± 9% perf-profile.calltrace.cycles-pp.do_exit.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.41 ± 12% -4.2 4.19 ± 8% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.page_fault 4.20 ± 38% -4.2 0.00 perf-profile.calltrace.cycles-pp.__do_munmap.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.17 ± 13% -4.1 4.08 ± 8% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 3.62 ± 24% -3.3 0.33 ±105% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.58 ± 24% -3.2 0.33 ±105% perf-profile.calltrace.cycles-pp.do_execve.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 18.83 ± 10% -3.2 15.67 ± 9% perf-profile.calltrace.cycles-pp.mmput.do_exit.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64 18.80 ± 10% -3.1 15.66 ± 9% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.__ia32_sys_exit_group.__wake_up_parent 3.40 ± 16% -2.7 0.68 ± 21% perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.39 ± 12% -2.7 5.68 ± 10% perf-profile.calltrace.cycles-pp.__do_execve_file.do_execve.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.71 ± 16% -2.4 0.32 ±100% perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.62 ± 12% -1.8 3.82 ± 5% perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.do_execve.__x64_sys_execve.do_syscall_64 5.58 ± 12% -1.8 3.81 ± 5% perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.do_execve.__x64_sys_execve 2.29 ± 10% -1.4 0.84 ± 30% perf-profile.calltrace.cycles-pp.dup_mm.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.74 ± 24% -1.4 1.32 ± 6% perf-profile.calltrace.cycles-pp.secondary_startup_64 2.72 ± 24% -1.4 1.31 ± 6% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 2.72 ± 24% -1.4 1.31 ± 6% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 2.72 ± 24% -1.4 1.31 ± 6% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.93 ± 9% -1.0 0.90 ± 5% perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 1.97 ± 26% -1.0 0.98 ± 6% perf-profile.calltrace.cycles-pp.mwait_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.82 ± 8% -1.0 0.84 ± 5% perf-profile.calltrace.cycles-pp.ret_from_fork 2.13 ± 7% -1.0 1.17 ± 4% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.__ia32_sys_exit_group 3.37 ± 13% -1.0 2.42 ± 7% perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.do_execve 1.88 ± 27% -0.9 0.94 ± 6% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.mwait_idle.do_idle.cpu_startup_entry.start_secondary 5.33 ± 10% -0.9 4.39 ± 10% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.30 ± 13% -0.9 2.38 ± 7% perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file 2.02 ± 7% -0.9 1.10 ± 4% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit 2.61 ± 9% -0.9 1.75 ± 11% perf-profile.calltrace.cycles-pp.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 1.69 ± 26% -0.8 0.85 ± 6% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.mwait_idle.do_idle.cpu_startup_entry 1.61 ± 6% -0.8 0.78 ± 5% perf-profile.calltrace.cycles-pp.do_task_dead.do_exit.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64 1.61 ± 6% -0.8 0.78 ± 5% perf-profile.calltrace.cycles-pp.__sched_text_start.do_task_dead.do_exit.__ia32_sys_exit_group.__wake_up_parent 1.62 ± 7% -0.8 0.82 ± 4% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 1.51 ± 7% -0.8 0.72 ± 5% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.do_task_dead.do_exit.__ia32_sys_exit_group 2.44 ± 9% -0.8 1.68 ± 11% perf-profile.calltrace.cycles-pp.wp_page_copy.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault 1.46 ± 7% -0.8 0.70 ± 5% perf-profile.calltrace.cycles-pp.load_balance.pick_next_task_fair.__sched_text_start.do_task_dead.do_exit 1.04 ± 6% -0.7 0.30 ±100% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.do_exit.__ia32_sys_exit_group 1.35 ± 7% -0.7 0.65 ± 5% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.pick_next_task_fair.__sched_text_start.do_task_dead 0.84 ± 9% -0.6 0.26 ±100% perf-profile.calltrace.cycles-pp.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.84 ± 9% -0.6 0.26 ±100% perf-profile.calltrace.cycles-pp.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.09 ± 11% -0.5 1.60 ± 24% perf-profile.calltrace.cycles-pp.__lru_cache_add.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 2.06 ± 11% -0.5 1.59 ± 24% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.__handle_mm_fault.handle_mm_fault.__do_page_fault 1.06 ± 9% -0.5 0.59 ± 6% perf-profile.calltrace.cycles-pp.__libc_fork 1.96 ± 11% -0.4 1.53 ± 24% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.__handle_mm_fault.handle_mm_fault 1.96 ± 11% -0.4 1.53 ± 24% perf-profile.calltrace.cycles-pp.queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.__handle_mm_fault 0.99 ± 10% -0.4 0.57 ± 6% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork 1.26 ± 17% -0.3 0.95 ± 10% perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.26 ± 17% -0.3 0.95 ± 10% perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.25 ± 16% -0.3 0.95 ± 10% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.22 ± 17% -0.3 0.94 ± 10% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 0.65 ± 6% +0.1 0.77 ± 7% perf-profile.calltrace.cycles-pp.__vm_munmap.elf_map.load_elf_binary.search_binary_handler.__do_execve_file 0.64 ± 6% +0.1 0.77 ± 7% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.elf_map.load_elf_binary.search_binary_handler 0.60 ± 6% +0.1 0.73 ± 9% perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.exit_mmap.mmput.flush_old_exec 0.59 ± 6% +0.1 0.72 ± 7% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.elf_map.load_elf_binary 0.60 ± 6% +0.1 0.73 ± 9% perf-profile.calltrace.cycles-pp.lru_add_drain.exit_mmap.mmput.flush_old_exec.load_elf_binary 0.56 ± 6% +0.1 0.70 ± 7% perf-profile.calltrace.cycles-pp.lru_add_drain.unmap_region.__do_munmap.__vm_munmap.elf_map 0.38 ±101% +0.5 0.86 ± 2% perf-profile.calltrace.cycles-pp.div_short 4.81 ± 3% +0.5 5.35 ± 4% perf-profile.calltrace.cycles-pp.do_execve.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 4.82 ± 3% +0.5 5.37 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 4.82 ± 3% +0.5 5.37 ± 4% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 4.82 ± 3% +0.5 5.37 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 0.36 ±103% +0.6 0.91 ± 3% perf-profile.calltrace.cycles-pp.div_int 4.83 ± 3% +0.6 5.39 ± 4% perf-profile.calltrace.cycles-pp.execve 0.44 ±101% +0.7 1.14 ± 3% perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test 0.44 ±101% +0.7 1.14 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test 0.44 ±101% +0.7 1.14 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test 0.44 ±101% +0.7 1.17 perf-profile.calltrace.cycles-pp.do_brk_flags.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 0.47 ±101% +0.8 1.22 ± 2% perf-profile.calltrace.cycles-pp.div_long 1.07 ± 45% +0.8 1.86 perf-profile.calltrace.cycles-pp.div_double 0.52 ±101% +0.8 1.31 ± 2% perf-profile.calltrace.cycles-pp.div_float 0.44 ±101% +0.9 1.29 ± 9% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault.page_test 0.53 ±101% +0.9 1.39 ± 2% perf-profile.calltrace.cycles-pp.__libc_fork.fork_test 0.45 ±101% +0.9 1.31 ± 9% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.page_fault.page_test 0.47 ±101% +0.9 1.36 ± 9% perf-profile.calltrace.cycles-pp.__do_page_fault.page_fault.page_test 0.47 ±101% +0.9 1.38 ± 9% perf-profile.calltrace.cycles-pp.page_fault.page_test 0.49 ±101% +0.9 1.43 ± 9% perf-profile.calltrace.cycles-pp.page_test 0.59 ±101% +1.0 1.55 ± 2% perf-profile.calltrace.cycles-pp.fork_test 1.79 ± 45% +1.4 3.19 perf-profile.calltrace.cycles-pp.array_rtns 1.84 ± 40% +1.5 3.34 ± 3% perf-profile.calltrace.cycles-pp.sieve 0.34 ±102% +1.7 2.02 ± 15% perf-profile.calltrace.cycles-pp.add_short.add_short 1.04 ± 48% +2.4 3.44 ± 9% perf-profile.calltrace.cycles-pp.mul_double.mul_double 0.62 ±101% +2.7 3.36 ± 15% perf-profile.calltrace.cycles-pp.add_long.add_long 0.66 ±103% +2.8 3.47 ± 10% perf-profile.calltrace.cycles-pp.mul_float.mul_float 0.56 ±103% +2.8 3.40 ± 15% perf-profile.calltrace.cycles-pp.add_int.add_int 1.42 ±101% +3.1 4.53 ± 9% perf-profile.calltrace.cycles-pp.__do_munmap.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 0.66 ±102% +3.2 3.89 ± 14% perf-profile.calltrace.cycles-pp.string_rtns_1 0.79 ±102% +3.5 4.28 ± 16% perf-profile.calltrace.cycles-pp.add_float.add_float 2.44 ± 64% +3.6 6.03 ± 6% perf-profile.calltrace.cycles-pp.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 2.48 ± 64% +3.6 6.11 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 2.50 ± 64% +3.7 6.15 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk 2.66 ± 62% +3.8 6.45 ± 6% perf-profile.calltrace.cycles-pp.brk 1.45 ± 61% +5.1 6.52 ± 14% perf-profile.calltrace.cycles-pp.add_double.add_double 63.15 ± 8% -19.7 43.46 ± 8% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 62.94 ± 8% -19.6 43.36 ± 8% perf-profile.children.cycles-pp.do_syscall_64 12.51 ± 7% -4.7 7.79 ± 6% perf-profile.children.cycles-pp.page_fault 11.99 ± 7% -4.5 7.47 ± 7% perf-profile.children.cycles-pp.__do_page_fault 21.14 ± 9% -4.3 16.81 ± 9% perf-profile.children.cycles-pp.__wake_up_parent 21.14 ± 9% -4.3 16.81 ± 9% perf-profile.children.cycles-pp.__ia32_sys_exit_group 21.14 ± 9% -4.3 16.81 ± 9% perf-profile.children.cycles-pp.do_exit 22.98 ± 11% -4.1 18.86 ± 9% perf-profile.children.cycles-pp.mmput 22.93 ± 11% -4.1 18.84 ± 9% perf-profile.children.cycles-pp.exit_mmap 11.01 ± 7% -4.0 6.97 ± 7% perf-profile.children.cycles-pp.handle_mm_fault 10.70 ± 7% -3.9 6.79 ± 7% perf-profile.children.cycles-pp.__handle_mm_fault 9.35 ± 6% -3.1 6.26 ± 8% perf-profile.children.cycles-pp.__se_sys_brk 5.24 ± 7% -2.8 2.47 ± 5% perf-profile.children.cycles-pp.__sched_text_start 8.46 ± 12% -2.5 5.93 ± 8% perf-profile.children.cycles-pp.__x64_sys_execve 8.41 ± 12% -2.5 5.90 ± 8% perf-profile.children.cycles-pp.__do_execve_file 8.41 ± 12% -2.5 5.90 ± 8% perf-profile.children.cycles-pp.do_execve 4.56 ± 8% -2.4 2.13 ± 5% perf-profile.children.cycles-pp.pick_next_task_fair 4.51 ± 8% -2.4 2.11 ± 4% perf-profile.children.cycles-pp.load_balance 4.84 ± 7% -2.4 2.46 ± 7% perf-profile.children.cycles-pp._do_fork 5.40 ± 16% -2.3 3.06 ± 3% perf-profile.children.cycles-pp.apic_timer_interrupt 12.99 ± 12% -2.3 10.71 ± 9% perf-profile.children.cycles-pp.__do_munmap 4.20 ± 8% -2.3 1.94 ± 5% perf-profile.children.cycles-pp.find_busiest_group 4.95 ± 15% -2.3 2.69 ± 4% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 12.40 ± 12% -2.0 10.40 ± 10% perf-profile.children.cycles-pp.unmap_region 6.93 ± 12% -1.9 5.05 ± 8% perf-profile.children.cycles-pp.search_binary_handler 6.89 ± 12% -1.9 5.03 ± 8% perf-profile.children.cycles-pp.load_elf_binary 3.76 ± 7% -1.9 1.89 ± 7% perf-profile.children.cycles-pp.copy_process 3.32 ± 8% -1.8 1.55 ± 5% perf-profile.children.cycles-pp.schedule 2.79 ± 8% -1.5 1.31 ± 2% perf-profile.children.cycles-pp.do_brk_flags 2.74 ± 24% -1.4 1.32 ± 6% perf-profile.children.cycles-pp.secondary_startup_64 2.74 ± 24% -1.4 1.32 ± 6% perf-profile.children.cycles-pp.cpu_startup_entry 2.74 ± 24% -1.4 1.32 ± 6% perf-profile.children.cycles-pp.do_idle 2.72 ± 24% -1.4 1.31 ± 6% perf-profile.children.cycles-pp.start_secondary 2.88 ± 7% -1.4 1.47 ± 9% perf-profile.children.cycles-pp.dup_mm 3.00 ± 7% -1.4 1.65 ± 5% perf-profile.children.cycles-pp.unmap_vmas 2.79 ± 8% -1.3 1.48 ± 3% perf-profile.children.cycles-pp.filemap_map_pages 2.86 ± 7% -1.3 1.56 ± 5% perf-profile.children.cycles-pp.unmap_page_range 5.58 ± 13% -1.2 4.37 ± 8% perf-profile.children.cycles-pp.vm_mmap_pgoff 2.30 ± 8% -1.2 1.11 ± 4% perf-profile.children.cycles-pp.do_sys_open 5.50 ± 13% -1.2 4.32 ± 8% perf-profile.children.cycles-pp.do_mmap 5.31 ± 13% -1.1 4.22 ± 8% perf-profile.children.cycles-pp.ksys_mmap_pgoff 2.05 ± 8% -1.1 0.96 ± 5% perf-profile.children.cycles-pp.__se_sys_wait4 2.04 ± 8% -1.1 0.96 ± 5% perf-profile.children.cycles-pp.kernel_wait4 2.02 ± 8% -1.1 0.95 ± 5% perf-profile.children.cycles-pp.do_wait 2.13 ± 27% -1.1 1.06 ± 6% perf-profile.children.cycles-pp.mwait_idle 5.26 ± 14% -1.1 4.19 ± 9% perf-profile.children.cycles-pp.mmap_region 2.06 ± 9% -1.1 1.01 ± 4% perf-profile.children.cycles-pp.do_filp_open 2.01 ± 8% -1.0 0.98 ± 4% perf-profile.children.cycles-pp.path_openat 4.23 ± 13% -1.0 3.23 ± 9% perf-profile.children.cycles-pp.flush_old_exec 2.19 ± 13% -1.0 1.20 ± 4% perf-profile.children.cycles-pp.hrtimer_interrupt 1.96 ± 7% -0.9 1.01 ± 4% perf-profile.children.cycles-pp.ret_from_fork 1.63 ± 8% -0.9 0.77 ± 15% perf-profile.children.cycles-pp.down_write 2.93 ± 8% -0.9 2.08 ± 9% perf-profile.children.cycles-pp.do_wp_page 1.76 ± 7% -0.8 0.92 ± 13% perf-profile.children.cycles-pp.free_pgtables 1.61 ± 6% -0.8 0.78 ± 5% perf-profile.children.cycles-pp.do_task_dead 1.84 ± 20% -0.8 1.01 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start 1.62 ± 7% -0.8 0.82 ± 4% perf-profile.children.cycles-pp.kthread 1.57 ± 8% -0.8 0.79 ± 4% perf-profile.children.cycles-pp.perf_event_mmap 1.63 ± 17% -0.8 0.87 ± 6% perf-profile.children.cycles-pp.irq_exit 2.73 ± 8% -0.8 1.97 ± 9% perf-profile.children.cycles-pp.wp_page_copy 1.67 ± 11% -0.8 0.92 ± 3% perf-profile.children.cycles-pp.__hrtimer_run_queues 1.45 ± 8% -0.7 0.75 ± 5% perf-profile.children.cycles-pp.__alloc_pages_nodemask 1.39 ± 9% -0.7 0.71 ± 6% perf-profile.children.cycles-pp.__vma_adjust 1.19 ± 10% -0.6 0.54 ± 20% perf-profile.children.cycles-pp.rwsem_down_write_failed 1.42 ± 7% -0.6 0.77 ± 6% perf-profile.children.cycles-pp.select_task_rq_fair 1.19 ± 20% -0.6 0.55 ± 19% perf-profile.children.cycles-pp.ksys_write 1.32 ± 9% -0.6 0.70 ± 3% perf-profile.children.cycles-pp.filename_lookup 1.14 ± 19% -0.6 0.52 ± 19% perf-profile.children.cycles-pp.vfs_write 1.25 ± 9% -0.6 0.67 ± 3% perf-profile.children.cycles-pp.path_lookupat 1.06 ± 18% -0.6 0.49 ± 19% perf-profile.children.cycles-pp.new_sync_write 3.71 ± 10% -0.6 3.15 ± 12% perf-profile.children.cycles-pp.__lru_cache_add 1.30 ± 28% -0.6 0.74 ± 5% perf-profile.children.cycles-pp.rcu_core 1.13 ± 9% -0.5 0.58 ± 3% perf-profile.children.cycles-pp.walk_component 1.00 ± 10% -0.5 0.47 ± 21% perf-profile.children.cycles-pp.rwsem_optimistic_spin 1.07 ± 9% -0.5 0.55 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist 0.99 ± 17% -0.5 0.47 ± 5% perf-profile.children.cycles-pp.update_nohz_stats 0.98 ± 8% -0.5 0.47 ± 2% perf-profile.children.cycles-pp.vma_merge 1.08 ± 8% -0.5 0.58 ± 4% perf-profile.children.cycles-pp.alloc_set_pte 0.94 ± 4% -0.5 0.44 ± 25% perf-profile.children.cycles-pp.try_to_wake_up 0.99 ± 7% -0.5 0.49 ± 6% perf-profile.children.cycles-pp.alloc_pages_vma 1.02 ± 5% -0.5 0.54 ± 6% perf-profile.children.cycles-pp.wake_up_new_task 0.89 ± 7% -0.5 0.41 ± 6% perf-profile.children.cycles-pp.source_load 1.05 ± 11% -0.5 0.59 ± 2% perf-profile.children.cycles-pp.setlocale 0.95 ± 8% -0.5 0.49 ± 6% perf-profile.children.cycles-pp.copy_page_range 0.90 ± 6% -0.4 0.45 ± 5% perf-profile.children.cycles-pp.anon_vma_fork 0.99 ± 10% -0.4 0.57 ± 6% perf-profile.children.cycles-pp.smpboot_thread_fn 0.91 ± 9% -0.4 0.49 ± 3% perf-profile.children.cycles-pp.link_path_walk 0.92 ± 9% -0.4 0.51 ± 8% perf-profile.children.cycles-pp.__x64_sys_mprotect 0.92 ± 9% -0.4 0.51 ± 8% perf-profile.children.cycles-pp.do_mprotect_pkey 0.84 ± 8% -0.4 0.44 ± 4% perf-profile.children.cycles-pp.vfs_read 0.87 ± 10% -0.4 0.48 ± 9% perf-profile.children.cycles-pp.__split_vma 0.78 ± 7% -0.4 0.39 ± 7% perf-profile.children.cycles-pp.unlink_anon_vmas 0.94 ± 8% -0.4 0.55 ± 3% perf-profile.children.cycles-pp.tick_sched_timer 0.87 ± 9% -0.4 0.48 ± 8% perf-profile.children.cycles-pp.mprotect_fixup 0.91 ± 8% -0.4 0.53 ± 7% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.78 ± 7% -0.4 0.40 ± 8% perf-profile.children.cycles-pp.perf_iterate_sb 0.61 ± 8% -0.4 0.25 ± 4% perf-profile.children.cycles-pp.worker_thread 0.77 ± 8% -0.4 0.41 ± 6% perf-profile.children.cycles-pp.page_remove_rmap 0.75 ± 6% -0.4 0.40 ± 4% perf-profile.children.cycles-pp.ksys_read 1.49 ± 14% -0.3 1.15 ± 8% perf-profile.children.cycles-pp.elf_map 0.73 ± 8% -0.3 0.39 ± 5% perf-profile.children.cycles-pp.___might_sleep 0.75 ± 9% -0.3 0.41 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc 0.77 ± 10% -0.3 0.42 ± 2% perf-profile.children.cycles-pp.vfs_statx 0.69 ± 7% -0.3 0.34 ± 5% perf-profile.children.cycles-pp.anon_vma_clone 0.64 ± 9% -0.3 0.30 ± 5% perf-profile.children.cycles-pp.new_sync_read 0.66 ± 8% -0.3 0.33 ± 8% perf-profile.children.cycles-pp.find_vma 1.34 ± 13% -0.3 1.01 ± 8% perf-profile.children.cycles-pp.load_script 0.66 ± 9% -0.3 0.36 ± 4% perf-profile.children.cycles-pp.wait4 0.57 ± 12% -0.3 0.27 ± 33% perf-profile.children.cycles-pp.osq_lock 0.71 ± 11% -0.3 0.40 ± 2% perf-profile.children.cycles-pp.__se_sys_newstat 0.63 ± 6% -0.3 0.33 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64 0.64 ± 5% -0.3 0.34 ± 5% perf-profile.children.cycles-pp.target_load 0.77 ± 7% -0.3 0.48 ± 4% perf-profile.children.cycles-pp.update_process_times 0.62 ± 10% -0.3 0.33 ± 5% perf-profile.children.cycles-pp.do_faccessat 0.61 ± 7% -0.3 0.32 ± 5% perf-profile.children.cycles-pp.__perf_sw_event 0.64 ± 9% -0.3 0.35 ± 14% perf-profile.children.cycles-pp.unlink_file_vma 0.52 ± 9% -0.3 0.26 ± 6% perf-profile.children.cycles-pp.lookup_slow 0.46 ± 8% -0.3 0.20 ± 8% perf-profile.children.cycles-pp.__wake_up_common_lock 0.54 ± 7% -0.3 0.28 ± 7% perf-profile.children.cycles-pp._cond_resched 0.46 ± 13% -0.3 0.21 ± 47% perf-profile.children.cycles-pp.rwsem_wake 0.60 ± 11% -0.3 0.35 ± 6% perf-profile.children.cycles-pp.copy_strings 0.53 ± 9% -0.2 0.28 ± 3% perf-profile.children.cycles-pp.lookup_fast 0.52 ± 8% -0.2 0.27 ± 6% perf-profile.children.cycles-pp.___perf_sw_event 0.53 ± 8% -0.2 0.28 ± 7% perf-profile.children.cycles-pp.kmem_cache_free 0.44 ± 14% -0.2 0.20 ± 45% perf-profile.children.cycles-pp.wake_up_q 0.45 ± 8% -0.2 0.21 ± 7% perf-profile.children.cycles-pp.__wake_up_common 0.45 ± 6% -0.2 0.23 ± 9% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.52 ± 9% -0.2 0.29 ± 7% perf-profile.children.cycles-pp.sched_exec 0.46 ± 13% -0.2 0.24 ± 7% perf-profile.children.cycles-pp._raw_spin_lock 0.45 ± 49% -0.2 0.23 ± 37% perf-profile.children.cycles-pp.generic_file_write_iter 0.44 ± 10% -0.2 0.22 ± 6% perf-profile.children.cycles-pp.__lookup_slow 0.57 ± 9% -0.2 0.35 ± 7% perf-profile.children.cycles-pp.task_work_run 0.41 ± 8% -0.2 0.20 ± 4% perf-profile.children.cycles-pp.get_unmapped_area 0.47 ± 10% -0.2 0.27 ± 5% perf-profile.children.cycles-pp.mmap64 0.42 ± 10% -0.2 0.22 ± 7% perf-profile.children.cycles-pp.__might_sleep 0.56 ± 10% -0.2 0.35 ± 7% perf-profile.children.cycles-pp.dput 0.39 ± 7% -0.2 0.19 ± 4% perf-profile.children.cycles-pp.cpumask_next_and 0.37 ± 9% -0.2 0.17 ± 4% perf-profile.children.cycles-pp.__vm_enough_memory 0.43 ± 9% -0.2 0.24 ± 6% perf-profile.children.cycles-pp.__clear_user 0.41 ± 8% -0.2 0.22 ± 5% perf-profile.children.cycles-pp.prep_new_page 0.31 ± 8% -0.2 0.12 ± 9% perf-profile.children.cycles-pp.pipe_write 0.40 ± 8% -0.2 0.21 ± 6% perf-profile.children.cycles-pp.page_add_file_rmap 0.42 ± 9% -0.2 0.24 ± 6% perf-profile.children.cycles-pp.padzero 0.48 ± 9% -0.2 0.30 ± 4% perf-profile.children.cycles-pp.scheduler_tick 0.38 ± 11% -0.2 0.20 ± 7% perf-profile.children.cycles-pp.pte_alloc_one 0.36 ± 10% -0.2 0.18 ± 2% perf-profile.children.cycles-pp.__d_lookup_rcu 0.33 ± 7% -0.2 0.15 ± 5% perf-profile.children.cycles-pp.find_next_and_bit 0.33 ± 10% -0.2 0.16 ± 7% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.31 ± 10% -0.2 0.14 ± 5% perf-profile.children.cycles-pp.finish_task_switch 0.55 ± 12% -0.2 0.39 ± 10% perf-profile.children.cycles-pp.__lock_text_start 0.46 ± 9% -0.2 0.30 ± 7% perf-profile.children.cycles-pp.__fput 0.34 ± 8% -0.2 0.18 ± 4% perf-profile.children.cycles-pp.lock_page_memcg 0.34 ± 9% -0.2 0.18 ± 4% perf-profile.children.cycles-pp.flush_tlb_mm_range 0.33 ± 10% -0.2 0.17 ± 4% perf-profile.children.cycles-pp.d_alloc_parallel 0.38 ± 11% -0.2 0.21 ± 12% perf-profile.children.cycles-pp.vma_link 0.33 ± 8% -0.2 0.17 ± 5% perf-profile.children.cycles-pp.clear_page_erms 0.32 ± 10% -0.2 0.16 ± 7% perf-profile.children.cycles-pp.vmacache_find 0.32 ± 5% -0.2 0.17 ± 4% perf-profile.children.cycles-pp.anon_vma_interval_tree_insert 0.28 ± 7% -0.2 0.12 ± 8% perf-profile.children.cycles-pp.autoremove_wake_function 0.32 ± 9% -0.2 0.16 ± 7% perf-profile.children.cycles-pp.wake_up_page_bit 0.32 ± 5% -0.2 0.16 ± 6% perf-profile.children.cycles-pp.do_signal 0.27 ± 8% -0.2 0.12 ± 11% perf-profile.children.cycles-pp.pipe_read 0.26 ± 19% -0.2 0.11 ± 4% perf-profile.children.cycles-pp.ktime_get 0.30 ± 10% -0.2 0.15 ± 8% perf-profile.children.cycles-pp.wait_consider_task 0.30 ± 11% -0.2 0.15 ± 4% perf-profile.children.cycles-pp.vma_gap_update 0.35 ± 10% -0.2 0.20 ± 2% perf-profile.children.cycles-pp._dl_addr 0.32 ± 8% -0.2 0.17 ± 7% perf-profile.children.cycles-pp.perf_event_mmap_output 0.30 ± 9% -0.2 0.15 ± 7% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay 0.27 ± 10% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.down_write_killable 0.27 ± 17% -0.1 0.12 ± 7% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.32 ± 12% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.getname_flags 0.24 ± 7% -0.1 0.09 ± 8% perf-profile.children.cycles-pp.schedule_idle 0.31 ± 10% -0.1 0.17 ± 3% perf-profile.children.cycles-pp.remove_vma 0.39 ± 6% -0.1 0.25 ± 7% perf-profile.children.cycles-pp.do_unlinkat 0.24 ± 8% -0.1 0.11 ± 10% perf-profile.children.cycles-pp.pipe_wait 0.26 ± 9% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.sock_write_iter 0.34 ± 9% -0.1 0.20 ± 2% perf-profile.children.cycles-pp._fini 0.30 ± 10% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.schedule_tail 0.25 ± 10% -0.1 0.12 ± 3% perf-profile.children.cycles-pp.sock_sendmsg 0.36 ± 7% -0.1 0.23 ± 7% perf-profile.children.cycles-pp.free_pages_and_swap_cache 0.29 ± 9% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.25 ± 10% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.release_task 0.24 ± 10% -0.1 0.12 ± 9% perf-profile.children.cycles-pp.__pte_alloc 0.21 ± 9% -0.1 0.08 ± 8% perf-profile.children.cycles-pp.queued_write_lock_slowpath 0.23 ± 11% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.__se_sys_getdents 0.30 ± 11% -0.1 0.17 ± 2% perf-profile.children.cycles-pp.sync 0.30 ± 11% -0.1 0.17 ± 2% perf-profile.children.cycles-pp.__x64_sys_sync 0.30 ± 11% -0.1 0.17 ± 2% perf-profile.children.cycles-pp.ksys_sync 0.27 ± 10% -0.1 0.14 ± 7% perf-profile.children.cycles-pp.mem_cgroup_commit_charge 0.28 ± 10% -0.1 0.16 ± 7% perf-profile.children.cycles-pp.cpumask_next 0.20 ± 8% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.queued_read_lock_slowpath 0.25 ± 9% -0.1 0.13 ± 6% perf-profile.children.cycles-pp.terminate_walk 0.22 ± 12% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.iterate_dir 0.20 ± 17% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.idle_cpu 0.24 ± 9% -0.1 0.13 ± 6% perf-profile.children.cycles-pp.__do_fault 0.27 ± 10% -0.1 0.15 ± 3% perf-profile.children.cycles-pp.iterate_supers 0.21 ± 11% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.dcache_readdir 0.26 ± 9% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.find_next_bit 0.29 ± 10% -0.1 0.17 ± 6% perf-profile.children.cycles-pp.__get_user_pages 0.28 ± 9% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.get_user_pages_remote 0.27 ± 9% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.__put_user_4 0.24 ± 10% -0.1 0.13 ± 6% perf-profile.children.cycles-pp.__get_free_pages 0.24 ± 10% -0.1 0.12 ± 4% perf-profile.children.cycles-pp.vm_area_dup 0.24 ± 7% -0.1 0.12 ± 4% perf-profile.children.cycles-pp.__rb_insert_augmented 0.23 ± 9% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.23 ± 12% -0.1 0.12 perf-profile.children.cycles-pp.vma_compute_subtree_gap 0.23 ± 9% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.rcu_all_qs 0.23 ± 3% -0.1 0.12 ± 3% perf-profile.children.cycles-pp.anon_vma_interval_tree_remove 0.21 ± 5% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.rebalance_domains 0.24 ± 9% -0.1 0.14 ± 8% perf-profile.children.cycles-pp.__slab_free 0.23 ± 11% -0.1 0.13 ± 3% perf-profile.children.cycles-pp.__might_fault 0.21 ± 7% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.ptep_clear_flush 0.23 ± 11% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.__tlb_remove_page_size 0.20 ± 9% -0.1 0.10 ± 7% perf-profile.children.cycles-pp.filemap_fault 0.14 ± 24% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.free_work 0.25 ± 11% -0.1 0.15 ± 5% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.16 ± 11% -0.1 0.06 ± 13% perf-profile.children.cycles-pp.__vmalloc_node_range 0.21 ± 10% -0.1 0.12 ± 7% perf-profile.children.cycles-pp.path_put 0.21 ± 13% -0.1 0.12 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret 0.18 ± 7% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.mem_cgroup_try_charge 0.18 ± 8% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.strlcpy 0.14 ± 24% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.__vunmap 0.20 ± 10% -0.1 0.10 ± 10% perf-profile.children.cycles-pp.copy_page 0.16 ± 9% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.__se_sys_kill 0.15 ± 22% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.process_one_work 0.23 ± 8% -0.1 0.13 ± 3% perf-profile.children.cycles-pp.vma_interval_tree_remove 0.17 ± 25% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.tick_nohz_idle_stop_tick 0.32 ± 11% -0.1 0.23 ± 11% perf-profile.children.cycles-pp.dentry_kill 0.17 ± 8% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.up_write 0.16 ± 6% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.ip_finish_output2 0.20 ± 10% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.inode_permission 0.19 ± 3% -0.1 0.10 ± 10% perf-profile.children.cycles-pp._vm_normal_page 0.17 ± 12% -0.1 0.08 ± 5% perf-profile.children.cycles-pp._copy_to_user 0.19 ± 15% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.strnlen_user 0.23 ± 6% -0.1 0.15 ± 4% perf-profile.children.cycles-pp.task_tick_fair 0.11 ± 8% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__se_sys_newlstat 0.19 ± 16% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.do_open_execat 0.30 ± 12% -0.1 0.22 ± 11% perf-profile.children.cycles-pp.__dentry_kill 0.18 ± 8% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.free_unref_page_list 0.16 ± 9% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.enqueue_task_fair 0.17 ± 10% -0.1 0.10 ± 5% perf-profile.children.cycles-pp.xas_find 0.16 ± 11% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.generic_file_read_iter 0.16 ± 8% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.activate_task 0.15 ± 8% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.find_vma_links 0.14 ± 3% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.sock_read_iter 0.15 ± 12% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.filldir 0.15 ± 9% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.xas_load 0.11 ± 13% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.kill_pid_info 0.16 ± 7% -0.1 0.08 ± 12% perf-profile.children.cycles-pp.d_path 0.15 ± 10% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.flush_tlb_func_common 0.15 ± 16% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.clockevents_program_event 0.15 ± 5% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.unlock_page 0.14 ± 8% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.update_blocked_averages 0.14 ± 11% -0.1 0.07 ± 13% perf-profile.children.cycles-pp.__tcp_transmit_skb 0.10 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.process_backlog 0.16 ± 11% -0.1 0.09 ± 7% perf-profile.children.cycles-pp.mark_page_accessed 0.15 ± 10% -0.1 0.08 perf-profile.children.cycles-pp.update_rq_clock 0.16 ± 9% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.change_protection 0.15 ± 10% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.dequeue_task_fair 0.15 ± 8% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.__put_anon_vma 0.14 ± 10% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.io_schedule 0.14 ± 11% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.__lock_page_killable 0.13 ± 28% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.tick_nohz_next_event 0.10 ± 13% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__tcp_push_pending_frames 0.16 ± 11% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.__filemap_fdatawrite_range 0.15 ± 12% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.unlazy_walk 0.15 ± 11% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.__x64_sys_connect 0.15 ± 11% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.__sys_connect 0.13 ± 9% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.__local_bh_enable_ip 0.10 ± 11% -0.1 0.03 ±100% perf-profile.children.cycles-pp.tcp_write_xmit 0.18 ± 8% -0.1 0.12 ± 3% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.16 ± 9% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.btrfs_sync_fs 0.17 ± 12% -0.1 0.10 ± 8% perf-profile.children.cycles-pp.do_notify_parent 0.16 ± 9% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.do_writepages 0.14 ± 7% -0.1 0.07 ± 5% perf-profile.children.cycles-pp._IO_file_open 0.14 ± 11% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.alloc_empty_file 0.14 ± 9% -0.1 0.07 ± 10% perf-profile.children.cycles-pp.mm_init 0.12 ± 11% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.__send_signal 0.16 ± 11% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.setup_arg_pages 0.15 ± 8% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.sync_regs 0.14 ± 7% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.simple_lookup 0.15 ± 11% -0.1 0.08 perf-profile.children.cycles-pp.__vma_link_rb 0.14 ± 13% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.strncpy_from_user 0.14 ± 8% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.free_pgd_range 0.14 ± 15% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.do_dentry_open 0.13 ± 14% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.sched_clock_cpu 0.12 ± 10% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.do_truncate 0.11 ± 8% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.get_signal 0.09 ± 7% -0.1 0.03 ±100% perf-profile.children.cycles-pp.perf_event_task_output 0.09 ± 7% -0.1 0.03 ±100% perf-profile.children.cycles-pp.unix_find_other 0.12 ± 7% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.do_softirq 0.15 ± 10% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.__percpu_counter_compare 0.15 ± 10% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.btree_writepages 0.16 ± 11% -0.1 0.10 ± 7% perf-profile.children.cycles-pp.copy_strings_kernel 0.14 ± 11% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.time 0.13 ± 12% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.unix_stream_connect 0.12 ± 8% -0.1 0.06 ± 13% perf-profile.children.cycles-pp.perf_event_task 0.12 ± 10% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.tcp_sendmsg 0.12 ± 10% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.__ip_queue_xmit 0.10 ± 10% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.__call_rcu 0.09 ± 4% -0.1 0.03 ±100% perf-profile.children.cycles-pp.perf_swevent_get_recursion_context 0.09 ± 9% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__rb_erase_color 0.09 ± 14% -0.1 0.03 ±100% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.12 ± 11% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.tcp_sendmsg_locked 0.11 ± 9% -0.1 0.05 perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn 0.15 ± 10% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.__percpu_counter_sum 0.09 ± 13% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__strcasecmp 0.09 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.12 ± 4% -0.1 0.07 ± 13% perf-profile.children.cycles-pp.find_get_entry 0.12 ± 13% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.path_init 0.12 ± 9% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.__se_sys_close 0.12 ± 7% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.fsnotify 0.11 ± 11% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.do_softirq_own_stack 0.14 ± 9% -0.1 0.08 perf-profile.children.cycles-pp.trailing_symlink 0.11 ± 11% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.__bitmap_weight 0.08 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.vm_area_alloc 0.14 ± 8% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.connect 0.13 ± 11% -0.1 0.07 perf-profile.children.cycles-pp.pagecache_get_page 0.12 ± 10% -0.1 0.06 ± 13% perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.12 ± 8% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.__pmd_alloc 0.12 ± 12% -0.1 0.06 perf-profile.children.cycles-pp.kernel_read 0.12 ± 12% -0.1 0.06 perf-profile.children.cycles-pp.kfree 0.15 ± 10% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.getenv 0.12 ± 30% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.rcu_irq_enter 0.11 ± 10% -0.1 0.05 perf-profile.children.cycles-pp.khugepaged_enter_vma_merge 0.11 ± 10% -0.1 0.05 perf-profile.children.cycles-pp.net_rx_action 0.08 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.d_alloc 0.08 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.finish_fault 0.13 ± 5% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.d_add 0.12 ± 15% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.open_exec 0.12 ± 8% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.pgd_alloc 0.18 ± 6% -0.1 0.13 ± 3% perf-profile.children.cycles-pp.malloc 0.08 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__alloc_fd 0.11 ± 10% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.__alloc_file 0.11 ± 4% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.__unlock_page_memcg 0.10 ± 15% -0.1 0.05 perf-profile.children.cycles-pp.sched_clock 0.12 ± 13% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.user_path_at_empty 0.12 ± 10% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.__pud_alloc 0.12 ± 17% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.__remove_hrtimer 0.11 ± 13% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.legitimize_path 0.09 ± 7% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.__vsnprintf_chk 0.09 ± 7% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.filp_close 0.11 ± 10% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.page_add_new_anon_rmap 0.10 ± 8% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.cap_vm_enough_memory 0.10 ± 7% -0.1 0.05 perf-profile.children.cycles-pp.ttwu_do_activate 0.10 ± 8% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.24 ± 13% -0.0 0.19 ± 8% perf-profile.children.cycles-pp.getpwuid_r 0.12 ± 11% -0.0 0.07 ± 10% perf-profile.children.cycles-pp._copy_from_user 0.12 ± 10% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.shift_arg_pages 0.12 ± 13% -0.0 0.07 perf-profile.children.cycles-pp.__fxstat64 0.12 ± 7% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.update_curr 0.11 ± 16% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.09 ± 16% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate 0.14 ± 10% -0.0 0.09 perf-profile.children.cycles-pp.strlen 0.10 ± 10% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.__d_lookup_done 0.09 ± 5% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.stop_one_cpu 0.11 ± 9% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__anon_vma_prepare 0.11 ± 9% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list 0.11 ± 14% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.get_user_arg_ptr 0.11 ± 14% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.complete_walk 0.11 ± 14% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.touch_atime 0.10 ± 12% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__se_sys_newfstat 0.10 ± 7% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.prepend_path 0.10 ± 4% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.10 ± 15% -0.0 0.05 perf-profile.children.cycles-pp.native_sched_clock 0.10 ± 8% -0.0 0.05 ± 9% perf-profile.children.cycles-pp.__follow_mount_rcu 0.10 ± 10% -0.0 0.06 perf-profile.children.cycles-pp.__update_load_avg_se 0.09 ± 11% -0.0 0.05 perf-profile.children.cycles-pp.unmap_single_vma 0.09 ± 11% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.atime_needs_update 0.09 ± 8% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.copy_fpstate_to_sigframe 0.09 ± 13% -0.0 0.05 perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.09 ± 22% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.timerqueue_del 0.09 ± 14% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.count 0.09 ± 7% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.prepare_exit_to_usermode 0.10 ± 8% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.09 ± 12% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.preempt_schedule_common 0.09 ± 9% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.decay_load 0.09 ± 22% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.enqueue_hrtimer 0.08 -0.0 0.05 perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.09 ± 11% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.open64 0.07 ± 5% -0.0 0.06 ± 7% perf-profile.children.cycles-pp._exit 0.08 ± 5% +0.0 0.10 ± 9% perf-profile.children.cycles-pp.vsnprintf 0.03 ±100% +0.0 0.07 ± 6% perf-profile.children.cycles-pp._IO_vfscanf 0.25 +0.0 0.30 ± 10% perf-profile.children.cycles-pp.munmap 0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.compar1 0.01 ±173% +0.1 0.07 ± 13% perf-profile.children.cycles-pp.vsscanf 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.sighandler 0.21 ± 20% +0.1 0.27 ± 4% perf-profile.children.cycles-pp.read 0.04 ±102% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.mem_rtns_1 0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.__ctype_tolower_loc 0.00 +0.1 0.09 ± 18% perf-profile.children.cycles-pp.__ctype_toupper_loc 0.02 ±173% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.__waitpid 0.12 ± 46% +0.2 0.28 ± 4% perf-profile.children.cycles-pp.close 0.21 ± 42% +0.2 0.38 ± 2% perf-profile.children.cycles-pp.write 0.07 ±102% +0.2 0.24 ± 2% perf-profile.children.cycles-pp.unlink 0.26 ± 43% +0.2 0.46 ± 3% perf-profile.children.cycles-pp.creat 0.26 ± 49% +0.2 0.48 ± 3% perf-profile.children.cycles-pp.wait 0.07 ± 72% +0.3 0.33 ± 9% perf-profile.children.cycles-pp.exec_test 0.55 ± 38% +0.3 0.86 perf-profile.children.cycles-pp.div_short 0.52 ± 40% +0.4 0.91 ± 3% perf-profile.children.cycles-pp.div_int 0.68 ± 39% +0.5 1.22 ± 2% perf-profile.children.cycles-pp.div_long 0.73 ± 44% +0.6 1.31 ± 2% perf-profile.children.cycles-pp.div_float 4.86 ± 3% +0.6 5.50 ± 4% perf-profile.children.cycles-pp.execve 1.08 ± 45% +0.8 1.87 ± 2% perf-profile.children.cycles-pp.div_double 0.76 ± 57% +0.8 1.56 ± 2% perf-profile.children.cycles-pp.fork_test 0.61 ± 65% +0.8 1.46 ± 9% perf-profile.children.cycles-pp.page_test 1.80 ± 45% +1.4 3.20 perf-profile.children.cycles-pp.array_rtns 1.85 ± 40% +1.5 3.35 ± 3% perf-profile.children.cycles-pp.sieve 0.45 ± 53% +1.6 2.03 ± 15% perf-profile.children.cycles-pp.add_short 1.04 ± 48% +2.4 3.45 ± 10% perf-profile.children.cycles-pp.mul_double 0.79 ± 59% +2.6 3.37 ± 15% perf-profile.children.cycles-pp.add_long 0.89 ± 53% +2.6 3.48 ± 10% perf-profile.children.cycles-pp.mul_float 0.75 ± 52% +2.7 3.42 ± 15% perf-profile.children.cycles-pp.add_int 0.87 ± 58% +3.1 3.95 ± 14% perf-profile.children.cycles-pp.string_rtns_1 1.03 ± 57% +3.3 4.29 ± 16% perf-profile.children.cycles-pp.add_float 2.68 ± 62% +3.8 6.48 ± 6% perf-profile.children.cycles-pp.brk 1.45 ± 61% +5.1 6.55 ± 14% perf-profile.children.cycles-pp.add_double 1.87 ± 8% -1.0 0.86 ± 5% perf-profile.self.cycles-pp.find_busiest_group 1.38 ± 8% -0.6 0.73 ± 3% perf-profile.self.cycles-pp.filemap_map_pages 1.40 ± 6% -0.6 0.77 ± 6% perf-profile.self.cycles-pp.unmap_page_range 0.98 ± 17% -0.5 0.47 ± 4% perf-profile.self.cycles-pp.update_nohz_stats 0.88 ± 7% -0.5 0.41 ± 7% perf-profile.self.cycles-pp.source_load 0.82 ± 6% -0.4 0.46 ± 4% perf-profile.self.cycles-pp.release_pages 0.72 ± 8% -0.3 0.39 ± 5% perf-profile.self.cycles-pp.__handle_mm_fault 0.70 ± 8% -0.3 0.38 ± 5% perf-profile.self.cycles-pp.___might_sleep 0.60 ± 7% -0.3 0.29 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64 0.56 ± 12% -0.3 0.26 ± 33% perf-profile.self.cycles-pp.osq_lock 0.62 ± 5% -0.3 0.33 ± 6% perf-profile.self.cycles-pp.target_load 0.58 ± 9% -0.3 0.31 ± 7% perf-profile.self.cycles-pp.page_remove_rmap 0.51 ± 8% -0.2 0.26 ± 9% perf-profile.self.cycles-pp.copy_page_range 0.50 ± 10% -0.2 0.26 ± 6% perf-profile.self.cycles-pp.get_page_from_freelist 0.49 ± 9% -0.2 0.27 ± 7% perf-profile.self.cycles-pp.select_task_rq_fair 0.45 ± 6% -0.2 0.23 ± 9% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.43 ± 9% -0.2 0.21 ± 2% perf-profile.self.cycles-pp.perf_event_mmap 0.44 ± 13% -0.2 0.23 ± 6% perf-profile.self.cycles-pp._raw_spin_lock 0.45 ± 6% -0.2 0.24 ± 3% perf-profile.self.cycles-pp.kmem_cache_alloc 0.49 ± 26% -0.2 0.28 ± 4% perf-profile.self.cycles-pp.smp_apic_timer_interrupt 0.36 ± 7% -0.2 0.16 ± 9% perf-profile.self.cycles-pp.try_to_wake_up 0.44 ± 7% -0.2 0.24 ± 3% perf-profile.self.cycles-pp.alloc_set_pte 0.39 ± 9% -0.2 0.20 ± 7% perf-profile.self.cycles-pp.__might_sleep 0.36 ± 7% -0.2 0.18 ± 2% perf-profile.self.cycles-pp.do_syscall_64 0.38 ± 10% -0.2 0.19 ± 6% perf-profile.self.cycles-pp.___perf_sw_event 0.34 ± 6% -0.2 0.16 ± 10% perf-profile.self.cycles-pp.perf_iterate_sb 0.34 ± 10% -0.2 0.17 ± 3% perf-profile.self.cycles-pp.__vma_adjust 0.34 ± 10% -0.2 0.18 ± 3% perf-profile.self.cycles-pp.__d_lookup_rcu 0.33 ± 7% -0.2 0.17 ± 5% perf-profile.self.cycles-pp.__do_page_fault 0.32 ± 10% -0.2 0.16 ± 6% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.31 ± 8% -0.2 0.15 ± 5% perf-profile.self.cycles-pp.find_next_and_bit 0.32 ± 7% -0.2 0.16 ± 5% perf-profile.self.cycles-pp.lock_page_memcg 0.32 ± 8% -0.2 0.16 ± 5% perf-profile.self.cycles-pp.clear_page_erms 0.30 ± 5% -0.2 0.15 ± 10% perf-profile.self.cycles-pp.find_vma 0.30 ± 10% -0.1 0.15 ± 8% perf-profile.self.cycles-pp.vmacache_find 0.34 ± 10% -0.1 0.20 ± 2% perf-profile.self.cycles-pp._dl_addr 0.30 ± 4% -0.1 0.16 ± 4% perf-profile.self.cycles-pp.anon_vma_interval_tree_insert 0.27 ± 33% -0.1 0.13 ± 3% perf-profile.self.cycles-pp.mwait_idle 0.27 ± 12% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.kmem_cache_free 0.27 ± 8% -0.1 0.14 ± 6% perf-profile.self.cycles-pp.free_pages_and_swap_cache 0.28 ± 7% -0.1 0.15 ± 4% perf-profile.self.cycles-pp.__alloc_pages_nodemask 0.21 ± 19% -0.1 0.09 ± 9% perf-profile.self.cycles-pp.ktime_get 0.20 ± 17% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.idle_cpu 0.27 ± 7% -0.1 0.15 ± 7% perf-profile.self.cycles-pp.handle_mm_fault 0.21 ± 7% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.22 ± 13% -0.1 0.11 ± 4% perf-profile.self.cycles-pp.vma_compute_subtree_gap 0.24 ± 10% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.find_next_bit 0.21 ± 9% -0.1 0.10 ± 8% perf-profile.self.cycles-pp._cond_resched 0.20 ± 9% -0.1 0.09 ± 4% perf-profile.self.cycles-pp.__vm_enough_memory 0.23 ± 9% -0.1 0.13 ± 7% perf-profile.self.cycles-pp.__slab_free 0.22 ± 8% -0.1 0.11 ± 4% perf-profile.self.cycles-pp.__rb_insert_augmented 0.20 ± 9% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.vma_merge 0.18 ± 11% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.__se_sys_brk 0.20 ± 21% -0.1 0.10 ± 8% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.24 ± 13% -0.1 0.14 ± 5% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.21 ± 13% -0.1 0.12 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret 0.18 ± 6% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.strlcpy 0.20 ± 5% -0.1 0.10 ± 10% perf-profile.self.cycles-pp.perf_event_mmap_output 0.20 ± 8% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.rcu_all_qs 0.19 ± 6% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.down_write 0.21 ± 8% -0.1 0.11 ± 3% perf-profile.self.cycles-pp.page_add_file_rmap 0.20 ± 4% -0.1 0.10 ± 4% perf-profile.self.cycles-pp.anon_vma_interval_tree_remove 0.22 ± 9% -0.1 0.13 ± 5% perf-profile.self.cycles-pp.vma_interval_tree_remove 0.20 ± 8% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.19 ± 10% -0.1 0.10 ± 7% perf-profile.self.cycles-pp.copy_page 0.16 ± 9% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.do_brk_flags 0.18 ± 15% -0.1 0.10 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.18 ± 10% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.link_path_walk 0.16 ± 9% -0.1 0.08 ± 10% perf-profile.self.cycles-pp.up_write 0.16 ± 11% -0.1 0.08 ± 12% perf-profile.self.cycles-pp.unlink_anon_vmas 0.17 ± 2% -0.1 0.10 ± 8% perf-profile.self.cycles-pp._vm_normal_page 0.15 ± 7% -0.1 0.07 perf-profile.self.cycles-pp.find_vma_links 0.13 ± 5% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.load_balance 0.10 ± 8% -0.1 0.03 ±100% perf-profile.self.cycles-pp.queued_write_lock_slowpath 0.16 ± 10% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.__tlb_remove_page_size 0.14 ± 26% -0.1 0.08 ± 10% perf-profile.self.cycles-pp.hrtimer_interrupt 0.15 ± 14% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.strnlen_user 0.15 ± 8% -0.1 0.09 ± 4% perf-profile.self.cycles-pp.sync_regs 0.13 ± 3% -0.1 0.07 ± 6% perf-profile.self.cycles-pp.unlock_page 0.12 ± 6% -0.1 0.06 perf-profile.self.cycles-pp.arch_get_unmapped_area_topdown 0.09 ± 7% -0.1 0.03 ±100% perf-profile.self.cycles-pp.queued_read_lock_slowpath 0.11 ± 14% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.__bitmap_weight 0.15 ± 7% -0.1 0.08 ± 15% perf-profile.self.cycles-pp.wp_page_copy 0.13 ± 9% -0.1 0.07 ± 6% perf-profile.self.cycles-pp.path_openat 0.10 ± 10% -0.1 0.04 ± 57% perf-profile.self.cycles-pp.down_write_killable 0.09 ± 9% -0.1 0.03 ±100% perf-profile.self.cycles-pp.copy_user_generic_unrolled 0.11 ± 4% -0.1 0.05 ± 8% perf-profile.self.cycles-pp.fsnotify 0.10 ± 8% -0.1 0.04 ± 57% perf-profile.self.cycles-pp.get_unmapped_area 0.14 ± 10% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.mark_page_accessed 0.11 ± 11% -0.1 0.05 ± 8% perf-profile.self.cycles-pp.__sched_text_start 0.10 ± 8% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.vma_gap_update 0.11 ± 9% -0.1 0.06 ± 9% perf-profile.self.cycles-pp.kfree 0.08 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.vm_area_dup 0.11 ± 9% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.dup_mm 0.10 ± 11% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.copy_process 0.08 ± 8% -0.1 0.03 ±100% perf-profile.self.cycles-pp.prep_new_page 0.11 ± 11% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.lookup_fast 0.09 ± 4% -0.1 0.04 ± 57% perf-profile.self.cycles-pp.percpu_counter_add_batch 0.11 ± 11% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.change_protection 0.11 ± 18% -0.1 0.06 ± 11% perf-profile.self.cycles-pp.__lock_text_start 0.08 ± 5% -0.1 0.03 ±100% perf-profile.self.cycles-pp.perf_swevent_get_recursion_context 0.12 ± 15% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.anon_vma_clone 0.11 ± 11% -0.1 0.06 perf-profile.self.cycles-pp.mem_cgroup_commit_charge 0.09 ± 9% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.update_rq_clock 0.09 ± 26% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.rcu_irq_enter 0.08 ± 5% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.10 ± 11% -0.0 0.05 perf-profile.self.cycles-pp.walk_component 0.10 ± 17% -0.0 0.05 perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.10 ± 5% -0.0 0.05 perf-profile.self.cycles-pp.__unlock_page_memcg 0.12 ± 11% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.inode_permission 0.10 ± 8% -0.0 0.05 ± 9% perf-profile.self.cycles-pp.update_curr 0.10 ± 9% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.do_wp_page 0.11 ± 7% -0.0 0.07 perf-profile.self.cycles-pp.__percpu_counter_sum 0.08 ± 14% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.task_tick_fair 0.09 ± 13% -0.0 0.05 perf-profile.self.cycles-pp.mem_cgroup_charge_statistics 0.11 ± 10% -0.0 0.07 perf-profile.self.cycles-pp.strlen 0.09 ± 9% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.decay_load 0.13 ± 6% -0.0 0.10 ± 5% perf-profile.self.cycles-pp.malloc 0.10 ± 10% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.06 ± 9% +0.0 0.09 ± 8% perf-profile.self.cycles-pp.vfprintf 0.01 ±173% +0.0 0.05 ± 9% perf-profile.self.cycles-pp.compar1 0.04 ±102% +0.1 0.09 perf-profile.self.cycles-pp.brk 0.04 ±102% +0.1 0.10 ± 4% perf-profile.self.cycles-pp.mem_rtns_1 0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.__ctype_tolower_loc 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.__ctype_toupper_loc 0.55 ± 38% +0.3 0.85 ± 2% perf-profile.self.cycles-pp.div_short 0.52 ± 40% +0.4 0.90 ± 3% perf-profile.self.cycles-pp.div_int 0.67 ± 40% +0.5 1.20 ± 2% perf-profile.self.cycles-pp.div_long 0.72 ± 44% +0.6 1.29 ± 2% perf-profile.self.cycles-pp.div_float 1.06 ± 45% +0.8 1.83 perf-profile.self.cycles-pp.div_double 1.77 ± 45% +1.4 3.15 perf-profile.self.cycles-pp.array_rtns 1.83 ± 40% +1.5 3.30 ± 3% perf-profile.self.cycles-pp.sieve 0.44 ± 53% +1.5 1.98 ± 15% perf-profile.self.cycles-pp.add_short 1.02 ± 48% +2.4 3.38 ± 9% perf-profile.self.cycles-pp.mul_double 0.78 ± 59% +2.5 3.30 ± 15% perf-profile.self.cycles-pp.add_long 0.87 ± 52% +2.5 3.42 ± 10% perf-profile.self.cycles-pp.mul_float 0.74 ± 52% +2.6 3.34 ± 15% perf-profile.self.cycles-pp.add_int 0.85 ± 58% +3.0 3.86 ± 14% perf-profile.self.cycles-pp.string_rtns_1 1.01 ± 57% +3.2 4.21 ± 16% perf-profile.self.cycles-pp.add_float 1.43 ± 61% +5.0 6.42 ± 14% perf-profile.self.cycles-pp.add_double reaim.time.user_time 33500 +-+-----------------------------------------------------------------+ |+ + + ++ + + + ++ + +++ + + + ++ + ++ ++++ + | 33000 +-+ : : :: : : : :: : ::: : : : :: : :: : : : | 32500 +-+::: : :::: :: :: :: ::: : ::: :: :: :: :: :: : : :| | ++++ + ++++ ++ ++ ++ +++ ++++++ ++++++++ ++ ++ ++ ++ ++++ + +| 32000 +-+ + | 31500 +-+ | | | 31000 +-+ | 30500 +-+ | |O O | 30000 +-+ OOOOOO O OOOO OOOO | 29500 +-+ | O OOOO OO OOOOOO O O | 29000 +-+---------------------OO------------------------------------------+ reaim.time.system_time 22000 +-+-----------------------------------------------------------------+ | OO | 21000 OOOOO | 20000 +-+ | | OO OO OOOOO OO O | 19000 +-+ OOO O O O O OOO O O | 18000 +-+ O O | | | 17000 +-+ | 16000 +-+ | | | 15000 +-+ | 14000 +-+ ++ + + + + + + ++ + + ++ + + + + + + | |+ ++ ++++++ + + ++++ + + ++++ ++++ +++ ++ + ++++ + + ++ + + ++++| 13000 +-+-----------------------------------------------------------------+ reaim.time.percent_of_cpu_this_job_got 16800 +-+-----------------------------------------------------------------+ | OO | 16600 OOOOO | 16400 +-+ | | | 16200 +-+ OOOOO | 16000 +-+ OOOOOOOOO OO O O OO OO | | O O OO O | 15800 +-+ | 15600 +-+ | | | 15400 +-+ + + + + + | 15200 +-+ + : ++++ ++ : + ++ :+ + + ++ +++ ++ : + ++ :++ | |+++ ++ +++ ++ +++ + +++ ++++ + ++ ++ +++ ++ ++ ++++++| 15000 +-+-----------------------------------------------------------------+ reaim.time.minor_page_faults 1.62e+08 +-+--------------------------------------------------------------+ 1.6e+08 +-++ + + + + + ++ + + ++ + + ++ + + + + ++++++ | |: : : : : : : :: : : :: : : :: : : : : : :: | 1.58e+08 +-+::: : :: :::: : ::: ::: : : : :: :: :::: : :: : :| 1.56e+08 +-++++ + ++ ++++ + +++ +++ ++++++++++++ + ++ ++ ++++ + ++ + +| | | 1.54e+08 +-+ | 1.52e+08 +-+ | 1.5e+08 +-+ | | | 1.48e+08 +O+O OOOOO O OOOO O OOO | 1.46e+08 +-+ | | | 1.44e+08 O-OOOO OO OOOOOO OOO O | 1.42e+08 +-+--------------------------------------------------------------+ reaim.parent_time 6.6 +-+-------------------------------------------------------------------+ | | 6.5 +-+O O O OO | 6.4 OOO O O O OOOOO O OO OO | | OOO OO O O | 6.3 +-+ OOOO | 6.2 +-+ | | | 6.1 +-+ | 6 +-+ | | | 5.9 +-+ | 5.8 +-+ ++ + + ++ + + +| |+++++ + ++++++++ + ++++++ + ++ ++++ ++ ++++++ + ++++++ + + :+ :+ | 5.7 +-+-------------------------------------------------------------------+ reaim.child_systime 650 +-+-------------------------------------------------------------------+ | | 600 +-+O O | OOO O | 550 +-+ OO OOOOOO O OO | | OOOOOO O O O OOOOO | 500 +-+ O O | | | 450 +-+ | | | 400 +-+ | | + ++ + + + ++ ++++ +++ + + + + | 350 +-++++++++ ++++ +++ ++++++++++ +++ + ++++ +++ ++++ +++ +++++ +++| | + | 300 +-+-------------------------------------------------------------------+ reaim.jobs_per_min 265000 +-+----------------------------------------------------------------+ | + + + + + + | 260000 +-++++ ++++++++++++++++++ ++++ + + ++++++ ++++++++ ++ +++ +++ | 255000 +-+ ++ +++++++ ++ + +| | | 250000 +-+ | | | 245000 +-+ | | | 240000 +-+ | 235000 +-+ OO O OOOO | OO O OOOO O O O O OOOOOO | 230000 +-OOOO O O OOOO O | | | 225000 +-+----------------------------------------------------------------+ reaim.jobs_per_min_child 1040 +-+------------------------------------------------------------------+ | | 1020 +-+++ ++++ ++++ +++ ++++ +++++ + ++++++++ ++++++++ +++++ + | 1000 +-+ + ++ + + + + +++++ ++ + + + + ++ + +| | + + + | 980 +-+ | | | 960 +-+ | | | 940 +-+ | 920 +-+ O OOO | |O O OOOOOOO OOOOO | 900 O-OO OOOOOOOO OO | | OO | 880 +-+------------------------------------------------------------------+ reaim.max_jobs_per_min 280000 +-+----------------------------------------------------------------+ | + + + + + +++ + + + + + + +++ + + + | 275000 +-+: + ::+++ : +:: + : + ::: + + :+ : + :: +: + :: ++ ++ | 270000 +-+++ + +++ + ++ + ++ :++ +++ : ++ + +++ +: : +++| | + + + +: | 265000 +-+ + | 260000 +-+ | | | 255000 +-+ | 250000 +-+ O O O O | | O O O O O | 245000 +-+ OOOOO O OO OO | 240000 OOOO O OO O OO O OO | | O | 235000 +-+----------------------------------------------------------------+ reaim.workload 1e+06 +-+----------------------------------------------------------------+ |: : : :: : : :: : : : :: : : : : : : : : : :: | 980000 +-+::: : : :: ::: : :::: : : : :::: : ::: :: :: : : :| | ++++ + + ++ +++ + ++++ + ++++++++++++ ++++ + +++ ++ ++++ + +| | | 960000 +-+ | | | 940000 +-+ | | | 920000 +O+O OOOOO O OOOO O OOO | | | | | 900000 O-OOOO OO OOOOOO OO O O | | | 880000 +-+----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-knl-f1: 256 threads Knights Landing with 96G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase: gcc-7/performance/x86_64-kexec/100%/debian-x86_64-2018-04-03.cgz/300s/lkp-knl-f1/custom/reaim commit: 132bb8cfc9 ("mm/vmscan: add tracepoints for node reclaim") e0ee0e7107 ("mm: memcontrol: track LRU counts in the vmstats array") 132bb8cfc9e08123 e0ee0e71078abbcadd4cbc38fb8 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at_ip_rwsem_down_write_failed/0x 0:4 -4% 0:4 perf-profile.children.cycles-pp.error_entry 0:4 -2% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 1237 +16.4% 1440 reaim.child_systime 493.27 -1.9% 483.74 reaim.child_utime 160864 -6.4% 150564 reaim.jobs_per_min 628.38 -6.4% 588.14 reaim.jobs_per_min_child 165870 -4.9% 157763 reaim.max_jobs_per_min 9.07 +6.8% 9.69 reaim.parent_time 4.38 -4.7% 4.17 reaim.std_dev_percent 303.71 +1.6% 308.61 reaim.time.elapsed_time 303.71 +1.6% 308.61 reaim.time.elapsed_time.max 1065525 +4.4% 1112193 reaim.time.involuntary_context_switches 1.476e+08 -3.6% 1.423e+08 reaim.time.minor_page_faults 15406 +5.4% 16231 reaim.time.percent_of_cpu_this_job_got 33460 +12.1% 37503 reaim.time.system_time 13332 -5.6% 12591 reaim.time.user_time 3982248 -2.4% 3885242 reaim.time.voluntary_context_switches 691200 -3.7% 665600 reaim.workload 0.10 ± 13% +0.0 0.13 ± 5% mpstat.cpu.all.soft% 738.00 ± 4% -12.7% 644.25 ± 7% slabinfo.pool_workqueue.active_objs 877.25 +4.7% 918.25 turbostat.Avg_MHz 23998 +36.0% 32648 ± 14% meminfo.Inactive 23802 +36.4% 32468 ± 14% meminfo.Inactive(anon) 40841 ± 2% +24.6% 50883 ± 10% meminfo.Mapped 23996 +36.1% 32656 ± 14% numa-meminfo.node0.Inactive 23800 +36.5% 32476 ± 14% numa-meminfo.node0.Inactive(anon) 31597 ± 2% +31.3% 41475 ± 12% numa-meminfo.node0.Mapped 5950 +36.8% 8137 ± 15% numa-vmstat.node0.nr_inactive_anon 7926 ± 2% +31.5% 10420 ± 13% numa-vmstat.node0.nr_mapped 5950 +36.8% 8137 ± 15% numa-vmstat.node0.nr_zone_inactive_anon 38.00 -8.6% 34.75 vmstat.cpu.id 17.00 -5.9% 16.00 vmstat.cpu.us 43525 -8.9% 39670 vmstat.system.cs 98219 +2.2% 100365 proc-vmstat.nr_anon_pages 5950 +36.5% 8122 ± 14% proc-vmstat.nr_inactive_anon 10199 ± 2% +24.8% 12727 ± 10% proc-vmstat.nr_mapped 4738 +2.6% 4860 proc-vmstat.nr_page_table_pages 32778 +1.8% 33362 proc-vmstat.nr_slab_reclaimable 5950 +36.5% 8122 ± 14% proc-vmstat.nr_zone_inactive_anon 1.351e+08 -3.8% 1.3e+08 proc-vmstat.numa_hit 1.351e+08 -3.8% 1.3e+08 proc-vmstat.numa_local 11249 +135.1% 26444 ± 31% proc-vmstat.pgactivate 1.393e+08 -3.8% 1.34e+08 proc-vmstat.pgalloc_normal 1.486e+08 -3.6% 1.432e+08 proc-vmstat.pgfault 1.392e+08 -3.8% 1.339e+08 proc-vmstat.pgfree 12135 -8.5% 11102 softirqs.CPU103.SCHED 10997 ± 4% -9.9% 9911 softirqs.CPU105.RCU 12084 -8.8% 11026 ± 2% softirqs.CPU107.SCHED 11362 ± 4% -7.6% 10496 ± 3% softirqs.CPU13.RCU 11108 ± 3% -9.8% 10022 ± 2% softirqs.CPU138.RCU 11863 ± 3% -8.5% 10850 ± 2% softirqs.CPU166.SCHED 12082 ± 3% -8.8% 11020 ± 3% softirqs.CPU176.SCHED 12278 ± 3% -8.7% 11214 ± 3% softirqs.CPU180.SCHED 11364 ± 2% -8.1% 10447 softirqs.CPU19.RCU 11916 -8.4% 10916 ± 2% softirqs.CPU229.SCHED 11917 ± 3% -6.3% 11163 softirqs.CPU237.SCHED 24555 +14.3% 28073 ± 9% softirqs.CPU62.TIMER 11934 ± 3% -8.3% 10938 ± 3% softirqs.CPU88.SCHED 12130 ± 4% -8.6% 11089 softirqs.CPU91.SCHED 382134 ± 7% -17.3% 315992 ± 6% sched_debug.cfs_rq:/.load.stddev 2321 ± 8% -19.4% 1871 ± 7% sched_debug.cfs_rq:/.load_avg.max 362.14 ± 6% -20.7% 287.21 ± 6% sched_debug.cfs_rq:/.load_avg.stddev 113433 ± 10% +19.5% 135582 sched_debug.cfs_rq:/.min_vruntime.avg 0.36 ± 7% -17.2% 0.30 ± 6% sched_debug.cfs_rq:/.nr_running.stddev 1660 ± 11% -25.7% 1234 ± 13% sched_debug.cfs_rq:/.runnable_load_avg.max 382831 ± 7% -17.5% 315857 ± 6% sched_debug.cfs_rq:/.runnable_weight.stddev -15729 -38.6% -9661 sched_debug.cfs_rq:/.spread0.avg 1328 -11.8% 1172 ± 5% sched_debug.cfs_rq:/.util_avg.max 3.60 ± 37% -66.4% 1.21 ± 20% sched_debug.cfs_rq:/.util_avg.min 83.47 ± 16% -40.9% 49.34 ± 12% sched_debug.cfs_rq:/.util_est_enqueued.avg 928.92 -20.4% 739.50 ± 14% sched_debug.cfs_rq:/.util_est_enqueued.max 143.09 ± 5% -25.6% 106.43 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.stddev 296723 +10.2% 327081 ± 6% sched_debug.cpu.avg_idle.stddev 1612 ± 6% -20.0% 1289 ± 4% sched_debug.cpu.cpu_load[0].max 145794 ± 4% -19.5% 117398 ± 2% sched_debug.cpu.curr->pid.max 54164 ± 10% -37.7% 33724 ± 3% sched_debug.cpu.curr->pid.stddev 382014 ± 7% -18.0% 313316 ± 7% sched_debug.cpu.load.stddev 29683 ± 9% +17.0% 34729 sched_debug.cpu.nr_load_updates.avg 34848 ± 7% +13.2% 39440 sched_debug.cpu.nr_load_updates.max 2.10 ± 4% -8.7% 1.92 ± 7% sched_debug.cpu.nr_running.max 0.37 ± 7% -18.3% 0.30 ± 7% sched_debug.cpu.nr_running.stddev 21.80 ± 6% +12.9% 24.62 ± 2% sched_debug.cpu.nr_uninterruptible.stddev 37.47 -5.1% 35.58 perf-stat.i.MPKI 1.101e+10 +3.5% 1.14e+10 perf-stat.i.branch-instructions 3.14 -0.1 3.02 perf-stat.i.branch-miss-rate% 3.006e+08 -1.9% 2.949e+08 perf-stat.i.branch-misses 28.84 -0.3 28.52 perf-stat.i.cache-miss-rate% 5.44e+08 -5.0% 5.166e+08 perf-stat.i.cache-misses 1.608e+09 -4.0% 1.544e+09 perf-stat.i.cache-references 40600 -10.1% 36480 perf-stat.i.context-switches 5.32 +2.0% 5.43 perf-stat.i.cpi 2.146e+11 +3.7% 2.225e+11 perf-stat.i.cpu-cycles 8829 -2.7% 8594 perf-stat.i.cpu-migrations 613.87 +9.8% 674.08 perf-stat.i.cycles-between-cache-misses 64777117 -5.9% 60975942 perf-stat.i.iTLB-load-misses 4.035e+10 +1.3% 4.086e+10 perf-stat.i.iTLB-loads 4.052e+10 +1.3% 4.105e+10 perf-stat.i.instructions 564.50 +5.9% 598.00 perf-stat.i.instructions-per-iTLB-miss 0.21 -2.1% 0.20 perf-stat.i.ipc 443323 -6.7% 413740 perf-stat.i.minor-faults 446984 -6.3% 418725 perf-stat.i.page-faults 37.89 -7.2% 35.14 perf-stat.overall.MPKI 2.66 -0.2 2.49 perf-stat.overall.branch-miss-rate% 32.69 -0.7 32.02 perf-stat.overall.cache-miss-rate% 5.42 +3.4% 5.60 perf-stat.overall.cpi 437.32 +13.8% 497.60 perf-stat.overall.cycles-between-cache-misses 0.17 -0.0 0.15 perf-stat.overall.iTLB-load-miss-rate% 605.56 +7.1% 648.47 perf-stat.overall.instructions-per-iTLB-miss 0.18 -3.3% 0.18 perf-stat.overall.ipc 17899119 +6.7% 19106380 perf-stat.overall.path-length 1.145e+10 +4.3% 1.193e+10 perf-stat.ps.branch-instructions 3.048e+08 -2.6% 2.968e+08 perf-stat.ps.branch-misses 5.101e+08 -8.0% 4.693e+08 perf-stat.ps.cache-misses 1.56e+09 -6.1% 1.466e+09 perf-stat.ps.cache-references 43547 -9.0% 39648 perf-stat.ps.context-switches 2.231e+11 +4.7% 2.335e+11 perf-stat.ps.cpu-cycles 68011741 -5.4% 64313813 perf-stat.ps.iTLB-load-misses 4.11e+10 +1.3% 4.164e+10 perf-stat.ps.iTLB-loads 4.118e+10 +1.3% 4.171e+10 perf-stat.ps.instructions 478582 -5.3% 452988 perf-stat.ps.minor-faults 479075 -5.3% 453567 perf-stat.ps.page-faults 1.237e+13 +2.8% 1.272e+13 perf-stat.total.instructions 1283034 -3.6% 1236666 interrupts.CAL:Function_call_interrupts 2603 ± 35% +50.3% 3913 ± 24% interrupts.CPU1.NMI:Non-maskable_interrupts 2603 ± 35% +50.3% 3913 ± 24% interrupts.CPU1.PMI:Performance_monitoring_interrupts 602.00 ± 5% -14.3% 516.00 ± 5% interrupts.CPU10.TLB:TLB_shootdowns 2050 ± 6% +50.3% 3082 ± 26% interrupts.CPU100.NMI:Non-maskable_interrupts 2050 ± 6% +50.3% 3082 ± 26% interrupts.CPU100.PMI:Performance_monitoring_interrupts 581.50 ± 7% -17.6% 479.00 ± 8% interrupts.CPU102.TLB:TLB_shootdowns 557.50 ± 4% -13.5% 482.25 ± 3% interrupts.CPU103.TLB:TLB_shootdowns 574.50 ± 3% -18.5% 468.50 ± 5% interrupts.CPU106.TLB:TLB_shootdowns 2218 ± 5% +10.3% 2448 ± 3% interrupts.CPU108.RES:Rescheduling_interrupts 564.25 ± 6% -16.1% 473.50 ± 10% interrupts.CPU108.TLB:TLB_shootdowns 2225 ± 3% +13.5% 2525 ± 3% interrupts.CPU109.RES:Rescheduling_interrupts 581.75 ± 7% -22.8% 449.00 ± 6% interrupts.CPU110.TLB:TLB_shootdowns 2220 +12.1% 2489 ± 4% interrupts.CPU111.RES:Rescheduling_interrupts 530.00 ± 3% -10.5% 474.25 ± 5% interrupts.CPU111.TLB:TLB_shootdowns 2262 +10.9% 2508 ± 5% interrupts.CPU113.RES:Rescheduling_interrupts 571.00 -11.7% 504.00 interrupts.CPU113.TLB:TLB_shootdowns 541.75 ± 5% -11.7% 478.50 ± 5% interrupts.CPU114.TLB:TLB_shootdowns 2243 ± 2% +9.2% 2451 ± 5% interrupts.CPU118.RES:Rescheduling_interrupts 569.50 ± 7% -13.5% 492.50 ± 6% interrupts.CPU119.TLB:TLB_shootdowns 2289 +9.2% 2499 ± 2% interrupts.CPU12.RES:Rescheduling_interrupts 547.75 -15.1% 465.25 ± 8% interrupts.CPU12.TLB:TLB_shootdowns 532.75 ± 4% -9.3% 483.25 interrupts.CPU120.TLB:TLB_shootdowns 2948 ± 34% +47.0% 4334 ± 5% interrupts.CPU121.NMI:Non-maskable_interrupts 2948 ± 34% +47.0% 4334 ± 5% interrupts.CPU121.PMI:Performance_monitoring_interrupts 557.75 ± 3% -14.9% 474.75 ± 2% interrupts.CPU121.TLB:TLB_shootdowns 2221 +10.7% 2458 ± 3% interrupts.CPU123.RES:Rescheduling_interrupts 2222 ± 4% +10.5% 2455 ± 4% interrupts.CPU124.RES:Rescheduling_interrupts 539.00 ± 6% -9.0% 490.25 ± 7% interrupts.CPU125.TLB:TLB_shootdowns 2277 +9.2% 2488 ± 2% interrupts.CPU126.RES:Rescheduling_interrupts 578.25 ± 5% -13.3% 501.50 ± 7% interrupts.CPU126.TLB:TLB_shootdowns 565.75 ± 4% -15.6% 477.25 ± 3% interrupts.CPU127.TLB:TLB_shootdowns 2233 ± 2% +10.4% 2464 ± 5% interrupts.CPU128.RES:Rescheduling_interrupts 551.00 ± 3% -13.4% 477.00 ± 2% interrupts.CPU128.TLB:TLB_shootdowns 568.25 ± 5% -17.1% 471.00 ± 7% interrupts.CPU129.TLB:TLB_shootdowns 2105 ± 2% +86.3% 3922 ± 21% interrupts.CPU13.NMI:Non-maskable_interrupts 2105 ± 2% +86.3% 3922 ± 21% interrupts.CPU13.PMI:Performance_monitoring_interrupts 582.25 ± 5% -12.4% 510.00 ± 8% interrupts.CPU130.TLB:TLB_shootdowns 2218 ± 3% +12.9% 2504 ± 7% interrupts.CPU132.RES:Rescheduling_interrupts 556.00 ± 4% -10.8% 495.75 ± 7% interrupts.CPU132.TLB:TLB_shootdowns 551.00 ± 3% -11.2% 489.25 ± 4% interrupts.CPU133.TLB:TLB_shootdowns 580.75 ± 6% -19.3% 468.75 ± 4% interrupts.CPU135.TLB:TLB_shootdowns 562.00 ± 4% -17.7% 462.50 interrupts.CPU136.TLB:TLB_shootdowns 536.25 ± 7% -9.4% 485.75 ± 2% interrupts.CPU137.TLB:TLB_shootdowns 2331 ± 4% +12.3% 2616 ± 5% interrupts.CPU14.RES:Rescheduling_interrupts 566.25 ± 5% -13.7% 488.75 ± 10% interrupts.CPU140.TLB:TLB_shootdowns 2652 ± 40% +67.8% 4451 ± 4% interrupts.CPU141.NMI:Non-maskable_interrupts 2652 ± 40% +67.8% 4451 ± 4% interrupts.CPU141.PMI:Performance_monitoring_interrupts 594.00 ± 6% -17.6% 489.25 ± 8% interrupts.CPU141.TLB:TLB_shootdowns 2179 ± 4% +13.2% 2466 ± 4% interrupts.CPU143.RES:Rescheduling_interrupts 557.50 ± 5% -13.8% 480.50 ± 5% interrupts.CPU143.TLB:TLB_shootdowns 569.25 ± 4% -9.9% 513.00 ± 5% interrupts.CPU145.TLB:TLB_shootdowns 581.75 ± 7% -17.5% 480.00 interrupts.CPU147.TLB:TLB_shootdowns 538.75 ± 6% -9.3% 488.75 ± 2% interrupts.CPU15.TLB:TLB_shootdowns 2191 ± 4% +10.2% 2414 ± 3% interrupts.CPU150.RES:Rescheduling_interrupts 565.50 ± 7% -17.4% 467.00 ± 7% interrupts.CPU153.TLB:TLB_shootdowns 529.75 ± 4% -12.5% 463.75 ± 7% interrupts.CPU155.TLB:TLB_shootdowns 2127 ± 2% +15.5% 2457 ± 4% interrupts.CPU156.RES:Rescheduling_interrupts 555.75 ± 8% -18.1% 455.00 ± 3% interrupts.CPU157.TLB:TLB_shootdowns 573.50 ± 9% -17.5% 473.25 ± 4% interrupts.CPU158.TLB:TLB_shootdowns 2079 +60.8% 3344 ± 33% interrupts.CPU16.NMI:Non-maskable_interrupts 2079 +60.8% 3344 ± 33% interrupts.CPU16.PMI:Performance_monitoring_interrupts 3694 ± 24% -43.7% 2078 ± 6% interrupts.CPU160.NMI:Non-maskable_interrupts 3694 ± 24% -43.7% 2078 ± 6% interrupts.CPU160.PMI:Performance_monitoring_interrupts 2072 ± 3% +46.2% 3029 ± 26% interrupts.CPU161.NMI:Non-maskable_interrupts 2072 ± 3% +46.2% 3029 ± 26% interrupts.CPU161.PMI:Performance_monitoring_interrupts 531.00 -10.2% 477.00 ± 2% interrupts.CPU161.TLB:TLB_shootdowns 545.25 ± 3% -15.6% 460.25 ± 8% interrupts.CPU162.TLB:TLB_shootdowns 561.00 ± 5% -20.7% 444.75 ± 7% interrupts.CPU163.TLB:TLB_shootdowns 543.75 ± 8% -14.5% 465.00 ± 6% interrupts.CPU166.TLB:TLB_shootdowns 584.75 ± 10% -16.2% 490.25 ± 4% interrupts.CPU167.TLB:TLB_shootdowns 550.50 ± 4% -10.3% 494.00 ± 7% interrupts.CPU168.TLB:TLB_shootdowns 545.25 ± 8% -20.7% 432.25 ± 3% interrupts.CPU169.TLB:TLB_shootdowns 2572 ± 31% +29.1% 3321 ± 34% interrupts.CPU17.NMI:Non-maskable_interrupts 2572 ± 31% +29.1% 3321 ± 34% interrupts.CPU17.PMI:Performance_monitoring_interrupts 550.00 ± 2% -16.0% 461.75 ± 6% interrupts.CPU170.TLB:TLB_shootdowns 549.00 ± 6% -12.6% 479.75 ± 6% interrupts.CPU172.TLB:TLB_shootdowns 2229 ± 4% +15.0% 2563 ± 3% interrupts.CPU173.RES:Rescheduling_interrupts 560.75 ± 3% -13.6% 484.50 ± 9% interrupts.CPU173.TLB:TLB_shootdowns 535.75 ± 4% -11.2% 475.75 ± 6% interrupts.CPU174.TLB:TLB_shootdowns 560.00 ± 9% -14.1% 481.25 ± 3% interrupts.CPU175.TLB:TLB_shootdowns 534.50 ± 4% -13.7% 461.25 ± 2% interrupts.CPU176.TLB:TLB_shootdowns 547.25 ± 4% -12.4% 479.25 ± 3% interrupts.CPU177.TLB:TLB_shootdowns 2152 +13.3% 2438 ± 3% interrupts.CPU178.RES:Rescheduling_interrupts 532.00 ± 5% -11.7% 469.50 ± 4% interrupts.CPU179.TLB:TLB_shootdowns 620.25 ± 9% -11.6% 548.50 ± 3% interrupts.CPU18.TLB:TLB_shootdowns 547.50 ± 5% -14.1% 470.50 ± 7% interrupts.CPU181.TLB:TLB_shootdowns 2185 ± 2% +18.0% 2578 ± 6% interrupts.CPU182.RES:Rescheduling_interrupts 545.25 ± 6% -14.4% 466.50 ± 3% interrupts.CPU182.TLB:TLB_shootdowns 543.00 ± 6% -9.5% 491.50 ± 5% interrupts.CPU183.TLB:TLB_shootdowns 567.75 ± 2% -17.6% 467.75 ± 3% interrupts.CPU184.TLB:TLB_shootdowns 533.25 ± 4% -13.5% 461.00 ± 6% interrupts.CPU185.TLB:TLB_shootdowns 2211 ± 5% +10.9% 2453 ± 3% interrupts.CPU186.RES:Rescheduling_interrupts 2237 ± 3% +8.4% 2426 ± 4% interrupts.CPU187.RES:Rescheduling_interrupts 2293 ± 3% +8.6% 2490 ± 4% interrupts.CPU189.RES:Rescheduling_interrupts 557.25 ± 3% -16.8% 463.50 ± 2% interrupts.CPU191.TLB:TLB_shootdowns 533.75 ± 7% -11.4% 472.75 ± 6% interrupts.CPU193.TLB:TLB_shootdowns 3709 ± 23% -44.1% 2074 ± 8% interrupts.CPU194.NMI:Non-maskable_interrupts 3709 ± 23% -44.1% 2074 ± 8% interrupts.CPU194.PMI:Performance_monitoring_interrupts 535.25 ± 2% -14.0% 460.25 ± 4% interrupts.CPU194.TLB:TLB_shootdowns 2518 ± 34% +48.5% 3739 ± 26% interrupts.CPU196.NMI:Non-maskable_interrupts 2518 ± 34% +48.5% 3739 ± 26% interrupts.CPU196.PMI:Performance_monitoring_interrupts 567.25 ± 7% -12.7% 495.25 ± 5% interrupts.CPU196.TLB:TLB_shootdowns 550.50 ± 5% -15.3% 466.50 ± 9% interrupts.CPU198.TLB:TLB_shootdowns 581.00 ± 4% -16.0% 488.00 ± 7% interrupts.CPU199.TLB:TLB_shootdowns 2145 +50.9% 3236 ± 28% interrupts.CPU2.NMI:Non-maskable_interrupts 2145 +50.9% 3236 ± 28% interrupts.CPU2.PMI:Performance_monitoring_interrupts 3704 ± 23% -40.7% 2196 ± 7% interrupts.CPU20.NMI:Non-maskable_interrupts 3704 ± 23% -40.7% 2196 ± 7% interrupts.CPU20.PMI:Performance_monitoring_interrupts 2236 ± 4% +13.9% 2546 ± 2% interrupts.CPU20.RES:Rescheduling_interrupts 2319 +8.8% 2523 ± 5% interrupts.CPU201.RES:Rescheduling_interrupts 2214 ± 7% +13.8% 2520 ± 2% interrupts.CPU204.RES:Rescheduling_interrupts 548.00 ± 8% -8.1% 503.75 ± 6% interrupts.CPU205.TLB:TLB_shootdowns 2561 ± 34% +47.2% 3771 ± 25% interrupts.CPU206.NMI:Non-maskable_interrupts 2561 ± 34% +47.2% 3771 ± 25% interrupts.CPU206.PMI:Performance_monitoring_interrupts 2065 ± 3% +23.1% 2543 ± 9% interrupts.CPU207.RES:Rescheduling_interrupts 4366 ± 8% -51.3% 2127 ± 10% interrupts.CPU208.NMI:Non-maskable_interrupts 4366 ± 8% -51.3% 2127 ± 10% interrupts.CPU208.PMI:Performance_monitoring_interrupts 2167 ± 3% +15.2% 2498 ± 3% interrupts.CPU208.RES:Rescheduling_interrupts 683.25 ± 36% -34.7% 446.00 ± 10% interrupts.CPU208.TLB:TLB_shootdowns 555.50 ± 8% -11.7% 490.25 ± 8% interrupts.CPU209.TLB:TLB_shootdowns 2132 ± 2% +17.5% 2506 ± 3% interrupts.CPU21.RES:Rescheduling_interrupts 576.25 ± 5% -17.5% 475.50 ± 9% interrupts.CPU210.TLB:TLB_shootdowns 542.75 ± 4% -14.9% 462.00 ± 5% interrupts.CPU212.TLB:TLB_shootdowns 2127 ± 4% +16.1% 2470 ± 7% interrupts.CPU213.RES:Rescheduling_interrupts 544.00 ± 2% -11.8% 480.00 ± 7% interrupts.CPU213.TLB:TLB_shootdowns 576.75 ± 6% -16.3% 483.00 ± 5% interrupts.CPU214.TLB:TLB_shootdowns 565.75 ± 7% -10.4% 506.75 ± 4% interrupts.CPU218.TLB:TLB_shootdowns 2262 ± 3% +13.3% 2563 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts 616.25 ± 7% -20.0% 493.25 ± 2% interrupts.CPU22.TLB:TLB_shootdowns 2178 ± 2% +12.6% 2452 ± 5% interrupts.CPU220.RES:Rescheduling_interrupts 566.50 ± 4% -17.3% 468.75 ± 3% interrupts.CPU223.TLB:TLB_shootdowns 542.75 ± 3% -12.9% 473.00 ± 10% interrupts.CPU224.TLB:TLB_shootdowns 558.25 ± 4% -18.4% 455.50 ± 8% interrupts.CPU226.TLB:TLB_shootdowns 2456 ± 33% +29.1% 3171 ± 31% interrupts.CPU227.NMI:Non-maskable_interrupts 2456 ± 33% +29.1% 3171 ± 31% interrupts.CPU227.PMI:Performance_monitoring_interrupts 2207 ± 3% +12.3% 2478 ± 2% interrupts.CPU227.RES:Rescheduling_interrupts 549.00 ± 3% -14.0% 472.25 ± 7% interrupts.CPU229.TLB:TLB_shootdowns 556.00 ± 5% -12.4% 487.00 ± 6% interrupts.CPU23.TLB:TLB_shootdowns 555.50 ± 3% -14.2% 476.50 ± 6% interrupts.CPU230.TLB:TLB_shootdowns 2050 +60.6% 3293 ± 37% interrupts.CPU231.NMI:Non-maskable_interrupts 2050 +60.6% 3293 ± 37% interrupts.CPU231.PMI:Performance_monitoring_interrupts 566.25 ± 6% -19.8% 454.00 ± 5% interrupts.CPU231.TLB:TLB_shootdowns 2047 ± 3% +108.9% 4275 ± 9% interrupts.CPU232.NMI:Non-maskable_interrupts 2047 ± 3% +108.9% 4275 ± 9% interrupts.CPU232.PMI:Performance_monitoring_interrupts 547.00 ± 5% -13.4% 473.75 ± 10% interrupts.CPU233.TLB:TLB_shootdowns 2068 ± 5% +104.1% 4222 ± 7% interrupts.CPU235.NMI:Non-maskable_interrupts 2068 ± 5% +104.1% 4222 ± 7% interrupts.CPU235.PMI:Performance_monitoring_interrupts 581.25 ± 14% -15.2% 492.75 ± 9% interrupts.CPU235.TLB:TLB_shootdowns 2043 ± 3% +104.3% 4173 ± 7% interrupts.CPU236.NMI:Non-maskable_interrupts 2043 ± 3% +104.3% 4173 ± 7% interrupts.CPU236.PMI:Performance_monitoring_interrupts 574.75 ± 4% -13.6% 496.75 ± 8% interrupts.CPU237.TLB:TLB_shootdowns 562.25 ± 9% -16.1% 472.00 ± 4% interrupts.CPU239.TLB:TLB_shootdowns 616.25 ± 13% -19.6% 495.25 ± 3% interrupts.CPU24.TLB:TLB_shootdowns 2271 +11.6% 2536 ± 3% interrupts.CPU240.RES:Rescheduling_interrupts 2266 ± 4% +8.1% 2450 ± 5% interrupts.CPU241.RES:Rescheduling_interrupts 2099 ± 4% +55.5% 3263 ± 25% interrupts.CPU243.NMI:Non-maskable_interrupts 2099 ± 4% +55.5% 3263 ± 25% interrupts.CPU243.PMI:Performance_monitoring_interrupts 558.75 ± 6% -15.7% 470.75 ± 2% interrupts.CPU243.TLB:TLB_shootdowns 2205 ± 4% +10.3% 2433 ± 5% interrupts.CPU244.RES:Rescheduling_interrupts 556.75 ± 4% -10.6% 497.75 ± 5% interrupts.CPU244.TLB:TLB_shootdowns 577.75 ± 7% -13.7% 498.75 ± 5% interrupts.CPU245.TLB:TLB_shootdowns 2204 ± 5% +12.0% 2468 ± 2% interrupts.CPU246.RES:Rescheduling_interrupts 551.50 ± 7% -15.5% 466.00 ± 7% interrupts.CPU246.TLB:TLB_shootdowns 555.75 ± 3% -16.7% 463.00 ± 6% interrupts.CPU247.TLB:TLB_shootdowns 2017 ± 2% +65.7% 3343 ± 37% interrupts.CPU249.NMI:Non-maskable_interrupts 2017 ± 2% +65.7% 3343 ± 37% interrupts.CPU249.PMI:Performance_monitoring_interrupts 581.25 ± 7% -14.7% 496.00 ± 6% interrupts.CPU249.TLB:TLB_shootdowns 563.50 ± 5% -14.9% 479.75 ± 6% interrupts.CPU250.TLB:TLB_shootdowns 2222 +12.4% 2498 ± 3% interrupts.CPU252.RES:Rescheduling_interrupts 565.25 ± 3% -13.4% 489.25 ± 6% interrupts.CPU252.TLB:TLB_shootdowns 584.25 ± 2% -16.2% 489.75 ± 12% interrupts.CPU253.TLB:TLB_shootdowns 543.00 ± 6% -9.0% 494.25 ± 5% interrupts.CPU27.TLB:TLB_shootdowns 578.00 ± 4% -14.8% 492.25 ± 2% interrupts.CPU28.TLB:TLB_shootdowns 2222 ± 3% +11.2% 2472 ± 2% interrupts.CPU29.RES:Rescheduling_interrupts 529.75 ± 4% -8.2% 486.50 ± 7% interrupts.CPU29.TLB:TLB_shootdowns 2508 ± 5% +13.5% 2846 ± 5% interrupts.CPU3.RES:Rescheduling_interrupts 531.25 ± 7% -14.7% 453.00 ± 6% interrupts.CPU3.TLB:TLB_shootdowns 2241 ± 4% +8.6% 2433 ± 2% interrupts.CPU31.RES:Rescheduling_interrupts 603.75 ± 7% -15.4% 510.75 interrupts.CPU31.TLB:TLB_shootdowns 578.00 ± 3% -19.2% 467.00 ± 7% interrupts.CPU33.TLB:TLB_shootdowns 583.75 ± 5% -17.0% 484.50 ± 5% interrupts.CPU34.TLB:TLB_shootdowns 2136 ± 3% +17.7% 2514 ± 2% interrupts.CPU35.RES:Rescheduling_interrupts 561.00 ± 4% -11.6% 495.75 ± 6% interrupts.CPU36.TLB:TLB_shootdowns 559.50 ± 5% -14.7% 477.25 ± 7% interrupts.CPU38.TLB:TLB_shootdowns 2085 ± 3% +32.8% 2769 ± 30% interrupts.CPU39.NMI:Non-maskable_interrupts 2085 ± 3% +32.8% 2769 ± 30% interrupts.CPU39.PMI:Performance_monitoring_interrupts 599.75 -15.9% 504.25 ± 7% interrupts.CPU39.TLB:TLB_shootdowns 2390 ± 4% +12.1% 2680 ± 4% interrupts.CPU4.RES:Rescheduling_interrupts 563.00 ± 5% -10.2% 505.50 ± 6% interrupts.CPU4.TLB:TLB_shootdowns 2523 ± 32% +29.6% 3271 ± 28% interrupts.CPU40.NMI:Non-maskable_interrupts 2523 ± 32% +29.6% 3271 ± 28% interrupts.CPU40.PMI:Performance_monitoring_interrupts 596.75 ± 10% -15.1% 506.50 ± 5% interrupts.CPU40.TLB:TLB_shootdowns 539.50 ± 8% -10.6% 482.50 ± 2% interrupts.CPU41.TLB:TLB_shootdowns 569.50 ± 4% -19.3% 459.50 ± 4% interrupts.CPU42.TLB:TLB_shootdowns 2291 ± 4% +11.8% 2562 ± 5% interrupts.CPU43.RES:Rescheduling_interrupts 2194 +10.4% 2424 ± 3% interrupts.CPU44.RES:Rescheduling_interrupts 600.25 ± 4% -18.1% 491.50 ± 6% interrupts.CPU44.TLB:TLB_shootdowns 541.25 ± 4% -15.5% 457.50 ± 3% interrupts.CPU5.TLB:TLB_shootdowns 551.75 ± 8% -14.0% 474.25 ± 2% interrupts.CPU50.TLB:TLB_shootdowns 578.75 ± 3% -15.6% 488.75 ± 7% interrupts.CPU54.TLB:TLB_shootdowns 2175 ± 7% +13.2% 2461 ± 6% interrupts.CPU55.RES:Rescheduling_interrupts 570.50 ± 8% -16.3% 477.50 ± 4% interrupts.CPU56.TLB:TLB_shootdowns 1866 ±120% -74.9% 467.50 ± 5% interrupts.CPU57.TLB:TLB_shootdowns 2020 ± 2% +37.5% 2777 ± 31% interrupts.CPU58.NMI:Non-maskable_interrupts 2020 ± 2% +37.5% 2777 ± 31% interrupts.CPU58.PMI:Performance_monitoring_interrupts 613.50 ± 10% -18.7% 498.75 ± 3% interrupts.CPU58.TLB:TLB_shootdowns 2315 +13.2% 2621 ± 2% interrupts.CPU6.RES:Rescheduling_interrupts 568.00 ± 3% -13.4% 492.00 ± 6% interrupts.CPU60.TLB:TLB_shootdowns 2139 ± 4% +12.2% 2399 ± 2% interrupts.CPU62.RES:Rescheduling_interrupts 570.25 ± 6% -14.8% 485.75 ± 7% interrupts.CPU62.TLB:TLB_shootdowns 550.00 ± 2% -14.1% 472.25 ± 2% interrupts.CPU63.TLB:TLB_shootdowns 568.25 ± 4% -15.8% 478.50 ± 3% interrupts.CPU64.TLB:TLB_shootdowns 2355 ± 4% +6.1% 2499 ± 3% interrupts.CPU65.RES:Rescheduling_interrupts 579.25 ± 9% -12.2% 508.75 ± 4% interrupts.CPU65.TLB:TLB_shootdowns 582.00 ± 3% -12.7% 508.00 ± 3% interrupts.CPU68.TLB:TLB_shootdowns 592.50 ± 7% -12.7% 517.00 ± 4% interrupts.CPU7.TLB:TLB_shootdowns 561.00 ± 6% -13.5% 485.25 ± 3% interrupts.CPU70.TLB:TLB_shootdowns 2171 ± 7% +11.7% 2425 ± 5% interrupts.CPU72.RES:Rescheduling_interrupts 540.25 ± 3% -14.3% 463.25 ± 5% interrupts.CPU72.TLB:TLB_shootdowns 2240 +10.3% 2470 ± 2% interrupts.CPU73.RES:Rescheduling_interrupts 548.00 ± 3% -12.7% 478.25 ± 8% interrupts.CPU73.TLB:TLB_shootdowns 572.25 ± 7% -11.5% 506.25 ± 6% interrupts.CPU74.TLB:TLB_shootdowns 564.25 ± 4% -14.4% 483.00 ± 13% interrupts.CPU77.TLB:TLB_shootdowns 558.75 ± 5% -11.4% 495.25 ± 5% interrupts.CPU79.TLB:TLB_shootdowns 579.25 ± 11% -22.9% 446.75 ± 3% interrupts.CPU80.TLB:TLB_shootdowns 519.00 ± 8% -9.1% 471.75 ± 5% interrupts.CPU81.TLB:TLB_shootdowns 2161 ± 3% +44.2% 3117 ± 27% interrupts.CPU82.NMI:Non-maskable_interrupts 2161 ± 3% +44.2% 3117 ± 27% interrupts.CPU82.PMI:Performance_monitoring_interrupts 563.50 ± 3% -16.9% 468.00 ± 4% interrupts.CPU83.TLB:TLB_shootdowns 2232 ± 4% +11.3% 2484 ± 5% interrupts.CPU84.RES:Rescheduling_interrupts 2080 +83.1% 3808 ± 21% interrupts.CPU85.NMI:Non-maskable_interrupts 2080 +83.1% 3808 ± 21% interrupts.CPU85.PMI:Performance_monitoring_interrupts 558.75 ± 5% -19.0% 452.50 ± 6% interrupts.CPU85.TLB:TLB_shootdowns 2054 ± 2% +75.3% 3600 ± 18% interrupts.CPU86.NMI:Non-maskable_interrupts 2054 ± 2% +75.3% 3600 ± 18% interrupts.CPU86.PMI:Performance_monitoring_interrupts 2098 ± 2% +18.0% 2476 ± 3% interrupts.CPU89.RES:Rescheduling_interrupts 578.50 ± 8% -14.6% 493.75 ± 3% interrupts.CPU89.TLB:TLB_shootdowns 545.25 -11.1% 484.75 ± 4% interrupts.CPU90.TLB:TLB_shootdowns 556.00 ± 8% -15.5% 470.00 ± 11% interrupts.CPU93.TLB:TLB_shootdowns 2279 ± 3% +9.2% 2490 ± 2% interrupts.CPU94.RES:Rescheduling_interrupts 561.25 ± 4% -20.1% 448.25 ± 9% interrupts.CPU95.TLB:TLB_shootdowns 2514 ± 35% +47.7% 3713 ± 25% interrupts.CPU96.NMI:Non-maskable_interrupts 2514 ± 35% +47.7% 3713 ± 25% interrupts.CPU96.PMI:Performance_monitoring_interrupts 574.50 ± 3% -11.6% 508.00 interrupts.CPU97.TLB:TLB_shootdowns 554.75 ± 3% -13.0% 482.50 ± 7% interrupts.CPU98.TLB:TLB_shootdowns 63.84 ± 3% -12.6 51.28 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 63.78 ± 3% -12.5 51.26 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.58 ± 10% -5.6 2.00 ± 46% perf-profile.calltrace.cycles-pp.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.20 ± 10% -5.3 1.89 ± 47% perf-profile.calltrace.cycles-pp.__do_munmap.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 10.78 ± 4% -3.1 7.68 ± 3% perf-profile.calltrace.cycles-pp.page_fault 10.53 ± 4% -3.0 7.51 ± 3% perf-profile.calltrace.cycles-pp.__do_page_fault.page_fault 9.89 ± 4% -2.8 7.09 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.page_fault 9.71 ± 4% -2.7 6.96 ± 2% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 4.14 ± 4% -2.1 2.06 ± 26% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.12 ± 4% -2.1 2.05 ± 25% perf-profile.calltrace.cycles-pp.do_execve.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.79 -1.6 8.21 ± 4% perf-profile.calltrace.cycles-pp.__do_execve_file.do_execve.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.63 ± 6% -1.4 1.21 ± 14% perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.87 -1.4 7.51 ± 4% perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.do_execve.__x64_sys_execve.do_syscall_64 8.86 -1.4 7.50 ± 4% perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.do_execve.__x64_sys_execve 2.13 ± 6% -1.1 0.99 ± 14% perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.39 ± 8% -0.9 0.50 ± 60% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.21 ± 7% -0.9 0.33 ±100% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.80 ± 2% -0.8 4.95 ± 4% perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.do_execve 5.75 ± 2% -0.8 4.92 ± 4% perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file 5.75 ± 2% -0.8 4.91 ± 4% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler 3.79 ± 2% -0.7 3.09 ± 9% perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.unmap_region.__do_munmap.__vm_munmap 3.00 ± 2% -0.6 2.44 ± 11% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec.load_elf_binary 3.00 ± 2% -0.6 2.43 ± 11% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec 1.97 ± 2% -0.5 1.45 ± 16% perf-profile.calltrace.cycles-pp.lru_add_drain.exit_mmap.mmput.flush_old_exec.load_elf_binary 1.97 ± 2% -0.5 1.45 ± 16% perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.exit_mmap.mmput.flush_old_exec 2.02 -0.5 1.49 ± 15% perf-profile.calltrace.cycles-pp.__vm_munmap.elf_map.load_elf_binary.search_binary_handler.__do_execve_file 4.40 ± 2% -0.5 3.87 ± 4% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.01 -0.5 1.49 ± 15% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.elf_map.load_elf_binary.search_binary_handler 4.38 ± 2% -0.5 3.86 ± 4% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.37 ± 2% -0.5 3.85 ± 4% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.31 ± 2% -0.5 3.81 ± 4% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 1.93 -0.5 1.44 ± 14% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.elf_map.load_elf_binary 2.25 -0.5 1.76 ± 14% perf-profile.calltrace.cycles-pp.elf_map.load_elf_binary.search_binary_handler.__do_execve_file.do_execve 1.37 ± 29% -0.5 0.89 ± 9% perf-profile.calltrace.cycles-pp.ret_from_fork 1.89 -0.5 1.42 ± 14% perf-profile.calltrace.cycles-pp.lru_add_drain.unmap_region.__do_munmap.__vm_munmap.elf_map 4.00 ± 2% -0.4 3.56 ± 4% perf-profile.calltrace.cycles-pp.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 3.91 ± 2% -0.4 3.48 ± 4% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff 3.79 ± 2% -0.4 3.37 ± 4% perf-profile.calltrace.cycles-pp.lru_add_drain.unmap_region.__do_munmap.mmap_region.do_mmap 3.78 ± 2% -0.4 3.37 ± 4% perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.unmap_region.__do_munmap.mmap_region 1.22 ± 32% -0.4 0.83 ± 9% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 6.90 -0.4 6.52 ± 2% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain.exit_mmap.mmput 0.74 ± 36% -0.3 0.41 ± 58% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.08 ± 3% -0.3 1.76 ± 5% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.08 ± 3% -0.3 1.76 ± 5% perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.08 ± 3% -0.3 1.76 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.06 ± 3% -0.3 1.75 ± 5% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 0.83 ± 25% -0.3 0.52 ± 68% perf-profile.calltrace.cycles-pp.__strcspn_sse42 0.83 ± 25% -0.3 0.52 ± 68% perf-profile.calltrace.cycles-pp.generic_start_main.__strcspn_sse42 0.83 ± 25% -0.3 0.52 ± 68% perf-profile.calltrace.cycles-pp.main.generic_start_main.__strcspn_sse42 0.83 ± 25% -0.3 0.52 ± 68% perf-profile.calltrace.cycles-pp.run_builtin.main.generic_start_main.__strcspn_sse42 0.70 ± 8% -0.3 0.42 ± 57% perf-profile.calltrace.cycles-pp.__libc_fork 6.36 -0.3 6.09 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain.exit_mmap 1.16 -0.3 0.90 ± 6% perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 1.90 ± 2% -0.2 1.67 ± 5% perf-profile.calltrace.cycles-pp.lru_add_drain.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap 0.83 ± 2% -0.2 0.62 ± 6% perf-profile.calltrace.cycles-pp.setlocale 1.40 ± 2% -0.2 1.20 ± 2% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.__ia32_sys_exit_group 1.32 ± 2% -0.2 1.14 ± 2% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit 0.56 ± 7% -0.2 0.39 ± 57% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.do_wait.kernel_wait4.__se_sys_wait4 0.56 ± 7% -0.2 0.39 ± 57% perf-profile.calltrace.cycles-pp.schedule.do_wait.kernel_wait4.__se_sys_wait4.do_syscall_64 0.81 ± 7% -0.1 0.68 ± 5% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__se_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.46 +0.3 3.79 ± 5% perf-profile.calltrace.cycles-pp.lru_add_drain.unmap_region.__do_munmap.__se_sys_brk.do_syscall_64 3.46 +0.3 3.79 ± 5% perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.unmap_region.__do_munmap.__se_sys_brk 4.21 +0.4 4.63 perf-profile.calltrace.cycles-pp.__lru_cache_add.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault 4.19 +0.4 4.62 perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.__handle_mm_fault.handle_mm_fault.__do_page_fault 4.08 +0.4 4.51 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.__handle_mm_fault.handle_mm_fault 4.08 +0.4 4.51 perf-profile.calltrace.cycles-pp.queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.__handle_mm_fault 5.68 +0.5 6.17 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 5.67 +0.5 6.16 ± 2% perf-profile.calltrace.cycles-pp.do_execve.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 5.68 +0.5 6.17 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 5.68 +0.5 6.17 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 5.69 +0.5 6.18 ± 2% perf-profile.calltrace.cycles-pp.execve 0.00 +0.5 0.53 ± 4% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.00 +0.5 0.55 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.00 +0.6 0.55 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 0.00 +0.6 0.62 ± 4% perf-profile.calltrace.cycles-pp.write 0.00 +0.6 0.64 ± 2% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 0.00 +0.7 0.69 ± 4% perf-profile.calltrace.cycles-pp.kernel_wait4.__se_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.69 ± 5% perf-profile.calltrace.cycles-pp.__se_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.70 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.70 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.71 ± 2% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 0.00 +0.7 0.72 ± 14% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 0.00 +0.7 0.72 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 0.00 +0.7 0.73 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat 0.00 +0.7 0.73 ± 14% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 0.00 +0.8 0.76 ± 5% perf-profile.calltrace.cycles-pp.wait 0.00 +0.8 0.76 ± 2% perf-profile.calltrace.cycles-pp.creat 0.00 +0.8 0.77 ± 14% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 0.00 +0.8 0.77 ± 13% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.close 0.00 +0.8 0.80 ± 14% perf-profile.calltrace.cycles-pp.close 7.00 +0.8 7.80 ± 3% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap.__se_sys_brk 7.00 +0.8 7.81 ± 3% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__se_sys_brk.do_syscall_64 6.96 +0.8 7.77 ± 3% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap 6.82 +0.8 7.63 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.release_pages.tlb_flush_mmu.tlb_finish_mmu.unmap_region 36.51 +1.0 37.46 perf-profile.calltrace.cycles-pp.__wake_up_parent.do_syscall_64.entry_SYSCALL_64_after_hwframe 36.50 +1.0 37.46 perf-profile.calltrace.cycles-pp.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64.entry_SYSCALL_64_after_hwframe 36.50 +1.0 37.46 perf-profile.calltrace.cycles-pp.do_exit.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.16 ±173% +1.1 1.24 ± 8% perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 34.96 +1.1 36.06 perf-profile.calltrace.cycles-pp.mmput.do_exit.__ia32_sys_exit_group.__wake_up_parent.do_syscall_64 34.94 +1.1 36.04 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.__ia32_sys_exit_group.__wake_up_parent 27.71 +1.2 28.90 ± 2% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.__ia32_sys_exit_group 27.70 +1.2 28.89 ± 2% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit 0.33 ±103% +1.2 1.57 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test 0.33 ±103% +1.2 1.57 ± 8% perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test 0.33 ±103% +1.2 1.57 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test 0.54 ± 64% +1.4 1.92 ± 9% perf-profile.calltrace.cycles-pp.__libc_fork.fork_test 10.54 +1.4 11.96 perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.74 ± 29% +1.5 2.19 ± 9% perf-profile.calltrace.cycles-pp.fork_test 36.05 +1.6 37.63 perf-profile.calltrace.cycles-pp.queued_spin_lock_slowpath._raw_spin_lock_irqsave.release_pages.tlb_flush_mmu.tlb_finish_mmu 1.27 ± 24% +2.4 3.66 ± 7% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.page_fault.page_test 1.27 ± 24% +2.4 3.69 ± 7% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.page_fault.page_test 1.31 ± 24% +2.4 3.76 ± 7% perf-profile.calltrace.cycles-pp.__do_page_fault.page_fault.page_test 1.32 ± 24% +2.5 3.79 ± 7% perf-profile.calltrace.cycles-pp.page_fault.page_test 1.36 ± 24% +2.5 3.87 ± 7% perf-profile.calltrace.cycles-pp.page_test 2.21 ± 32% +3.5 5.69 ± 18% perf-profile.calltrace.cycles-pp.sieve 3.39 ± 24% +6.7 10.11 ± 8% perf-profile.calltrace.cycles-pp.__do_munmap.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 3.58 ± 23% +6.9 10.48 ± 7% perf-profile.calltrace.cycles-pp.__se_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 3.60 ± 23% +6.9 10.50 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk 3.60 ± 23% +6.9 10.50 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 3.63 ± 23% +7.0 10.59 ± 7% perf-profile.calltrace.cycles-pp.brk 78.36 -2.0 76.33 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 78.28 -2.0 76.27 perf-profile.children.cycles-pp.do_syscall_64 9.82 -1.6 8.23 ± 4% perf-profile.children.cycles-pp.__x64_sys_execve 9.79 -1.6 8.21 ± 4% perf-profile.children.cycles-pp.__do_execve_file 9.79 -1.6 8.21 ± 4% perf-profile.children.cycles-pp.do_execve 8.87 -1.4 7.51 ± 4% perf-profile.children.cycles-pp.search_binary_handler 8.86 -1.4 7.50 ± 4% perf-profile.children.cycles-pp.load_elf_binary 5.80 ± 2% -0.9 4.95 ± 4% perf-profile.children.cycles-pp.flush_old_exec 4.92 ± 2% -0.6 4.28 ± 4% perf-profile.children.cycles-pp.vm_mmap_pgoff 4.88 ± 2% -0.6 4.24 ± 4% perf-profile.children.cycles-pp.do_mmap 3.60 ± 8% -0.6 2.97 ± 5% perf-profile.children.cycles-pp.apic_timer_interrupt 3.31 ± 9% -0.6 2.69 ± 6% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 4.73 ± 2% -0.6 4.13 ± 4% perf-profile.children.cycles-pp.mmap_region 4.71 ± 2% -0.6 4.12 ± 4% perf-profile.children.cycles-pp.ksys_mmap_pgoff 18.98 -0.5 18.43 ± 2% perf-profile.children.cycles-pp.lru_add_drain 1.31 ± 41% -0.5 0.79 ± 7% perf-profile.children.cycles-pp.__softirqentry_text_start 3.69 ± 2% -0.5 3.18 ± 4% perf-profile.children.cycles-pp._do_fork 13.72 -0.5 13.23 perf-profile.children.cycles-pp.page_fault 13.33 -0.4 12.88 perf-profile.children.cycles-pp.__do_page_fault 4.21 -0.4 3.79 ± 4% perf-profile.children.cycles-pp.__vm_munmap 2.94 ± 3% -0.4 2.52 ± 4% perf-profile.children.cycles-pp.copy_process 1.48 ± 27% -0.4 1.07 ± 7% perf-profile.children.cycles-pp.ret_from_fork 1.22 ± 32% -0.4 0.83 ± 9% perf-profile.children.cycles-pp.kthread 1.09 ± 29% -0.4 0.73 ± 7% perf-profile.children.cycles-pp.irq_exit 2.29 ± 5% -0.3 1.97 ± 3% perf-profile.children.cycles-pp.dup_mm 2.25 -0.3 1.94 ± 4% perf-profile.children.cycles-pp.elf_map 1.89 -0.3 1.58 ± 2% perf-profile.children.cycles-pp.unmap_vmas 1.77 ± 8% -0.3 1.46 ± 6% perf-profile.children.cycles-pp.do_sys_open 12.60 -0.3 12.30 perf-profile.children.cycles-pp.handle_mm_fault 1.61 ± 10% -0.3 1.32 ± 5% perf-profile.children.cycles-pp.do_filp_open 1.79 -0.3 1.50 ± 2% perf-profile.children.cycles-pp.unmap_page_range 1.58 ± 10% -0.3 1.29 ± 6% perf-profile.children.cycles-pp.path_openat 12.36 -0.3 12.08 perf-profile.children.cycles-pp.__handle_mm_fault 1.37 ± 16% -0.3 1.10 ± 18% perf-profile.children.cycles-pp.ksys_write 0.66 ± 36% -0.3 0.40 ± 57% perf-profile.children.cycles-pp.cmd_record 0.64 ± 37% -0.3 0.39 ± 57% perf-profile.children.cycles-pp.record__mmap_read_evlist 1.32 ± 15% -0.3 1.07 ± 18% perf-profile.children.cycles-pp.vfs_write 0.63 ± 36% -0.2 0.38 ± 56% perf-profile.children.cycles-pp.perf_mmap__push 1.64 -0.2 1.40 ± 4% perf-profile.children.cycles-pp.filemap_map_pages 0.60 ± 36% -0.2 0.36 ± 56% perf-profile.children.cycles-pp.record__pushfn 0.58 ± 36% -0.2 0.35 ± 56% perf-profile.children.cycles-pp.__libc_write 0.55 ± 39% -0.2 0.32 ± 7% perf-profile.children.cycles-pp.smpboot_thread_fn 1.24 ± 15% -0.2 1.02 ± 18% perf-profile.children.cycles-pp.new_sync_write 1.55 ± 4% -0.2 1.34 ± 4% perf-profile.children.cycles-pp.hrtimer_interrupt 0.83 ± 25% -0.2 0.62 ± 37% perf-profile.children.cycles-pp.__strcspn_sse42 0.83 ± 25% -0.2 0.62 ± 37% perf-profile.children.cycles-pp.generic_start_main 0.83 ± 25% -0.2 0.62 ± 37% perf-profile.children.cycles-pp.main 0.83 ± 25% -0.2 0.62 ± 37% perf-profile.children.cycles-pp.run_builtin 0.83 ± 2% -0.2 0.62 ± 6% perf-profile.children.cycles-pp.setlocale 1.76 ± 3% -0.2 1.56 ± 4% perf-profile.children.cycles-pp.evict 1.09 ± 2% -0.2 0.89 ± 3% perf-profile.children.cycles-pp.__alloc_pages_nodemask 1.75 ± 3% -0.2 1.54 ± 3% perf-profile.children.cycles-pp.shmem_truncate_range 1.75 ± 3% -0.2 1.55 ± 4% perf-profile.children.cycles-pp.shmem_evict_inode 1.74 ± 3% -0.2 1.54 ± 3% perf-profile.children.cycles-pp.shmem_undo_range 0.66 ± 26% -0.2 0.47 ± 35% perf-profile.children.cycles-pp.generic_file_write_iter 1.71 ± 3% -0.2 1.52 ± 4% perf-profile.children.cycles-pp.__pagevec_release 0.64 ± 27% -0.2 0.45 ± 35% perf-profile.children.cycles-pp.__generic_file_write_iter 1.21 ± 4% -0.2 1.03 ± 4% perf-profile.children.cycles-pp.__hrtimer_run_queues 1.73 ± 3% -0.2 1.55 ± 3% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.60 ± 28% -0.2 0.43 ± 35% perf-profile.children.cycles-pp.generic_perform_write 2.20 -0.2 2.03 ± 4% perf-profile.children.cycles-pp.__x64_sys_munmap 1.46 ± 3% -0.2 1.30 ± 4% perf-profile.children.cycles-pp.dput 1.48 ± 3% -0.2 1.33 ± 4% perf-profile.children.cycles-pp.task_work_run 0.82 -0.2 0.67 ± 3% perf-profile.children.cycles-pp.copy_page_range 0.93 ± 2% -0.1 0.79 ± 3% perf-profile.children.cycles-pp.select_task_rq_fair 1.44 ± 5% -0.1 1.29 ± 4% perf-profile.children.cycles-pp.do_wait 0.74 ± 2% -0.1 0.59 ± 3% perf-profile.children.cycles-pp.alloc_pages_vma 1.46 ± 5% -0.1 1.31 ± 4% perf-profile.children.cycles-pp.__se_sys_wait4 1.46 ± 5% -0.1 1.31 ± 4% perf-profile.children.cycles-pp.kernel_wait4 0.80 ± 2% -0.1 0.66 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist 0.27 ± 60% -0.1 0.13 ± 9% perf-profile.children.cycles-pp.d_alloc_parallel 1.41 ± 3% -0.1 1.27 ± 4% perf-profile.children.cycles-pp.__fput 1.33 ± 3% -0.1 1.19 ± 5% perf-profile.children.cycles-pp.dentry_kill 1.32 ± 3% -0.1 1.19 ± 4% perf-profile.children.cycles-pp.__dentry_kill 0.58 -0.1 0.46 ± 6% perf-profile.children.cycles-pp.walk_component 0.71 ± 3% -0.1 0.59 ± 5% perf-profile.children.cycles-pp.tick_sched_timer 0.74 ± 4% -0.1 0.62 perf-profile.children.cycles-pp.source_load 0.52 ± 2% -0.1 0.40 ± 6% perf-profile.children.cycles-pp.filename_lookup 0.72 ± 2% -0.1 0.60 ± 2% perf-profile.children.cycles-pp.do_unlinkat 0.45 ± 25% -0.1 0.34 ± 33% perf-profile.children.cycles-pp.shmem_getpage 0.26 ± 43% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.__d_lookup_rcu 0.51 ± 4% -0.1 0.40 ± 6% perf-profile.children.cycles-pp.perf_event_mmap 0.45 ± 27% -0.1 0.34 ± 33% perf-profile.children.cycles-pp.shmem_getpage_gfp 0.49 ± 2% -0.1 0.39 ± 6% perf-profile.children.cycles-pp.link_path_walk 0.49 ± 3% -0.1 0.38 ± 6% perf-profile.children.cycles-pp.path_lookupat 0.47 ± 3% -0.1 0.37 ± 3% perf-profile.children.cycles-pp.__perf_sw_event 0.61 ± 2% -0.1 0.51 ± 4% perf-profile.children.cycles-pp.update_process_times 0.41 ± 2% -0.1 0.32 ± 3% perf-profile.children.cycles-pp.___perf_sw_event 0.61 -0.1 0.53 ± 4% perf-profile.children.cycles-pp.alloc_set_pte 0.39 -0.1 0.30 ± 6% perf-profile.children.cycles-pp.copy_strings 0.46 ± 15% -0.1 0.38 ± 8% perf-profile.children.cycles-pp.__x64_sys_mprotect 0.38 ± 2% -0.1 0.29 ± 7% perf-profile.children.cycles-pp.wait4 0.46 ± 14% -0.1 0.37 ± 8% perf-profile.children.cycles-pp.do_mprotect_pkey 0.46 -0.1 0.38 ± 2% perf-profile.children.cycles-pp.kmem_cache_alloc 0.49 ± 5% -0.1 0.41 ± 5% perf-profile.children.cycles-pp.do_brk_flags 0.82 ± 3% -0.1 0.74 ± 2% perf-profile.children.cycles-pp.__lock_text_start 0.70 ± 3% -0.1 0.62 ± 3% perf-profile.children.cycles-pp.wake_up_new_task 0.33 ± 2% -0.1 0.25 ± 7% perf-profile.children.cycles-pp.__clear_user 0.32 ± 2% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.padzero 0.30 ± 2% -0.1 0.22 ± 4% perf-profile.children.cycles-pp.sched_exec 0.35 ± 2% -0.1 0.28 ± 6% perf-profile.children.cycles-pp.mmap64 0.25 -0.1 0.18 ± 6% perf-profile.children.cycles-pp.__se_sys_newstat 0.66 ± 3% -0.1 0.59 ± 4% perf-profile.children.cycles-pp.anon_vma_fork 0.29 ± 2% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.__x64_sys_sync 0.29 ± 2% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.ksys_sync 0.29 ± 2% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.sync 0.30 ± 5% -0.1 0.23 ± 7% perf-profile.children.cycles-pp.do_faccessat 0.46 -0.1 0.39 ± 4% perf-profile.children.cycles-pp.page_remove_rmap 0.38 ± 3% -0.1 0.32 ± 3% perf-profile.children.cycles-pp.scheduler_tick 0.30 ± 4% -0.1 0.23 ± 3% perf-profile.children.cycles-pp.find_vma 0.33 ± 4% -0.1 0.27 ± 4% perf-profile.children.cycles-pp.kmem_cache_free 0.29 -0.1 0.22 ± 6% perf-profile.children.cycles-pp.vfs_statx 0.27 ± 4% -0.1 0.20 ± 7% perf-profile.children.cycles-pp.iterate_supers 0.28 ± 2% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.lookup_fast 0.31 ± 5% -0.1 0.26 ± 5% perf-profile.children.cycles-pp.perf_iterate_sb 0.42 ± 2% -0.1 0.36 ± 3% perf-profile.children.cycles-pp.target_load 0.25 ± 5% -0.1 0.20 ± 4% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.28 ± 3% -0.1 0.23 ± 3% perf-profile.children.cycles-pp._cond_resched 0.27 ± 6% -0.1 0.22 ± 7% perf-profile.children.cycles-pp.lookup_slow 0.22 ± 7% -0.1 0.16 ± 9% perf-profile.children.cycles-pp.__lookup_slow 0.28 ± 5% -0.1 0.23 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64 0.28 ± 3% -0.1 0.23 ± 5% perf-profile.children.cycles-pp.pte_alloc_one 0.33 ± 3% -0.0 0.28 ± 5% perf-profile.children.cycles-pp.free_pages_and_swap_cache 0.30 ± 2% -0.0 0.25 ± 4% perf-profile.children.cycles-pp.prep_new_page 0.21 ± 10% -0.0 0.16 ± 10% perf-profile.children.cycles-pp.wake_up_page_bit 0.21 ± 3% -0.0 0.16 ± 9% perf-profile.children.cycles-pp.__get_user_pages 0.20 ± 2% -0.0 0.15 ± 7% perf-profile.children.cycles-pp.get_user_pages_remote 0.21 ± 2% -0.0 0.16 ± 2% perf-profile.children.cycles-pp.__xstat64 0.50 ± 2% -0.0 0.45 ± 4% perf-profile.children.cycles-pp.unlink_anon_vmas 0.25 ± 3% -0.0 0.20 ± 4% perf-profile.children.cycles-pp.flush_tlb_mm_range 0.55 ± 2% -0.0 0.51 ± 5% perf-profile.children.cycles-pp.new_sync_read 0.23 ± 3% -0.0 0.19 ± 6% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay 0.37 -0.0 0.32 ± 4% perf-profile.children.cycles-pp.___might_sleep 0.16 ± 6% -0.0 0.12 ± 5% perf-profile.children.cycles-pp.__do_fault 0.47 ± 3% -0.0 0.43 ± 3% perf-profile.children.cycles-pp.anon_vma_clone 0.18 ± 4% -0.0 0.15 ± 3% perf-profile.children.cycles-pp.task_tick_fair 0.35 ± 3% -0.0 0.31 ± 3% perf-profile.children.cycles-pp.__wake_up_common 0.15 ± 3% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.get_unmapped_area 0.22 ± 3% -0.0 0.18 ± 4% perf-profile.children.cycles-pp.__might_sleep 0.15 ± 2% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.queued_write_lock_slowpath 0.31 ± 2% -0.0 0.27 ± 5% perf-profile.children.cycles-pp._raw_spin_lock 0.15 ± 2% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.do_writepages 0.23 ± 2% -0.0 0.19 ± 6% perf-profile.children.cycles-pp.page_add_file_rmap 0.20 ± 3% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.rebalance_domains 0.20 ± 4% -0.0 0.16 ± 4% perf-profile.children.cycles-pp.__pte_alloc 0.15 ± 3% -0.0 0.12 ± 5% perf-profile.children.cycles-pp.btrfs_sync_fs 0.15 ± 2% -0.0 0.12 ± 9% perf-profile.children.cycles-pp.__filemap_fdatawrite_range 0.06 -0.0 0.03 ±100% perf-profile.children.cycles-pp.path_parentat 0.06 -0.0 0.03 ±100% perf-profile.children.cycles-pp.perf_exclude_event 0.18 ± 4% -0.0 0.15 ± 5% perf-profile.children.cycles-pp._dl_addr 0.28 ± 3% -0.0 0.25 ± 4% perf-profile.children.cycles-pp.cpumask_next_and 0.22 ± 4% -0.0 0.18 ± 4% perf-profile.children.cycles-pp.vma_merge 0.15 ± 4% -0.0 0.12 ± 7% perf-profile.children.cycles-pp.__rb_insert_augmented 0.14 ± 3% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.__percpu_counter_compare 0.14 ± 3% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.btree_writepages 0.25 ± 3% -0.0 0.22 ± 3% perf-profile.children.cycles-pp.sock_write_iter 0.25 -0.0 0.21 ± 4% perf-profile.children.cycles-pp.sock_sendmsg 0.23 -0.0 0.20 ± 2% perf-profile.children.cycles-pp.wait_consider_task 0.23 ± 2% -0.0 0.19 ± 7% perf-profile.children.cycles-pp.schedule_idle 0.18 ± 2% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.cpumask_next 0.12 ± 14% -0.0 0.09 ± 27% perf-profile.children.cycles-pp.mark_page_accessed 0.15 ± 4% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.vmacache_find 0.13 ± 3% -0.0 0.10 ± 5% perf-profile.children.cycles-pp.do_open_execat 0.13 ± 5% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.filemap_fault 0.23 ± 2% -0.0 0.20 ± 4% perf-profile.children.cycles-pp.clear_page_erms 0.17 ± 2% -0.0 0.14 ± 5% perf-profile.children.cycles-pp.getname_flags 0.14 ± 5% -0.0 0.11 ± 3% perf-profile.children.cycles-pp.queued_read_lock_slowpath 0.14 ± 3% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.__percpu_counter_sum 0.24 ± 5% -0.0 0.21 ± 3% perf-profile.children.cycles-pp.find_next_and_bit 0.21 ± 2% -0.0 0.18 ± 6% perf-profile.children.cycles-pp.finish_task_switch 0.20 ± 4% -0.0 0.17 ± 3% perf-profile.children.cycles-pp.mem_cgroup_commit_charge 0.16 ± 5% -0.0 0.13 ± 6% perf-profile.children.cycles-pp.__tlb_remove_page_size 0.13 ± 3% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.14 ± 3% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.mem_cgroup_try_charge 0.12 ± 7% -0.0 0.09 ± 9% perf-profile.children.cycles-pp.strnlen_user 0.11 ± 3% -0.0 0.08 ± 13% perf-profile.children.cycles-pp.setup_arg_pages 0.24 ± 3% -0.0 0.21 ± 3% perf-profile.children.cycles-pp.__put_user_4 0.18 ± 2% -0.0 0.15 ± 7% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.14 ± 3% -0.0 0.11 ± 4% perf-profile.children.cycles-pp._vm_normal_page 0.23 ± 2% -0.0 0.21 ± 2% perf-profile.children.cycles-pp.schedule_tail 0.24 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.do_signal 0.19 ± 6% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.__get_free_pages 0.18 ± 2% -0.0 0.16 ± 2% perf-profile.children.cycles-pp.release_task 0.17 ± 2% -0.0 0.14 ± 5% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.17 ± 3% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.find_next_bit 0.16 ± 5% -0.0 0.13 ± 5% perf-profile.children.cycles-pp.ptep_clear_flush 0.13 -0.0 0.10 ± 4% perf-profile.children.cycles-pp.terminate_walk 0.13 ± 3% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.free_unref_page_list 0.12 ± 3% -0.0 0.09 ± 11% perf-profile.children.cycles-pp.copy_strings_kernel 0.11 -0.0 0.08 ± 5% perf-profile.children.cycles-pp.path_put 0.07 ± 7% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__call_rcu 0.14 ± 7% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.__slab_free 0.09 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.page_add_new_anon_rmap 0.16 ± 2% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.ip_finish_output2 0.11 ± 7% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.activate_task 0.09 ± 8% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.__lock_page_killable 0.06 ± 6% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.perf_swevent_event 0.14 ± 5% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.__tcp_transmit_skb 0.14 ± 7% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.copy_page 0.11 ± 7% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.flush_tlb_func_common 0.10 -0.0 0.08 ± 5% perf-profile.children.cycles-pp.mm_init 0.10 ± 8% -0.0 0.08 perf-profile.children.cycles-pp.enqueue_task_fair 0.09 ± 4% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.update_curr 0.08 ± 5% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.d_path 0.08 ± 6% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.open_exec 0.17 ± 2% -0.0 0.15 ± 6% perf-profile.children.cycles-pp.remove_vma 0.17 ± 2% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.iterate_dir 0.16 -0.0 0.14 ± 6% perf-profile.children.cycles-pp.dcache_readdir 0.12 ± 3% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.inode_permission 0.12 ± 4% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.do_notify_parent 0.11 ± 4% -0.0 0.09 ± 8% perf-profile.children.cycles-pp.sync_regs 0.11 ± 6% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.perf_event_mmap_output 0.09 ± 7% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.io_schedule 0.06 -0.0 0.04 ± 57% perf-profile.children.cycles-pp.kfree 0.06 -0.0 0.04 ± 57% perf-profile.children.cycles-pp.cpumask_any_but 0.06 -0.0 0.04 ± 57% perf-profile.children.cycles-pp.bad_range 0.18 ± 2% -0.0 0.15 ± 7% perf-profile.children.cycles-pp.lock_page_memcg 0.14 ± 3% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.anon_vma_interval_tree_remove 0.14 ± 5% -0.0 0.12 perf-profile.children.cycles-pp.vm_area_dup 0.14 ± 6% -0.0 0.12 ± 9% perf-profile.children.cycles-pp.ktime_get 0.08 ± 6% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.path_init 0.11 ± 4% -0.0 0.09 ± 9% perf-profile.children.cycles-pp.xas_load 0.08 ± 8% -0.0 0.06 ± 11% perf-profile.children.cycles-pp._IO_file_open 0.08 -0.0 0.06 perf-profile.children.cycles-pp.switch_mm_irqs_off 0.12 ± 4% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.tcp_sendmsg 0.12 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.rcu_all_qs 0.12 -0.0 0.10 ± 7% perf-profile.children.cycles-pp.vma_interval_tree_remove 0.09 ± 4% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.unlazy_walk 0.09 ± 4% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.simple_lookup 0.09 -0.0 0.07 perf-profile.children.cycles-pp.vma_gap_update 0.13 -0.0 0.11 ± 3% perf-profile.children.cycles-pp.__local_bh_enable_ip 0.08 ± 6% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__fxstat64 0.08 ± 10% -0.0 0.06 perf-profile.children.cycles-pp.__update_load_avg_se 0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.up_write 0.10 ± 5% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.tcp_write_xmit 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.unlock_page 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.shift_arg_pages 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.d_add 0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.ttwu_do_activate 0.07 -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__anon_vma_prepare 0.11 ± 4% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.update_blocked_averages 0.11 ± 4% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.tcp_sendmsg_locked 0.12 -0.0 0.10 ± 4% perf-profile.children.cycles-pp.do_softirq 0.12 ± 3% -0.0 0.10 perf-profile.children.cycles-pp.do_softirq_own_stack 0.09 -0.0 0.07 ± 5% perf-profile.children.cycles-pp.alloc_empty_file 0.09 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list 0.09 -0.0 0.07 ± 11% perf-profile.children.cycles-pp.pgd_alloc 0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.time 0.23 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.anon_vma_interval_tree_insert 0.14 ± 3% -0.0 0.13 ± 3% perf-profile.children.cycles-pp.__might_fault 0.10 -0.0 0.08 ± 5% perf-profile.children.cycles-pp.process_backlog 0.07 ± 5% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.11 -0.0 0.10 ± 5% perf-profile.children.cycles-pp.net_rx_action 0.11 ± 4% -0.0 0.09 ± 4% perf-profile.children.cycles-pp._copy_to_user 0.10 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__tcp_push_pending_frames 0.10 ± 5% -0.0 0.08 perf-profile.children.cycles-pp.__netif_receive_skb_one_core 0.09 ± 5% -0.0 0.07 perf-profile.children.cycles-pp.free_pgd_range 0.08 -0.0 0.07 ± 7% perf-profile.children.cycles-pp.__se_sys_close 0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.rcu_irq_enter 0.08 -0.0 0.07 ± 7% perf-profile.children.cycles-pp.strncpy_from_user 0.07 ± 12% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.08 ± 5% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.vma_compute_subtree_gap 0.07 ± 6% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__alloc_file 0.11 ± 4% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.__vm_enough_memory 0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.__vma_link_rb 0.07 -0.0 0.06 ± 7% perf-profile.children.cycles-pp.copy_fpstate_to_sigframe 0.07 ± 5% -0.0 0.06 perf-profile.children.cycles-pp._copy_from_user 0.08 ± 6% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate 0.07 -0.0 0.06 ± 7% perf-profile.children.cycles-pp.decay_load 0.09 ± 5% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.08 -0.0 0.07 ± 6% perf-profile.children.cycles-pp.get_signal 0.07 -0.0 0.06 perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.03 ±100% +0.0 0.06 perf-profile.children.cycles-pp._exit 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__lxstat64 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.link 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.sighandler 0.01 ±173% +0.1 0.10 ± 10% perf-profile.children.cycles-pp.__waitpid 0.11 ± 28% +0.1 0.23 ± 9% perf-profile.children.cycles-pp.munmap 0.11 ± 23% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.kill 0.18 ± 20% +0.2 0.41 ± 4% perf-profile.children.cycles-pp.read 0.10 ± 28% +0.2 0.35 ± 14% perf-profile.children.cycles-pp.unlink 0.27 ± 22% +0.4 0.64 ± 4% perf-profile.children.cycles-pp.write 0.28 ± 33% +0.5 0.76 ± 5% perf-profile.children.cycles-pp.wait 0.29 ± 36% +0.5 0.78 ± 2% perf-profile.children.cycles-pp.creat 5.69 +0.5 6.18 ± 2% perf-profile.children.cycles-pp.execve 7.81 +0.5 8.33 ± 2% perf-profile.children.cycles-pp.__lru_cache_add 18.84 +0.5 19.38 ± 2% perf-profile.children.cycles-pp.__do_munmap 18.61 +0.6 19.20 ± 2% perf-profile.children.cycles-pp.unmap_region 0.23 ± 31% +0.6 0.81 ± 13% perf-profile.children.cycles-pp.close 36.54 +1.0 37.51 perf-profile.children.cycles-pp.__ia32_sys_exit_group 36.54 +1.0 37.51 perf-profile.children.cycles-pp.do_exit 36.55 +1.0 37.52 perf-profile.children.cycles-pp.__wake_up_parent 1.37 ± 13% +1.1 2.48 ± 6% perf-profile.children.cycles-pp.__libc_fork 11.18 +1.3 12.49 perf-profile.children.cycles-pp.__se_sys_brk 0.74 ± 29% +1.5 2.20 ± 9% perf-profile.children.cycles-pp.fork_test 39.50 +1.6 41.11 perf-profile.children.cycles-pp.release_pages 37.92 +1.8 39.67 perf-profile.children.cycles-pp.tlb_finish_mmu 37.89 +1.8 39.64 perf-profile.children.cycles-pp.tlb_flush_mmu 64.47 +1.8 66.28 perf-profile.children.cycles-pp.queued_spin_lock_slowpath 63.94 +2.0 65.91 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.37 ± 24% +2.5 3.90 ± 7% perf-profile.children.cycles-pp.page_test 2.22 ± 32% +3.5 5.70 ± 18% perf-profile.children.cycles-pp.sieve 3.64 ± 23% +7.0 10.59 ± 7% perf-profile.children.cycles-pp.brk 1.48 -0.2 1.29 ± 4% perf-profile.self.cycles-pp.find_busiest_group 0.92 ± 2% -0.2 0.76 ± 2% perf-profile.self.cycles-pp.unmap_page_range 0.73 ± 4% -0.1 0.61 ± 2% perf-profile.self.cycles-pp.source_load 0.81 -0.1 0.69 ± 5% perf-profile.self.cycles-pp.filemap_map_pages 0.24 ± 43% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.__d_lookup_rcu 0.46 -0.1 0.37 ± 2% perf-profile.self.cycles-pp.copy_page_range 0.56 ± 2% -0.1 0.46 ± 3% perf-profile.self.cycles-pp.__handle_mm_fault 0.39 ± 3% -0.1 0.32 ± 3% perf-profile.self.cycles-pp.get_page_from_freelist 0.61 -0.1 0.54 ± 3% perf-profile.self.cycles-pp.release_pages 0.29 ± 5% -0.1 0.22 ± 3% perf-profile.self.cycles-pp.___perf_sw_event 0.33 ± 3% -0.1 0.27 ± 4% perf-profile.self.cycles-pp.select_task_rq_fair 0.27 ± 5% -0.1 0.21 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64 0.36 ± 2% -0.1 0.30 ± 4% perf-profile.self.cycles-pp.page_remove_rmap 0.30 -0.1 0.24 ± 2% perf-profile.self.cycles-pp.kmem_cache_alloc 0.26 ± 4% -0.1 0.20 ± 4% perf-profile.self.cycles-pp.__do_page_fault 0.41 ± 2% -0.1 0.36 ± 3% perf-profile.self.cycles-pp.target_load 0.23 ± 2% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.free_pages_and_swap_cache 0.24 ± 5% -0.0 0.19 ± 4% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.22 ± 3% -0.0 0.18 ± 6% perf-profile.self.cycles-pp.__alloc_pages_nodemask 0.35 -0.0 0.31 ± 4% perf-profile.self.cycles-pp.___might_sleep 0.25 -0.0 0.22 ± 3% perf-profile.self.cycles-pp.alloc_set_pte 0.19 ± 5% -0.0 0.16 ± 8% perf-profile.self.cycles-pp.smp_apic_timer_interrupt 0.17 ± 4% -0.0 0.14 ± 3% perf-profile.self.cycles-pp.do_syscall_64 0.30 ± 2% -0.0 0.26 ± 5% perf-profile.self.cycles-pp._raw_spin_lock 0.20 ± 2% -0.0 0.16 ± 6% perf-profile.self.cycles-pp.__might_sleep 0.23 -0.0 0.20 ± 4% perf-profile.self.cycles-pp.clear_page_erms 0.17 ± 4% -0.0 0.14 ± 7% perf-profile.self.cycles-pp._dl_addr 0.16 ± 4% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.find_next_bit 0.21 ± 5% -0.0 0.18 ± 7% perf-profile.self.cycles-pp.idle_cpu 0.23 ± 5% -0.0 0.20 ± 4% perf-profile.self.cycles-pp.find_next_and_bit 0.18 ± 2% -0.0 0.15 ± 7% perf-profile.self.cycles-pp.kmem_cache_free 0.14 ± 10% -0.0 0.11 ± 3% perf-profile.self.cycles-pp.__slab_free 0.14 ± 6% -0.0 0.11 ± 9% perf-profile.self.cycles-pp.__rb_insert_augmented 0.13 ± 5% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.find_vma 0.12 ± 3% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.12 ± 4% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.perf_iterate_sb 0.14 ± 11% -0.0 0.12 ± 5% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.14 ± 5% -0.0 0.12 ± 3% perf-profile.self.cycles-pp.vmacache_find 0.14 ± 6% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.copy_page 0.09 ± 5% -0.0 0.06 ± 13% perf-profile.self.cycles-pp.strnlen_user 0.08 ± 5% -0.0 0.06 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.16 ± 2% -0.0 0.14 ± 8% perf-profile.self.cycles-pp.lock_page_memcg 0.12 -0.0 0.10 ± 4% perf-profile.self.cycles-pp.vma_interval_tree_remove 0.06 -0.0 0.04 ± 57% perf-profile.self.cycles-pp.kfree 0.23 ± 2% -0.0 0.20 ± 2% perf-profile.self.cycles-pp.anon_vma_interval_tree_insert 0.10 ± 4% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.__percpu_counter_sum 0.10 ± 5% -0.0 0.07 ± 11% perf-profile.self.cycles-pp.perf_event_mmap 0.09 ± 4% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__vma_adjust 0.12 ± 3% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.12 ± 3% -0.0 0.10 ± 4% perf-profile.self.cycles-pp._vm_normal_page 0.11 ± 3% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.sync_regs 0.10 ± 5% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.link_path_walk 0.10 ± 4% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.unlink_anon_vmas 0.11 ± 4% -0.0 0.09 ± 12% perf-profile.self.cycles-pp.ktime_get 0.08 ± 6% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.vma_compute_subtree_gap 0.12 ± 4% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.anon_vma_interval_tree_remove 0.09 ± 4% -0.0 0.07 perf-profile.self.cycles-pp.__sched_text_start 0.11 ± 3% -0.0 0.10 ± 5% perf-profile.self.cycles-pp.wp_page_copy 0.11 ± 6% -0.0 0.09 ± 4% perf-profile.self.cycles-pp.rcu_all_qs 0.08 ± 5% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.inode_permission 0.07 -0.0 0.06 ± 9% perf-profile.self.cycles-pp.update_curr 0.07 -0.0 0.06 ± 9% perf-profile.self.cycles-pp.decay_load 0.11 ± 4% -0.0 0.09 ± 7% perf-profile.self.cycles-pp._cond_resched 0.08 -0.0 0.07 ± 7% perf-profile.self.cycles-pp.mark_page_accessed 0.07 ± 7% -0.0 0.05 perf-profile.self.cycles-pp.switch_mm_irqs_off 0.07 -0.0 0.06 ± 7% perf-profile.self.cycles-pp.queued_write_lock_slowpath 0.07 ± 7% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.copy_user_generic_unrolled 0.09 -0.0 0.08 ± 5% perf-profile.self.cycles-pp.path_openat 0.07 -0.0 0.06 perf-profile.self.cycles-pp.mem_cgroup_charge_statistics 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.page_test 64.46 +1.8 66.28 perf-profile.self.cycles-pp.queued_spin_lock_slowpath 2.18 ± 32% +3.4 5.61 ± 18% perf-profile.self.cycles-pp.sieve Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

2 years, 6 months

1
0
0 / 0

[drm/bochs] a3232987fd: WARNING:at_drivers/gpu/drm/ttm/ttm_bo.c:#ttm_bo_validate[ttm]

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: a3232987fdbf0bede92a9d7c7e2db99a5084d31b ("drm/bochs: Convert bochs driver to |struct drm_gem_vram_object|") git://anongit.freedesktop.org/drm/drm-misc drm-misc-next in testcase: trinity with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------------------------------+------------+------------+ | | 3f87330e50 | a3232987fd | +-----------------------------------------------------------------------------+------------+------------+ | boot_successes | 16 | 0 | | boot_failures | 0 | 16 | | WARNING:at_drivers/gpu/drm/ttm/ttm_bo.c:#ttm_bo_validate[ttm] | 0 | 16 | | RIP:ttm_bo_validate[ttm] | 0 | 16 | | WARNING:at_drivers/dma-buf/reservation.c:#reservation_object_reserve_shared | 0 | 16 | | RIP:reservation_object_reserve_shared | 0 | 16 | | WARNING:suspicious_RCU_usage | 0 | 16 | | include/linux/reservation.h:#suspicious_rcu_dereference_protected()usage | 0 | 16 | | WARNING:at_drivers/dma-buf/reservation.c:#reservation_object_add_excl_fence | 0 | 16 | | RIP:reservation_object_add_excl_fence | 0 | 16 | +-----------------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 10.171773] WARNING: CPU: 0 PID: 403 at drivers/gpu/drm/ttm/ttm_bo.c:1161 ttm_bo_validate+0x41/0x141 [ttm] [ 10.173555] Modules linked in: parport_pc parport bochs_drm(+) drm_vram_helper ttm drm_kms_helper drm drm_panel_orientation_quirks fb_sys_fops psmouse button syscopyarea sysfillrect sysimgblt cfbfillrect virtio_pci(+) cfbimgblt cfbcopyarea i2c_piix4 fb fbdev i2c_core [ 10.177221] CPU: 0 PID: 403 Comm: modprobe Tainted: G T 5.1.0-rc5-01639-ga3232987 #23 [ 10.178618] RIP: 0010:ttm_bo_validate+0x41/0x141 [ttm] [ 10.179421] Code: 00 00 00 48 89 44 24 70 31 c0 83 3d 8e 52 5b e2 00 74 19 48 8b 87 00 02 00 00 83 ce ff 48 8d 78 70 e8 2e f9 f8 e0 85 c0 75 02 <0f> 0b 48 8d 73 30 4c 89 e7 48 8d 54 24 0c e8 25 e4 ff ff 84 c0 0f [ 10.182267] RSP: 0018:ffffc9000077f928 EFLAGS: 00010246 [ 10.183125] RAX: 0000000000000000 RBX: ffff88807dad5a38 RCX: 0000000000000000 [ 10.184211] RDX: 0000000000000246 RSI: ffff88807dad5cb0 RDI: ffff88807e4c6538 [ 10.185299] RBP: ffffc9000077f9c0 R08: 00000000c5611196 R09: 0000000000000006 [ 10.186399] R10: 0000000000000000 R11: ffff88807dae2838 R12: ffff88807dad5df8 [ 10.187492] R13: 0000000000000300 R14: 0000000000000400 R15: 0000000034325258 [ 10.188618] FS: 00007fca184c6700(0000) GS:ffff888077a00000(0000) knlGS:0000000000000000 [ 10.189901] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 10.190811] CR2: 00007ffd685c2000 CR3: 000000007e73a000 CR4: 00000000000406f0 [ 10.191945] Call Trace: [ 10.192365] ? kvm_sched_clock_read+0x5/0xd [ 10.193035] ? get_lock_stats+0x11/0x3f [ 10.193674] drm_gem_vram_pin+0x77/0xa2 [drm_vram_helper] [ 10.194550] drm_gem_vram_driver_gem_prime_vmap+0xe/0x39 [drm_vram_helper] [ 10.195671] drm_gem_vmap+0x36/0x43 [drm] [ 10.196347] drm_client_framebuffer_create+0xc6/0x1ca [drm] [ 10.197290] drm_fb_helper_generic_probe+0x4c/0x157 [drm_kms_helper] [ 10.198327] __drm_fb_helper_initial_config_and_unlock+0x307/0x442 [drm_kms_helper] [ 10.199549] drm_fbdev_client_hotplug+0xc8/0x115 [drm_kms_helper] [ 10.200546] drm_fbdev_generic_setup+0xc4/0xf1 [drm_kms_helper] [ 10.201464] bochs_pci_probe+0x123/0x143 [bochs_drm] [ 10.202218] local_pci_probe+0x34/0x75 [ 10.202810] pci_device_probe+0xf8/0x150 [ 10.203432] really_probe+0x199/0x360 [ 10.204015] driver_probe_device+0xcf/0xff [ 10.204660] device_driver_attach+0x38/0x4f [ 10.205334] __driver_attach+0x105/0x10d [ 10.205937] ? device_driver_attach+0x4f/0x4f [ 10.206647] bus_for_each_dev+0x6c/0x9e [ 10.207245] bus_add_driver+0x125/0x1d4 [ 10.207870] ? 0xffffffffa009e000 [ 10.208398] driver_register+0x94/0xc6 [ 10.208979] ? 0xffffffffa009e000 [ 10.209507] do_one_initcall+0x10e/0x297 [ 10.210085] ? rcu_read_lock_sched_held+0x58/0x5e [ 10.210771] ? kmem_cache_alloc_trace+0x21b/0x25b [ 10.211478] do_init_module+0x59/0x491 [ 10.212047] load_module+0x1178/0x138a [ 10.212642] ? __se_sys_init_module+0x103/0x13e [ 10.213318] __se_sys_init_module+0x103/0x13e [ 10.213987] do_syscall_64+0x78/0x188 [ 10.214527] entry_SYSCALL_64_after_hwframe+0x49/0xbe [ 10.215261] RIP: 0033:0x7fca17fe0bca [ 10.215794] Code: 48 8b 0d 79 32 2c 00 31 d2 48 29 c2 64 89 11 48 83 c8 ff eb ea 90 90 90 90 90 90 90 90 90 90 90 49 89 ca b8 af 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 46 32 2c 00 31 d2 48 29 c2 64 [ 10.218407] RSP: 002b:00007ffc21228fd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000af [ 10.219537] RAX: ffffffffffffffda RBX: 00000000006115d0 RCX: 00007fca17fe0bca [ 10.220605] RDX: 0000000000611700 RSI: 0000000000048620 RDI: 00007fca1847c000 [ 10.221709] RBP: 0000000000611700 R08: 00000000ffffffff R09: 0000000000000001 [ 10.222758] R10: 00007fca17fd3100 R11: 0000000000000246 R12: 000000000060f150 [ 10.223770] R13: 000000000060f1f0 R14: 0000000000000000 R15: 00000000006115e8 [ 10.224803] irq event stamp: 23288 [ 10.225321] hardirqs last enabled at (23287): [<ffffffff811ad400>] kmem_cache_alloc_trace+0x133/0x25b [ 10.226681] hardirqs last disabled at (23288): [<ffffffff81001621>] trace_hardirqs_off_thunk+0x1a/0x1c [ 10.228034] softirqs last enabled at (23228): [<ffffffff81c003cf>] __do_softirq+0x3cf/0x411 [ 10.229227] softirqs last disabled at (23215): [<ffffffff8107de91>] irq_exit+0x66/0xe1 [ 10.230358] ---[ end trace cf9927661fdd2749 ]--- To reproduce: # build kernel cd linux cp config-5.1.0-rc5-01639-ga3232987 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

2 years, 6 months

1
0
0 / 0

[drm/bochs] a3232987fd: WARNING:at_drivers/gpu/drm/ttm/ttm_bo.c:#ttm_bo_validate[ttm]

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: a3232987fdbf0bede92a9d7c7e2db99a5084d31b ("drm/bochs: Convert bochs driver to |struct drm_gem_vram_object|") git://anongit.freedesktop.org/drm/drm-misc drm-misc-next in testcase: locktorture with following parameters: runtime: 300s test: default test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors. test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------------------------------+--------+--------+ | | error: | error: | +-----------------------------------------------------------------------------+--------+--------+ | boot_successes | 16 | 0 | | boot_failures | 0 | 16 | | WARNING:at_drivers/gpu/drm/ttm/ttm_bo.c:#ttm_bo_validate[ttm] | 0 | 16 | | RIP:ttm_bo_validate[ttm] | 0 | 16 | | WARNING:at_drivers/dma-buf/reservation.c:#reservation_object_reserve_shared | 0 | 16 | | RIP:reservation_object_reserve_shared | 0 | 16 | | WARNING:suspicious_RCU_usage | 0 | 16 | | include/linux/reservation.h:#suspicious_rcu_dereference_protected()usage | 0 | 16 | | WARNING:at_drivers/dma-buf/reservation.c:#reservation_object_add_excl_fence | 0 | 16 | | RIP:reservation_object_add_excl_fence | 0 | 16 | +-----------------------------------------------------------------------------+--------+--------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 9.999183] WARNING: CPU: 1 PID: 351 at drivers/gpu/drm/ttm/ttm_bo.c:1161 ttm_bo_validate+0x41/0x141 [ttm] [ 10.000494] Modules linked in: crct10dif_pclmul(+) bochs_drm(+) crc32c_intel drm_vram_helper ttm ghash_clmulni_intel drm_kms_helper drm parport_pc drm_panel_orientation_quirks fb_sys_fops syscopyarea sysfillrect psmouse sysimgblt cfbfillrect cfbimgblt cfbcopyarea fb i2c_piix4(+) fbdev virtio_pci(+) i2c_core parport button [ 10.003662] CPU: 1 PID: 351 Comm: systemd-udevd Tainted: G T 5.1.0-rc5-01639-ga3232987 #23 [ 10.004734] RIP: 0010:ttm_bo_validate+0x41/0x141 [ttm] [ 10.005322] Code: 00 00 00 48 89 44 24 70 31 c0 83 3d 8e 92 4f e2 00 74 19 48 8b 87 00 02 00 00 83 ce ff 48 8d 78 70 e8 2e 39 ed e0 85 c0 75 02 <0f> 0b 48 8d 73 30 4c 89 e7 48 8d 54 24 0c e8 25 e4 ff ff 84 c0 0f [ 10.007416] RSP: 0018:ffffc900006d3928 EFLAGS: 00010246 [ 10.008004] RAX: 0000000000000000 RBX: ffff88807d60b238 RCX: 0000000000000000 [ 10.008805] RDX: 0000000000000246 RSI: ffff88807d60b4b0 RDI: ffff88807e9263b8 [ 10.009607] RBP: ffffc900006d39c0 R08: 00000000de9be681 R09: 0000000000000004 [ 10.010406] R10: 0000000000000000 R11: ffff88807daac838 R12: ffff88807d60b5f8 [ 10.011208] R13: 0000000000000300 R14: 0000000000000400 R15: 0000000034325258 [ 10.012007] FS: 00007f35dce728c0(0000) GS:ffff888075400000(0000) knlGS:0000000000000000 [ 10.013787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 LKP: HOSTNAME vm [ 10.015669] ? kvm_sched_clock_read+0x5/0xd [ 10.016157] ? get_lock_stats+0x11/0x3f [ 10.016607] drm_gem_vram_pin+0x77/0xa2 [drm_vram_helper] [ 10.017229] drm_gem_vram_driver_gem_prime_vmap+0xe/0x39 [drm_vram_helper] [ 10.018015] drm_gem_vmap+0x36/0x43 [drm] [ 10.018491] drm_client_framebuffer_create+0xc6/0x1ca [drm] [ 10.019143] drm_fb_helper_generic_probe+0x4c/0x157 [drm_kms_helper] [ 10.019864] __drm_fb_helper_initial_config_and_unlock+0x307/0x442 [drm_kms_helper] [ 10.020739] drm_fbdev_client_hotplug+0xc8/0x115 [drm_kms_helper] [ 10.021442] drm_fbdev_generic_setup+0xc4/0xf1 [drm_kms_helper] [ 10.022120] bochs_pci_probe+0x123/0x143 [bochs_drm] [ 10.022688] local_pci_probe+0x34/0x75 [ 10.023127] pci_device_probe+0xf8/0x150 [ 10.023585] really_probe+0x199/0x360 [ 10.024009] driver_probe_device+0xcf/0xff [ 10.024483] device_driver_attach+0x38/0x4f [ 10.024964] __driver_attach+0x105/0x10d [ 10.032000] ? device_driver_attach+0x4f/0x4f [ 10.032560] bus_for_each_dev+0x6c/0x9e [ 10.033006] bus_add_driver+0x125/0x1d4 [ 10.033454] ? 0xffffffffa024e000 [ 10.033839] driver_register+0x94/0xc6 [ 10.034279] ? 0xffffffffa024e000 [ 10.034650] do_one_initcall+0x10e/0x297 [ 10.035091] ? rcu_read_lock_sched_held+0x58/0x5e [ 10.035638] ? kmem_cache_alloc_trace+0x21b/0x25b [ 10.036184] do_init_module+0x59/0x491 [ 10.036616] load_module+0x1178/0x138a [ 10.037040] ? vfs_read+0x115/0x121 [ 10.037456] ? __se_sys_finit_module+0xaf/0xd5 [ 10.037966] __se_sys_finit_module+0xaf/0xd5 [ 10.038468] do_syscall_64+0x78/0x188 [ 10.038893] entry_SYSCALL_64_after_hwframe+0x49/0xbe [ 10.039471] RIP: 0033:0x7f35dbcef229 [ 10.039871] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 3f 4c 2b 00 f7 d8 64 89 01 48 [ 10.047091] RSP: 002b:00007ffef4fddd48 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 10.048100] RAX: ffffffffffffffda RBX: 0000561f5bb7db80 RCX: 00007f35dbcef229 [ 10.048957] RDX: 0000000000000000 RSI: 00007f35dc608265 RDI: 000000000000001d [ 10.050498] RBP: 00007f35dc608265 R08: 0000000000000000 R09: 00007ffef4fde2c0 [ 10.051303] R10: 000000000000001d R11: 0000000000000246 R12: 0000000000000000 [ 10.052106] R13: 0000561f5bb70d70 R14: 0000000000020000 R15: 0000561f5bb40cbc [ 10.052917] irq event stamp: 22742 [ 10.053315] hardirqs last enabled at (22741): [<ffffffff811ad400>] kmem_cache_alloc_trace+0x133/0x25b [ 10.054358] hardirqs last disabled at (22742): [<ffffffff81001621>] trace_hardirqs_off_thunk+0x1a/0x1c [ 10.055402] softirqs last enabled at (22728): [<ffffffff81c003cf>] __do_softirq+0x3cf/0x411 [ 10.056350] softirqs last disabled at (22721): [<ffffffff8107de91>] irq_exit+0x66/0xe1 [ 10.057251] ---[ end trace c03d531d529a8736 ]--- To reproduce: # build kernel cd linux cp config-5.1.0-rc5-01639-ga3232987 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, lkp

2 years, 6 months

1
0
0 / 0

[sched/fair] 07cf623c04: aim7.jobs-per-min 69.7% improvement

by kernel test robot

Greeting, FYI, we noticed a 69.7% improvement of aim7.jobs-per-min due to commit: commit: 07cf623c04048316ec3c273fd0cebe478f1caa65 ("sched/fair: Replace source_load() & target_load() w/ weighted_cpuload()") grep: /cephfs/kbuild/commit-list/aaron/aaron:batch_size-phas1_1: in testcase: aim7 on test machine: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory with following parameters: disk: 1BRD_48G fs: xfs test: disk_wrt load: 3000 cpufreq_governor: performance test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ In addition to that, the commit also has significant impact on the following tests: +------------------+-----------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput 98.5% improvement | | test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory | | test parameters | cpufreq_governor=performance