December 2020 - LKP - Ml01.01.Org

[locking/qspinlock] 0e8d8f4f12: stress-ng.zero.ops_per_sec -9.7% regression

by kernel test robot

Greeting, FYI, we noticed a -9.7% regression of stress-ng.zero.ops_per_sec due to commit: commit: 0e8d8f4f1214cfbac219d6917b5f6460f818bb7c ("[PATCH v13 3/6] locking/qspinlock: Introduce CNA into the slow path of qspinlock") url: https://github.com/0day-ci/linux/commits/Alex-Kogan/Add-NUMA-awareness-to... base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git cb262935a166bdef0ccfe6e2adffa00c0f2d038a in testcase: stress-ng on test machine: 48 threads Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory with following parameters: nr_threads: 100% disk: 1HDD testtime: 30s class: device cpufreq_governor: performance ucode: 0x42e In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------------------------------------+ | testcase: change | fsmark: fsmark.files_per_sec 213.9% improvement | | test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | disk=1BRD_48G | | | filesize=4M | | | fs=btrfs | | | iterations=1x | | | nr_threads=64t | | | sync_method=NoSync | | | test_size=24G | | | ucode=0x5003003 | +------------------+---------------------------------------------------------------------------+ | testcase: change | reaim: reaim.jobs_per_min 96.1% improvement | | test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | nr_task=100% | | | runtime=300s | | | test=new_fserver | | | ucode=0x5003003 | +------------------+---------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode: device/gcc-9/performance/1HDD/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/stress-ng/30s/0x42e commit: cb45bab007 ("locking/qspinlock: Refactor the qspinlock slow path") 0e8d8f4f12 ("locking/qspinlock: Introduce CNA into the slow path of qspinlock") cb45bab007ff0cfc 0e8d8f4f1214cfbac219d6917b5 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 last_state.is_incomplete_run :4 25% 1:4 dmesg.Kernel_panic-not_syncing:softlockup:hung_tasks :4 25% 1:4 dmesg.RIP:smp_call_function_many_cond :4 25% 1:4 dmesg.RIP:smp_call_function_single %stddev %change %stddev \ | \ 481980 ± 9% -12.0% 424197 ± 5% stress-ng.time.involuntary_context_switches 1.198e+08 -4.0% 1.15e+08 stress-ng.time.minor_page_faults 689.06 -4.9% 655.29 stress-ng.time.user_time 10626516 -9.7% 9598124 stress-ng.zero.ops 354216 -9.7% 319937 stress-ng.zero.ops_per_sec 12871 +19.8% 15424 ± 12% meminfo.max_used_kB 29.00 +4.6% 30.33 vmstat.cpu.id 29.66 +3.7% 30.75 ± 2% iostat.cpu.idle 8.21 -7.6% 7.59 ± 2% iostat.cpu.user 67636 ± 12% -21.3% 53263 ± 14% sched_debug.cpu.nr_switches.max 70.29 ± 16% -22.1% 54.73 ± 14% sched_debug.cpu.nr_uninterruptible.stddev 7841 ± 58% +418.8% 40676 ± 2% numa-meminfo.node0.Active 6226 ± 71% +542.5% 40001 numa-meminfo.node0.Active(anon) 15043 ± 32% +271.6% 55899 numa-meminfo.node0.Shmem 77673 ± 3% -50.0% 38874 ± 9% numa-meminfo.node1.Active 77439 ± 3% -51.0% 37925 ± 8% numa-meminfo.node1.Active(anon) 233.75 ±157% +306.0% 949.00 ± 66% numa-meminfo.node1.Active(file) 575517 ± 4% -8.8% 525050 ± 3% numa-meminfo.node1.FilePages 87936 ± 4% -53.1% 41275 ± 9% numa-meminfo.node1.Shmem 2097 ± 5% +26.8% 2660 ± 21% slabinfo.dmaengine-unmap-16.active_objs 2097 ± 5% +26.8% 2660 ± 21% slabinfo.dmaengine-unmap-16.num_objs 40336 ± 6% +102.0% 81465 ± 50% slabinfo.filp.active_objs 657.00 ± 6% +98.0% 1301 ± 49% slabinfo.filp.active_slabs 42081 ± 6% +97.9% 83296 ± 49% slabinfo.filp.num_objs 657.00 ± 6% +98.0% 1301 ± 49% slabinfo.filp.num_slabs 13106 ± 3% +12.6% 14752 ± 3% slabinfo.shmem_inode_cache.active_objs 13224 ± 3% +12.5% 14873 ± 3% slabinfo.shmem_inode_cache.num_objs 1557 ± 71% +545.2% 10045 ± 2% numa-vmstat.node0.nr_active_anon 117.50 ± 57% -97.4% 3.00 ± 47% numa-vmstat.node0.nr_mlock 3761 ± 32% +273.2% 14037 numa-vmstat.node0.nr_shmem 1557 ± 71% +545.2% 10045 ± 2% numa-vmstat.node0.nr_zone_active_anon 19391 ± 3% -50.8% 9533 ± 7% numa-vmstat.node1.nr_active_anon 58.25 ±157% +301.1% 233.67 ± 67% numa-vmstat.node1.nr_active_file 143875 ± 3% -8.7% 131291 ± 3% numa-vmstat.node1.nr_file_pages 21981 ± 4% -52.9% 10346 ± 8% numa-vmstat.node1.nr_shmem 19391 ± 3% -50.8% 9533 ± 7% numa-vmstat.node1.nr_zone_active_anon 58.25 ±157% +301.1% 233.67 ± 67% numa-vmstat.node1.nr_zone_active_file 110768 ± 3% -10.6% 99008 ± 4% softirqs.CPU0.RCU 108763 ± 3% -10.1% 97774 ± 4% softirqs.CPU1.RCU 104199 ± 3% -9.5% 94314 ± 4% softirqs.CPU12.RCU 106156 ± 5% -11.6% 93873 ± 4% softirqs.CPU13.RCU 107231 ± 4% -11.3% 95088 ± 6% softirqs.CPU14.RCU 105547 ± 5% -10.5% 94461 ± 4% softirqs.CPU15.RCU 104326 ± 5% -7.4% 96653 ± 4% softirqs.CPU22.RCU 108301 ± 3% -9.9% 97571 ± 3% softirqs.CPU25.RCU 109423 ± 3% -10.9% 97448 ± 3% softirqs.CPU26.RCU 109554 ± 4% -7.2% 101691 ± 3% softirqs.CPU31.RCU 108410 ± 4% -11.2% 96233 ± 3% softirqs.CPU37.RCU 107189 ± 4% -9.8% 96642 ± 4% softirqs.CPU38.RCU 108943 ± 4% -10.9% 97052 ± 4% softirqs.CPU39.RCU 3348 ± 37% +214.8% 10541 ± 51% softirqs.NET_RX 20942 ± 2% -6.2% 19637 ± 4% proc-vmstat.nr_active_anon 67173 ± 4% -3.7% 64699 proc-vmstat.nr_anon_pages 10595 -1.7% 10418 proc-vmstat.nr_mapped 25771 ± 2% -5.1% 24461 ± 3% proc-vmstat.nr_shmem 38683 +5.7% 40878 ± 3% proc-vmstat.nr_slab_unreclaimable 20942 ± 2% -6.2% 19637 ± 4% proc-vmstat.nr_zone_active_anon 21010 ± 11% -23.8% 16020 ± 11% proc-vmstat.numa_hint_faults 16666 ± 11% -28.6% 11904 ± 7% proc-vmstat.numa_hint_faults_local 69020 ± 3% -3.7% 66499 proc-vmstat.numa_other 21276729 -9.4% 19266740 proc-vmstat.pgactivate 45217 +4.0% 47044 proc-vmstat.pgalloc_dma32 1.065e+08 -2.8% 1.035e+08 proc-vmstat.pgalloc_normal 610.50 ± 10% +83.9% 1123 ± 28% proc-vmstat.pgdeactivate 1.209e+08 -4.1% 1.159e+08 proc-vmstat.pgfault 1.064e+08 -2.7% 1.035e+08 proc-vmstat.pgfree 5.50 ± 20% +71439.4% 3934 ±141% proc-vmstat.pgmigrate_fail 3540 ± 29% +139.9% 8494 ± 7% proc-vmstat.pgrotated 10600738 -9.5% 9598142 proc-vmstat.unevictable_pgs_mlocked 10600295 -9.5% 9598142 proc-vmstat.unevictable_pgs_munlocked 0.05 ± 97% -59.4% 0.02 ± 2% perf-sched.sch_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown] 0.03 ± 6% +29749.0% 9.03 ± 71% perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 20.46 ± 3% -8.9% 18.64 ± 4% perf-sched.sch_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.path_openat 7526 ± 15% -25.7% 5592 ± 5% perf-sched.total_wait_and_delay.max.ms 7526 ± 15% -25.7% 5592 ± 5% perf-sched.total_wait_time.max.ms 9.67 ±168% -97.6% 0.24 ± 30% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common._cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 343.12 ±139% +236.4% 1154 ± 14% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter 1.39 ±173% +26107.3% 364.94 perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 5.59 ± 6% -20.2% 4.46 ± 6% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 1770 ± 6% +26.3% 2236 ± 7% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 18.50 ± 51% +272.3% 68.88 ± 22% perf-sched.wait_and_delay.max.ms.preempt_schedule_common._cond_resched.remove_vma.__do_munmap.__vm_munmap 20.79 ± 26% +217.3% 65.97 ± 9% perf-sched.wait_and_delay.max.ms.preempt_schedule_common._cond_resched.unmap_vmas.unmap_region.__do_munmap 242.02 ± 18% -60.5% 95.68 ± 51% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 0.12 ± 32% +266.9% 0.43 ± 78% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page 1971 ±123% -99.4% 11.34 ± 10% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page 9.67 ±168% -97.6% 0.24 ± 30% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 348.74 ±136% +231.0% 1154 ± 14% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter 5.86 ± 4% +1071.7% 68.64 ± 19% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.khugepaged.kthread.ret_from_fork 38.63 ± 52% +843.9% 364.62 perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 5.57 ± 6% -20.3% 4.44 ± 6% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 1.57 ± 14% +683.9% 12.28 ±100% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page 2468 ±103% -99.5% 11.34 ± 10% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page 3.91 ± 14% -41.4% 2.29 ± 6% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_read.__x64_sys_msync.do_syscall_64 7.68 ± 17% +1121.8% 93.81 ± 13% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.khugepaged.kthread.ret_from_fork 18.50 ± 51% +272.3% 68.88 ± 22% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.remove_vma.__do_munmap.__vm_munmap 20.79 ± 26% +217.3% 65.97 ± 9% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.unmap_vmas.unmap_region.__do_munmap 242.00 ± 18% -62.5% 90.66 ± 61% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 47358339 ± 7% -10.5% 42382902 ± 2% perf-stat.i.branch-misses 19845519 ± 2% -8.5% 18156709 ± 3% perf-stat.i.cache-misses 1.72e+08 -5.7% 1.621e+08 perf-stat.i.cache-references 725.90 ± 5% -13.2% 630.12 ± 5% perf-stat.i.cpu-migrations 3.09e+09 -4.3% 2.957e+09 perf-stat.i.dTLB-stores 19570792 -6.2% 18352176 perf-stat.i.iTLB-load-misses 19871 ± 4% +9.8% 21819 ± 3% perf-stat.i.instructions-per-iTLB-miss 382.70 -3.0% 371.36 ± 2% perf-stat.i.metric.M/sec 7111839 ± 4% -11.4% 6302363 ± 2% perf-stat.i.node-load-misses 8853002 ± 4% -9.6% 8004893 perf-stat.i.node-loads 6500622 -7.9% 5986359 ± 4% perf-stat.i.node-store-misses 8596412 -6.5% 8036645 ± 3% perf-stat.i.node-stores 5.60 ± 2% -3.9% 5.38 perf-stat.overall.MPKI 0.63 ± 7% -0.1 0.57 perf-stat.overall.branch-miss-rate% 5180 ± 2% +9.2% 5659 ± 3% perf-stat.overall.cycles-between-cache-misses 1575 +4.8% 1651 ± 3% perf-stat.overall.instructions-per-iTLB-miss 44.52 -0.5 43.98 perf-stat.overall.node-load-miss-rate% 43.02 -0.4 42.61 perf-stat.overall.node-store-miss-rate% 47096030 ± 7% -11.4% 41713545 ± 3% perf-stat.ps.branch-misses 19690067 ± 2% -9.4% 17836765 ± 3% perf-stat.ps.cache-misses 1.7e+08 ± 2% -6.9% 1.582e+08 ± 2% perf-stat.ps.cache-references 1.019e+11 -1.1% 1.008e+11 perf-stat.ps.cpu-cycles 748.16 ± 5% -11.3% 663.37 ± 5% perf-stat.ps.cpu-migrations 3.052e+09 -5.5% 2.885e+09 ± 2% perf-stat.ps.dTLB-stores 19264658 -7.6% 17802646 ± 2% perf-stat.ps.iTLB-load-misses 7041022 ± 4% -12.4% 6164936 perf-stat.ps.node-load-misses 8774703 ± 4% -10.5% 7851024 perf-stat.ps.node-loads 6428583 -9.0% 5851692 ± 4% perf-stat.ps.node-store-misses 8513354 -7.5% 7878662 ± 4% perf-stat.ps.node-stores 793.75 ± 6% -16.3% 664.33 ± 12% interrupts.22:IO-APIC.22-fasteoi.ehci_hcd:usb1 10846 ± 12% -22.7% 8387 ± 8% interrupts.CPU0.CAL:Function_call_interrupts 4222 ± 14% -49.6% 2128 ± 43% interrupts.CPU1.NMI:Non-maskable_interrupts 4222 ± 14% -49.6% 2128 ± 43% interrupts.CPU1.PMI:Performance_monitoring_interrupts 3219 ± 28% -21.0% 2544 ± 29% interrupts.CPU10.NMI:Non-maskable_interrupts 3219 ± 28% -21.0% 2544 ± 29% interrupts.CPU10.PMI:Performance_monitoring_interrupts 12387 ± 8% -10.7% 11065 ± 10% interrupts.CPU10.TLB:TLB_shootdowns 3883 ± 23% -35.3% 2511 ± 43% interrupts.CPU11.NMI:Non-maskable_interrupts 3883 ± 23% -35.3% 2511 ± 43% interrupts.CPU11.PMI:Performance_monitoring_interrupts 11453 ± 37% -34.1% 7553 ± 14% interrupts.CPU12.CAL:Function_call_interrupts 2074 ±126% -77.6% 464.00 ± 9% interrupts.CPU12.RES:Rescheduling_interrupts 13347 ± 59% -45.5% 7274 ± 10% interrupts.CPU12.TLB:TLB_shootdowns 11138 ± 23% -31.3% 7657 ± 13% interrupts.CPU13.CAL:Function_call_interrupts 3399 ± 34% -29.1% 2410 ± 50% interrupts.CPU15.NMI:Non-maskable_interrupts 3399 ± 34% -29.1% 2410 ± 50% interrupts.CPU15.PMI:Performance_monitoring_interrupts 3318 ± 29% -25.3% 2479 ± 34% interrupts.CPU16.NMI:Non-maskable_interrupts 3318 ± 29% -25.3% 2479 ± 34% interrupts.CPU16.PMI:Performance_monitoring_interrupts 4574 ± 17% -58.7% 1890 ± 29% interrupts.CPU20.NMI:Non-maskable_interrupts 4574 ± 17% -58.7% 1890 ± 29% interrupts.CPU20.PMI:Performance_monitoring_interrupts 2768 ± 37% -44.7% 1531 ± 30% interrupts.CPU22.NMI:Non-maskable_interrupts 2768 ± 37% -44.7% 1531 ± 30% interrupts.CPU22.PMI:Performance_monitoring_interrupts 516.00 ± 23% -18.9% 418.33 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts 3326 ± 27% -28.2% 2387 ± 34% interrupts.CPU23.NMI:Non-maskable_interrupts 3326 ± 27% -28.2% 2387 ± 34% interrupts.CPU23.PMI:Performance_monitoring_interrupts 3850 ± 20% -39.2% 2340 ± 50% interrupts.CPU25.NMI:Non-maskable_interrupts 3850 ± 20% -39.2% 2340 ± 50% interrupts.CPU25.PMI:Performance_monitoring_interrupts 859.25 ± 48% -46.0% 464.33 ± 5% interrupts.CPU25.RES:Rescheduling_interrupts 13154 ± 35% -25.2% 9841 ± 14% interrupts.CPU25.TLB:TLB_shootdowns 3711 ± 23% -45.6% 2018 ± 45% interrupts.CPU26.NMI:Non-maskable_interrupts 3711 ± 23% -45.6% 2018 ± 45% interrupts.CPU26.PMI:Performance_monitoring_interrupts 4507 ± 4% -43.3% 2556 ± 40% interrupts.CPU27.NMI:Non-maskable_interrupts 4507 ± 4% -43.3% 2556 ± 40% interrupts.CPU27.PMI:Performance_monitoring_interrupts 11363 ± 9% -14.9% 9671 ± 8% interrupts.CPU27.TLB:TLB_shootdowns 4430 ± 5% -51.0% 2172 ± 43% interrupts.CPU28.NMI:Non-maskable_interrupts 4430 ± 5% -51.0% 2172 ± 43% interrupts.CPU28.PMI:Performance_monitoring_interrupts 9512 ± 3% -16.7% 7921 ± 8% interrupts.CPU29.CAL:Function_call_interrupts 3914 ± 14% -59.0% 1606 ± 27% interrupts.CPU29.NMI:Non-maskable_interrupts 3914 ± 14% -59.0% 1606 ± 27% interrupts.CPU29.PMI:Performance_monitoring_interrupts 998.00 ± 77% -55.5% 444.00 ± 2% interrupts.CPU29.RES:Rescheduling_interrupts 11508 ± 12% -22.8% 8881 ± 10% interrupts.CPU29.TLB:TLB_shootdowns 3287 ± 22% -36.6% 2082 ± 43% interrupts.CPU30.NMI:Non-maskable_interrupts 3287 ± 22% -36.6% 2082 ± 43% interrupts.CPU30.PMI:Performance_monitoring_interrupts 571.75 ± 12% -21.0% 451.67 ± 10% interrupts.CPU30.RES:Rescheduling_interrupts 10554 ± 20% -26.5% 7757 ± 6% interrupts.CPU31.CAL:Function_call_interrupts 3521 ± 21% -47.8% 1838 ± 9% interrupts.CPU31.NMI:Non-maskable_interrupts 3521 ± 21% -47.8% 1838 ± 9% interrupts.CPU31.PMI:Performance_monitoring_interrupts 604.00 ± 20% -26.0% 447.00 ± 14% interrupts.CPU31.RES:Rescheduling_interrupts 3946 ± 21% -51.9% 1898 ± 6% interrupts.CPU32.NMI:Non-maskable_interrupts 3946 ± 21% -51.9% 1898 ± 6% interrupts.CPU32.PMI:Performance_monitoring_interrupts 2221 ± 74% -74.2% 573.00 ± 13% interrupts.CPU32.RES:Rescheduling_interrupts 2969 ± 22% -40.2% 1774 ± 11% interrupts.CPU33.NMI:Non-maskable_interrupts 2969 ± 22% -40.2% 1774 ± 11% interrupts.CPU33.PMI:Performance_monitoring_interrupts 13653 ± 16% -40.8% 8079 ± 6% interrupts.CPU34.CAL:Function_call_interrupts 3074 ± 20% -41.7% 1791 ± 18% interrupts.CPU34.NMI:Non-maskable_interrupts 3074 ± 20% -41.7% 1791 ± 18% interrupts.CPU34.PMI:Performance_monitoring_interrupts 18328 ± 31% -48.1% 9519 ± 7% interrupts.CPU34.TLB:TLB_shootdowns 11937 ± 21% -36.1% 7623 ± 15% interrupts.CPU35.CAL:Function_call_interrupts 3503 ± 30% -36.4% 2229 ± 12% interrupts.CPU35.NMI:Non-maskable_interrupts 3503 ± 30% -36.4% 2229 ± 12% interrupts.CPU35.PMI:Performance_monitoring_interrupts 16203 ± 41% -47.9% 8444 ± 15% interrupts.CPU35.TLB:TLB_shootdowns 4311 ± 20% -43.4% 2440 ± 50% interrupts.CPU37.NMI:Non-maskable_interrupts 4311 ± 20% -43.4% 2440 ± 50% interrupts.CPU37.PMI:Performance_monitoring_interrupts 1028 ± 98% -60.6% 404.67 ± 5% interrupts.CPU37.RES:Rescheduling_interrupts 11376 ± 22% -35.6% 7324 ± 2% interrupts.CPU37.TLB:TLB_shootdowns 3390 ± 35% -35.8% 2177 ± 50% interrupts.CPU38.NMI:Non-maskable_interrupts 3390 ± 35% -35.8% 2177 ± 50% interrupts.CPU38.PMI:Performance_monitoring_interrupts 2077 ±133% -80.7% 401.33 ± 12% interrupts.CPU38.RES:Rescheduling_interrupts 3760 ± 19% -54.3% 1716 ± 66% interrupts.CPU39.NMI:Non-maskable_interrupts 3760 ± 19% -54.3% 1716 ± 66% interrupts.CPU39.PMI:Performance_monitoring_interrupts 3338 ± 68% -85.1% 496.67 ± 17% interrupts.CPU4.RES:Rescheduling_interrupts 3731 ± 27% -45.6% 2030 ± 38% interrupts.CPU40.NMI:Non-maskable_interrupts 3731 ± 27% -45.6% 2030 ± 38% interrupts.CPU40.PMI:Performance_monitoring_interrupts 4265 ± 5% -43.5% 2409 ± 45% interrupts.CPU42.NMI:Non-maskable_interrupts 4265 ± 5% -43.5% 2409 ± 45% interrupts.CPU42.PMI:Performance_monitoring_interrupts 3425 ± 18% -41.4% 2007 ± 51% interrupts.CPU43.NMI:Non-maskable_interrupts 3425 ± 18% -41.4% 2007 ± 51% interrupts.CPU43.PMI:Performance_monitoring_interrupts 627.00 ± 46% -43.4% 354.67 ± 2% interrupts.CPU43.RES:Rescheduling_interrupts 4679 ± 13% -71.6% 1331 ± 21% interrupts.CPU44.NMI:Non-maskable_interrupts 4679 ± 13% -71.6% 1331 ± 21% interrupts.CPU44.PMI:Performance_monitoring_interrupts 494.50 ± 18% -25.8% 367.00 ± 15% interrupts.CPU44.RES:Rescheduling_interrupts 3975 ± 18% -43.4% 2249 ± 46% interrupts.CPU45.NMI:Non-maskable_interrupts 3975 ± 18% -43.4% 2249 ± 46% interrupts.CPU45.PMI:Performance_monitoring_interrupts 8711 ± 9% -11.6% 7705 interrupts.CPU46.CAL:Function_call_interrupts 3650 ± 22% -44.9% 2010 ± 55% interrupts.CPU46.NMI:Non-maskable_interrupts 3650 ± 22% -44.9% 2010 ± 55% interrupts.CPU46.PMI:Performance_monitoring_interrupts 440.75 ± 9% -16.7% 367.00 ± 7% interrupts.CPU46.RES:Rescheduling_interrupts 7891 ± 10% -25.7% 5860 ± 11% interrupts.CPU47.CAL:Function_call_interrupts 793.00 ± 40% -50.6% 392.00 ± 3% interrupts.CPU47.RES:Rescheduling_interrupts 2663 ± 23% -21.6% 2087 ± 7% interrupts.CPU5.NMI:Non-maskable_interrupts 2663 ± 23% -21.6% 2087 ± 7% interrupts.CPU5.PMI:Performance_monitoring_interrupts 12129 ± 30% -32.7% 8164 ± 2% interrupts.CPU7.CAL:Function_call_interrupts 14622 ± 38% -33.7% 9701 ± 6% interrupts.CPU7.TLB:TLB_shootdowns 793.75 ± 6% -16.3% 664.33 ± 12% interrupts.CPU8.22:IO-APIC.22-fasteoi.ehci_hcd:usb1 2516 ± 7% +26.7% 3188 ± 15% interrupts.CPU8.NMI:Non-maskable_interrupts 2516 ± 7% +26.7% 3188 ± 15% interrupts.CPU8.PMI:Performance_monitoring_interrupts 1784 ± 54% -58.8% 735.00 ± 4% interrupts.CPU8.RES:Rescheduling_interrupts 656.75 ± 18% +51.0% 992.00 ± 20% interrupts.CPU9.RES:Rescheduling_interrupts 168231 ± 7% -33.4% 112034 ± 19% interrupts.NMI:Non-maskable_interrupts 168231 ± 7% -33.4% 112034 ± 19% interrupts.PMI:Performance_monitoring_interrupts 7.01 ± 14% -3.4 3.60 ± 50% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 4.21 ± 21% -1.9 2.29 ± 63% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 2.84 ± 12% -1.9 0.96 ± 39% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.06 ± 21% -1.8 2.23 ± 65% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 2.64 ± 13% -1.8 0.87 ± 40% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.84 ± 22% -1.7 2.13 ± 67% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 1.49 ± 7% -0.9 0.54 ± 70% perf-profile.calltrace.cycles-pp.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2.do_sys_open 1.46 ± 8% -0.9 0.53 ± 70% perf-profile.calltrace.cycles-pp.__alloc_file.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2 1.28 ± 5% -0.8 0.51 ± 71% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 1.06 ± 6% -0.6 0.42 ± 71% perf-profile.calltrace.cycles-pp.__entry_text_start 0.77 ± 13% +0.3 1.05 ± 11% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 0.82 ± 12% +0.3 1.12 ± 11% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 1.23 ± 13% +0.4 1.68 ± 18% perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock 1.23 ± 13% +0.4 1.68 ± 18% perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit 1.82 ± 13% +0.6 2.39 ± 17% perf-profile.calltrace.cycles-pp.create_basic_memory_bitmaps.snapshot_open.misc_open.chrdev_open.do_dentry_open 0.00 +0.6 0.61 ± 12% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 0.00 +0.6 0.62 ± 12% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 4.96 ± 7% +1.7 6.69 ± 19% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.misc_open.chrdev_open.do_dentry_open 7.19 ± 14% -3.4 3.78 ± 45% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 3.03 ± 53% -2.8 0.24 ± 21% perf-profile.children.cycles-pp.link_path_walk 4.28 ± 21% -1.9 2.35 ± 61% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 2.85 ± 12% -1.9 0.96 ± 40% perf-profile.children.cycles-pp.ksys_mmap_pgoff 4.26 ± 21% -1.9 2.38 ± 62% perf-profile.children.cycles-pp.task_work_run 2.65 ± 13% -1.8 0.88 ± 40% perf-profile.children.cycles-pp.vm_mmap_pgoff 4.04 ± 22% -1.8 2.27 ± 64% perf-profile.children.cycles-pp.__fput 1.69 ± 54% -1.6 0.13 ± 22% perf-profile.children.cycles-pp.inode_permission 1.47 ± 51% -1.3 0.16 ± 3% perf-profile.children.cycles-pp.walk_component 1.33 ± 54% -1.2 0.11 ± 14% perf-profile.children.cycles-pp.lookup_fast 1.49 ± 27% -1.1 0.36 ± 28% perf-profile.children.cycles-pp._raw_spin_lock 1.49 ± 31% -1.1 0.40 ± 48% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 1.51 ± 21% -1.1 0.44 ± 53% perf-profile.children.cycles-pp.down_write_killable 0.91 ± 62% -0.9 0.04 ± 71% perf-profile.children.cycles-pp.hidraw_release 1.58 ± 8% -0.8 0.73 ± 24% perf-profile.children.cycles-pp.alloc_empty_file 1.55 ± 9% -0.8 0.72 ± 24% perf-profile.children.cycles-pp.__alloc_file 1.49 ± 5% -0.7 0.74 ± 28% perf-profile.children.cycles-pp.syscall_return_via_sysret 1.26 ± 6% -0.6 0.63 ± 27% perf-profile.children.cycles-pp.__entry_text_start 1.12 ± 9% -0.6 0.55 ± 24% perf-profile.children.cycles-pp.kmem_cache_alloc 0.87 ± 18% -0.6 0.31 ± 34% perf-profile.children.cycles-pp.do_mmap 0.63 ± 7% -0.4 0.22 ± 25% perf-profile.children.cycles-pp.dput 0.55 ± 17% -0.4 0.15 ± 34% perf-profile.children.cycles-pp.security_file_open 0.53 ± 19% -0.4 0.14 ± 36% perf-profile.children.cycles-pp.apparmor_file_open 0.52 ± 32% -0.4 0.14 ± 55% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.48 ± 22% -0.4 0.12 ± 13% perf-profile.children.cycles-pp.ima_file_check 0.65 ± 7% -0.4 0.29 ± 35% perf-profile.children.cycles-pp.__x64_sys_select 0.47 ± 23% -0.4 0.11 ± 14% perf-profile.children.cycles-pp.security_task_getsecid 0.64 ± 7% -0.4 0.29 ± 35% perf-profile.children.cycles-pp.kern_select 0.62 ± 13% -0.3 0.27 ± 36% perf-profile.children.cycles-pp.__x64_sys_exit_group 0.62 ± 12% -0.3 0.28 ± 33% perf-profile.children.cycles-pp.do_group_exit 0.62 ± 12% -0.3 0.28 ± 33% perf-profile.children.cycles-pp.do_exit 0.45 ± 24% -0.3 0.11 ± 19% perf-profile.children.cycles-pp.apparmor_task_getsecid 0.49 ± 65% -0.3 0.16 ± 83% perf-profile.children.cycles-pp.__x64_sys_munmap 0.49 ± 64% -0.3 0.16 ± 83% perf-profile.children.cycles-pp.__vm_munmap 0.48 ± 5% -0.3 0.16 ± 34% perf-profile.children.cycles-pp.lockref_put_or_lock 0.51 ± 9% -0.3 0.19 ± 15% perf-profile.children.cycles-pp.security_file_alloc 0.51 ± 7% -0.3 0.20 ± 38% perf-profile.children.cycles-pp.__x64_sys_close 0.59 ± 12% -0.3 0.30 ± 13% perf-profile.children.cycles-pp.__do_sys_clone 0.59 ± 12% -0.3 0.30 ± 13% perf-profile.children.cycles-pp.kernel_clone 0.41 ± 11% -0.3 0.13 ± 18% perf-profile.children.cycles-pp.apparmor_file_alloc_security 0.57 ± 12% -0.3 0.29 ± 12% perf-profile.children.cycles-pp.copy_process 0.51 ± 8% -0.3 0.23 ± 38% perf-profile.children.cycles-pp.core_sys_select 0.43 ± 14% -0.3 0.17 ± 14% perf-profile.children.cycles-pp.mmput 0.43 ± 14% -0.3 0.17 ± 14% perf-profile.children.cycles-pp.exit_mmap 0.45 ± 8% -0.3 0.19 ± 35% perf-profile.children.cycles-pp.get_unmapped_area 0.40 ± 17% -0.3 0.14 ± 20% perf-profile.children.cycles-pp.__do_sys_newfstat 0.50 ± 13% -0.2 0.26 ± 12% perf-profile.children.cycles-pp.dup_mm 0.71 ± 9% -0.2 0.48 ± 11% perf-profile.children.cycles-pp.do_softirq_own_stack 0.75 ± 10% -0.2 0.52 ± 11% perf-profile.children.cycles-pp.irq_exit_rcu 0.49 ± 12% -0.2 0.26 ± 12% perf-profile.children.cycles-pp.dup_mmap 0.41 ± 9% -0.2 0.19 ± 36% perf-profile.children.cycles-pp.__fget_files 0.28 ± 52% -0.2 0.06 ± 75% perf-profile.children.cycles-pp.mmap_region 0.35 ± 5% -0.2 0.14 ± 34% perf-profile.children.cycles-pp.security_mmap_file 0.39 ± 7% -0.2 0.18 ± 15% perf-profile.children.cycles-pp.getname_flags 0.32 ± 7% -0.2 0.12 ± 35% perf-profile.children.cycles-pp.complete_walk 0.32 ± 7% -0.2 0.12 ± 31% perf-profile.children.cycles-pp.unlazy_walk 0.29 ± 22% -0.2 0.09 ± 27% perf-profile.children.cycles-pp.vfs_fstat 0.30 ± 17% -0.2 0.10 ± 12% perf-profile.children.cycles-pp.security_file_free 0.28 ± 21% -0.2 0.08 ± 14% perf-profile.children.cycles-pp.aa_get_task_label 0.29 ± 17% -0.2 0.09 ± 14% perf-profile.children.cycles-pp.apparmor_file_free_security 0.25 ± 32% -0.2 0.06 ± 13% perf-profile.children.cycles-pp.step_into 0.36 ± 10% -0.2 0.17 ± 39% perf-profile.children.cycles-pp.do_select 0.33 ± 7% -0.2 0.14 ± 34% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.29 ± 7% -0.2 0.10 ± 31% perf-profile.children.cycles-pp.__legitimize_path 0.36 ± 17% -0.2 0.17 ± 7% perf-profile.children.cycles-pp.__schedule 0.29 ± 8% -0.2 0.11 ± 40% perf-profile.children.cycles-pp.terminate_walk 0.34 ± 8% -0.2 0.17 ± 34% perf-profile.children.cycles-pp.__fget_light 0.25 ± 25% -0.2 0.08 ± 24% perf-profile.children.cycles-pp.may_open 0.25 ± 18% -0.2 0.08 ± 35% perf-profile.children.cycles-pp.mutex_lock 0.35 ± 7% -0.2 0.18 ± 50% perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.39 ± 13% -0.2 0.22 ± 24% perf-profile.children.cycles-pp.ksys_lseek 0.25 ± 58% -0.2 0.09 ± 84% perf-profile.children.cycles-pp.__do_munmap 0.22 ± 8% -0.2 0.06 ± 71% perf-profile.children.cycles-pp.lockref_get_not_dead 0.21 ± 17% -0.2 0.06 ± 75% perf-profile.children.cycles-pp.cdev_put 0.25 ± 10% -0.2 0.10 ± 38% perf-profile.children.cycles-pp.__close_fd 0.24 ± 10% -0.1 0.10 ± 38% perf-profile.children.cycles-pp.pick_file 0.37 ± 10% -0.1 0.23 ± 12% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.27 ± 9% -0.1 0.13 ± 33% perf-profile.children.cycles-pp.__alloc_fd 0.21 ± 23% -0.1 0.07 ± 20% perf-profile.children.cycles-pp.free_pgtables 0.27 ± 20% -0.1 0.13 ± 9% perf-profile.children.cycles-pp.schedule 0.26 ± 7% -0.1 0.12 ± 18% perf-profile.children.cycles-pp.strncpy_from_user 0.23 ± 10% -0.1 0.09 ± 39% perf-profile.children.cycles-pp.filp_close 0.20 ± 11% -0.1 0.07 ± 71% perf-profile.children.cycles-pp.vm_unmapped_area 0.25 ± 4% -0.1 0.12 ± 29% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack 0.17 ± 16% -0.1 0.04 ± 76% perf-profile.children.cycles-pp.kobject_put 0.19 ± 19% -0.1 0.06 ± 29% perf-profile.children.cycles-pp.copy_page_range 0.22 ± 11% -0.1 0.10 ± 14% perf-profile.children.cycles-pp.try_to_wake_up 0.21 ± 9% -0.1 0.08 ± 34% perf-profile.children.cycles-pp.common_file_perm 0.22 ± 10% -0.1 0.10 ± 32% perf-profile.children.cycles-pp.fput_many 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.drm_release 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.drm_client_dev_restore 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.drm_fbdev_client_restore 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.__drm_fb_helper_restore_fbdev_mode_unlocked 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.drm_client_modeset_commit 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.drm_client_modeset_commit_locked 0.29 ± 21% -0.1 0.17 ± 47% perf-profile.children.cycles-pp.drm_client_modeset_commit_atomic 0.28 ± 4% -0.1 0.16 ± 48% perf-profile.children.cycles-pp.get_page_from_freelist 0.20 ± 15% -0.1 0.08 ± 30% perf-profile.children.cycles-pp.unmap_vmas 0.16 ± 21% -0.1 0.04 ± 76% perf-profile.children.cycles-pp.copy_pte_range 0.18 ± 9% -0.1 0.07 ± 71% perf-profile.children.cycles-pp.__x64_sys_fcntl 0.22 ± 7% -0.1 0.10 ± 36% perf-profile.children.cycles-pp.__x64_sys_poll 0.22 ± 7% -0.1 0.10 ± 9% perf-profile.children.cycles-pp.__check_object_size 0.18 ± 12% -0.1 0.07 ± 25% perf-profile.children.cycles-pp.unmap_page_range 0.20 ± 8% -0.1 0.09 ± 33% perf-profile.children.cycles-pp.do_sys_poll 0.15 ± 7% -0.1 0.05 ± 72% perf-profile.children.cycles-pp.__might_sleep 0.15 ± 8% -0.1 0.05 ± 78% perf-profile.children.cycles-pp.obj_cgroup_charge 0.15 ± 9% -0.1 0.06 ± 16% perf-profile.children.cycles-pp.zap_pte_range 0.17 ± 20% -0.1 0.07 ± 72% perf-profile.children.cycles-pp.__slab_alloc 0.16 ± 22% -0.1 0.07 ± 72% perf-profile.children.cycles-pp.___slab_alloc 0.14 ± 19% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.unlink_anon_vmas 0.17 ± 38% -0.1 0.07 ± 74% perf-profile.children.cycles-pp.block_ioctl 0.16 ± 9% -0.1 0.07 ± 20% perf-profile.children.cycles-pp.anon_vma_fork 0.18 ± 5% -0.1 0.09 ± 18% perf-profile.children.cycles-pp.___might_sleep 0.14 ± 32% -0.1 0.05 ± 81% perf-profile.children.cycles-pp.drm_stub_open 0.14 ± 32% -0.1 0.05 ± 81% perf-profile.children.cycles-pp.drm_open 0.14 ± 32% -0.1 0.05 ± 81% perf-profile.children.cycles-pp.drm_master_open 0.16 ± 9% -0.1 0.07 ± 23% perf-profile.children.cycles-pp.get_obj_cgroup_from_current 0.16 ± 38% -0.1 0.07 ± 74% perf-profile.children.cycles-pp.blkdev_ioctl 0.12 ± 12% -0.1 0.04 ± 71% perf-profile.children.cycles-pp._cond_resched 0.12 ± 8% -0.1 0.04 ± 73% perf-profile.children.cycles-pp.memset_erms 0.14 ± 25% -0.1 0.06 ± 72% perf-profile.children.cycles-pp.allocate_slab 0.12 ± 13% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.call_rcu 0.17 ± 25% -0.1 0.09 ± 50% perf-profile.children.cycles-pp.path_lookupat 0.17 ± 30% -0.1 0.10 ± 61% perf-profile.children.cycles-pp.__fxstat64 0.11 ± 12% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.anon_vma_clone 0.11 ± 10% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.15 ± 16% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.pick_next_task_fair 0.14 ± 6% -0.1 0.07 ± 11% perf-profile.children.cycles-pp.syscall_enter_from_user_mode 0.10 ± 12% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.cp_new_stat 0.13 ± 10% -0.1 0.06 ± 19% perf-profile.children.cycles-pp.__d_lookup_rcu 0.10 ± 15% -0.1 0.04 ± 73% perf-profile.children.cycles-pp.generic_permission 0.14 ± 9% -0.1 0.08 ± 20% perf-profile.children.cycles-pp.__x86_retpoline_rax 0.08 ± 5% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.ktime_get_ts64 0.09 ± 4% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.__might_fault 0.07 ± 17% -0.0 0.03 ± 70% perf-profile.children.cycles-pp.schedule_timeout 0.11 ± 9% -0.0 0.08 ± 12% perf-profile.children.cycles-pp.update_load_avg 0.09 ± 8% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.newidle_balance 0.10 ± 14% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.task_tick_fair 0.06 ± 15% +0.0 0.08 ± 16% perf-profile.children.cycles-pp.tick_irq_enter 0.04 ± 57% +0.0 0.06 perf-profile.children.cycles-pp.sched_clock_cpu 0.08 ± 13% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.irq_enter_rcu 0.07 ± 5% +0.0 0.12 ± 24% perf-profile.children.cycles-pp.clockevents_program_event 0.01 ±173% +0.1 0.07 ± 18% perf-profile.children.cycles-pp.rebalance_domains 0.09 ± 4% +0.1 0.15 ± 26% perf-profile.children.cycles-pp.ktime_get 0.16 ± 9% +0.1 0.23 ± 7% perf-profile.children.cycles-pp.menu_select 0.21 ± 11% +0.1 0.28 ± 16% perf-profile.children.cycles-pp.io_serial_out 0.15 ± 20% +0.1 0.23 ± 6% perf-profile.children.cycles-pp.delay_tsc 1.83 ± 14% +0.5 2.38 ± 12% perf-profile.children.cycles-pp.serial8250_console_putchar 1.85 ± 14% +0.6 2.40 ± 12% perf-profile.children.cycles-pp.wait_for_xmitr 1.99 ± 15% +0.6 2.56 ± 16% perf-profile.children.cycles-pp.__dynamic_pr_debug 1.82 ± 13% +0.6 2.39 ± 17% perf-profile.children.cycles-pp.create_basic_memory_bitmaps 2.13 ± 13% +0.6 2.74 ± 13% perf-profile.children.cycles-pp.console_unlock 2.03 ± 13% +0.6 2.65 ± 12% perf-profile.children.cycles-pp.uart_console_write 2.17 ± 15% +0.6 2.79 ± 14% perf-profile.children.cycles-pp.printk 2.17 ± 15% +0.6 2.79 ± 14% perf-profile.children.cycles-pp.vprintk_emit 2.05 ± 13% +0.6 2.67 ± 12% perf-profile.children.cycles-pp.serial8250_console_write 0.00 +3.7 3.73 ± 66% perf-profile.children.cycles-pp.__cna_queued_spin_lock_slowpath 2.92 ± 6% -1.5 1.44 ± 22% perf-profile.self.cycles-pp.syscall_exit_to_user_mode 1.48 ± 5% -0.7 0.74 ± 28% perf-profile.self.cycles-pp.syscall_return_via_sysret 1.25 ± 6% -0.6 0.62 ± 28% perf-profile.self.cycles-pp.__entry_text_start 0.52 ± 18% -0.4 0.13 ± 34% perf-profile.self.cycles-pp.apparmor_file_open 0.50 ± 32% -0.4 0.13 ± 54% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.44 ± 5% -0.3 0.13 ± 36% perf-profile.self.cycles-pp.lockref_put_or_lock 0.38 ± 12% -0.3 0.12 ± 18% perf-profile.self.cycles-pp.apparmor_file_alloc_security 0.52 ± 4% -0.3 0.27 ± 25% perf-profile.self.cycles-pp._raw_spin_lock 0.28 ± 22% -0.2 0.05 ± 72% perf-profile.self.cycles-pp.aa_get_task_label 0.45 ± 7% -0.2 0.24 ± 20% perf-profile.self.cycles-pp.kmem_cache_alloc 0.39 ± 10% -0.2 0.19 ± 36% perf-profile.self.cycles-pp.__fget_files 0.28 ± 19% -0.2 0.08 ± 11% perf-profile.self.cycles-pp.apparmor_file_free_security 0.30 ± 8% -0.2 0.11 ± 36% perf-profile.self.cycles-pp.do_dentry_open 0.21 ± 21% -0.2 0.04 ± 76% perf-profile.self.cycles-pp.mutex_lock 0.20 ± 3% -0.1 0.06 ± 71% perf-profile.self.cycles-pp.lockref_get_not_dead 0.20 ± 11% -0.1 0.06 ± 73% perf-profile.self.cycles-pp.vm_unmapped_area 0.18 ± 8% -0.1 0.06 ± 73% perf-profile.self.cycles-pp.common_file_perm 0.17 ± 14% -0.1 0.04 ± 76% perf-profile.self.cycles-pp.kobject_put 0.27 ± 15% -0.1 0.15 ± 25% perf-profile.self.cycles-pp.__alloc_file 0.16 ± 39% -0.1 0.05 ± 78% perf-profile.self.cycles-pp.rwsem_down_write_slowpath 0.16 ± 11% -0.1 0.05 ± 77% perf-profile.self.cycles-pp.fput_many 0.14 ± 7% -0.1 0.04 ± 71% perf-profile.self.cycles-pp.__might_sleep 0.18 ± 5% -0.1 0.09 ± 30% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.14 ± 11% -0.1 0.04 ± 71% perf-profile.self.cycles-pp.do_sys_openat2 0.15 ± 5% -0.1 0.06 ± 73% perf-profile.self.cycles-pp.__fput 0.20 ± 5% -0.1 0.11 ± 31% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.13 ± 14% -0.1 0.04 ± 70% perf-profile.self.cycles-pp.link_path_walk 0.18 ± 8% -0.1 0.09 ± 18% perf-profile.self.cycles-pp.___might_sleep 0.13 ± 14% -0.1 0.04 ± 71% perf-profile.self.cycles-pp.get_obj_cgroup_from_current 0.12 ± 6% -0.1 0.04 ± 73% perf-profile.self.cycles-pp.do_mmap 0.12 ± 10% -0.1 0.05 ± 71% perf-profile.self.cycles-pp.__x86_retpoline_rax 0.12 ± 24% -0.1 0.05 ± 72% perf-profile.self.cycles-pp.allocate_slab 0.12 ± 8% -0.1 0.06 ± 19% perf-profile.self.cycles-pp.__d_lookup_rcu 0.10 ± 13% -0.1 0.04 ± 71% perf-profile.self.cycles-pp.generic_permission 0.09 ± 8% -0.1 0.04 ± 71% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack 0.10 ± 4% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.syscall_enter_from_user_mode 0.07 ± 17% +0.0 0.11 ± 8% perf-profile.self.cycles-pp.cpuidle_enter_state 0.10 ± 9% +0.0 0.14 ± 10% perf-profile.self.cycles-pp.menu_select 0.03 ±100% +0.1 0.09 ± 36% perf-profile.self.cycles-pp.ktime_get 0.15 ± 20% +0.1 0.23 ± 6% perf-profile.self.cycles-pp.delay_tsc 0.20 ± 16% +0.1 0.28 ± 16% perf-profile.self.cycles-pp.io_serial_out 0.00 +3.7 3.73 ± 66% perf-profile.self.cycles-pp.__cna_queued_spin_lock_slowpath stress-ng.zero.ops_per_sec 400000 +------------------------------------------------------------------+ |.+.. .+.. .+..+. .+.+.. +.. | 350000 |-+ + + +.+..+.+.. .+..+ O +. O O +.+..O+O +.+..+.+..+.| | O : O : O O + O O + O O O | 300000 |-+ : : O | 250000 |-+ : : | | : : | 200000 |-+ : : | | : : | 150000 |-+ : : | 100000 |-+ : : | | :: | 50000 |-+ :: | | : | 0 +------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-csl-2ap2: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode: gcc-9/performance/1BRD_48G/4M/btrfs/1x/x86_64-rhel-8.3/64t/debian-10.4-x86_64-20200603.cgz/NoSync/lkp-csl-2ap2/24G/fsmark/0x5003003 commit: cb45bab007 ("locking/qspinlock: Refactor the qspinlock slow path") 0e8d8f4f12 ("locking/qspinlock: Introduce CNA into the slow path of qspinlock") cb45bab007ff0cfc 0e8d8f4f1214cfbac219d6917b5 ---------------- --------------------------- %stddev %change %stddev \ | \ 1180 ± 2% +213.9% 3706 ± 11% fsmark.files_per_sec 773.00 ± 4% -30.2% 539.75 ± 7% fsmark.time.percent_of_cpu_this_job_got 137.19 ± 3% -28.5% 98.13 ± 8% fsmark.time.system_time 48917 ± 4% -9.0% 44537 ± 8% meminfo.AnonHugePages 4.83 ± 4% -1.0 3.83 ± 5% mpstat.cpu.all.sys% 93.48 +1.1% 94.51 iostat.cpu.idle 5.76 ± 2% -16.9% 4.79 ± 6% iostat.cpu.system 93.00 +1.1% 94.00 vmstat.cpu.id 20606 ± 5% +97.4% 40682 ± 34% vmstat.system.cs 4237881 ± 29% +321.3% 17854499 ±106% cpuidle.C1.time 44169 ± 32% +396.5% 219318 ±113% cpuidle.C1.usage 72208 ± 6% +191.8% 210719 ± 39% cpuidle.POLL.time 36708 ± 9% +306.0% 149034 ± 48% cpuidle.POLL.usage 2157 ± 2% +13.8% 2454 ± 6% slabinfo.biovec-max.active_objs 2271 ± 2% +12.8% 2561 ± 5% slabinfo.biovec-max.num_objs 6624 +13.4% 7512 ± 5% slabinfo.btrfs_delayed_node.active_objs 6768 +12.1% 7589 ± 5% slabinfo.btrfs_delayed_node.num_objs 47815 ± 86% -89.2% 5149 ± 6% sched_debug.cfs_rq:/.load.stddev 142.69 ± 15% +66.8% 237.99 ± 13% sched_debug.cfs_rq:/.load_avg.avg 1598 ± 30% +92.4% 3075 ± 20% sched_debug.cfs_rq:/.load_avg.max 383.38 ± 21% +90.4% 730.10 ± 13% sched_debug.cfs_rq:/.load_avg.stddev 37712 ± 16% -27.1% 27508 ± 16% sched_debug.cfs_rq:/.min_vruntime.avg 58.89 ± 49% +57.8% 92.96 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.stddev 1901 ± 4% -8.3% 1743 ± 3% proc-vmstat.nr_active_anon 5055884 +3.2% 5219972 proc-vmstat.nr_file_pages 4788961 ± 2% +3.4% 4953360 proc-vmstat.nr_inactive_file 36576 ± 2% -4.1% 35069 proc-vmstat.nr_kernel_stack 9756 -1.6% 9601 proc-vmstat.nr_mapped 5205 ± 2% -5.1% 4939 proc-vmstat.nr_shmem 1901 ± 4% -8.3% 1743 ± 3% proc-vmstat.nr_zone_active_anon 4788961 ± 2% +3.4% 4953360 proc-vmstat.nr_zone_inactive_file 4864 ± 5% -8.2% 4465 proc-vmstat.pgactivate 2.507e+09 -8.7% 2.29e+09 perf-stat.i.branch-instructions 71942409 -5.3% 68125925 ± 2% perf-stat.i.cache-misses 4.372e+10 -18.5% 3.565e+10 ± 3% perf-stat.i.cpu-cycles 1.231e+10 -7.5% 1.138e+10 perf-stat.i.instructions 2515 ± 8% -11.4% 2228 ± 5% perf-stat.i.instructions-per-iTLB-miss 0.23 -17.3% 0.19 ± 3% perf-stat.i.metric.GHz 0.71 ± 19% +37.6% 0.97 ± 17% perf-stat.i.metric.K/sec 35.43 -6.2% 33.24 ± 2% perf-stat.i.metric.M/sec 3.58 -8.5% 3.28 perf-stat.overall.cpi 612.62 -9.0% 557.36 ± 3% perf-stat.overall.cycles-between-cache-misses 2610 ± 6% -11.9% 2299 ± 4% perf-stat.overall.instructions-per-iTLB-miss 0.28 +9.3% 0.31 perf-stat.overall.ipc 2.39e+09 ± 2% -6.3% 2.239e+09 perf-stat.ps.branch-instructions 68534728 ± 2% -4.6% 65359103 ± 2% perf-stat.ps.cache-misses 4.199e+10 ± 2% -13.3% 3.641e+10 perf-stat.ps.cpu-cycles 1.173e+10 ± 2% -5.3% 1.112e+10 perf-stat.ps.instructions 226946 ± 18% +44.8% 328685 ± 19% numa-meminfo.node0.AnonPages 249710 ± 18% +41.9% 354296 ± 20% numa-meminfo.node0.AnonPages.max 233745 ± 17% +42.0% 331984 ± 20% numa-meminfo.node0.Inactive(anon) 8680 ± 73% +135.9% 20474 ± 28% numa-meminfo.node0.PageTables 250653 ± 2% +6.8% 267784 ± 5% numa-meminfo.node0.Unevictable 2890241 ± 9% -58.3% 1206212 ± 10% numa-meminfo.node0.Writeback 338312 ± 83% +111.9% 716979 ± 64% numa-meminfo.node1.Dirty 8444 ± 82% +169.8% 22785 ± 37% numa-meminfo.node2.AnonHugePages 236489 ± 16% +142.5% 573382 ± 36% numa-meminfo.node2.Dirty 2484617 ± 13% +117.6% 5406277 ± 50% numa-meminfo.node2.FilePages 2459002 ± 19% +115.1% 5290461 ± 51% numa-meminfo.node2.Inactive 2216704 ± 16% +131.7% 5135596 ± 53% numa-meminfo.node2.Inactive(file) 871702 ± 16% +52.8% 1331684 ± 6% numa-meminfo.node2.Writeback 3888 ± 16% -24.5% 2937 ± 6% numa-meminfo.node3.Active(anon) 57796 ± 19% -49.7% 29078 ± 34% numa-meminfo.node3.KReclaimable 57796 ± 19% -49.7% 29078 ± 34% numa-meminfo.node3.SReclaimable 130240 ± 7% -30.1% 91037 ± 15% numa-meminfo.node3.Slab 56616 ± 18% +45.2% 82199 ± 19% numa-vmstat.node0.nr_anon_pages 58314 ± 17% +42.4% 83024 ± 20% numa-vmstat.node0.nr_inactive_anon 2172 ± 73% +135.7% 5122 ± 28% numa-vmstat.node0.nr_page_table_pages 62662 ± 2% +6.8% 66945 ± 5% numa-vmstat.node0.nr_unevictable 738434 ± 9% -59.3% 300391 ± 10% numa-vmstat.node0.nr_writeback 58312 ± 17% +42.4% 83023 ± 20% numa-vmstat.node0.nr_zone_inactive_anon 62662 ± 2% +6.8% 66945 ± 5% numa-vmstat.node0.nr_zone_unevictable 926442 ± 6% -53.1% 434282 ± 12% numa-vmstat.node0.nr_zone_write_pending 84324 ± 81% +112.0% 178764 ± 64% numa-vmstat.node1.nr_dirty 427046 ± 84% +74.8% 746464 ± 46% numa-vmstat.node1.nr_zone_write_pending 627042 ± 18% +129.0% 1435752 ± 55% numa-vmstat.node2.nr_dirtied 59963 ± 18% +137.8% 142585 ± 36% numa-vmstat.node2.nr_dirty 634106 ± 15% +112.1% 1345185 ± 50% numa-vmstat.node2.nr_file_pages 567086 ± 17% +125.3% 1277507 ± 53% numa-vmstat.node2.nr_inactive_file 223407 ± 17% +48.3% 331299 ± 7% numa-vmstat.node2.nr_writeback 567087 ± 17% +125.3% 1277515 ± 53% numa-vmstat.node2.nr_zone_inactive_file 283372 ± 17% +67.2% 473906 ± 8% numa-vmstat.node2.nr_zone_write_pending 922.00 ± 19% -20.0% 737.25 ± 6% numa-vmstat.node3.nr_active_anon 14591 ± 20% -50.1% 7276 ± 35% numa-vmstat.node3.nr_slab_reclaimable 922.00 ± 19% -20.0% 737.25 ± 6% numa-vmstat.node3.nr_zone_active_anon 141466 ± 17% +523.4% 881964 ± 85% numa-vmstat.node3.numa_other 282981 ± 14% +46.6% 414731 ± 12% interrupts.CAL:Function_call_interrupts 770.00 ± 51% -56.5% 335.00 ± 59% interrupts.CPU0.NMI:Non-maskable_interrupts 770.00 ± 51% -56.5% 335.00 ± 59% interrupts.CPU0.PMI:Performance_monitoring_interrupts 346.25 ± 15% -46.7% 184.50 ± 23% interrupts.CPU110.NMI:Non-maskable_interrupts 346.25 ± 15% -46.7% 184.50 ± 23% interrupts.CPU110.PMI:Performance_monitoring_interrupts 1359 ± 14% +31.7% 1789 ± 17% interrupts.CPU128.CAL:Function_call_interrupts 1378 ± 14% +2294.9% 33020 ±164% interrupts.CPU153.CAL:Function_call_interrupts 214.50 ± 34% +91.7% 411.25 ± 39% interrupts.CPU16.NMI:Non-maskable_interrupts 214.50 ± 34% +91.7% 411.25 ± 39% interrupts.CPU16.PMI:Performance_monitoring_interrupts 403.50 ± 35% -40.3% 241.00 ± 8% interrupts.CPU169.NMI:Non-maskable_interrupts 403.50 ± 35% -40.3% 241.00 ± 8% interrupts.CPU169.PMI:Performance_monitoring_interrupts 439.00 ± 50% -51.5% 212.75 ± 22% interrupts.CPU170.NMI:Non-maskable_interrupts 439.00 ± 50% -51.5% 212.75 ± 22% interrupts.CPU170.PMI:Performance_monitoring_interrupts 1062 ±116% -77.3% 240.75 ± 23% interrupts.CPU174.NMI:Non-maskable_interrupts 1062 ±116% -77.3% 240.75 ± 23% interrupts.CPU174.PMI:Performance_monitoring_interrupts 291.25 ± 31% -34.2% 191.75 ± 30% interrupts.CPU2.NMI:Non-maskable_interrupts 291.25 ± 31% -34.2% 191.75 ± 30% interrupts.CPU2.PMI:Performance_monitoring_interrupts 342.00 ± 43% -58.3% 142.75 ± 16% interrupts.CPU22.NMI:Non-maskable_interrupts 342.00 ± 43% -58.3% 142.75 ± 16% interrupts.CPU22.PMI:Performance_monitoring_interrupts 241.25 ± 22% -42.6% 138.50 ± 22% interrupts.CPU23.NMI:Non-maskable_interrupts 241.25 ± 22% -42.6% 138.50 ± 22% interrupts.CPU23.PMI:Performance_monitoring_interrupts 1365 ± 14% +49.5% 2041 ± 24% interrupts.CPU35.CAL:Function_call_interrupts 222.00 ± 94% +175.1% 610.75 ± 51% interrupts.CPU63.NMI:Non-maskable_interrupts 222.00 ± 94% +175.1% 610.75 ± 51% interrupts.CPU63.PMI:Performance_monitoring_interrupts 146.75 ± 39% +104.6% 300.25 ± 32% interrupts.CPU64.NMI:Non-maskable_interrupts 146.75 ± 39% +104.6% 300.25 ± 32% interrupts.CPU64.PMI:Performance_monitoring_interrupts 557.00 ± 88% -61.3% 215.75 ± 21% interrupts.CPU74.NMI:Non-maskable_interrupts 557.00 ± 88% -61.3% 215.75 ± 21% interrupts.CPU74.PMI:Performance_monitoring_interrupts 319.25 ± 22% -43.9% 179.25 ± 36% interrupts.CPU75.NMI:Non-maskable_interrupts 319.25 ± 22% -43.9% 179.25 ± 36% interrupts.CPU75.PMI:Performance_monitoring_interrupts 1343 ± 15% +23.0% 1652 ± 4% interrupts.CPU80.CAL:Function_call_interrupts 1095 ± 66% -76.5% 257.00 ± 17% interrupts.CPU96.NMI:Non-maskable_interrupts 1095 ± 66% -76.5% 257.00 ± 17% interrupts.CPU96.PMI:Performance_monitoring_interrupts 817.25 ± 12% +62.6% 1329 ± 17% interrupts.RES:Rescheduling_interrupts 12.39 ± 23% -8.2 4.22 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 12.35 ± 24% -8.1 4.21 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.12 ± 24% -8.0 4.08 ± 6% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.11 ± 24% -8.0 4.07 ± 6% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.10 ± 24% -8.0 4.06 ± 6% perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 12.07 ± 24% -8.0 4.04 ± 6% perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write 12.28 ± 24% -7.5 4.83 ± 5% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.07 ± 31% -6.1 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__reserve_bytes.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata 6.36 ± 30% -4.8 1.55 ± 11% perf-profile.calltrace.cycles-pp.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 6.31 ± 30% -4.8 1.51 ± 12% perf-profile.calltrace.cycles-pp.__reserve_bytes.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter 6.31 ± 30% -4.8 1.51 ± 12% perf-profile.calltrace.cycles-pp.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 6.13 ± 31% -4.8 1.38 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock.__reserve_bytes.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write 4.39 ± 18% -3.2 1.21 ± 15% perf-profile.calltrace.cycles-pp.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 4.38 ± 18% -3.2 1.20 ± 15% perf-profile.calltrace.cycles-pp.btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 4.21 ± 19% -3.1 1.09 ± 20% perf-profile.calltrace.cycles-pp._raw_spin_lock.btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter 0.13 ±173% +0.5 0.63 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 4.51 ± 6% +0.5 5.04 ± 3% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 4.48 ± 5% +0.5 5.02 ± 3% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 4.37 ± 6% +0.6 4.93 ± 3% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.18 ±173% +0.6 0.75 ± 27% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write 0.18 ±173% +0.6 0.76 ± 27% perf-profile.calltrace.cycles-pp.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write 0.18 ±173% +0.6 0.76 ± 27% perf-profile.calltrace.cycles-pp.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write.do_syscall_64 0.18 ±173% +0.6 0.76 ± 27% perf-profile.calltrace.cycles-pp.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write 0.18 ±173% +0.6 0.77 ± 27% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 0.18 ±173% +0.6 0.77 ± 27% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.18 ±173% +0.6 0.77 ± 27% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.18 ±173% +0.6 0.77 ± 27% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.18 ±173% +0.6 0.77 ± 27% perf-profile.calltrace.cycles-pp.write 0.00 +0.6 0.62 ± 7% perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 0.00 +1.1 1.06 ± 21% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write 7.48 ± 5% +1.2 8.68 ± 2% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 0.00 +1.3 1.33 ± 15% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.__reserve_bytes.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata 11.79 ± 8% +2.8 14.63 ± 8% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 9.11 ± 14% +4.4 13.51 ± 18% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 10.58 ± 26% -10.6 0.00 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 12.10 ± 24% -8.0 4.06 ± 6% perf-profile.children.cycles-pp.btrfs_file_write_iter 12.07 ± 24% -8.0 4.04 ± 6% perf-profile.children.cycles-pp.btrfs_buffered_write 14.00 ± 18% -7.9 6.09 ± 7% perf-profile.children.cycles-pp._raw_spin_lock 12.64 ± 23% -7.8 4.85 ± 5% perf-profile.children.cycles-pp.ksys_write 12.62 ± 24% -7.8 4.83 ± 5% perf-profile.children.cycles-pp.new_sync_write 12.63 ± 23% -7.8 4.85 ± 5% perf-profile.children.cycles-pp.vfs_write 13.17 ± 23% -7.6 5.60 ± 6% perf-profile.children.cycles-pp.do_syscall_64 13.24 ± 23% -7.3 5.92 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 6.38 ± 30% -4.8 1.55 ± 12% perf-profile.children.cycles-pp.__reserve_bytes 6.33 ± 30% -4.8 1.52 ± 12% perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes 6.36 ± 30% -4.8 1.55 ± 11% perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata 4.49 ± 18% -3.3 1.23 ± 15% perf-profile.children.cycles-pp.btrfs_block_rsv_release 4.39 ± 18% -3.2 1.21 ± 15% perf-profile.children.cycles-pp.btrfs_inode_rsv_release 0.16 ± 77% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.do_filp_open 0.16 ± 77% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.path_openat 0.16 ± 75% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.do_sys_open 0.16 ± 75% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.do_sys_openat2 0.21 ± 32% -0.1 0.13 ± 29% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.22 ± 9% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.update_blocked_averages 0.10 ± 29% -0.0 0.05 ± 70% perf-profile.children.cycles-pp.update_ts_time_stats 0.07 ± 12% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.16 ± 9% +0.0 0.20 ± 12% perf-profile.children.cycles-pp.brd_lookup_page 0.13 ± 11% +0.0 0.17 ± 18% perf-profile.children.cycles-pp.__radix_tree_lookup 0.14 ± 7% +0.1 0.20 ± 9% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.48 ± 8% +0.1 0.62 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.51 ± 29% +0.3 0.77 ± 27% perf-profile.children.cycles-pp.write 0.39 ± 32% +0.3 0.65 ± 6% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.50 ± 30% +0.3 0.76 ± 27% perf-profile.children.cycles-pp.devkmsg_write.cold 0.50 ± 30% +0.3 0.76 ± 27% perf-profile.children.cycles-pp.devkmsg_emit 0.03 ±173% +0.3 0.29 ±108% perf-profile.children.cycles-pp.osq_lock 0.03 ±173% +0.3 0.29 ±107% perf-profile.children.cycles-pp.__mutex_lock 0.11 ±130% +0.3 0.45 ± 68% perf-profile.children.cycles-pp.__do_sys_finit_module 0.11 ±130% +0.3 0.45 ± 68% perf-profile.children.cycles-pp.load_module 0.11 ±130% +0.3 0.45 ± 67% perf-profile.children.cycles-pp.syscall 0.14 ± 88% +0.4 0.54 ± 53% perf-profile.children.cycles-pp.wb_workfn 0.14 ± 88% +0.4 0.54 ± 53% perf-profile.children.cycles-pp.wb_writeback 0.14 ± 88% +0.4 0.54 ± 53% perf-profile.children.cycles-pp.writeback_sb_inodes 0.12 ±105% +0.4 0.53 ± 54% perf-profile.children.cycles-pp.__writeback_single_inode 4.76 ± 5% +0.5 5.21 ± 3% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 4.65 ± 5% +0.5 5.13 ± 2% perf-profile.children.cycles-pp.hrtimer_interrupt 6.15 ± 5% +0.5 6.65 ± 2% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack 2.06 ± 28% +1.0 3.05 ± 9% perf-profile.children.cycles-pp.ktime_get 7.80 ± 4% +1.1 8.94 ± 2% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 10.10 ± 6% +2.0 12.05 ± 6% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 0.00 +2.6 2.56 ± 19% perf-profile.children.cycles-pp.__cna_queued_spin_lock_slowpath 9.16 ± 14% +4.4 13.57 ± 18% perf-profile.children.cycles-pp.menu_select 10.50 ± 26% -10.5 0.00 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.18 ± 30% -0.1 0.11 ± 27% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.10 ± 11% +0.0 0.13 ± 10% perf-profile.self.cycles-pp.__extent_writepage 0.14 ± 7% +0.1 0.20 ± 9% perf-profile.self.cycles-pp.__intel_pmu_enable_all 0.08 ± 10% +0.1 0.16 ± 22% perf-profile.self.cycles-pp.end_page_writeback 0.03 ±173% +0.2 0.28 ±105% perf-profile.self.cycles-pp.osq_lock 1.77 ± 32% +1.0 2.75 ± 10% perf-profile.self.cycles-pp.ktime_get 0.00 +2.5 2.51 ± 19% perf-profile.self.cycles-pp.__cna_queued_spin_lock_slowpath 7.68 ± 15% +4.1 11.79 ± 21% perf-profile.self.cycles-pp.menu_select *************************************************************************************************** lkp-csl-2ap3: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap3/new_fserver/reaim/0x5003003 commit: cb45bab007 ("locking/qspinlock: Refactor the qspinlock slow path") 0e8d8f4f12 ("locking/qspinlock: Introduce CNA into the slow path of qspinlock") cb45bab007ff0cfc 0e8d8f4f1214cfbac219d6917b5 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 last_state.is_incomplete_run 1:4 -25% :4 last_state.wget_initrd :4 8% 0:4 perf-profile.children.cycles-pp.error_entry %stddev %change %stddev \ | \ 556.93 -64.1% 200.03 reaim.child_systime 49.95 +3.6% 51.77 reaim.child_utime 318145 +96.1% 623983 reaim.jobs_per_min 1657 +96.1% 3249 reaim.jobs_per_min_child 92.26 -7.8% 85.11 reaim.jti 327019 +100.4% 655467 reaim.max_jobs_per_min 3.55 -49.0% 1.81 reaim.parent_time 7.19 ± 2% +100.0% 14.38 ± 4% reaim.std_dev_percent 0.24 ± 2% -7.3% 0.22 ± 2% reaim.std_dev_time 462973 +17.9% 545826 reaim.time.involuntary_context_switches 38288 +98.5% 75996 ± 2% reaim.time.major_page_faults 1.041e+08 +44.8% 1.509e+08 reaim.time.minor_page_faults 10863 -39.7% 6549 reaim.time.percent_of_cpu_this_job_got 30257 -47.9% 15754 reaim.time.system_time 2714 +50.2% 4077 reaim.time.user_time 3000456 ± 2% +38.9% 4167220 ± 2% reaim.time.voluntary_context_switches 1043200 +44.9% 1512000 reaim.workload 29843 +40.0% 41767 uptime.idle 20127118 ± 12% +48.7% 29930674 ± 4% cpuidle.C1.time 284217 ± 9% +66.1% 472177 ± 2% cpuidle.C1.usage 308815 ± 13% +26.0% 389201 ± 16% cpuidle.POLL.usage 41.44 +20.8 62.28 mpstat.cpu.all.idle% 0.69 +1.3 1.98 ± 2% mpstat.cpu.all.soft% 51.88 -24.6 27.26 mpstat.cpu.all.sys% 4.60 +2.3 6.91 mpstat.cpu.all.usr% 41.33 +50.0% 62.00 vmstat.cpu.id 53.00 -43.4% 30.00 vmstat.cpu.sy 110.00 -25.9% 81.50 ± 2% vmstat.procs.r 25559 ± 2% +46.2% 37370 vmstat.system.cs 269427 ± 4% -12.8% 234969 meminfo.Active 269427 ± 4% -12.8% 234969 meminfo.Active(anon) 32953 +9.7% 36144 ± 2% meminfo.KernelStack 19202 +63.2% 31338 meminfo.PageTables 483410 +11.8% 540459 meminfo.SUnreclaim 304770 ± 4% -12.8% 265628 meminfo.Shmem 620741 +10.5% 685878 meminfo.Slab 18788579 +43.8% 27017272 ± 4% numa-numastat.node0.local_node 18827783 +43.8% 27074532 ± 4% numa-numastat.node0.numa_hit 19046024 +45.8% 27771991 ± 2% numa-numastat.node1.local_node 19126483 +45.6% 27844754 ± 2% numa-numastat.node1.numa_hit 18849870 +44.4% 27228340 ± 2% numa-numastat.node2.local_node 18926181 +44.1% 27271719 ± 2% numa-numastat.node2.numa_hit 18622314 +46.2% 27216882 ± 3% numa-numastat.node3.local_node 18686267 +46.1% 27303516 ± 3% numa-numastat.node3.numa_hit 42977 ± 81% -79.9% 8629 ± 59% numa-meminfo.node0.Active 42977 ± 81% -79.9% 8629 ± 59% numa-meminfo.node0.Active(anon) 7040 +24.4% 8759 ± 8% numa-meminfo.node1.KernelStack 2790 ± 11% +140.4% 6708 ± 26% numa-meminfo.node1.PageTables 103698 +19.3% 123717 ± 9% numa-meminfo.node1.SUnreclaim 129487 ± 2% +18.0% 152790 ± 7% numa-meminfo.node1.Slab 32541 ± 26% +46.6% 47695 ± 24% numa-meminfo.node2.KReclaimable 32541 ± 26% +46.6% 47695 ± 24% numa-meminfo.node2.SReclaimable 150472 ± 20% +21.5% 182840 ± 15% numa-meminfo.node2.Slab 167884 ± 33% +71.3% 287506 ± 45% numa-meminfo.node3.AnonPages.max 2974 ± 11% +145.0% 7288 ± 28% numa-meminfo.node3.PageTables 109568 ± 4% +13.7% 124544 ± 12% numa-meminfo.node3.SUnreclaim 10666 ± 81% -79.8% 2152 ± 59% numa-vmstat.node0.nr_active_anon 10665 ± 81% -79.8% 2152 ± 59% numa-vmstat.node0.nr_zone_active_anon 9854862 +41.8% 13975810 ± 2% numa-vmstat.node0.numa_hit 9773079 +41.9% 13870000 ± 2% numa-vmstat.node0.numa_local 7029 +25.1% 8796 ± 8% numa-vmstat.node1.nr_kernel_stack 678.67 ± 8% +152.6% 1714 ± 26% numa-vmstat.node1.nr_page_table_pages 25872 +20.1% 31062 ± 9% numa-vmstat.node1.nr_slab_unreclaimable 9970820 +42.6% 14214395 numa-vmstat.node1.numa_hit 9810384 +43.4% 14063434 numa-vmstat.node1.numa_local 8132 ± 26% +46.4% 11904 ± 24% numa-vmstat.node2.nr_slab_reclaimable 9969168 +43.4% 14294976 ± 2% numa-vmstat.node2.numa_hit 9812426 +44.6% 14186949 ± 3% numa-vmstat.node2.numa_local 726.67 ± 12% +158.7% 1879 ± 26% numa-vmstat.node3.nr_page_table_pages 27327 ± 4% +13.9% 31114 ± 12% numa-vmstat.node3.nr_slab_unreclaimable 9719726 +44.0% 13991557 ± 2% numa-vmstat.node3.numa_hit 9615461 +44.1% 13853485 ± 2% numa-vmstat.node3.numa_local 104269 ± 49% +32.4% 138078 ± 20% numa-vmstat.node3.numa_other 67226 ± 4% -12.4% 58905 proc-vmstat.nr_active_anon 316527 -3.1% 306823 proc-vmstat.nr_file_pages 92663 -2.9% 89935 proc-vmstat.nr_inactive_anon 33012 +9.3% 36075 ± 2% proc-vmstat.nr_kernel_stack 4865 +59.3% 7749 ± 4% proc-vmstat.nr_page_table_pages 76214 ± 4% -12.7% 66510 proc-vmstat.nr_shmem 34346 +5.8% 36334 proc-vmstat.nr_slab_reclaimable 120937 +11.5% 134852 proc-vmstat.nr_slab_unreclaimable 67226 ± 4% -12.4% 58905 proc-vmstat.nr_zone_active_anon 92663 -2.9% 89935 proc-vmstat.nr_zone_inactive_anon 152011 ± 9% -72.0% 42500 ± 30% proc-vmstat.numa_hint_faults 75604538 +44.9% 1.095e+08 proc-vmstat.numa_hit 75344552 +45.0% 1.093e+08 proc-vmstat.numa_local 129725 ± 13% -78.5% 27855 ± 33% proc-vmstat.numa_pages_migrated 440421 ± 8% -27.0% 321634 ± 22% proc-vmstat.numa_pte_updates 187992 ± 4% +5.4% 198156 proc-vmstat.pgactivate 83223343 +45.7% 1.213e+08 proc-vmstat.pgalloc_normal 1.056e+08 +44.3% 1.524e+08 proc-vmstat.pgfault 83115624 +45.8% 1.212e+08 proc-vmstat.pgfree 129725 ± 13% -78.5% 27855 ± 33% proc-vmstat.pgmigrate_success 10628125 +46.1% 15525117 proc-vmstat.pgreuse 13330 ± 54% +717.2% 108933 ± 77% sched_debug.cfs_rq:/.MIN_vruntime.avg 184231 ± 54% +190.7% 535537 ± 48% sched_debug.cfs_rq:/.MIN_vruntime.stddev 6040 ± 6% +338.5% 26486 ± 51% sched_debug.cfs_rq:/.load.avg 284313 ± 37% +159.7% 738429 ± 14% sched_debug.cfs_rq:/.load.max 1180 ± 35% -100.0% 0.00 sched_debug.cfs_rq:/.load.min 22088 ± 35% +398.6% 110141 ± 30% sched_debug.cfs_rq:/.load.stddev 13330 ± 54% +717.2% 108933 ± 77% sched_debug.cfs_rq:/.max_vruntime.avg 184231 ± 54% +190.7% 535537 ± 48% sched_debug.cfs_rq:/.max_vruntime.stddev 16468615 -51.1% 8045534 ± 11% sched_debug.cfs_rq:/.min_vruntime.avg 16715699 -50.1% 8341867 ± 11% sched_debug.cfs_rq:/.min_vruntime.max 15817769 -51.3% 7697369 ± 11% sched_debug.cfs_rq:/.min_vruntime.min 0.71 ± 11% -47.8% 0.37 ± 14% sched_debug.cfs_rq:/.nr_running.avg 1.17 +19.3% 1.39 ± 4% sched_debug.cfs_rq:/.nr_running.max 0.22 ± 35% -100.0% 0.00 sched_debug.cfs_rq:/.nr_running.min 0.14 ± 18% +74.2% 0.25 ± 6% sched_debug.cfs_rq:/.nr_running.stddev 694.83 ± 15% -51.9% 334.48 ± 20% sched_debug.cfs_rq:/.runnable_avg.avg 110.72 ± 51% -90.4% 10.63 ±114% sched_debug.cfs_rq:/.runnable_avg.min 155.35 ± 11% +42.5% 221.31 ± 9% sched_debug.cfs_rq:/.runnable_avg.stddev 64422 ± 94% +295.3% 254650 ± 19% sched_debug.cfs_rq:/.spread0.avg 311765 ± 14% +76.7% 550961 ± 14% sched_debug.cfs_rq:/.spread0.max -587893 -84.1% -93210 sched_debug.cfs_rq:/.spread0.min 685.90 ± 14% -56.7% 297.04 ± 23% sched_debug.cfs_rq:/.util_avg.avg 100.39 ± 59% -90.9% 9.12 ±125% sched_debug.cfs_rq:/.util_avg.min 153.19 ± 12% +28.3% 196.53 ± 12% sched_debug.cfs_rq:/.util_avg.stddev 398.32 ± 19% -79.6% 81.24 ± 25% sched_debug.cfs_rq:/.util_est_enqueued.avg 932.06 ± 8% -26.5% 684.67 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.max 0.28 ± 28% -100.0% 0.00 sched_debug.cfs_rq:/.util_est_enqueued.min 186.70 ± 17% -31.0% 128.84 ± 18% sched_debug.cfs_rq:/.util_est_enqueued.stddev 42223 ± 22% +72.6% 72869 ± 21% sched_debug.cpu.avg_idle.min 513534 ± 67% -58.1% 214959 ± 3% sched_debug.cpu.avg_idle.stddev 69440 ± 18% -53.1% 32566 ± 23% sched_debug.cpu.curr->pid.avg 465.44 ± 54% -100.0% 0.00 sched_debug.cpu.curr->pid.min 0.71 ± 11% -40.6% 0.42 ± 9% sched_debug.cpu.nr_running.avg 0.22 ± 35% -100.0% 0.00 sched_debug.cpu.nr_running.min 0.18 ± 10% +68.8% 0.31 ± 5% sched_debug.cpu.nr_running.stddev 21723 ± 2% +35.3% 29395 ± 9% sched_debug.cpu.nr_switches.avg 37415 ± 16% +23.6% 46248 ± 5% sched_debug.cpu.nr_switches.max 17608 +44.3% 25417 ± 10% sched_debug.cpu.nr_switches.min 161.39 ± 12% +47.1% 237.34 ± 18% sched_debug.cpu.nr_uninterruptible.max -54.78 +48.6% -81.42 sched_debug.cpu.nr_uninterruptible.min 24.07 ± 4% +58.5% 38.15 ± 11% sched_debug.cpu.nr_uninterruptible.stddev 11566 +11.1% 12849 slabinfo.Acpi-State.active_objs 11566 +11.1% 12849 slabinfo.Acpi-State.num_objs 240075 +13.6% 272838 slabinfo.dentry.active_objs 5793 +13.6% 6580 slabinfo.dentry.active_slabs 243365 +13.6% 276386 slabinfo.dentry.num_objs 5793 +13.6% 6580 slabinfo.dentry.num_slabs 955.00 ± 9% +16.4% 1112 ± 7% slabinfo.file_lock_cache.active_objs 955.00 ± 9% +16.4% 1112 ± 7% slabinfo.file_lock_cache.num_objs 14271 +14.7% 16366 slabinfo.files_cache.active_objs 14271 +14.7% 16366 slabinfo.files_cache.num_objs 145916 +52.7% 222770 ± 2% slabinfo.filp.active_objs 2300 +53.0% 3519 ± 2% slabinfo.filp.active_slabs 147261 +53.0% 225274 ± 2% slabinfo.filp.num_objs 2300 +53.0% 3519 ± 2% slabinfo.filp.num_slabs 1319 ± 14% +26.2% 1664 ± 8% slabinfo.khugepaged_mm_slot.active_objs 1319 ± 14% +26.2% 1664 ± 8% slabinfo.khugepaged_mm_slot.num_objs 1037 +19.6% 1240 slabinfo.kmalloc-512.active_slabs 66437 +19.5% 79424 slabinfo.kmalloc-512.num_objs 1037 +19.6% 1240 slabinfo.kmalloc-512.num_slabs 114959 +9.0% 125273 slabinfo.kmalloc-8.active_objs 4536 ± 5% +7.2% 4862 ± 3% slabinfo.kmalloc-rcl-64.active_objs 4536 ± 5% +7.2% 4862 ± 3% slabinfo.kmalloc-rcl-64.num_objs 10920 +18.9% 12978 slabinfo.mm_struct.active_objs 10920 +18.9% 12979 slabinfo.mm_struct.num_objs 1104 ± 5% -16.9% 917.00 ± 10% slabinfo.mnt_cache.active_objs 1104 ± 5% -16.9% 917.00 ± 10% slabinfo.mnt_cache.num_objs 1551 +14.3% 1773 ± 2% slabinfo.names_cache.active_objs 1551 +14.3% 1773 ± 2% slabinfo.names_cache.num_objs 35694 ± 2% +49.3% 53295 ± 4% slabinfo.pid.active_objs 557.00 ± 2% +49.4% 832.25 ± 4% slabinfo.pid.active_slabs 35694 ± 2% +49.3% 53295 ± 4% slabinfo.pid.num_objs 557.00 ± 2% +49.4% 832.25 ± 4% slabinfo.pid.num_slabs 8786 +20.2% 10558 slabinfo.sighand_cache.active_objs 590.00 +20.3% 709.75 slabinfo.sighand_cache.active_slabs 8858 +20.3% 10654 slabinfo.sighand_cache.num_objs 590.00 +20.3% 709.75 slabinfo.sighand_cache.num_slabs 8502 +11.6% 9489 ± 2% slabinfo.sock_inode_cache.active_objs 8502 +11.6% 9489 ± 2% slabinfo.sock_inode_cache.num_objs 39805 ± 2% +45.4% 57892 ± 2% slabinfo.task_delay_info.active_objs 780.00 ± 2% +45.5% 1135 ± 2% slabinfo.task_delay_info.active_slabs 39805 ± 2% +45.5% 57905 ± 2% slabinfo.task_delay_info.num_objs 780.00 ± 2% +45.5% 1135 ± 2% slabinfo.task_delay_info.num_slabs 3088 +29.3% 3992 ± 2% slabinfo.task_struct.active_objs 3098 +29.3% 4005 ± 2% slabinfo.task_struct.active_slabs 3098 +29.3% 4005 ± 2% slabinfo.task_struct.num_objs 3098 +29.3% 4005 ± 2% slabinfo.task_struct.num_slabs 1.353e+10 +11.8% 1.513e+10 perf-stat.i.branch-instructions 84012986 ± 5% +46.6% 1.232e+08 ± 6% perf-stat.i.branch-misses 31.81 ± 12% -10.8 21.01 ± 21% perf-stat.i.cache-miss-rate% 68723351 ± 2% -10.6% 61409511 ± 4% perf-stat.i.cache-misses 2.121e+08 ± 10% +57.2% 3.333e+08 ± 8% perf-stat.i.cache-references 25583 ± 2% +51.4% 38727 perf-stat.i.context-switches 5.21 ± 3% -25.2% 3.90 ± 5% perf-stat.i.cpi 192200 +7.5% 206633 perf-stat.i.cpu-clock 3.37e+11 -28.3% 2.415e+11 perf-stat.i.cpu-cycles 3432 +61.5% 5541 ± 3% perf-stat.i.cpu-migrations 4302 -29.4% 3039 ± 8% perf-stat.i.cycles-between-cache-misses 2726072 ± 23% +52.3% 4151327 ± 26% perf-stat.i.dTLB-load-misses 1.215e+10 +6.3% 1.292e+10 perf-stat.i.dTLB-loads 941111 ± 11% +46.9% 1382681 ± 11% perf-stat.i.dTLB-store-misses 2.493e+09 +48.4% 3.701e+09 perf-stat.i.dTLB-stores 71.80 ± 4% -6.7 65.13 perf-stat.i.iTLB-load-miss-rate% 8355924 ± 6% +47.0% 12280660 ± 7% perf-stat.i.iTLB-load-misses 3268044 ± 18% +65.6% 5412376 ± 8% perf-stat.i.iTLB-loads 6.464e+10 +19.2% 7.704e+10 perf-stat.i.instructions 6911 ± 3% -32.1% 4691 ± 6% perf-stat.i.instructions-per-iTLB-miss 0.23 +28.9% 0.30 perf-stat.i.ipc 124.96 +101.4% 251.73 ± 2% perf-stat.i.major-faults 1.76 -41.2% 1.03 perf-stat.i.metric.GHz 0.56 ± 8% +32.5% 0.75 ± 7% perf-stat.i.metric.K/sec 332691 +49.2% 496370 perf-stat.i.minor-faults 91.27 -4.0 87.22 perf-stat.i.node-load-miss-rate% 18748059 -13.0% 16311904 ± 3% perf-stat.i.node-load-misses 1587953 +50.0% 2382313 perf-stat.i.node-loads 86.40 -8.3 78.07 ± 2% perf-stat.i.node-store-miss-rate% 9547999 -19.9% 7644037 ± 2% perf-stat.i.node-store-misses 1064509 +92.2% 2045699 ± 2% perf-stat.i.node-stores 332816 +49.2% 496622 perf-stat.i.page-faults 192200 +7.5% 206633 perf-stat.i.task-clock 3.25 ± 9% +36.0% 4.42 ± 7% perf-stat.overall.MPKI 0.62 ± 5% +0.2 0.83 ± 5% perf-stat.overall.branch-miss-rate% 32.96 ± 10% -13.4 19.58 ± 11% perf-stat.overall.cache-miss-rate% 5.25 -42.4% 3.02 perf-stat.overall.cpi 4953 -28.7% 3533 ± 4% perf-stat.overall.cycles-between-cache-misses 0.02 ± 23% +0.0 0.03 ± 24% perf-stat.overall.dTLB-load-miss-rate% 72.34 ± 3% -3.1 69.29 perf-stat.overall.iTLB-load-miss-rate% 7868 ± 6% -20.0% 6292 ± 7% perf-stat.overall.instructions-per-iTLB-miss 0.19 +73.5% 0.33 perf-stat.overall.ipc 92.20 -4.8 87.37 perf-stat.overall.node-load-miss-rate% 90.00 -9.8 80.24 perf-stat.overall.node-store-miss-rate% 19255954 -23.1% 14811673 perf-stat.overall.path-length 1.382e+10 +5.2% 1.454e+10 perf-stat.ps.branch-instructions 85147082 ± 5% +42.1% 1.21e+08 ± 5% perf-stat.ps.branch-misses 69832184 ± 2% -9.6% 63144472 ± 4% perf-stat.ps.cache-misses 2.141e+08 ± 9% +52.0% 3.254e+08 ± 8% perf-stat.ps.cache-references 25647 ± 2% +46.2% 37498 perf-stat.ps.context-switches 3.458e+11 -35.6% 2.227e+11 perf-stat.ps.cpu-cycles 3456 +55.5% 5375 ± 4% perf-stat.ps.cpu-migrations 2731148 ± 22% +50.7% 4114660 ± 24% perf-stat.ps.dTLB-load-misses 951612 ± 11% +42.4% 1354727 ± 10% perf-stat.ps.dTLB-store-misses 2.534e+09 +43.0% 3.624e+09 perf-stat.ps.dTLB-stores 8410006 ± 6% +39.9% 11763281 ± 6% perf-stat.ps.iTLB-load-misses 3251030 ± 17% +60.5% 5218236 ± 7% perf-stat.ps.iTLB-loads 6.591e+10 +11.7% 7.364e+10 perf-stat.ps.instructions 127.07 +97.9% 251.44 ± 2% perf-stat.ps.major-faults 338752 +44.5% 489644 perf-stat.ps.minor-faults 19070733 -11.1% 16952678 ± 4% perf-stat.ps.node-load-misses 1613838 +51.7% 2448074 perf-stat.ps.node-loads 9716997 -18.4% 7933032 ± 2% perf-stat.ps.node-store-misses 1079544 +80.8% 1952245 perf-stat.ps.node-stores 338879 +44.6% 489896 perf-stat.ps.page-faults 2.009e+13 +11.5% 2.239e+13 perf-stat.total.instructions 0.04 ± 54% +278.3% 0.14 ± 41% perf-sched.sch_delay.avg.ms.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.part 0.11 ±123% +813.3% 1.04 ±120% perf-sched.sch_delay.avg.ms.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.isra 0.03 ± 9% +210.5% 0.10 ± 21% perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 0.17 ± 89% +210.6% 0.52 ± 59% perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.05 ± 34% +1883.2% 0.91 ± 48% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 0.12 ± 45% +772.8% 1.04 ± 65% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown] 0.09 ± 9% +1004.3% 0.97 ± 90% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown] 0.06 ± 28% +390.8% 0.29 ± 41% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 0.63 ± 7% +80.2% 1.13 ± 21% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.ret_from_fork.[unknown] 0.07 ± 16% +113.1% 0.14 ± 21% perf-sched.sch_delay.avg.ms.io_schedule.__lock_page_killable.filemap_fault.__do_fault 0.01 ± 7% +196.2% 0.02 ± 65% perf-sched.sch_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read 0.04 ± 45% +742.5% 0.35 ± 83% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.alloc_pages_vma.wp_page_copy 0.07 ± 78% -84.3% 0.01 ±142% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.allocate_slab.___slab_alloc 0.04 ± 79% +2194.9% 0.89 ±164% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.pte_alloc_one.__pte_alloc 0.07 ± 19% -86.5% 0.01 ± 59% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.__anon_vma_prepare.do_fault.__handle_mm_fault 0.25 ±105% -98.2% 0.00 ±137% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.copy_page_to_iter.generic_file_buffered_read.new_sync_read 0.40 ± 6% +91.2% 0.77 ± 5% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.08 ±100% -92.6% 0.01 ± 94% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write.__anon_vma_prepare.do_anonymous_page 0.03 ± 79% +277.4% 0.12 ± 73% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write.__vma_adjust.__split_vma 0.01 ± 16% +1.5e+05% 8.25 ±103% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write.do_truncate.path_openat 0.04 ± 19% +318.9% 0.16 ± 44% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write.unlink_anon_vmas.free_pgtables 0.04 ± 7% +1180.0% 0.51 ±145% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write.unlink_file_vma.free_pgtables 0.00 ± 10% -89.3% 0.00 ±173% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write_killable.__vm_munmap.__x64_sys_munmap 0.07 ± 54% +242.3% 0.26 ± 62% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write_killable.vm_mmap_pgoff.elf_map 0.03 ± 11% -87.8% 0.00 ± 13% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 0.01 ± 49% +1.3e+05% 8.04 ±152% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.do_unlinkat.do_syscall_64 0.10 ±127% +16890.4% 16.82 ±163% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.done_path_create.do_linkat 0.13 ± 18% +459.3% 0.71 ± 18% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.path_openat.do_filp_open 0.44 ±118% +204.8% 1.33 ± 94% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.scan_positives.dcache_readdir 0.01 ± 36% +3156.9% 0.43 ± 63% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.step_into.path_openat 0.07 ± 21% +554.5% 0.46 ± 93% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat 0.00 ±141% +19625.0% 0.07 ±150% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.generic_file_buffered_read.__kernel_read.load_elf_binary 0.08 ±134% +686.6% 0.66 ± 59% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__d_alloc.d_alloc_cursor 0.04 ± 37% +648.3% 0.33 ± 28% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.security_file_alloc.__alloc_file 0.21 ± 61% -77.6% 0.05 ±139% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.vm_area_alloc.__install_special_mapping 0.30 ± 97% -99.2% 0.00 ± 34% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.vm_area_alloc.do_brk_flags 3.67 ±140% -100.0% 0.00 ±173% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_node_trace.__get_vm_area_node.__vmalloc_node_range 0.05 ± 51% +75.6% 0.09 ± 30% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_trace.perf_event_mmap.mmap_region 0.19 ± 85% -93.9% 0.01 ±148% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_trace.perf_event_mmap.mprotect_fixup 0.01 ± 66% +89763.4% 8.39 ±106% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open 0.01 ±108% +903.8% 0.13 ±129% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.mutex_lock.futex_exec_release.exec_mm_release 0.03 ± 53% -67.5% 0.01 ± 83% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.mutex_lock.futex_exit_release.exit_mm_release 0.11 ±125% +1883.9% 2.25 ± 40% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork 0.01 ± 70% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate 0.30 ± 3% +308.2% 1.22 ± 26% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 0.08 ± 68% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.wait_for_completion.stop_two_cpus.migrate_swap 0.01 ±103% -100.0% 0.00 perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap 0.01 ±106% -100.0% 0.00 perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages 0.01 ± 49% +1115.0% 0.14 ±143% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap 0.03 ± 52% -89.4% 0.00 ±107% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.anon_vma_clone.anon_vma_fork.dup_mmap 0.02 ± 54% +1681.5% 0.39 ± 70% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.01 ± 80% +507.1% 0.09 ± 45% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 0.02 ± 24% +1250.0% 0.26 ± 68% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.filename_create.do_linkat.__x64_sys_link 0.07 ± 65% -87.3% 0.01 ± 75% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap 0.02 ± 20% +232.6% 0.05 ± 33% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap 0.01 ± 27% +363.9% 0.04 ± 43% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 0.19 ± 68% -95.1% 0.01 ± 13% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 0.04 ± 18% +5366.5% 1.93 ± 40% perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 0.04 ± 39% +464.8% 0.24 ± 60% perf-sched.sch_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 0.00 ±141% +48300.0% 0.97 ±170% perf-sched.sch_delay.avg.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all 0.20 ± 7% +1238.1% 2.63 ± 31% perf-sched.sch_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork 0.12 ± 27% -74.7% 0.03 ±149% perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.path_openat 0.01 ± 7% +9784.2% 1.25 ± 18% perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork 5.01 ± 31% +324.7% 21.26 ± 36% perf-sched.sch_delay.max.ms.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.part 3.59 ±132% +1076.4% 42.25 ± 96% perf-sched.sch_delay.max.ms.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.isra 16.19 ± 7% +1397.5% 242.51 ± 30% perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 9.13 ± 27% +2518.1% 238.94 ± 62% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 10.04 ± 65% +1971.0% 207.85 ± 63% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown] 9.21 ± 61% +2000.8% 193.58 ± 63% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown] 11.01 ± 18% +799.2% 99.02 ± 86% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 14.73 ± 13% +265.9% 53.91 ± 26% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.ret_from_fork.[unknown] 10.65 ± 44% +151.1% 26.76 ± 19% perf-sched.sch_delay.max.ms.io_schedule.__lock_page_killable.filemap_fault.__do_fault 1.21 ± 24% +2921.4% 36.62 ±124% perf-sched.sch_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 0.53 ± 55% +1359.3% 7.76 ±113% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.alloc_pages_vma.wp_page_copy 0.30 ± 92% -90.7% 0.03 ±155% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.allocate_slab.___slab_alloc 0.37 ± 69% +3449.8% 13.07 ±162% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.pte_alloc_one.__pte_alloc 0.48 ± 37% -89.3% 0.05 ±102% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.__anon_vma_prepare.do_fault.__handle_mm_fault 0.55 ± 93% -95.3% 0.03 ±153% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.__kmalloc_node.memcg_alloc_page_obj_cgroups.kmem_cache_alloc_node 0.97 ± 13% +591.3% 6.72 ±119% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.change_p4d_range.change_protection.mprotect_fixup 0.31 ±106% -98.6% 0.00 ±137% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.copy_page_to_iter.generic_file_buffered_read.new_sync_read 11.49 ± 5% +87.8% 21.57 ± 31% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.32 ±102% -96.0% 0.01 ± 79% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write.__anon_vma_prepare.do_anonymous_page 1.05 ± 98% +478.9% 6.10 ± 82% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write.__vma_adjust.__split_vma 0.02 ± 5% +1.4e+06% 217.29 ±104% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write.do_truncate.path_openat 1.95 ± 26% +682.5% 15.25 ± 64% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write.unlink_anon_vmas.free_pgtables 0.93 ± 14% +9721.3% 91.57 ±158% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write.unlink_file_vma.free_pgtables 0.00 ± 10% -78.6% 0.00 ±173% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write_killable.__vm_munmap.__x64_sys_munmap 0.24 ± 43% -96.7% 0.01 ± 72% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 0.01 ± 28% +8.3e+05% 113.60 ±164% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.do_unlinkat.do_syscall_64 0.21 ±108% +34647.0% 72.97 ±145% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.done_path_create.do_linkat 3.03 ± 39% +1407.5% 45.73 ± 29% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.path_openat.do_filp_open 1.22 ± 39% +4068.4% 50.91 ± 79% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.step_into.path_openat 3.38 ± 60% +3700.6% 128.54 ±127% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat 0.88 ± 46% +299.6% 3.50 ± 55% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.exit_mmap.mmput.begin_new_exec 0.00 ±141% +22250.0% 0.30 ±167% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.generic_file_buffered_read.__kernel_read.load_elf_binary 0.57 ±139% +12527.6% 71.47 ± 89% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__d_alloc.d_alloc_cursor 0.00 ±141% +1525.0% 0.03 ±144% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__delayacct_tsk_init.copy_process 1.73 ± 43% +863.5% 16.71 ± 50% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.security_file_alloc.__alloc_file 3.67 ±140% -100.0% 0.00 ±173% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_node_trace.__get_vm_area_node.__vmalloc_node_range 3.19 ± 52% +345.8% 14.24 ± 84% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_trace.perf_event_mmap.mmap_region 1.01 ± 99% -91.8% 0.08 ±167% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_trace.perf_event_mmap.mprotect_fixup 0.11 ± 85% +1.7e+05% 187.38 ± 84% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open 0.05 ±130% +602.6% 0.36 ±142% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.mutex_lock.futex_exec_release.exec_mm_release 0.52 ±136% +10794.6% 57.09 ± 72% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork 0.06 ± 92% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate 28.50 ± 12% +645.4% 212.48 ± 39% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 1.20 ± 76% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.wait_for_completion.stop_two_cpus.migrate_swap 0.18 ±130% -100.0% 0.00 perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap 0.20 ±132% -100.0% 0.00 perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages 1.33 ±103% -96.9% 0.04 ±173% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.__put_anon_vma.unlink_anon_vmas.free_pgtables 1.53 ± 79% +6359.8% 98.51 ±148% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap 2.57 ± 63% +676.1% 19.92 ± 49% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup 0.78 ± 76% -99.2% 0.01 ±138% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.anon_vma_clone.anon_vma_fork.dup_mmap 0.19 ± 94% -97.6% 0.00 ±100% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.anon_vma_fork.dup_mmap.dup_mm 5.70 ± 45% +1878.3% 112.68 ± 89% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.68 ±111% +1530.5% 60.07 ± 26% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 6.33 ± 17% +2353.2% 155.41 ±105% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.filename_create.do_linkat.__x64_sys_link 2.23 ± 66% -98.3% 0.04 ± 65% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap 6.50 ± 41% +643.0% 48.28 ± 78% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap 2.45 ± 43% +1688.6% 43.80 ± 88% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 9.31 ± 80% -99.6% 0.04 ± 54% perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 0.52 ± 65% +15185.6% 79.99 ± 38% perf-sched.sch_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 16.34 ± 98% +385.7% 79.39 ± 79% perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 0.00 ±141% +72153.1% 1.93 ±171% perf-sched.sch_delay.max.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all 10.28 ± 58% +2363.0% 253.08 ± 17% perf-sched.sch_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork 8.41 ± 37% +3406.7% 295.08 ± 29% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork 0.12 ± 74% +358.2% 0.54 ± 29% perf-sched.total_sch_delay.average.ms 39.70 ± 3% -15.2% 33.67 ± 3% perf-sched.total_wait_and_delay.average.ms 157875 ± 3% +29.4% 204320 ± 3% perf-sched.total_wait_and_delay.count.ms 5585 +14.5% 6395 ± 3% perf-sched.total_wait_and_delay.max.ms 39.58 ± 3% -16.3% 33.13 ± 3% perf-sched.total_wait_time.average.ms 5585 +14.5% 6395 ± 3% perf-sched.total_wait_time.max.ms 6.67 ± 2% +90.8% 12.72 ± 10% perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 6.25 ± 22% +706.2% 50.40 ± 54% perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 6.09 ± 15% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 38.34 ± 13% +47.7% 56.61 ± 33% perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read 5.09 +14.7% 5.83 ± 3% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity 0.33 ± 3% +330.6% 1.42 ± 24% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 1.33 ± 20% +419.5% 6.93 ± 7% perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.60 ± 70% +168.1% 1.61 ± 18% perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 3.71 ± 11% +29.9% 4.82 ± 12% perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2 0.04 ±141% +440.1% 0.24 ± 12% perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.unmap_region 0.06 ±141% +604.1% 0.41 ± 20% perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 251.31 ± 7% -36.4% 159.76 ± 18% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 87.92 ± 14% +50.7% 132.47 ± 22% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 384.15 -32.3% 260.23 ± 10% perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork 142.29 -30.8% 98.47 ± 6% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork 35.67 ± 11% +58.4% 56.50 perf-sched.wait_and_delay.count.devkmsg_read.vfs_read.ksys_read.do_syscall_64 14.67 ± 8% +19.3% 17.50 ± 4% perf-sched.wait_and_delay.count.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64 35.67 ± 9% +58.4% 56.50 perf-sched.wait_and_delay.count.do_syslog.part.0.kmsg_read.vfs_read 39991 +28.3% 51295 ± 4% perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 41076 +26.8% 52088 ± 4% perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 914.67 ± 2% +68.3% 1539 ± 6% perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 122.33 ±141% +401.1% 613.00 ± 22% perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown] 1649 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 4728 ± 13% -91.3% 412.00 ±100% perf-sched.wait_and_delay.count.preempt_schedule_common._cond_resched.dput.scan_positives.dcache_readdir 4.67 ± 44% +1325.0% 66.50 ± 51% perf-sched.wait_and_delay.count.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork 1987 ± 4% -13.4% 1720 ± 4% perf-sched.wait_and_delay.count.preempt_schedule_common._cond_resched.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity 3064 ± 8% +76.6% 5412 ± 13% perf-sched.wait_and_delay.count.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 2046 ± 7% +68.3% 3443 ± 15% perf-sched.wait_and_delay.count.rwsem_down_read_slowpath.walk_component.path_lookupat.isra.0 896.33 ± 5% +81.3% 1625 ± 12% perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 776.00 ± 75% +292.9% 3049 ± 44% perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 1649 ± 32% +198.7% 4926 ± 45% perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap 354.67 ±141% +482.9% 2067 ± 36% perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.unmap_region 350.00 ±141% +496.1% 2086 ± 33% perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 13.00 ± 21% +61.5% 21.00 perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select 163.67 ± 3% -35.2% 106.00 ± 25% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 1762 ± 4% -17.5% 1454 ± 12% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 9129 ± 2% +43.1% 13062 ± 9% perf-sched.wait_and_delay.count.smpboot_thread_fn.kthread.ret_from_fork 12642 +52.2% 19242 ± 3% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork 5512 -30.9% 3811 perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 5512 -30.9% 3811 perf-sched.wait_and_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read 340.62 ±141% +203.4% 1033 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown] 5496 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 5580 -30.1% 3899 perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 1495 ± 31% +114.1% 3203 ± 4% perf-sched.wait_and_delay.max.ms.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork 28.50 ± 12% +645.4% 212.48 ± 39% perf-sched.wait_and_delay.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 20.64 ± 78% +2946.5% 628.69 ± 62% perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 20.38 ± 28% +299.0% 81.32 ± 53% perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap 3.90 ±141% +526.7% 24.46 ± 34% perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.unmap_region 3.78 ±141% +1570.8% 63.11 ± 45% perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 5176 -31.0% 3569 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 5585 -30.2% 3899 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select 505.28 +31.3% 663.68 ± 9% perf-sched.wait_and_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 4817 ± 15% -31.2% 3315 ± 3% perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork 1791 -16.1% 1502 ± 3% perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork 0.08 ± 39% +460.9% 0.43 ± 27% perf-sched.wait_time.avg.ms.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.part 0.17 ± 92% +182.7% 0.48 ± 59% perf-sched.wait_time.avg.ms.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.isra 6.50 ± 3% +87.7% 12.20 ± 8% perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.59 ±123% +129.1% 1.35 ± 86% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 6.21 ± 22% +697.5% 49.49 ± 55% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 8.60 ± 95% +175.7% 23.70 ± 34% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown] 6.03 ± 15% +354.9% 27.43 ± 13% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 0.00 ± 88% +24178.6% 1.13 ±156% perf-sched.wait_time.avg.ms.io_schedule.__lock_page.__do_fault.do_fault 38.33 ± 13% +47.6% 56.59 ± 33% perf-sched.wait_time.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read 0.53 ±120% -98.4% 0.01 ±102% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__alloc_pages_nodemask.__pmd_alloc.__handle_mm_fault 0.01 ±115% +6617.2% 0.36 ±168% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__kmalloc.load_elf_phdrs.load_elf_binary 0.42 ± 44% +593.4% 2.89 ± 57% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__kmalloc.security_task_alloc.copy_process 0.08 ± 57% +614.6% 0.60 ± 48% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__put_anon_vma.unlink_anon_vmas.free_pgtables 0.27 ±140% +525.8% 1.67 ± 86% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.cgroup_can_fork.copy_process.kernel_clone 0.05 ± 25% +978.8% 0.50 ± 50% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.change_p4d_range.change_protection.mprotect_fixup 0.53 ± 73% +685.8% 4.14 ± 66% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.copy_pte_range.copy_page_range.dup_mmap 0.02 ±123% +6830.4% 1.59 ±103% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_read.path_openat.do_filp_open 0.06 ± 29% +796.1% 0.51 ± 93% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_read.walk_component.link_path_walk 0.01 ±141% +2254.2% 0.14 ±161% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_read_killable.create_elf_tables.isra 0.01 ± 97% +9626.4% 1.13 ± 62% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.__anon_vma_prepare.do_fault 0.02 ± 87% +4118.8% 0.79 ± 55% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.__vma_adjust.shift_arg_pages 1.50 ± 68% +1104.7% 18.05 ±100% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.anon_vma_fork.dup_mmap 2.02 ± 13% +454.8% 11.23 ± 69% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.do_truncate.path_openat 1.78 ± 66% +587.5% 12.24 ± 99% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.dup_mmap.dup_mm 0.86 ± 39% +37.3% 1.18 ± 11% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.unlink_file_vma.free_pgtables 0.01 ±141% +3608.3% 0.22 ± 85% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write_killable.__vm_munmap.elf_map 0.01 ±135% +539.5% 0.08 ± 83% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write_killable.vm_brk_flags.load_elf_interp 0.04 ± 21% +251.3% 0.14 ± 50% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write_killable.vm_mmap_pgoff.elf_map 0.25 ± 70% +1512.8% 4.09 ±132% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.__fput.task_work_run 0.18 ±139% +1040.9% 2.06 ± 93% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.dcache_dir_close.__fput 0.32 ± 75% +3385.1% 11.30 ±101% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.do_unlinkat.do_syscall_64 9.06 ± 10% +226.6% 29.60 ± 20% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.scan_positives.dcache_readdir 2.19 ±119% +216.9% 6.95 ± 21% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.step_into.path_openat 0.16 ± 19% +1845.7% 3.15 ± 29% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat 0.03 ± 70% +2914.6% 0.82 ± 63% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.exit_mmap.mmput.begin_new_exec 0.97 ± 23% +131.5% 2.24 ± 56% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.exit_mmap.mmput.do_exit 0.01 ±126% +319.3% 0.06 ± 53% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__anon_vma_prepare.do_anonymous_page 0.04 ± 15% +2327.3% 0.89 ± 54% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__d_alloc.d_alloc 0.62 ± 70% +3428.4% 21.95 ± 35% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__d_alloc.d_alloc_cursor 0.29 ± 72% +1816.0% 5.56 ± 89% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.copy_fs_struct.copy_process 0.05 ±119% +1698.6% 0.95 ± 91% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.getname_flags.do_sys_openat2 0.18 ± 72% +533.7% 1.16 ± 31% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.getname_flags.user_path_at_empty 0.41 ± 34% +890.7% 4.09 ± 49% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.prepare_creds.copy_creds 3.70 ± 18% +55.5% 5.76 ± 42% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.vm_area_dup.dup_mmap 10.64 ±105% +189.5% 30.81 ± 66% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open 0.10 ± 68% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.mutex_lock_killable.begin_new_exec.load_elf_binary 0.05 ± 97% +1166.8% 0.58 ± 67% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.remove_vma.__do_munmap.__vm_munmap 5.09 +14.7% 5.83 ± 3% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity 2.90 ± 20% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate 0.03 ± 5% +539.8% 0.20 ± 26% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 2.38 ± 18% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.wait_for_completion.stop_two_cpus.migrate_swap 0.23 ± 2% +87.1% 0.44 ± 35% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 2.62 ± 44% -100.0% 0.00 perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap 2.41 ± 41% -100.0% 0.00 perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages 0.17 ± 4% +96.1% 0.34 ± 48% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup 1.31 ± 21% +398.6% 6.54 ± 7% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.93 ± 7% +64.0% 1.53 ± 16% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 0.17 ± 14% +31.3% 0.22 ± 13% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.unmap_region 0.20 ± 15% +83.9% 0.37 ± 25% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 251.12 ± 7% -36.4% 159.75 ± 18% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 87.92 ± 14% +50.6% 132.37 ± 23% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 383.96 -32.9% 257.59 ± 9% perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork 142.28 -31.7% 97.22 ± 6% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork 8.16 ± 46% +383.8% 39.47 ± 75% perf-sched.wait_time.max.ms.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.part 5512 -30.9% 3811 perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 5512 -30.9% 3811 perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read 5496 -30.6% 3813 perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown] 0.07 ±107% +29156.2% 21.16 ±159% perf-sched.wait_time.max.ms.io_schedule.__lock_page.__do_fault.do_fault 5580 -30.1% 3899 perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 4.62 ± 40% +343.5% 20.48 ± 14% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.__kmalloc.security_task_alloc.copy_process 2.87 ± 85% +498.7% 17.16 ± 34% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.__put_anon_vma.unlink_anon_vmas.free_pgtables 1.03 ±140% +525.1% 6.42 ± 54% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.cgroup_can_fork.copy_process.kernel_clone 0.85 ± 22% +2220.1% 19.71 ± 82% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.change_p4d_range.change_protection.mprotect_fixup 7.98 ± 62% +586.9% 54.83 ±100% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.copy_pte_range.copy_page_range.dup_mmap 0.42 ± 73% +476.2% 2.44 ± 95% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.copy_strings.isra.0 0.18 ±131% +4103.5% 7.45 ± 88% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_read.path_openat.do_filp_open 2.68 ± 50% +1905.1% 53.65 ±123% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_read.walk_component.link_path_walk 0.04 ±141% +3772.9% 1.39 ±166% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_read_killable.create_elf_tables.isra 0.03 ±122% +22698.3% 6.76 ± 88% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write.__anon_vma_prepare.do_fault 0.25 ±103% +3843.4% 9.87 ± 62% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write.__vma_adjust.shift_arg_pages 23.74 ± 13% +1153.9% 297.72 ±136% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write.anon_vma_clone.anon_vma_fork 8.46 ± 76% +3275.9% 285.49 ±146% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write.anon_vma_fork.dup_mmap 8.55 ± 14% +2664.7% 236.39 ± 90% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write.do_truncate.path_openat 0.02 ±141% +3120.9% 0.78 ± 90% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write_killable.__vm_munmap.elf_map 0.63 ± 47% +456.1% 3.51 ± 76% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write_killable.vm_mmap_pgoff.elf_map 0.36 ±139% +758.2% 3.10 ± 66% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.dcache_dir_close.__fput 1.91 ± 89% +6827.3% 132.20 ±137% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.do_unlinkat.do_syscall_64 336.18 ±140% +73.0% 581.60 ± 78% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.done_path_create.do_linkat 341.13 ±137% +196.8% 1012 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.step_into.path_openat 9.64 ± 52% +4704.9% 463.29 ± 72% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat 0.94 ± 71% +1718.2% 17.05 ± 33% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.exit_mmap.mmput.begin_new_exec 6.94 ± 41% +683.1% 54.36 ±113% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.exit_mmap.mmput.do_exit 0.07 ±119% +888.4% 0.65 ± 80% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__anon_vma_prepare.do_anonymous_page 0.42 ± 51% +3060.9% 13.37 ± 71% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__d_alloc.d_alloc 1.61 ± 71% +29984.9% 484.07 ± 65% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__d_alloc.d_alloc_cursor 1.01 ± 76% +779.3% 8.90 ± 68% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.copy_fs_struct.copy_process 1.25 ± 73% +327.5% 5.36 ± 28% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.getname_flags.user_path_at_empty 23.94 ± 16% +259.0% 85.92 ± 53% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.vm_area_dup.dup_mmap 6.01 ± 27% +52.0% 9.13 ± 24% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc_trace.perf_event_mmap.mmap_region 0.27 ± 77% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.mutex_lock_killable.begin_new_exec.load_elf_binary 0.41 ± 97% +1470.1% 6.36 ± 97% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.remove_vma.__do_munmap.__vm_munmap 2.81 ± 79% +146.3% 6.92 ± 44% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.remove_vma.__do_munmap.mmap_region 7.51 ± 23% +226.7% 24.54 ± 98% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.remove_vma.exit_mmap.mmput 7.36 ±116% +497.6% 44.00 ± 94% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.shmem_undo_range.shmem_truncate_range.shmem_evict_inode 1495 ± 31% +114.1% 3203 ± 4% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork 9.21 ± 22% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate 12.64 ± 2% +300.8% 50.66 ± 43% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve 7.61 ± 29% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.wait_for_completion.stop_two_cpus.migrate_swap 20.69 ± 50% -100.0% 0.00 perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap 19.13 ± 36% -100.0% 0.00 perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages 2.03 ± 55% -96.2% 0.08 ±151% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.__put_anon_vma.unlink_anon_vmas.free_pgtables 7.53 ± 25% +397.1% 37.43 ± 76% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup 31.44 ± 23% +1888.2% 625.17 ± 62% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 2.32 ± 99% -88.3% 0.27 ± 87% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap 20.37 ± 28% +184.7% 57.99 ± 80% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap 11.76 ± 17% +170.3% 31.80 ± 43% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 5176 -31.0% 3569 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 5585 -30.2% 3899 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select 505.14 +15.5% 583.69 ± 5% perf-sched.wait_time.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 4816 ± 15% -31.5% 3297 ± 3% perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork 1791 -20.7% 1420 ± 3% perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork 29455 ± 2% +33.9% 39449 ± 7% softirqs.CPU0.NET_RX 25470 +32.0% 33628 softirqs.CPU0.SCHED 26529 ± 11% +43.7% 38110 ± 9% softirqs.CPU1.NET_RX 22797 ± 3% +43.8% 32782 ± 3% softirqs.CPU1.SCHED 28371 ± 3% +54.2% 43762 ± 13% softirqs.CPU10.NET_RX 22629 ± 2% +43.4% 32439 ± 2% softirqs.CPU10.SCHED 27171 ± 4% +38.4% 37593 ± 9% softirqs.CPU100.NET_RX 23180 ± 2% +39.1% 32248 softirqs.CPU100.SCHED 28196 ± 2% +34.4% 37895 ± 5% softirqs.CPU101.NET_RX 23100 +40.7% 32511 ± 2% softirqs.CPU101.SCHED 27883 ± 3% +43.5% 40015 ± 11% softirqs.CPU102.NET_RX 22937 ± 2% +41.4% 32444 ± 2% softirqs.CPU102.SCHED 28037 +40.7% 39461 ± 7% softirqs.CPU103.NET_RX 23000 ± 2% +41.0% 32435 ± 2% softirqs.CPU103.SCHED 28345 +34.9% 38229 ± 9% softirqs.CPU104.NET_RX 22314 ± 3% +45.3% 32417 ± 2% softirqs.CPU104.SCHED 27097 ± 2% +40.7% 38114 ± 3% softirqs.CPU105.NET_RX 22615 ± 2% +42.8% 32294 ± 2% softirqs.CPU105.SCHED 26463 ± 3% +50.9% 39943 ± 12% softirqs.CPU106.NET_RX 22730 ± 2% +42.2% 32319 ± 2% softirqs.CPU106.SCHED 27957 ± 2% +29.0% 36058 ± 6% softirqs.CPU107.NET_RX 22901 ± 2% +41.3% 32362 ± 2% softirqs.CPU107.SCHED 29320 ± 8% +33.4% 39101 ± 10% softirqs.CPU108.NET_RX 22873 ± 2% +41.2% 32301 ± 2% softirqs.CPU108.SCHED 29106 ± 2% +31.5% 38266 ± 3% softirqs.CPU109.NET_RX 22591 ± 2% +43.1% 32336 softirqs.CPU109.SCHED 28741 ± 5% +34.6% 38676 ± 6% softirqs.CPU11.NET_RX 22399 ± 3% +44.5% 32364 ± 2% softirqs.CPU11.SCHED 26804 ± 5% +41.8% 38006 ± 5% softirqs.CPU110.NET_RX 22766 ± 2% +43.3% 32619 ± 2% softirqs.CPU110.SCHED 25623 ± 7% +45.9% 37393 ± 9% softirqs.CPU111.NET_RX 22586 ± 2% +43.4% 32391 ± 2% softirqs.CPU111.SCHED 28020 ± 6% +31.8% 36917 ± 7% softirqs.CPU112.NET_RX 22741 +42.2% 32349 ± 2% softirqs.CPU112.SCHED 28310 ± 7% +35.1% 38234 ± 12% softirqs.CPU113.NET_RX 22884 ± 2% +42.4% 32577 ± 2% softirqs.CPU113.SCHED 25668 ± 5% +45.9% 37457 ± 7% softirqs.CPU114.NET_RX 22706 ± 3% +41.7% 32178 softirqs.CPU114.SCHED 28637 ± 5% +37.6% 39418 ± 6% softirqs.CPU115.NET_RX 22796 +41.0% 32139 softirqs.CPU115.SCHED 26953 ± 7% +42.1% 38291 ± 7% softirqs.CPU116.NET_RX 22646 +42.1% 32171 ± 2% softirqs.CPU116.SCHED 28477 ± 8% +35.4% 38544 ± 3% softirqs.CPU117.NET_RX 22866 ± 2% +40.8% 32189 ± 2% softirqs.CPU117.SCHED 27445 ± 7% +40.9% 38675 ± 11% softirqs.CPU118.NET_RX 22902 +41.4% 32386 ± 2% softirqs.CPU118.SCHED 26884 ± 4% +38.3% 37182 ± 6% softirqs.CPU119.NET_RX 22721 ± 2% +42.0% 32265 ± 2% softirqs.CPU119.SCHED 28376 ± 9% +36.6% 38767 ± 9% softirqs.CPU12.NET_RX 22706 ± 3% +40.4% 31877 ± 2% softirqs.CPU12.SCHED 27315 ± 7% +45.1% 39644 ± 4% softirqs.CPU120.NET_RX 23157 ± 2% +38.9% 32175 softirqs.CPU120.SCHED 26387 ± 5% +51.6% 40015 ± 4% softirqs.CPU121.NET_RX 22856 +38.5% 31646 softirqs.CPU121.SCHED 25176 ± 7% +67.6% 42194 ± 4% softirqs.CPU122.NET_RX 22775 +40.3% 31962 softirqs.CPU122.SCHED 25636 ± 5% +60.8% 41225 ± 7% softirqs.CPU123.NET_RX 23322 +37.7% 32124 softirqs.CPU123.SCHED 29777 ± 2% +37.4% 40911 ± 3% softirqs.CPU124.NET_RX 23141 ± 2% +38.7% 32098 softirqs.CPU124.SCHED 25720 ± 7% +53.0% 39356 ± 4% softirqs.CPU125.NET_RX 23140 ± 3% +38.7% 32104 softirqs.CPU125.SCHED 27106 ± 2% +44.7% 39214 ± 2% softirqs.CPU126.NET_RX 33141 ± 3% +11.4% 36924 ± 7% softirqs.CPU126.RCU 23154 ± 2% +38.6% 32083 softirqs.CPU126.SCHED 25748 ± 4% +53.8% 39601 ± 8% softirqs.CPU127.NET_RX 23011 ± 2% +39.4% 32068 softirqs.CPU127.SCHED 28647 ± 11% +42.1% 40718 softirqs.CPU128.NET_RX 34186 ± 3% +11.6% 38137 ± 7% softirqs.CPU128.RCU 23173 ± 2% +38.2% 32016 softirqs.CPU128.SCHED 27101 ± 3% +48.6% 40259 ± 5% softirqs.CPU129.NET_RX 22818 +40.4% 32045 softirqs.CPU129.SCHED 31534 ± 12% +25.9% 39696 ± 10% softirqs.CPU13.NET_RX 22674 ± 2% +41.6% 32108 ± 2% softirqs.CPU13.SCHED 27452 +48.9% 40871 ± 2% softirqs.CPU130.NET_RX 23203 +37.1% 31807 ± 2% softirqs.CPU130.SCHED 26896 ± 3% +51.9% 40860 ± 4% softirqs.CPU131.NET_RX 23148 ± 2% +37.4% 31814 softirqs.CPU131.SCHED 28393 ± 3% +41.2% 40084 ± 7% softirqs.CPU132.NET_RX 23200 +36.7% 31706 softirqs.CPU132.SCHED 26482 ± 3% +54.4% 40891 ± 3% softirqs.CPU133.NET_RX 22970 +41.0% 32382 ± 2% softirqs.CPU133.SCHED 26774 ± 7% +44.7% 38735 ± 5% softirqs.CPU134.NET_RX 33646 +10.7% 37240 ± 7% softirqs.CPU134.RCU 23088 ± 2% +38.6% 32008 softirqs.CPU134.SCHED 26666 +54.1% 41081 ± 7% softirqs.CPU135.NET_RX 33456 ± 4% +14.0% 38141 ± 8% softirqs.CPU135.RCU 22804 +40.0% 31925 softirqs.CPU135.SCHED 26562 ± 5% +55.4% 41276 ± 7% softirqs.CPU136.NET_RX 23134 ± 3% +38.9% 32141 softirqs.CPU136.SCHED 25297 ± 4% +62.9% 41210 ± 6% softirqs.CPU137.NET_RX 22846 ± 2% +39.9% 31955 softirqs.CPU137.SCHED 26519 ± 6% +51.6% 40192 ± 4% softirqs.CPU138.NET_RX 22478 ± 2% +41.7% 31858 softirqs.CPU138.SCHED 26079 ± 9% +62.0% 42258 ± 2% softirqs.CPU139.NET_RX 22994 ± 3% +39.2% 32007 softirqs.CPU139.SCHED 26936 ± 2% +43.0% 38512 ± 9% softirqs.CPU14.NET_RX 22604 ± 3% +42.3% 32166 ± 3% softirqs.CPU14.SCHED 27625 ± 9% +44.2% 39847 ± 5% softirqs.CPU140.NET_RX 33066 ± 5% +14.6% 37895 ± 8% softirqs.CPU140.RCU 22609 +41.6% 32006 softirqs.CPU140.SCHED 26460 ± 5% +58.1% 41826 ± 5% softirqs.CPU141.NET_RX 34319 ± 4% +9.6% 37601 ± 8% softirqs.CPU141.RCU 22848 ± 2% +39.5% 31868 softirqs.CPU141.SCHED 27385 ± 8% +52.1% 41645 ± 6% softirqs.CPU142.NET_RX 22881 ± 2% +40.0% 32033 softirqs.CPU142.SCHED 27724 ± 3% +46.8% 40700 ± 5% softirqs.CPU143.NET_RX 34109 ± 4% +10.8% 37789 ± 8% softirqs.CPU143.RCU 23092 ± 2% +39.1% 32110 softirqs.CPU143.SCHED 28902 ± 8% +30.5% 37711 softirqs.CPU144.NET_RX 34885 ± 7% +8.2% 37745 ± 7% softirqs.CPU144.RCU 22671 +40.8% 31929 softirqs.CPU144.SCHED 29181 ± 10% +43.3% 41814 ± 7% softirqs.CPU145.NET_RX 22655 +38.5% 31371 ± 2% softirqs.CPU145.SCHED 28250 ± 7% +33.9% 37815 ± 5% softirqs.CPU146.NET_RX 22502 +42.7% 32115 softirqs.CPU146.SCHED 26352 ± 5% +44.3% 38033 ± 4% softirqs.CPU147.NET_RX 34098 +9.1% 37212 ± 5% softirqs.CPU147.RCU 22712 +39.8% 31759 softirqs.CPU147.SCHED 26457 ± 5% +47.7% 39077 ± 2% softirqs.CPU148.NET_RX 34771 +10.8% 38542 ± 5% softirqs.CPU148.RCU 22626 +41.1% 31925 softirqs.CPU148.SCHED 27813 ± 3% +38.2% 38431 ± 3% softirqs.CPU149.NET_RX 34785 ± 3% +9.4% 38071 ± 6% softirqs.CPU149.RCU 22830 +39.5% 31857 softirqs.CPU149.SCHED 27674 +35.0% 37356 ± 10% softirqs.CPU15.NET_RX 22708 ± 3% +40.8% 31984 ± 2% softirqs.CPU15.SCHED 28914 ± 4% +38.6% 40073 ± 5% softirqs.CPU150.NET_RX 22867 +40.2% 32054 softirqs.CPU150.SCHED 26654 +46.9% 39145 ± 4% softirqs.CPU151.NET_RX 35269 ± 5% +7.1% 37772 ± 5% softirqs.CPU151.RCU 22567 +41.7% 31987 softirqs.CPU151.SCHED 27340 ± 3% +35.5% 37050 ± 7% softirqs.CPU152.NET_RX 22561 +41.1% 31833 softirqs.CPU152.SCHED 25682 ± 4% +52.9% 39264 ± 3% softirqs.CPU153.NET_RX 33854 ± 3% +13.6% 38450 ± 5% softirqs.CPU153.RCU 22484 +42.2% 31972 softirqs.CPU153.SCHED 27824 ± 6% +45.0% 40343 softirqs.CPU154.NET_RX 34996 ± 2% +9.1% 38165 ± 5% softirqs.CPU154.RCU 22409 +41.5% 31717 softirqs.CPU154.SCHED 26948 ± 6% +51.9% 40940 ± 3% softirqs.CPU155.NET_RX 35069 +10.6% 38779 ± 5% softirqs.CPU155.RCU 22696 +42.2% 32266 softirqs.CPU155.SCHED 26787 ± 3% +45.7% 39032 ± 4% softirqs.CPU156.NET_RX 22583 +41.3% 31902 softirqs.CPU156.SCHED 26065 ± 2% +47.8% 38529 ± 4% softirqs.CPU157.NET_RX 22442 +42.0% 31866 softirqs.CPU157.SCHED 27310 ± 3% +42.2% 38826 ± 8% softirqs.CPU158.NET_RX 22593 +40.5% 31752 softirqs.CPU158.SCHED 26411 ± 4% +47.7% 39018 softirqs.CPU159.NET_RX 22535 +42.5% 32103 softirqs.CPU159.SCHED 28586 ± 3% +30.9% 37421 ± 8% softirqs.CPU16.NET_RX 22668 ± 3% +45.0% 32879 ± 3% softirqs.CPU16.SCHED 27341 ± 2% +39.4% 38105 ± 2% softirqs.CPU160.NET_RX 22494 +41.5% 31829 softirqs.CPU160.SCHED 26309 +47.7% 38870 ± 6% softirqs.CPU161.NET_RX 22652 +41.1% 31964 softirqs.CPU161.SCHED 28102 ± 3% +35.3% 38031 ± 3% softirqs.CPU162.NET_RX 34995 ± 4% +6.5% 37255 ± 7% softirqs.CPU162.RCU 22800 +40.4% 32000 softirqs.CPU162.SCHED 24958 ± 5% +53.9% 38412 ± 7% softirqs.CPU163.NET_RX 22582 +42.1% 32079 softirqs.CPU163.SCHED 27327 ± 2% +36.9% 37415 ± 4% softirqs.CPU164.NET_RX 22516 +43.0% 32204 softirqs.CPU164.SCHED 27456 ± 5% +46.4% 40188 ± 4% softirqs.CPU165.NET_RX 22509 +42.6% 32104 softirqs.CPU165.SCHED 26840 ± 3% +42.0% 38118 ± 5% softirqs.CPU166.NET_RX 22847 +40.1% 32002 softirqs.CPU166.SCHED 28288 ± 2% +45.7% 41208 ± 8% softirqs.CPU167.NET_RX 22656 +43.6% 32529 ± 2% softirqs.CPU167.SCHED 27845 +40.0% 38982 ± 5% softirqs.CPU168.NET_RX 22861 +39.9% 31984 softirqs.CPU168.SCHED 26590 ± 8% +55.4% 41316 ± 5% softirqs.CPU169.NET_RX 22774 +40.5% 31990 softirqs.CPU169.SCHED 27965 ± 4% +34.4% 37581 ± 6% softirqs.CPU17.NET_RX 22416 +43.0% 32064 ± 3% softirqs.CPU17.SCHED 29095 ± 2% +43.8% 41848 ± 4% softirqs.CPU170.NET_RX 22753 +41.9% 32295 softirqs.CPU170.SCHED 25289 +56.3% 39538 ± 4% softirqs.CPU171.NET_RX 33179 ± 2% +7.3% 35615 ± 7% softirqs.CPU171.RCU 22899 +40.5% 32171 softirqs.CPU171.SCHED 25293 ± 3% +60.0% 40480 ± 7% softirqs.CPU172.NET_RX 22584 +42.6% 32196 softirqs.CPU172.SCHED 27200 ± 5% +50.1% 40831 ± 4% softirqs.CPU173.NET_RX 22804 +41.1% 32183 softirqs.CPU173.SCHED 27779 ± 3% +49.3% 41464 ± 7% softirqs.CPU174.NET_RX 22569 +42.0% 32056 softirqs.CPU174.SCHED 26980 ± 6% +49.2% 40261 ± 5% softirqs.CPU175.NET_RX 22818 +41.2% 32220 softirqs.CPU175.SCHED 27496 ± 6% +48.8% 40909 ± 9% softirqs.CPU176.NET_RX 22818 +40.9% 32139 softirqs.CPU176.SCHED 27197 +42.7% 38817 ± 8% softirqs.CPU177.NET_RX 22770 +40.4% 31976 softirqs.CPU177.SCHED 27688 ± 2% +45.6% 40318 ± 8% softirqs.CPU178.NET_RX 22820 +39.9% 31937 softirqs.CPU178.SCHED 26078 ± 4% +51.3% 39444 ± 5% softirqs.CPU179.NET_RX 22716 +40.5% 31912 softirqs.CPU179.SCHED 27755 ± 2% +41.2% 39191 ± 8% softirqs.CPU18.NET_RX 22621 ± 2% +41.0% 31900 softirqs.CPU18.SCHED 28019 ± 5% +40.3% 39303 ± 9% softirqs.CPU180.NET_RX 22549 +41.3% 31869 softirqs.CPU180.SCHED 27487 ± 10% +46.9% 40381 ± 7% softirqs.CPU181.NET_RX 22776 +40.2% 31943 softirqs.CPU181.SCHED 26432 ± 2% +55.0% 40971 ± 7% softirqs.CPU182.NET_RX 22815 +40.7% 32105 softirqs.CPU182.SCHED 27997 ± 4% +46.5% 41010 ± 4% softirqs.CPU183.NET_RX 22875 +39.9% 32004 softirqs.CPU183.SCHED 24478 ± 14% +67.2% 40939 ± 10% softirqs.CPU184.NET_RX 22192 ± 3% +45.0% 32177 softirqs.CPU184.SCHED 27366 +40.4% 38417 ± 8% softirqs.CPU185.NET_RX 22879 +40.4% 32119 softirqs.CPU185.SCHED 28955 ± 4% +36.2% 39443 ± 6% softirqs.CPU186.NET_RX 22929 +39.2% 31913 softirqs.CPU186.SCHED 26140 ± 5% +50.3% 39290 ± 8% softirqs.CPU187.NET_RX 23163 +38.6% 32110 softirqs.CPU187.SCHED 26199 +56.2% 40920 ± 11% softirqs.CPU188.NET_RX 22814 +41.5% 32276 softirqs.CPU188.SCHED 27178 ± 5% +49.7% 40699 ± 3% softirqs.CPU189.NET_RX 22673 +41.5% 32083 softirqs.CPU189.SCHED 27438 ± 7% +38.7% 38069 ± 5% softirqs.CPU19.NET_RX 22583 ± 3% +42.0% 32066 ± 2% softirqs.CPU19.SCHED 26118 ± 9% +42.6% 37257 ± 8% softirqs.CPU190.NET_RX 22621 +41.6% 32022 softirqs.CPU190.SCHED 25609 ± 5% +52.5% 39055 ± 9% softirqs.CPU191.NET_RX 22510 +40.5% 31618 softirqs.CPU191.SCHED 28410 ± 5% +34.1% 38091 ± 5% softirqs.CPU2.NET_RX 22190 +43.9% 31937 ± 2% softirqs.CPU2.SCHED 28923 ± 10% +37.5% 39780 ± 9% softirqs.CPU20.NET_RX 22749 ± 4% +41.2% 32113 ± 2% softirqs.CPU20.SCHED 27078 ± 3% +38.2% 37429 ± 8% softirqs.CPU21.NET_RX 22477 ± 3% +42.5% 32029 ± 2% softirqs.CPU21.SCHED 26006 ± 9% +49.7% 38922 ± 11% softirqs.CPU22.NET_RX 22743 ± 3% +41.2% 32108 ± 2% softirqs.CPU22.SCHED 28691 ± 2% +39.6% 40046 ± 5% softirqs.CPU23.NET_RX 22668 ± 3% +41.1% 31976 ± 2% softirqs.CPU23.SCHED 32698 ± 4% +27.5% 41704 ± 3% softirqs.CPU24.NET_RX 23538 +34.9% 31764 softirqs.CPU24.SCHED 27793 +44.1% 40038 ± 9% softirqs.CPU25.NET_RX 22892 ± 2% +38.0% 31602 softirqs.CPU25.SCHED 30671 ± 3% +36.4% 41822 ± 7% softirqs.CPU26.NET_RX 23207 ± 2% +36.8% 31744 softirqs.CPU26.SCHED 26281 ± 6% +57.6% 41417 ± 3% softirqs.CPU27.NET_RX 22758 ± 2% +40.4% 31952 softirqs.CPU27.SCHED 26713 ± 5% +54.6% 41300 ± 4% softirqs.CPU28.NET_RX 33769 ± 2% +11.3% 37593 ± 7% softirqs.CPU28.RCU 22857 ± 3% +38.2% 31586 softirqs.CPU28.SCHED 27219 ± 3% +53.1% 41664 ± 8% softirqs.CPU29.NET_RX 22988 ± 3% +38.2% 31775 softirqs.CPU29.SCHED 26571 ± 5% +51.2% 40171 ± 8% softirqs.CPU3.NET_RX 23000 ± 3% +38.9% 31946 ± 3% softirqs.CPU3.SCHED 26856 ± 4% +57.9% 42396 ± 2% softirqs.CPU30.NET_RX 22915 ± 3% +38.0% 31629 softirqs.CPU30.SCHED 28747 ± 6% +42.3% 40898 ± 9% softirqs.CPU31.NET_RX 22863 ± 2% +39.4% 31864 softirqs.CPU31.SCHED 26418 ± 4% +56.0% 41211 ± 4% softirqs.CPU32.NET_RX 22861 ± 3% +38.3% 31613 softirqs.CPU32.SCHED 27379 ± 13% +52.0% 41619 ± 3% softirqs.CPU33.NET_RX 22743 +38.7% 31538 softirqs.CPU33.SCHED 27331 ± 6% +47.9% 40432 ± 7% softirqs.CPU34.NET_RX 23071 ± 2% +37.5% 31730 softirqs.CPU34.SCHED 27997 ± 9% +49.7% 41922 ± 4% softirqs.CPU35.NET_RX 34868 ± 3% +10.6% 38580 ± 7% softirqs.CPU35.RCU 23029 ± 3% +37.4% 31635 softirqs.CPU35.SCHED 26763 ± 4% +59.4% 42657 ± 6% softirqs.CPU36.NET_RX 22829 +38.7% 31657 softirqs.CPU36.SCHED 27252 +48.6% 40489 ± 3% softirqs.CPU37.NET_RX 22546 ± 2% +40.2% 31603 softirqs.CPU37.SCHED 26072 ± 9% +67.4% 43643 ± 7% softirqs.CPU38.NET_RX 22711 ± 4% +39.6% 31710 softirqs.CPU38.SCHED 27579 ± 3% +57.8% 43518 ± 5% softirqs.CPU39.NET_RX 22705 ± 2% +39.2% 31596 softirqs.CPU39.SCHED 28570 ± 3% +30.7% 37345 ± 7% softirqs.CPU4.NET_RX 22763 ± 3% +41.4% 32189 ± 3% softirqs.CPU4.SCHED 26544 ± 5% +52.0% 40348 ± 5% softirqs.CPU40.NET_RX 22746 ± 3% +39.5% 31726 softirqs.CPU40.SCHED 28165 ± 5% +47.1% 41432 ± 3% softirqs.CPU41.NET_RX 22791 ± 3% +38.8% 31624 softirqs.CPU41.SCHED 28718 ± 6% +43.4% 41176 ± 8% softirqs.CPU42.NET_RX 22603 +39.3% 31493 softirqs.CPU42.SCHED 27257 ± 4% +54.4% 42085 ± 4% softirqs.CPU43.NET_RX 22763 ± 3% +39.4% 31742 softirqs.CPU43.SCHED 26604 ± 3% +58.0% 42041 ± 5% softirqs.CPU44.NET_RX 33772 ± 5% +13.2% 38218 ± 7% softirqs.CPU44.RCU 22764 ± 2% +39.6% 31790 softirqs.CPU44.SCHED 26786 ± 4% +54.4% 41361 ± 6% softirqs.CPU45.NET_RX 34271 ± 3% +10.2% 37764 ± 8% softirqs.CPU45.RCU 22813 ± 3% +38.4% 31565 softirqs.CPU45.SCHED 28082 ± 5% +43.0% 40154 ± 7% softirqs.CPU46.NET_RX 34703 ± 4% +9.0% 37818 ± 6% softirqs.CPU46.RCU 22800 ± 4% +39.4% 31785 softirqs.CPU46.SCHED 28229 ± 2% +49.3% 42156 ± 6% softirqs.CPU47.NET_RX 35007 ± 3% +9.5% 38323 ± 7% softirqs.CPU47.RCU 22878 ± 2% +38.2% 31613 softirqs.CPU47.SCHED 29087 ± 4% +39.9% 40686 ± 3% softirqs.CPU48.NET_RX 22510 +40.5% 31621 softirqs.CPU48.SCHED 27833 ± 5% +47.3% 40991 ± 6% softirqs.CPU49.NET_RX 22119 +42.7% 31572 softirqs.CPU49.SCHED 28242 +35.9% 38374 ± 6% softirqs.CPU5.NET_RX 22636 ± 3% +42.1% 32161 ± 2% softirqs.CPU5.SCHED 28615 ± 4% +37.2% 39250 ± 5% softirqs.CPU50.NET_RX 34409 +12.2% 38623 ± 5% softirqs.CPU50.RCU 22248 +41.5% 31482 softirqs.CPU50.SCHED 28739 ± 5% +40.6% 40405 softirqs.CPU51.NET_RX 22458 ± 2% +41.1% 31679 softirqs.CPU51.SCHED 28428 ± 6% +34.7% 38284 softirqs.CPU52.NET_RX 22308 +41.7% 31601 softirqs.CPU52.SCHED 29032 ± 6% +33.6% 38786 ± 7% softirqs.CPU53.NET_RX 34502 ± 5% +10.0% 37943 ± 8% softirqs.CPU53.RCU 22408 +40.7% 31526 softirqs.CPU53.SCHED 27640 ± 7% +42.5% 39380 ± 2% softirqs.CPU54.NET_RX 22473 +40.7% 31609 softirqs.CPU54.SCHED 26943 ± 9% +42.4% 38374 ± 4% softirqs.CPU55.NET_RX 22289 ± 2% +42.7% 31800 softirqs.CPU55.SCHED 27400 ± 4% +40.2% 38409 ± 5% softirqs.CPU56.NET_RX 22354 +40.0% 31300 softirqs.CPU56.SCHED 26999 ± 2% +46.5% 39554 ± 6% softirqs.CPU57.NET_RX 34130 ± 3% +12.9% 38546 ± 7% softirqs.CPU57.RCU 22383 +41.0% 31569 softirqs.CPU57.SCHED 26684 ± 3% +50.6% 40177 ± 3% softirqs.CPU58.NET_RX 34403 ± 3% +11.9% 38510 ± 7% softirqs.CPU58.RCU 21983 +44.1% 31667 softirqs.CPU58.SCHED 28353 +41.2% 40037 ± 5% softirqs.CPU59.NET_RX 22456 +40.7% 31589 softirqs.CPU59.SCHED 27801 ± 10% +34.5% 37398 ± 5% softirqs.CPU6.NET_RX 22604 ± 3% +41.8% 32058 ± 2% softirqs.CPU6.SCHED 26348 ± 3% +55.7% 41023 softirqs.CPU60.NET_RX 22333 +41.1% 31517 softirqs.CPU60.SCHED 27592 ± 8% +43.0% 39449 ± 4% softirqs.CPU61.NET_RX 22340 +40.8% 31449 softirqs.CPU61.SCHED 27991 ± 6% +39.9% 39173 ± 6% softirqs.CPU62.NET_RX 22336 +41.0% 31505 softirqs.CPU62.SCHED 27979 ± 6% +42.4% 39848 ± 6% softirqs.CPU63.NET_RX 22455 +40.7% 31595 softirqs.CPU63.SCHED 27343 ± 4% +47.1% 40224 ± 7% softirqs.CPU64.NET_RX 22264 +42.4% 31709 softirqs.CPU64.SCHED 30930 ± 12% +24.7% 38565 ± 3% softirqs.CPU65.NET_RX 22563 +39.9% 31572 softirqs.CPU65.SCHED 27228 ± 3% +40.3% 38207 ± 5% softirqs.CPU66.NET_RX 33624 ± 2% +10.9% 37300 ± 6% softirqs.CPU66.RCU 22263 +42.0% 31615 softirqs.CPU66.SCHED 26629 ± 7% +45.8% 38826 ± 3% softirqs.CPU67.NET_RX 22267 +42.1% 31644 softirqs.CPU67.SCHED 27039 ± 7% +46.4% 39598 ± 3% softirqs.CPU68.NET_RX 22376 +41.0% 31552 softirqs.CPU68.SCHED 26835 ± 4% +41.3% 37921 ± 4% softirqs.CPU69.NET_RX 22292 +42.2% 31695 softirqs.CPU69.SCHED 28526 ± 9% +36.6% 38980 ± 9% softirqs.CPU7.NET_RX 22556 ± 3% +42.0% 32026 ± 3% softirqs.CPU7.SCHED 27716 ± 6% +44.2% 39956 ± 5% softirqs.CPU70.NET_RX 22376 +40.4% 31421 softirqs.CPU70.SCHED 25987 ± 2% +54.0% 40017 ± 5% softirqs.CPU71.NET_RX 22256 +42.9% 31803 softirqs.CPU71.SCHED 30271 ± 2% +31.6% 39836 ± 8% softirqs.CPU72.NET_RX 22864 +39.9% 31988 softirqs.CPU72.SCHED 28646 ± 7% +40.8% 40326 ± 6% softirqs.CPU73.NET_RX 22434 +41.4% 31715 softirqs.CPU73.SCHED 27673 ± 4% +44.6% 40027 ± 5% softirqs.CPU74.NET_RX 22454 +41.1% 31688 softirqs.CPU74.SCHED 26780 ± 5% +50.1% 40207 ± 5% softirqs.CPU75.NET_RX 22613 +40.8% 31840 softirqs.CPU75.SCHED 28051 +45.5% 40826 ± 5% softirqs.CPU76.NET_RX 22608 +41.0% 31879 softirqs.CPU76.SCHED 26339 ± 5% +49.7% 39425 ± 10% softirqs.CPU77.NET_RX 22329 +43.4% 32019 softirqs.CPU77.SCHED 28822 +38.8% 40011 ± 6% softirqs.CPU78.NET_RX 22588 +41.2% 31903 softirqs.CPU78.SCHED 26965 ± 4% +50.8% 40656 ± 8% softirqs.CPU79.NET_RX 22337 +41.9% 31701 softirqs.CPU79.SCHED 28854 ± 2% +36.0% 39243 ± 7% softirqs.CPU8.NET_RX 33868 ± 2% +8.2% 36644 ± 4% softirqs.CPU8.RCU 22572 ± 2% +41.6% 31966 ± 3% softirqs.CPU8.SCHED 25294 ± 3% +62.3% 41046 ± 9% softirqs.CPU80.NET_RX 22560 +41.6% 31949 softirqs.CPU80.SCHED 27226 ± 6% +44.2% 39272 ± 5% softirqs.CPU81.NET_RX 22433 +41.8% 31802 softirqs.CPU81.SCHED 28179 ± 2% +45.8% 41089 ± 6% softirqs.CPU82.NET_RX 22503 +41.1% 31742 softirqs.CPU82.SCHED 25370 ± 6% +65.5% 41993 ± 3% softirqs.CPU83.NET_RX 33224 ± 3% +9.5% 36387 ± 5% softirqs.CPU83.RCU 22482 +43.4% 32239 softirqs.CPU83.SCHED 29150 ± 4% +41.9% 41357 ± 6% softirqs.CPU84.NET_RX 22540 +40.3% 31629 softirqs.CPU84.SCHED 27566 ± 7% +45.2% 40032 ± 6% softirqs.CPU85.NET_RX 22614 +40.5% 31779 softirqs.CPU85.SCHED 26616 ± 3% +48.0% 39392 ± 8% softirqs.CPU86.NET_RX 22503 +41.8% 31899 softirqs.CPU86.SCHED 27217 +54.7% 42097 ± 4% softirqs.CPU87.NET_RX 32656 +11.1% 36286 ± 8% softirqs.CPU87.RCU 22383 +41.8% 31744 softirqs.CPU87.SCHED 29444 ± 5% +35.2% 39821 ± 6% softirqs.CPU88.NET_RX 22560 ± 2% +41.3% 31887 softirqs.CPU88.SCHED 26383 ± 3% +49.4% 39403 ± 5% softirqs.CPU89.NET_RX 22647 +41.2% 31984 softirqs.CPU89.SCHED 27413 +45.5% 39873 ± 3% softirqs.CPU9.NET_RX 22436 ± 3% +43.3% 32154 ± 2% softirqs.CPU9.SCHED 28117 ± 4% +39.1% 39110 ± 5% softirqs.CPU90.NET_RX 22524 +41.6% 31903 softirqs.CPU90.SCHED 28805 ± 3% +43.1% 41207 ± 2% softirqs.CPU91.NET_RX 22981 +38.0% 31714 softirqs.CPU91.SCHED 27920 ± 9% +46.1% 40778 ± 7% softirqs.CPU92.NET_RX 33255 ± 4% +8.9% 36199 ± 7% softirqs.CPU92.RCU 22467 +42.2% 31955 softirqs.CPU92.SCHED 26935 ± 5% +49.3% 40211 ± 6% softirqs.CPU93.NET_RX 22407 +42.4% 31898 softirqs.CPU93.SCHED 25585 ± 6% +63.7% 41880 ± 5% softirqs.CPU94.NET_RX 33095 ± 4% +10.4% 36528 ± 9% softirqs.CPU94.RCU 22417 +41.7% 31761 softirqs.CPU94.SCHED 27659 ± 6% +43.3% 39639 ± 6% softirqs.CPU95.NET_RX 21998 +42.6% 31361 softirqs.CPU95.SCHED 26582 ± 2% +43.4% 38128 ± 8% softirqs.CPU96.NET_RX 22170 ± 3% +45.7% 32297 softirqs.CPU96.SCHED 27522 ± 5% +39.4% 38353 ± 9% softirqs.CPU97.NET_RX 22468 ± 3% +43.4% 32209 ± 2% softirqs.CPU97.SCHED 27117 ± 12% +39.8% 37902 ± 10% softirqs.CPU98.NET_RX 22600 +43.2% 32361 ± 2% softirqs.CPU98.SCHED 26557 ± 2% +43.7% 38161 ± 7% softirqs.CPU99.NET_RX 23003 +41.6% 32565 softirqs.CPU99.SCHED 5270210 +44.9% 7635912 softirqs.NET_RX 4357512 +40.8% 6136169 softirqs.SCHED 80.01 -80.0 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.scan_positives.dcache_readdir.iterate_dir 81.90 -68.9 13.02 ± 5% perf-profile.calltrace.cycles-pp.dcache_readdir.iterate_dir.__x64_sys_getdents64.do_syscall_64.entry_SYSCALL_64_after_hwframe 81.91 -68.9 13.03 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_getdents64.do_syscall_64.entry_SYSCALL_64_after_hwframe 81.90 -68.9 13.03 ± 5% perf-profile.calltrace.cycles-pp.iterate_dir.__x64_sys_getdents64.do_syscall_64.entry_SYSCALL_64_after_hwframe 80.60 -68.8 11.80 ± 5% perf-profile.calltrace.cycles-pp.scan_positives.dcache_readdir.iterate_dir.__x64_sys_getdents64.do_syscall_64 80.30 -68.7 11.63 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.scan_positives.dcache_readdir.iterate_dir.__x64_sys_getdents64 85.88 -51.1 34.79 ± 13% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 85.98 -50.8 35.15 ± 13% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 0.37 ± 70% +0.4 0.80 ± 4% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64 0.37 ± 70% +0.4 0.81 ± 4% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64 0.37 ± 70% +0.4 0.81 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64 0.39 ± 70% +0.4 0.82 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat64 0.39 ± 70% +0.4 0.84 ± 3% perf-profile.calltrace.cycles-pp.creat64 0.37 ± 70% +0.6 0.93 ± 10% perf-profile.calltrace.cycles-pp.div_long 0.00 +0.6 0.62 ± 10% perf-profile.calltrace.cycles-pp.kmem_cache_free.rcu_do_batch.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack 0.00 +0.6 0.62 ± 10% perf-profile.calltrace.cycles-pp.__strcat_chk 0.39 ± 70% +0.7 1.04 ± 9% perf-profile.calltrace.cycles-pp.add_int.add_int 0.38 ± 70% +0.7 1.04 ± 8% perf-profile.calltrace.cycles-pp.add_long.add_long 0.00 +0.7 0.68 ± 9% perf-profile.calltrace.cycles-pp.rcu_do_batch.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack 0.00 +0.7 0.69 ± 9% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu 0.00 +0.7 0.73 ± 3% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +0.8 0.76 ± 9% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt 0.00 +0.8 0.76 ± 9% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.8 0.76 ± 9% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 0.36 ± 70% +0.8 1.12 ± 11% perf-profile.calltrace.cycles-pp.__strncat_chk 0.00 +0.8 0.77 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +0.8 0.77 ± 9% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +0.8 0.79 ± 23% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap 0.00 +0.8 0.81 ± 23% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.mmap_region 0.00 +0.8 0.81 ± 22% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup 0.00 +0.8 0.82 ± 3% perf-profile.calltrace.cycles-pp.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2 0.00 +0.8 0.84 ± 21% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey 0.00 +0.8 0.85 ± 3% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +0.9 0.85 ± 3% perf-profile.calltrace.cycles-pp.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 +0.9 0.86 ± 3% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault 0.00 +0.9 0.86 ± 22% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.__do_munmap.mmap_region.do_mmap 0.18 ±141% +0.9 1.04 ± 24% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.unmap_region 0.17 ±141% +0.9 1.03 ± 22% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap 0.00 +0.9 0.88 ± 24% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.begin_new_exec 0.00 +0.9 0.88 ± 21% perf-profile.calltrace.cycles-pp.__split_vma.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff 0.18 ±141% +0.9 1.07 ± 23% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.unmap_region.__do_munmap 0.17 ±141% +0.9 1.06 ± 21% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap.vm_mmap_pgoff 0.18 ±141% +0.9 1.08 ± 23% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.unmap_region.__do_munmap.mmap_region 0.19 ±141% +0.9 1.09 ± 23% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.__do_munmap.mmap_region.do_mmap 0.19 ±141% +0.9 1.12 ± 23% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff 0.00 +0.9 0.93 ± 4% perf-profile.calltrace.cycles-pp.asm_exc_page_fault 0.17 ±141% +0.9 1.10 ± 19% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.begin_new_exec.load_elf_binary 0.18 ±141% +0.9 1.12 ± 20% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 0.00 +0.9 0.94 ± 19% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect 0.00 +1.0 0.98 ± 18% perf-profile.calltrace.cycles-pp.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64 0.00 +1.0 1.02 ± 18% perf-profile.calltrace.cycles-pp.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±141% +1.0 1.22 ± 24% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.do_exit 0.00 +1.0 1.03 ± 18% perf-profile.calltrace.cycles-pp.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.0 1.03 ± 18% perf-profile.calltrace.cycles-pp.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.39 ± 72% +1.1 1.45 ± 11% perf-profile.calltrace.cycles-pp.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.39 ± 72% +1.1 1.45 ± 11% perf-profile.calltrace.cycles-pp.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.1 1.06 ± 26% perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_get.d_alloc_cursor.dcache_dir_open.do_dentry_open 0.00 +1.1 1.06 ± 26% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.lockref_get.d_alloc_cursor.dcache_dir_open 0.00 +1.1 1.06 ± 26% perf-profile.calltrace.cycles-pp.lockref_get.d_alloc_cursor.dcache_dir_open.do_dentry_open.path_openat 0.00 +1.1 1.06 ± 26% perf-profile.calltrace.cycles-pp.dcache_dir_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2 0.00 +1.1 1.06 ± 26% perf-profile.calltrace.cycles-pp.d_alloc_cursor.dcache_dir_open.do_dentry_open.path_openat.do_filp_open 0.20 ±141% +1.1 1.27 ± 14% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork 0.20 ±141% +1.1 1.27 ± 14% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 0.20 ±141% +1.1 1.27 ± 14% perf-profile.calltrace.cycles-pp.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 0.19 ±141% +1.1 1.27 ± 14% perf-profile.calltrace.cycles-pp.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 0.21 ±141% +1.1 1.33 ± 22% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.do_exit.do_group_exit 0.00 +1.1 1.12 ± 11% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.dcache_readdir.iterate_dir.__x64_sys_getdents64 0.60 ± 6% +1.1 1.73 ± 24% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.begin_new_exec.load_elf_binary.exec_binprm 0.20 ±141% +1.1 1.33 ± 13% perf-profile.calltrace.cycles-pp.__libc_fork 0.60 ± 6% +1.1 1.73 ± 24% perf-profile.calltrace.cycles-pp.mmput.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve 0.17 ±141% +1.1 1.32 ± 16% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +1.1 1.15 ± 18% perf-profile.calltrace.cycles-pp.drain_obj_stock.refill_obj_stock.kmem_cache_free.rcu_do_batch.rcu_core 0.62 ± 6% +1.2 1.78 ± 23% perf-profile.calltrace.cycles-pp.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common 0.00 +1.2 1.18 ± 21% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 0.80 ± 20% +1.2 2.03 ± 22% perf-profile.calltrace.cycles-pp.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 0.73 ± 17% +1.2 1.98 ± 14% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group 0.73 ± 17% +1.2 1.98 ± 14% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 0.00 +1.3 1.28 ± 18% perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_get.do_dentry_open.path_openat.do_filp_open 0.00 +1.3 1.28 ± 18% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.lockref_get.do_dentry_open.path_openat 0.00 +1.3 1.29 ± 18% perf-profile.calltrace.cycles-pp.lockref_get.do_dentry_open.path_openat.do_filp_open.do_sys_openat2 0.00 +1.4 1.36 ± 39% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process 0.81 ± 16% +1.4 2.20 ± 13% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.81 ± 16% +1.4 2.21 ± 13% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.81 ± 16% +1.4 2.21 ± 13% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.4 1.41 ± 38% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process.kernel_clone 0.00 +1.4 1.41 ± 17% perf-profile.calltrace.cycles-pp.refill_obj_stock.kmem_cache_free.rcu_do_batch.rcu_core.__softirqentry_text_start 0.18 ±141% +1.7 1.92 ± 26% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap 0.19 ±141% +1.8 2.01 ± 25% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap.mmput 0.83 ± 5% +1.8 2.65 ± 14% perf-profile.calltrace.cycles-pp.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve 0.83 ± 4% +1.8 2.67 ± 13% perf-profile.calltrace.cycles-pp.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.36 ±141% +2.0 2.32 ± 15% perf-profile.calltrace.cycles-pp.dup_mm.copy_process.kernel_clone.__do_sys_clone.do_syscall_64 1.24 ± 20% +2.0 3.23 ± 21% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 1.25 ± 20% +2.0 3.23 ± 21% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.26 ± 20% +2.0 3.25 ± 21% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.26 ± 20% +2.0 3.25 ± 21% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.68 ± 14% +2.0 3.72 ± 10% perf-profile.calltrace.cycles-pp.string_rtns_1 0.19 ±141% +2.1 2.29 ± 15% perf-profile.calltrace.cycles-pp.dup_mmap.dup_mm.copy_process.kernel_clone.__do_sys_clone 0.39 ±141% +2.2 2.58 ± 13% perf-profile.calltrace.cycles-pp.copy_process.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.6 2.62 ± 6% perf-profile.calltrace.cycles-pp.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.40 ± 70% +3.1 3.52 ± 15% perf-profile.calltrace.cycles-pp.kmem_cache_free.rcu_do_batch.rcu_core.__softirqentry_text_start.run_ksoftirqd 0.61 ± 11% +3.2 3.79 ± 15% perf-profile.calltrace.cycles-pp.rcu_do_batch.rcu_core.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn 0.61 ± 11% +3.2 3.79 ± 15% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn.kthread 0.61 ± 11% +3.2 3.79 ± 15% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork 0.61 ± 11% +3.2 3.79 ± 15% perf-profile.calltrace.cycles-pp.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork 0.61 ± 12% +3.2 3.82 ± 15% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork 0.65 ± 11% +3.2 3.88 ± 15% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 0.65 ± 11% +3.2 3.89 ± 15% perf-profile.calltrace.cycles-pp.ret_from_fork 0.22 ±141% +4.1 4.27 ± 28% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.22 ±141% +4.1 4.28 ± 28% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.30 ± 10% +6.1 9.36 ± 10% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +6.2 6.21 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_get_not_dead.__legitimize_path.unlazy_walk.complete_walk 0.00 +6.2 6.22 ± 3% perf-profile.calltrace.cycles-pp.lockref_get_not_dead.__legitimize_path.unlazy_walk.complete_walk.path_openat 0.00 +6.2 6.22 ± 3% perf-profile.calltrace.cycles-pp.unlazy_walk.complete_walk.path_openat.do_filp_open.do_sys_openat2 0.00 +6.2 6.22 ± 3% perf-profile.calltrace.cycles-pp.__legitimize_path.unlazy_walk.complete_walk.path_openat.do_filp_open 0.00 +6.2 6.22 ± 3% perf-profile.calltrace.cycles-pp.complete_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 +6.5 6.47 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_put_or_lock.dput.step_into.path_openat 0.00 +6.5 6.47 ± 7% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.lockref_put_or_lock.dput.step_into 0.00 +6.5 6.47 ± 7% perf-profile.calltrace.cycles-pp.dput.step_into.path_openat.do_filp_open.do_open_execat 0.00 +6.5 6.47 ± 7% perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.step_into.path_openat.do_filp_open 0.00 +7.0 6.99 ± 19% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.__open64_nocancel 0.00 +7.0 6.99 ± 19% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.__open64_nocancel 0.00 +7.0 6.99 ± 18% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__open64_nocancel 0.00 +7.0 7.00 ± 18% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__open64_nocancel 0.00 +7.0 7.00 ± 18% perf-profile.calltrace.cycles-pp.__open64_nocancel 3.79 ± 10% +7.0 10.82 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 3.86 ± 9% +7.1 10.96 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 4.17 ± 6% +7.4 11.59 ± 8% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 4.17 ± 6% +7.4 11.59 ± 8% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 4.17 ± 6% +7.4 11.59 ± 8% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify 4.20 ± 6% +7.4 11.63 ± 8% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 0.00 +8.6 8.58 ± 38% perf-profile.calltrace.cycles-pp.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +8.6 8.59 ± 38% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +11.2 11.23 ± 5% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.scan_positives.dcache_readdir.iterate_dir 0.56 ± 7% +11.4 11.95 ± 2% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 0.56 ± 7% +11.4 11.96 ± 2% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +24.2 24.23 ± 4% perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_get_not_dead.__legitimize_path.unlazy_walk.pick_link 0.00 +24.2 24.25 ± 4% perf-profile.calltrace.cycles-pp.unlazy_walk.pick_link.step_into.path_openat.do_filp_open 0.00 +24.2 24.25 ± 4% perf-profile.calltrace.cycles-pp.__legitimize_path.unlazy_walk.pick_link.step_into.path_openat 0.00 +24.2 24.25 ± 4% perf-profile.calltrace.cycles-pp.lockref_get_not_dead.__legitimize_path.unlazy_walk.pick_link.step_into 0.00 +24.2 24.25 ± 4% perf-profile.calltrace.cycles-pp.pick_link.step_into.path_openat.do_filp_open.do_open_execat 1.02 ± 4% +24.4 25.41 ± 8% perf-profile.calltrace.cycles-pp.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 1.02 ± 4% +24.4 25.42 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 1.02 ± 4% +24.4 25.42 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 1.02 ± 4% +24.4 25.42 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 1.03 ± 4% +24.4 25.43 ± 8% perf-profile.calltrace.cycles-pp.execve 0.00 +30.4 30.45 ± 3% perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock.lockref_get_not_dead.__legitimize_path.unlazy_walk 0.00 +30.8 30.82 ± 3% perf-profile.calltrace.cycles-pp.step_into.path_openat.do_filp_open.do_open_execat.bprm_execve 0.00 +30.8 30.84 ± 3% perf-profile.calltrace.cycles-pp.do_filp_open.do_open_execat.bprm_execve.do_execveat_common.__x64_sys_execve 0.00 +30.8 30.84 ± 3% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_open_execat.bprm_execve.do_execveat_common 0.00 +30.8 30.84 ± 3% perf-profile.calltrace.cycles-pp.do_open_execat.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.95 ± 4% +32.8 33.76 ± 3% perf-profile.calltrace.cycles-pp.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 82.33 -82.3 0.00 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 81.90 -68.9 13.02 ± 5% perf-profile.children.cycles-pp.dcache_readdir 81.91 -68.9 13.03 ± 5% perf-profile.children.cycles-pp.__x64_sys_getdents64 81.90 -68.9 13.03 ± 5% perf-profile.children.cycles-pp.iterate_dir 80.60 -68.8 11.80 ± 5% perf-profile.children.cycles-pp.scan_positives 82.71 -27.9 54.83 ± 2% perf-profile.children.cycles-pp._raw_spin_lock 89.05 -18.0 71.08 perf-profile.children.cycles-pp.do_syscall_64 89.35 -17.5 71.82 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.54 ± 22% -0.2 0.32 ± 20% perf-profile.children.cycles-pp.llseek 0.62 -0.2 0.45 ± 9% perf-profile.children.cycles-pp.ksys_lseek 0.62 -0.2 0.45 ± 9% perf-profile.children.cycles-pp.dcache_dir_lseek 0.06 ± 8% +0.0 0.09 ± 21% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.06 ± 13% +0.0 0.10 ± 15% perf-profile.children.cycles-pp.update_load_avg 0.16 ± 8% +0.0 0.21 ± 17% perf-profile.children.cycles-pp.ktime_get 0.00 +0.1 0.05 perf-profile.children.cycles-pp.copy_page 0.00 +0.1 0.05 perf-profile.children.cycles-pp.copy_string_kernel 0.00 +0.1 0.05 perf-profile.children.cycles-pp.time 0.00 +0.1 0.05 perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn 0.00 +0.1 0.05 perf-profile.children.cycles-pp.perf_iterate_sb 0.00 +0.1 0.05 perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.1 0.05 perf-profile.children.cycles-pp.irqtime_account_irq 0.00 +0.1 0.05 perf-profile.children.cycles-pp.unlock_page 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.common_file_perm 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.shift_arg_pages 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__check_object_size 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.compar1 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.lru_add_drain_cpu 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.do_faccessat 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.call_rcu 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.rebalance_domains 0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.__pud_alloc 0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.do_task_dead 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.new_sync_read 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.ip_finish_output2 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.sync_regs 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.d_add 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.lru_add_drain 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp._cond_resched 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.cfree 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.update_rq_clock 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.__rb_insert_augmented 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.kfree 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.security_cred_free 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.worker_thread 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.read 0.00 +0.1 0.06 perf-profile.children.cycles-pp.anon_vma_interval_tree_insert 0.00 +0.1 0.06 perf-profile.children.cycles-pp.__might_sleep 0.00 +0.1 0.06 perf-profile.children.cycles-pp.simple_lookup 0.00 +0.1 0.06 perf-profile.children.cycles-pp.create_elf_tables 0.00 +0.1 0.06 perf-profile.children.cycles-pp.setup_arg_pages 0.02 ±141% +0.1 0.08 ± 54% perf-profile.children.cycles-pp.irq_enter_rcu 0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.alloc_pages_vma 0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.page_add_file_rmap 0.00 +0.1 0.06 ± 17% perf-profile.children.cycles-pp.memcpy_erms 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.do_linkat 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__x64_sys_link 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.inode_permission 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.ip_output 0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.tick_nohz_next_event 0.05 ± 70% +0.1 0.12 ± 10% perf-profile.children.cycles-pp.__close 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.try_charge 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.do_truncate 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.udp_sendmsg 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.put_task_stack 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.free_pages_and_swap_cache 0.02 ±141% +0.1 0.08 ± 5% perf-profile.children.cycles-pp.unlink 0.07 ± 12% +0.1 0.14 ± 15% perf-profile.children.cycles-pp.write 0.06 +0.1 0.13 perf-profile.children.cycles-pp.wake_up_new_task 0.06 ± 13% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.__d_lookup_rcu 0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.uncharge_batch 0.00 +0.1 0.07 perf-profile.children.cycles-pp.group_send_sig_info 0.00 +0.1 0.07 perf-profile.children.cycles-pp.__get_user_pages 0.00 +0.1 0.07 perf-profile.children.cycles-pp.strnlen_user 0.00 +0.1 0.07 perf-profile.children.cycles-pp.security_task_kill 0.00 +0.1 0.07 perf-profile.children.cycles-pp.apparmor_task_kill 0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.__pmd_alloc 0.05 ± 8% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.apparmor_file_open 0.09 ± 24% +0.1 0.16 ± 6% perf-profile.children.cycles-pp.kill 0.05 +0.1 0.12 ± 3% perf-profile.children.cycles-pp.security_file_free 0.05 +0.1 0.12 ± 3% perf-profile.children.cycles-pp.apparmor_file_free_security 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.__anon_vma_prepare 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.find_vma 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.get_arg_page 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.__get_user_pages_remote 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.mem_cgroup_charge 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.try_to_wake_up 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.00 +0.1 0.07 ± 22% perf-profile.children.cycles-pp.file_free_rcu 0.05 ± 8% +0.1 0.13 ± 6% perf-profile.children.cycles-pp.security_file_open 0.05 ± 8% +0.1 0.13 ± 3% perf-profile.children.cycles-pp.getname_flags 0.03 ± 70% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.kill_pid_info 0.07 +0.1 0.15 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.vfs_read 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.__mod_memcg_state 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list 0.03 ± 70% +0.1 0.11 perf-profile.children.cycles-pp.kill_something_info 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.ksys_read 0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.rcu_cblist_dequeue 0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.vma_interval_tree_remove 0.04 ± 71% +0.1 0.12 ± 3% perf-profile.children.cycles-pp.__x64_sys_kill 0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.filldir64 0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.put_cred_rcu 0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.00 +0.1 0.08 ± 13% perf-profile.children.cycles-pp.__slab_free 0.02 ±141% +0.1 0.10 perf-profile.children.cycles-pp.up_write 0.05 ± 8% +0.1 0.14 ± 3% perf-profile.children.cycles-pp.copy_pte_range 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.clear_page_erms 0.06 ± 8% +0.1 0.14 ± 5% perf-profile.children.cycles-pp.down_write 0.02 ±141% +0.1 0.10 ± 10% perf-profile.children.cycles-pp.malloc 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.wait4 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.down_read 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.__get_free_pages 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.__put_anon_vma 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.arch_do_signal 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.__dentry_kill 0.02 ±141% +0.1 0.11 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.00 +0.1 0.09 perf-profile.children.cycles-pp.strncpy_from_user 0.00 +0.1 0.09 ± 7% perf-profile.children.cycles-pp.aa_get_task_label 0.00 +0.1 0.09 ± 7% perf-profile.children.cycles-pp.schedule_idle 0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.rwsem_wake 0.02 ±141% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.___might_sleep 0.03 ± 70% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.copy_strings 0.09 ± 13% +0.1 0.19 ± 14% perf-profile.children.cycles-pp.update_cfs_group 0.08 ± 10% +0.1 0.17 ± 11% perf-profile.children.cycles-pp.new_sync_write 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.sched_exec 0.02 ±141% +0.1 0.11 perf-profile.children.cycles-pp.alloc_set_pte 0.05 ± 8% +0.1 0.15 ± 2% perf-profile.children.cycles-pp.get_page_from_freelist 0.00 +0.1 0.10 ± 5% perf-profile.children.cycles-pp.prep_new_page 0.00 +0.1 0.10 ± 9% perf-profile.children.cycles-pp.__pte_alloc 0.04 ± 71% +0.1 0.13 ± 6% perf-profile.children.cycles-pp.__mmap 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.sock_sendmsg 0.00 +0.1 0.10 ± 4% perf-profile.children.cycles-pp.perf_event_mmap 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.__memcg_kmem_uncharge_page 0.00 +0.1 0.10 ± 45% perf-profile.children.cycles-pp.dcache_dir_close 0.00 +0.1 0.10 ± 7% perf-profile.children.cycles-pp.sock_write_iter 0.00 +0.1 0.10 ± 7% perf-profile.children.cycles-pp.lockref_put_return 0.09 ± 10% +0.1 0.19 ± 9% perf-profile.children.cycles-pp.ksys_write 0.02 ±141% +0.1 0.12 ± 3% perf-profile.children.cycles-pp.apparmor_task_getsecid 0.08 ± 5% +0.1 0.19 ± 9% perf-profile.children.cycles-pp.vfs_write 0.00 +0.1 0.11 ± 10% perf-profile.children.cycles-pp.do_unlinkat 0.08 ± 10% +0.1 0.19 ± 2% perf-profile.children.cycles-pp.find_idlest_group 0.00 +0.1 0.11 ± 33% perf-profile.children.cycles-pp.__close_nocancel 0.00 +0.1 0.11 ± 4% perf-profile.children.cycles-pp.vm_area_alloc 0.06 ± 16% +0.1 0.16 ± 5% perf-profile.children.cycles-pp.do_anonymous_page 0.02 ±141% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.security_task_getsecid 0.08 ± 14% +0.1 0.19 ± 6% perf-profile.children.cycles-pp.__xstat64 0.00 +0.1 0.11 perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.06 ± 16% +0.1 0.17 ± 4% perf-profile.children.cycles-pp.obj_cgroup_charge 0.07 +0.1 0.18 ± 5% perf-profile.children.cycles-pp.apparmor_file_alloc_security 0.00 +0.1 0.11 ± 3% perf-profile.children.cycles-pp.__clear_user 0.20 ± 12% +0.1 0.31 ± 15% perf-profile.children.cycles-pp.task_tick_fair 0.02 ±141% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.find_busiest_group 0.02 ±141% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.update_sd_lb_stats 0.00 +0.1 0.11 ± 4% perf-profile.children.cycles-pp.ima_file_check 0.08 ± 10% +0.1 0.20 ± 4% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.07 ± 14% +0.1 0.18 ± 4% perf-profile.children.cycles-pp.page_remove_rmap 0.02 ±141% +0.1 0.14 ± 3% perf-profile.children.cycles-pp.wp_page_copy 0.02 ±141% +0.1 0.14 ± 6% perf-profile.children.cycles-pp.pte_alloc_one 0.03 ± 70% +0.1 0.15 ± 2% perf-profile.children.cycles-pp.schedule 0.07 ± 11% +0.1 0.19 perf-profile.children.cycles-pp._dl_addr 0.00 +0.1 0.12 ± 8% perf-profile.children.cycles-pp.finish_task_switch 0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.__put_task_struct 0.08 +0.1 0.20 ± 5% perf-profile.children.cycles-pp.security_file_alloc 0.09 ± 9% +0.1 0.21 ± 2% perf-profile.children.cycles-pp.select_task_rq_fair 0.04 ± 71% +0.1 0.16 ± 5% perf-profile.children.cycles-pp.load_balance 0.05 ± 8% +0.1 0.18 ± 4% perf-profile.children.cycles-pp.vm_area_dup 0.04 ± 71% +0.1 0.17 ± 2% perf-profile.children.cycles-pp.__d_alloc 0.02 ±141% +0.1 0.15 ± 7% perf-profile.children.cycles-pp.do_wait 0.02 ±141% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.pick_next_task_fair 0.06 ± 16% +0.1 0.19 ± 3% perf-profile.children.cycles-pp.anon_vma_clone 0.02 ±141% +0.1 0.15 ± 8% perf-profile.children.cycles-pp.__do_sys_wait4 0.02 ±141% +0.1 0.15 ± 8% perf-profile.children.cycles-pp.kernel_wait4 0.05 ± 8% +0.1 0.19 ± 2% perf-profile.children.cycles-pp.__vm_munmap 0.28 ± 13% +0.1 0.42 ± 12% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.1 0.14 ± 3% perf-profile.children.cycles-pp.cna_order_queue 0.08 ± 12% +0.1 0.22 ± 5% perf-profile.children.cycles-pp.copy_page_range 0.06 ± 19% +0.1 0.21 ± 7% perf-profile.children.cycles-pp.__memcg_kmem_charge_page 0.00 +0.1 0.15 ± 5% perf-profile.children.cycles-pp.newidle_balance 0.05 ± 8% +0.2 0.21 ± 19% perf-profile.children.cycles-pp.__lock_parent 0.08 ± 14% +0.2 0.26 ± 4% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.09 ± 15% +0.2 0.28 ± 4% perf-profile.children.cycles-pp.release_pages 0.09 ± 19% +0.2 0.28 ± 5% perf-profile.children.cycles-pp.page_counter_try_charge 0.21 ± 21% +0.2 0.41 ± 10% perf-profile.children.cycles-pp.div_int 0.39 ± 14% +0.2 0.58 ± 10% perf-profile.children.cycles-pp.update_process_times 0.39 ± 14% +0.2 0.59 ± 10% perf-profile.children.cycles-pp.tick_sched_handle 0.09 ± 20% +0.2 0.29 ± 3% perf-profile.children.cycles-pp.__memcg_kmem_charge 0.08 ± 17% +0.2 0.28 ± 3% perf-profile.children.cycles-pp.anon_vma_fork 0.16 ± 12% +0.2 0.36 ± 10% perf-profile.children.cycles-pp.mem_rtns_1 0.25 ± 20% +0.2 0.46 ± 10% perf-profile.children.cycles-pp.div_short 0.07 ± 25% +0.2 0.28 ± 4% perf-profile.children.cycles-pp.remove_vma 0.43 ± 14% +0.2 0.64 ± 10% perf-profile.children.cycles-pp.tick_sched_timer 0.14 ± 3% +0.2 0.36 ± 5% perf-profile.children.cycles-pp.setlocale 0.09 ± 9% +0.2 0.31 perf-profile.children.cycles-pp.__schedule 0.11 ± 12% +0.2 0.33 ± 4% perf-profile.children.cycles-pp.tlb_flush_mmu 0.11 ± 16% +0.2 0.34 ± 5% perf-profile.children.cycles-pp.tlb_finish_mmu 0.10 ± 4% +0.2 0.33 ± 11% perf-profile.children.cycles-pp.__fput 0.11 ± 11% +0.2 0.35 ± 4% perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.52 ± 14% +0.2 0.76 ± 12% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.22 ± 19% +0.2 0.46 ± 11% perf-profile.children.cycles-pp.add_short 0.13 ± 10% +0.3 0.38 ± 5% perf-profile.children.cycles-pp.lookup_fast 0.09 ± 15% +0.3 0.35 perf-profile.children.cycles-pp.unlink_anon_vmas 0.09 ± 19% +0.3 0.34 ± 4% perf-profile.children.cycles-pp.get_obj_cgroup_from_current 0.12 ± 3% +0.3 0.38 ± 10% perf-profile.children.cycles-pp.task_work_run 0.09 ± 20% +0.3 0.35 perf-profile.children.cycles-pp.iterate_supers 0.09 ± 20% +0.3 0.36 ± 2% perf-profile.children.cycles-pp.__x64_sys_sync 0.09 ± 20% +0.3 0.36 ± 2% perf-profile.children.cycles-pp.ksys_sync 0.12 ± 11% +0.3 0.39 ± 2% perf-profile.children.cycles-pp.d_alloc 0.09 ± 20% +0.3 0.36 ± 2% perf-profile.children.cycles-pp.sync 0.75 ± 12% +0.3 1.03 ± 11% perf-profile.children.cycles-pp.hrtimer_interrupt 0.75 ± 12% +0.3 1.04 ± 12% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 0.15 ± 3% +0.3 0.45 ± 8% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 0.09 ± 20% +0.3 0.39 ± 3% perf-profile.children.cycles-pp.load_elf_interp 0.19 ± 12% +0.3 0.49 ± 3% perf-profile.children.cycles-pp.zap_pte_range 0.20 ± 11% +0.3 0.51 ± 3% perf-profile.children.cycles-pp.unmap_page_range 0.52 ± 19% +0.3 0.84 ± 3% perf-profile.children.cycles-pp.creat64 0.21 ± 8% +0.3 0.54 ± 3% perf-profile.children.cycles-pp.unmap_vmas 0.09 ± 24% +0.3 0.42 ± 11% perf-profile.children.cycles-pp.propagate_protected_usage 0.28 ± 14% +0.3 0.62 ± 10% perf-profile.children.cycles-pp.__strcat_chk 0.25 ± 7% +0.3 0.59 ± 4% perf-profile.children.cycles-pp.path_lookupat 0.25 ± 8% +0.4 0.60 ± 4% perf-profile.children.cycles-pp.filename_lookup 0.26 ± 8% +0.4 0.62 ± 4% perf-profile.children.cycles-pp.__do_sys_newstat 0.19 ± 11% +0.4 0.56 ± 4% perf-profile.children.cycles-pp.__alloc_file 0.19 ± 9% +0.4 0.56 ± 3% perf-profile.children.cycles-pp.alloc_empty_file 0.26 ± 8% +0.4 0.63 ± 4% perf-profile.children.cycles-pp.vfs_statx 0.12 ± 15% +0.4 0.49 ± 2% perf-profile.children.cycles-pp.elf_map 0.22 ± 11% +0.4 0.60 ± 2% perf-profile.children.cycles-pp.d_alloc_parallel 0.29 ± 8% +0.4 0.68 ± 3% perf-profile.children.cycles-pp.filemap_map_pages 0.24 ± 9% +0.4 0.63 ± 2% perf-profile.children.cycles-pp.__lookup_slow 0.30 ± 32% +0.4 0.73 ± 41% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 0.49 ± 20% +0.4 0.93 ± 10% perf-profile.children.cycles-pp.div_long 0.32 ± 10% +0.5 0.78 ± 3% perf-profile.children.cycles-pp.do_fault 0.52 ± 17% +0.5 1.04 ± 9% perf-profile.children.cycles-pp.add_int 0.51 ± 18% +0.5 1.04 ± 8% perf-profile.children.cycles-pp.add_long 0.50 ± 14% +0.6 1.12 ± 11% perf-profile.children.cycles-pp.__strncat_chk 0.12 ± 14% +0.6 0.74 ± 10% perf-profile.children.cycles-pp.terminate_walk 0.39 ± 19% +0.6 1.02 ± 18% perf-profile.children.cycles-pp.mprotect_fixup 0.39 ± 18% +0.6 1.03 ± 18% perf-profile.children.cycles-pp.__x64_sys_mprotect 0.39 ± 18% +0.6 1.03 ± 18% perf-profile.children.cycles-pp.do_mprotect_pkey 0.21 ± 23% +0.7 0.90 ± 13% perf-profile.children.cycles-pp.__memcg_kmem_uncharge 0.46 ± 21% +0.7 1.20 ± 21% perf-profile.children.cycles-pp.unmap_region 0.30 ± 17% +0.7 1.04 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc 0.48 ± 9% +0.8 1.23 ± 3% perf-profile.children.cycles-pp.__handle_mm_fault 0.50 ± 10% +0.8 1.30 ± 3% perf-profile.children.cycles-pp.handle_mm_fault 0.53 ± 9% +0.8 1.37 ± 3% perf-profile.children.cycles-pp.do_user_addr_fault 0.47 ± 9% +0.8 1.30 ± 2% perf-profile.children.cycles-pp.link_path_walk 0.54 ± 8% +0.8 1.38 ± 3% perf-profile.children.cycles-pp.exc_page_fault 0.48 ± 9% +0.9 1.33 ± 3% perf-profile.children.cycles-pp.walk_component 0.49 ± 18% +0.9 1.34 ± 13% perf-profile.children.cycles-pp.__libc_fork 0.50 ± 20% +0.9 1.41 ± 16% perf-profile.children.cycles-pp.vma_link 0.59 ± 4% +0.9 1.51 ± 4% perf-profile.children.cycles-pp.asm_exc_page_fault 0.34 ± 22% +1.1 1.43 ± 12% perf-profile.children.cycles-pp.page_counter_cancel 0.72 ± 19% +1.2 1.88 ± 19% perf-profile.children.cycles-pp.__vma_adjust 0.36 ± 22% +1.2 1.54 ± 12% perf-profile.children.cycles-pp.page_counter_uncharge 0.74 ± 19% +1.2 1.94 ± 19% perf-profile.children.cycles-pp.__split_vma 0.37 ± 21% +1.2 1.59 ± 5% perf-profile.children.cycles-pp.irq_exit_rcu 0.36 ± 22% +1.2 1.59 ± 5% perf-profile.children.cycles-pp.do_softirq_own_stack 0.00 +1.2 1.23 ± 19% perf-profile.children.cycles-pp.dcache_dir_open 0.00 +1.2 1.23 ± 19% perf-profile.children.cycles-pp.d_alloc_cursor 0.69 ± 15% +1.3 1.96 ± 14% perf-profile.children.cycles-pp.begin_new_exec 0.85 ± 20% +1.4 2.21 ± 20% perf-profile.children.cycles-pp.__do_munmap 0.81 ± 16% +1.4 2.22 ± 13% perf-profile.children.cycles-pp.__x64_sys_exit_group 0.81 ± 16% +1.4 2.22 ± 13% perf-profile.children.cycles-pp.do_group_exit 0.81 ± 16% +1.4 2.22 ± 13% perf-profile.children.cycles-pp.do_exit 1.09 ± 16% +1.4 2.50 ± 8% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack 0.84 ± 20% +1.4 2.29 ± 15% perf-profile.children.cycles-pp.dup_mmap 0.39 ± 20% +1.5 1.84 ± 12% perf-profile.children.cycles-pp.drain_obj_stock 0.85 ± 20% +1.5 2.32 ± 15% perf-profile.children.cycles-pp.dup_mm 1.18 ± 15% +1.6 2.74 ± 8% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 0.94 ± 18% +1.6 2.58 ± 13% perf-profile.children.cycles-pp.copy_process 1.29 ± 11% +1.6 2.94 ± 7% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 1.00 ± 18% +1.7 2.72 ± 13% perf-profile.children.cycles-pp.__do_sys_clone 1.00 ± 18% +1.7 2.72 ± 13% perf-profile.children.cycles-pp.kernel_clone 0.47 ± 18% +1.8 2.25 ± 12% perf-profile.children.cycles-pp.refill_obj_stock 0.92 ± 14% +1.9 2.78 ± 10% perf-profile.children.cycles-pp.load_elf_binary 0.93 ± 14% +1.9 2.79 ± 10% perf-profile.children.cycles-pp.exec_binprm 1.68 ± 14% +2.1 3.74 ± 10% perf-profile.children.cycles-pp.string_rtns_1 1.30 ± 20% +2.1 3.37 ± 20% perf-profile.children.cycles-pp.ksys_mmap_pgoff 1.35 ± 19% +2.2 3.51 ± 24% perf-profile.children.cycles-pp.unlink_file_vma 1.36 ± 20% +2.3 3.63 ± 18% perf-profile.children.cycles-pp.mmap_region 1.37 ± 20% +2.3 3.67 ± 18% perf-profile.children.cycles-pp.do_mmap 1.39 ± 20% +2.3 3.72 ± 18% perf-profile.children.cycles-pp.vm_mmap_pgoff 1.46 ± 19% +2.5 3.92 ± 21% perf-profile.children.cycles-pp.free_pgtables 1.40 ± 16% +2.5 3.88 ± 14% perf-profile.children.cycles-pp.exit_mmap 1.40 ± 16% +2.5 3.89 ± 14% perf-profile.children.cycles-pp.mmput 0.00 +2.7 2.65 ± 9% perf-profile.children.cycles-pp.lockref_get 0.08 ± 5% +2.7 2.80 ± 8% perf-profile.children.cycles-pp.do_dentry_open 0.61 ± 11% +3.2 3.79 ± 15% perf-profile.children.cycles-pp.run_ksoftirqd 0.61 ± 12% +3.2 3.82 ± 15% perf-profile.children.cycles-pp.smpboot_thread_fn 0.65 ± 11% +3.2 3.88 ± 15% perf-profile.children.cycles-pp.kthread 0.66 ± 11% +3.3 3.92 ± 15% perf-profile.children.cycles-pp.ret_from_fork 0.91 ± 14% +4.3 5.25 ± 12% perf-profile.children.cycles-pp.rcu_do_batch 0.92 ± 13% +4.3 5.25 ± 12% perf-profile.children.cycles-pp.rcu_core 0.97 ± 13% +4.4 5.38 ± 12% perf-profile.children.cycles-pp.__softirqentry_text_start 0.99 ± 14% +4.5 5.52 ± 10% perf-profile.children.cycles-pp.kmem_cache_free 3.02 ± 19% +4.7 7.76 ± 23% perf-profile.children.cycles-pp.osq_lock 3.15 ± 19% +5.0 8.16 ± 22% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 3.33 ± 10% +6.1 9.38 ± 10% perf-profile.children.cycles-pp.intel_idle 0.00 +6.4 6.37 ± 2% perf-profile.children.cycles-pp.complete_walk 0.13 ± 3% +7.1 7.19 ± 18% perf-profile.children.cycles-pp.__open64_nocancel 3.89 ± 9% +7.1 10.99 ± 8% perf-profile.children.cycles-pp.cpuidle_enter_state 3.89 ± 9% +7.1 11.00 ± 8% perf-profile.children.cycles-pp.cpuidle_enter 0.28 ± 3% +7.2 7.48 ± 6% perf-profile.children.cycles-pp.lockref_put_or_lock 4.17 ± 6% +7.4 11.59 ± 8% perf-profile.children.cycles-pp.start_secondary 4.20 ± 6% +7.4 11.63 ± 8% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 4.20 ± 6% +7.4 11.63 ± 8% perf-profile.children.cycles-pp.cpu_startup_entry 4.20 ± 6% +7.4 11.63 ± 8% perf-profile.children.cycles-pp.do_idle 0.54 ± 4% +7.5 8.04 ± 6% perf-profile.children.cycles-pp.dput 1.12 ± 2% +11.1 12.26 ± 2% perf-profile.children.cycles-pp.do_sys_open 1.12 ± 2% +11.1 12.25 ± 2% perf-profile.children.cycles-pp.do_sys_openat2 0.06 ± 14% +24.2 24.28 ± 4% perf-profile.children.cycles-pp.pick_link 1.03 ± 4% +24.4 25.43 ± 8% perf-profile.children.cycles-pp.execve 0.17 ± 10% +30.8 30.92 ± 3% perf-profile.children.cycles-pp.lockref_get_not_dead 0.10 ± 8% +30.8 30.87 ± 3% perf-profile.children.cycles-pp.do_open_execat 0.18 ± 9% +30.8 30.95 ± 3% perf-profile.children.cycles-pp.__legitimize_path 0.18 ± 12% +30.8 30.96 ± 3% perf-profile.children.cycles-pp.unlazy_walk 0.20 ± 10% +31.0 31.15 ± 3% perf-profile.children.cycles-pp.step_into 1.05 ± 14% +32.7 33.76 ± 3% perf-profile.children.cycles-pp.bprm_execve 1.14 ± 13% +32.9 33.99 ± 3% perf-profile.children.cycles-pp.do_execveat_common 1.15 ± 13% +32.9 34.01 ± 3% perf-profile.children.cycles-pp.__x64_sys_execve 1.16 ± 3% +41.8 42.98 ± 2% perf-profile.children.cycles-pp.path_openat 1.17 ± 3% +41.8 42.98 ± 2% perf-profile.children.cycles-pp.do_filp_open 0.00 +54.2 54.20 ± 2% perf-profile.children.cycles-pp.__cna_queued_spin_lock_slowpath 81.68 -81.7 0.00 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.05 ± 8% +0.0 0.08 ± 21% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.00 +0.1 0.05 perf-profile.self.cycles-pp.link_path_walk 0.00 +0.1 0.05 perf-profile.self.cycles-pp.apparmor_task_getsecid 0.00 +0.1 0.05 perf-profile.self.cycles-pp.page_add_file_rmap 0.00 +0.1 0.05 perf-profile.self.cycles-pp.common_file_perm 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.05 perf-profile.self.cycles-pp.copy_page 0.00 +0.1 0.05 perf-profile.self.cycles-pp._raw_spin_trylock 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.__rb_insert_augmented 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.compar1 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.__might_sleep 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.sync_regs 0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.__alloc_file 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.kfree 0.00 +0.1 0.06 perf-profile.self.cycles-pp.strnlen_user 0.00 +0.1 0.06 perf-profile.self.cycles-pp.anon_vma_interval_tree_insert 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.memcpy_erms 0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.free_pages_and_swap_cache 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.filldir64 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.06 ± 16% +0.1 0.12 ± 3% perf-profile.self.cycles-pp.__d_lookup_rcu 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.copy_pte_range 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.00 +0.1 0.07 ± 19% perf-profile.self.cycles-pp.file_free_rcu 0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.rwsem_down_write_slowpath 0.05 ± 8% +0.1 0.12 ± 4% perf-profile.self.cycles-pp.apparmor_file_open 0.05 +0.1 0.12 ± 3% perf-profile.self.cycles-pp.apparmor_file_free_security 0.00 +0.1 0.07 ± 5% perf-profile.self.cycles-pp.vma_interval_tree_remove 0.07 +0.1 0.15 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret 0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.rcu_cblist_dequeue 0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__handle_mm_fault 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.down_read 0.02 ±141% +0.1 0.10 ± 5% perf-profile.self.cycles-pp.up_write 0.00 +0.1 0.08 ± 13% perf-profile.self.cycles-pp.__slab_free 0.06 ± 8% +0.1 0.14 ± 8% perf-profile.self.cycles-pp.lockref_get_not_dead 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.clear_page_erms 0.03 ± 70% +0.1 0.12 ± 6% perf-profile.self.cycles-pp.down_write 0.00 +0.1 0.09 ± 7% perf-profile.self.cycles-pp.malloc 0.00 +0.1 0.09 ± 7% perf-profile.self.cycles-pp.aa_get_task_label 0.02 ±141% +0.1 0.11 ± 4% perf-profile.self.cycles-pp.___might_sleep 0.09 ± 13% +0.1 0.19 ± 14% perf-profile.self.cycles-pp.update_cfs_group 0.06 ± 13% +0.1 0.15 ± 5% perf-profile.self.cycles-pp.page_remove_rmap 0.07 ± 11% +0.1 0.17 ± 2% perf-profile.self.cycles-pp.find_idlest_group 0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.lockref_put_return 0.07 ± 7% +0.1 0.17 ± 6% perf-profile.self.cycles-pp.apparmor_file_alloc_security 0.00 +0.1 0.11 ± 7% perf-profile.self.cycles-pp.update_sd_lb_stats 0.08 ± 10% +0.1 0.19 ± 3% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.04 ± 71% +0.1 0.15 ± 5% perf-profile.self.cycles-pp.release_pages 0.00 +0.1 0.12 ± 13% perf-profile.self.cycles-pp.page_counter_uncharge 0.07 ± 11% +0.1 0.19 ± 2% perf-profile.self.cycles-pp._dl_addr 0.00 +0.1 0.13 ± 3% perf-profile.self.cycles-pp.cna_order_queue 0.10 ± 8% +0.1 0.25 ± 2% perf-profile.self.cycles-pp.zap_pte_range 0.08 ± 22% +0.2 0.23 ± 4% perf-profile.self.cycles-pp.page_counter_try_charge 0.08 ± 14% +0.2 0.25 ± 2% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.21 ± 20% +0.2 0.40 ± 11% perf-profile.self.cycles-pp.div_int 0.15 ± 9% +0.2 0.35 ± 11% perf-profile.self.cycles-pp.mem_rtns_1 0.25 ± 22% +0.2 0.45 ± 11% perf-profile.self.cycles-pp.div_short 0.22 ± 19% +0.2 0.45 ± 10% perf-profile.self.cycles-pp.add_short 0.08 ± 27% +0.2 0.32 ± 4% perf-profile.self.cycles-pp.get_obj_cgroup_from_current 0.42 ± 2% +0.3 0.69 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 0.22 ± 9% +0.3 0.49 ± 2% perf-profile.self.cycles-pp.filemap_map_pages 0.11 ± 19% +0.3 0.41 ± 3% perf-profile.self.cycles-pp.kmem_cache_alloc 0.07 ± 6% +0.3 0.40 ± 10% perf-profile.self.cycles-pp.refill_obj_stock 0.28 ± 14% +0.3 0.60 ± 11% perf-profile.self.cycles-pp.__strcat_chk 0.09 ± 24% +0.3 0.42 ± 11% perf-profile.self.cycles-pp.propagate_protected_usage 0.07 ± 11% +0.4 0.46 ± 10% perf-profile.self.cycles-pp.drain_obj_stock 0.49 ± 19% +0.4 0.92 ± 10% perf-profile.self.cycles-pp.div_long 0.51 ± 17% +0.5 1.01 ± 8% perf-profile.self.cycles-pp.add_long 0.51 ± 17% +0.5 1.02 ± 9% perf-profile.self.cycles-pp.add_int 0.49 ± 14% +0.6 1.10 ± 11% perf-profile.self.cycles-pp.__strncat_chk 0.26 ± 21% +0.8 1.04 ± 12% perf-profile.self.cycles-pp.page_counter_cancel 1.66 ± 14% +2.0 3.65 ± 10% perf-profile.self.cycles-pp.string_rtns_1 0.49 ± 13% +2.6 3.11 ± 9% perf-profile.self.cycles-pp.kmem_cache_free 2.93 ± 19% +4.6 7.50 ± 22% perf-profile.self.cycles-pp.osq_lock 3.33 ± 10% +6.0 9.38 ± 10% perf-profile.self.cycles-pp.intel_idle 0.00 +53.4 53.38 ± 2% perf-profile.self.cycles-pp.__cna_queued_spin_lock_slowpath 1579 ± 53% +572.8% 10624 ± 82% interrupts.31:PCI-MSI.524289-edge.eth0-TxRx-0 1203 ±112% +61.3% 1940 ± 68% interrupts.32:PCI-MSI.524290-edge.eth0-TxRx-1 8340 ± 68% -76.0% 2003 ± 74% interrupts.34:PCI-MSI.524292-edge.eth0-TxRx-3 775419 ± 5% +21.9% 944875 ± 2% interrupts.CAL:Function_call_interrupts 5146 ± 4% -51.2% 2512 ± 34% interrupts.CPU0.NMI:Non-maskable_interrupts 5146 ± 4% -51.2% 2512 ± 34% interrupts.CPU0.PMI:Performance_monitoring_interrupts 1113 ± 8% +13.1% 1259 ± 4% interrupts.CPU0.RES:Rescheduling_interrupts 643.67 ± 4% +53.6% 988.50 ± 7% interrupts.CPU0.TLB:TLB_shootdowns 4043 ± 7% +33.6% 5400 ± 5% interrupts.CPU1.CAL:Function_call_interrupts 5177 ± 3% -41.7% 3020 ± 36% interrupts.CPU1.NMI:Non-maskable_interrupts 5177 ± 3% -41.7% 3020 ± 36% interrupts.CPU1.PMI:Performance_monitoring_interrupts 735.33 ± 5% +48.3% 1090 ± 8% interrupts.CPU1.RES:Rescheduling_interrupts 562.00 ± 12% +47.5% 829.00 ± 6% interrupts.CPU1.TLB:TLB_shootdowns 1579 ± 53% +572.8% 10624 ± 82% interrupts.CPU10.31:PCI-MSI.524289-edge.eth0-TxRx-0 3821 ± 7% +28.3% 4903 ± 6% interrupts.CPU10.CAL:Function_call_interrupts 5187 ± 4% -23.5% 3968 ± 5% interrupts.CPU10.NMI:Non-maskable_interrupts 5187 ± 4% -23.5% 3968 ± 5% interrupts.CPU10.PMI:Performance_monitoring_interrupts 738.67 ± 5% +48.7% 1098 ± 4% interrupts.CPU10.RES:Rescheduling_interrupts 522.00 ± 33% +72.4% 900.00 ± 10% interrupts.CPU10.TLB:TLB_shootdowns 3934 ± 9% +24.9% 4913 ± 6% interrupts.CPU100.CAL:Function_call_interrupts 5204 ± 3% -24.7% 3916 ± 8% interrupts.CPU100.NMI:Non-maskable_interrupts 5204 ± 3% -24.7% 3916 ± 8% interrupts.CPU100.PMI:Performance_monitoring_interrupts 743.67 ± 7% +61.4% 1200 ± 9% interrupts.CPU100.RES:Rescheduling_interrupts 474.00 ± 14% +91.8% 909.00 ± 12% interrupts.CPU100.TLB:TLB_shootdowns 3945 ± 4% +24.3% 4901 ± 4% interrupts.CPU101.CAL:Function_call_interrupts 5197 ± 3% -36.2% 3313 ± 26% interrupts.CPU101.NMI:Non-maskable_interrupts 5197 ± 3% -36.2% 3313 ± 26% interrupts.CPU101.PMI:Performance_monitoring_interrupts 720.33 ± 5% +60.8% 1158 ± 7% interrupts.CPU101.RES:Rescheduling_interrupts 496.67 ± 7% +82.6% 906.75 ± 15% interrupts.CPU101.TLB:TLB_shootdowns 3918 ± 5% +22.8% 4810 ± 6% interrupts.CPU102.CAL:Function_call_interrupts 5186 ± 4% -25.2% 3879 ± 10% interrupts.CPU102.NMI:Non-maskable_interrupts 5186 ± 4% -25.2% 3879 ± 10% interrupts.CPU102.PMI:Performance_monitoring_interrupts 699.33 ± 3% +61.8% 1131 ± 7% interrupts.CPU102.RES:Rescheduling_interrupts 406.33 ± 7% +108.2% 846.00 ± 12% interrupts.CPU102.TLB:TLB_shootdowns 3882 ± 5% +26.2% 4897 ± 4% interrupts.CPU103.CAL:Function_call_interrupts 5224 ± 3% -34.9% 3399 ± 26% interrupts.CPU103.NMI:Non-maskable_interrupts 5224 ± 3% -34.9% 3399 ± 26% interrupts.CPU103.PMI:Performance_monitoring_interrupts 658.33 ± 4% +73.4% 1141 ± 5% interrupts.CPU103.RES:Rescheduling_interrupts 449.00 ± 16% +89.6% 851.50 ± 8% interrupts.CPU103.TLB:TLB_shootdowns 3881 ± 3% +23.9% 4807 ± 3% interrupts.CPU104.CAL:Function_call_interrupts 5212 ± 3% -26.6% 3826 ± 8% interrupts.CPU104.NMI:Non-maskable_interrupts 5212 ± 3% -26.6% 3826 ± 8% interrupts.CPU104.PMI:Performance_monitoring_interrupts 637.67 ± 7% +73.6% 1106 ± 9% interrupts.CPU104.RES:Rescheduling_interrupts 423.33 ± 7% +90.1% 804.75 ± 14% interrupts.CPU104.TLB:TLB_shootdowns 3845 +20.2% 4623 interrupts.CPU105.CAL:Function_call_interrupts 661.33 ± 8% +68.5% 1114 ± 2% interrupts.CPU105.RES:Rescheduling_interrupts 467.33 ± 17% +87.6% 876.50 ± 21% interrupts.CPU105.TLB:TLB_shootdowns 3959 ± 4% +18.2% 4679 interrupts.CPU106.CAL:Function_call_interrupts 5251 ± 3% -25.6% 3905 ± 10% interrupts.CPU106.NMI:Non-maskable_interrupts 5251 ± 3% -25.6% 3905 ± 10% interrupts.CPU106.PMI:Performance_monitoring_interrupts 721.33 ± 5% +59.2% 1148 ± 8% interrupts.CPU106.RES:Rescheduling_interrupts 419.00 ± 15% +150.8% 1050 ± 30% interrupts.CPU106.TLB:TLB_shootdowns 3930 ± 5% +18.9% 4674 ± 4% interrupts.CPU107.CAL:Function_call_interrupts 5177 ± 5% -34.4% 3398 ± 26% interrupts.CPU107.NMI:Non-maskable_interrupts 5177 ± 5% -34.4% 3398 ± 26% interrupts.CPU107.PMI:Performance_monitoring_interrupts 665.33 ± 5% +75.8% 1169 ± 4% interrupts.CPU107.RES:Rescheduling_interrupts 445.00 ± 18% +83.9% 818.50 ± 13% interrupts.CPU107.TLB:TLB_shootdowns 3915 ± 8% +20.9% 4735 ± 3% interrupts.CPU108.CAL:Function_call_interrupts 5255 ± 3% -36.2% 3350 ± 25% interrupts.CPU108.NMI:Non-maskable_interrupts 5255 ± 3% -36.2% 3350 ± 25% interrupts.CPU108.PMI:Performance_monitoring_interrupts 684.33 ± 7% +67.5% 1146 ± 7% interrupts.CPU108.RES:Rescheduling_interrupts 509.00 ± 11% +66.4% 846.75 ± 6% interrupts.CPU108.TLB:TLB_shootdowns 3965 ± 3% +19.8% 4749 ± 4% interrupts.CPU109.CAL:Function_call_interrupts 5207 ± 3% -42.8% 2976 ± 38% interrupts.CPU109.NMI:Non-maskable_interrupts 5207 ± 3% -42.8% 2976 ± 38% interrupts.CPU109.PMI:Performance_monitoring_interrupts 701.00 ± 4% +55.2% 1087 ± 5% interrupts.CPU109.RES:Rescheduling_interrupts 510.33 ± 11% +71.9% 877.25 ± 6% interrupts.CPU109.TLB:TLB_shootdowns 1203 ±112% +61.3% 1940 ± 68% interrupts.CPU11.32:PCI-MSI.524290-edge.eth0-TxRx-1 3794 ± 5% +31.8% 4999 ± 4% interrupts.CPU11.CAL:Function_call_interrupts 734.33 ± 6% +51.7% 1114 ± 3% interrupts.CPU11.RES:Rescheduling_interrupts 458.67 ± 14% +100.9% 921.50 ± 10% interrupts.CPU11.TLB:TLB_shootdowns 3949 ± 5% +27.3% 5029 ± 4% interrupts.CPU110.CAL:Function_call_interrupts 5230 ± 3% -35.3% 3385 ± 24% interrupts.CPU110.NMI:Non-maskable_interrupts 5230 ± 3% -35.3% 3385 ± 24% interrupts.CPU110.PMI:Performance_monitoring_interrupts 670.67 ± 6% +74.5% 1170 ± 7% interrupts.CPU110.RES:Rescheduling_interrupts 442.00 ± 8% +88.5% 833.00 ± 18% interrupts.CPU110.TLB:TLB_shootdowns 3865 ± 4% +24.2% 4802 ± 4% interrupts.CPU111.CAL:Function_call_interrupts 5230 ± 3% -36.3% 3330 ± 25% interrupts.CPU111.NMI:Non-maskable_interrupts 5230 ± 3% -36.3% 3330 ± 25% interrupts.CPU111.PMI:Performance_monitoring_interrupts 634.00 ± 9% +85.7% 1177 ± 10% interrupts.CPU111.RES:Rescheduling_interrupts 441.33 ± 13% +96.4% 866.75 ± 14% interrupts.CPU111.TLB:TLB_shootdowns 3873 ± 5% +24.7% 4829 ± 2% interrupts.CPU112.CAL:Function_call_interrupts 5121 ± 4% -35.0% 3326 ± 24% interrupts.CPU112.NMI:Non-maskable_interrupts 5121 ± 4% -35.0% 3326 ± 24% interrupts.CPU112.PMI:Performance_monitoring_interrupts 669.00 ± 2% +72.3% 1152 ± 7% interrupts.CPU112.RES:Rescheduling_interrupts 430.00 ± 2% +111.9% 911.00 ± 15% interrupts.CPU112.TLB:TLB_shootdowns 3921 ± 6% +24.6% 4885 ± 3% interrupts.CPU113.CAL:Function_call_interrupts 672.33 ± 8% +70.0% 1142 ± 7% interrupts.CPU113.RES:Rescheduling_interrupts 431.33 ± 9% +98.2% 855.00 ± 11% interrupts.CPU113.TLB:TLB_shootdowns 3779 ± 7% +27.7% 4827 ± 4% interrupts.CPU114.CAL:Function_call_interrupts 641.00 ± 13% +79.3% 1149 ± 4% interrupts.CPU114.RES:Rescheduling_interrupts 504.00 ± 10% +77.2% 893.25 ± 20% interrupts.CPU114.TLB:TLB_shootdowns 3904 ± 6% +20.2% 4693 interrupts.CPU115.CAL:Function_call_interrupts 651.67 ± 3% +78.9% 1165 ± 2% interrupts.CPU115.RES:Rescheduling_interrupts 501.67 ± 29% +69.9% 852.50 ± 4% interrupts.CPU115.TLB:TLB_shootdowns 3818 ± 3% +23.2% 4703 interrupts.CPU116.CAL:Function_call_interrupts 630.67 ± 7% +81.6% 1145 ± 6% interrupts.CPU116.RES:Rescheduling_interrupts 439.67 ± 14% +98.7% 873.50 ± 15% interrupts.CPU116.TLB:TLB_shootdowns 4154 ± 4% +13.8% 4728 interrupts.CPU117.CAL:Function_call_interrupts 650.67 ± 8% +70.7% 1110 ± 6% interrupts.CPU117.RES:Rescheduling_interrupts 502.33 ± 12% +77.0% 889.00 ± 10% interrupts.CPU117.TLB:TLB_shootdowns 3947 ± 5% +21.6% 4798 ± 5% interrupts.CPU118.CAL:Function_call_interrupts 659.33 +71.4% 1130 ± 4% interrupts.CPU118.RES:Rescheduling_interrupts 464.67 ± 11% +84.5% 857.25 ± 9% interrupts.CPU118.TLB:TLB_shootdowns 4065 ± 4% +19.6% 4860 ± 5% interrupts.CPU119.CAL:Function_call_interrupts 614.00 ± 8% +82.9% 1123 ± 4% interrupts.CPU119.RES:Rescheduling_interrupts 480.33 ± 8% +74.6% 838.50 ± 8% interrupts.CPU119.TLB:TLB_shootdowns 4011 ± 3% +20.9% 4848 ± 7% interrupts.CPU12.CAL:Function_call_interrupts 769.33 ± 2% +44.1% 1108 ± 8% interrupts.CPU12.RES:Rescheduling_interrupts 502.00 ± 4% +96.4% 986.00 ± 12% interrupts.CPU12.TLB:TLB_shootdowns 4091 ± 4% +22.3% 5003 ± 3% interrupts.CPU120.CAL:Function_call_interrupts 717.33 ± 9% +64.2% 1177 ± 6% interrupts.CPU120.RES:Rescheduling_interrupts 459.67 ± 14% +103.1% 933.50 ± 15% interrupts.CPU120.TLB:TLB_shootdowns 3923 ± 4% +25.2% 4913 ± 3% interrupts.CPU121.CAL:Function_call_interrupts 617.33 ± 3% +89.4% 1169 ± 4% interrupts.CPU121.RES:Rescheduling_interrupts 401.67 ± 22% +195.5% 1186 ± 39% interrupts.CPU121.TLB:TLB_shootdowns 3867 ± 4% +34.9% 5218 ± 4% interrupts.CPU122.CAL:Function_call_interrupts 596.67 ± 8% +100.9% 1198 ± 5% interrupts.CPU122.RES:Rescheduling_interrupts 450.00 ± 16% +109.0% 940.50 ± 6% interrupts.CPU122.TLB:TLB_shootdowns 4031 ± 8% +23.2% 4967 ± 3% interrupts.CPU123.CAL:Function_call_interrupts 628.00 ± 4% +94.1% 1218 ± 7% interrupts.CPU123.RES:Rescheduling_interrupts 474.67 ± 13% +96.1% 931.00 ± 12% interrupts.CPU123.TLB:TLB_shootdowns 4232 ± 4% +20.3% 5090 ± 3% interrupts.CPU124.CAL:Function_call_interrupts 639.00 +82.9% 1168 ± 7% interrupts.CPU124.RES:Rescheduling_interrupts 463.33 ± 17% +110.1% 973.25 ± 11% interrupts.CPU124.TLB:TLB_shootdowns 3972 +21.5% 4826 ± 3% interrupts.CPU125.CAL:Function_call_interrupts 658.67 ± 8% +78.4% 1175 ± 4% interrupts.CPU125.RES:Rescheduling_interrupts 480.00 ± 13% +96.0% 940.75 ± 23% interrupts.CPU125.TLB:TLB_shootdowns 4093 ± 3% +20.8% 4947 ± 4% interrupts.CPU126.CAL:Function_call_interrupts 672.67 ± 5% +75.9% 1183 ± 2% interrupts.CPU126.RES:Rescheduling_interrupts 498.00 ± 10% +90.0% 946.25 ± 11% interrupts.CPU126.TLB:TLB_shootdowns 4111 ± 5% +20.8% 4965 ± 5% interrupts.CPU127.CAL:Function_call_interrupts 613.67 ± 2% +95.2% 1198 ± 5% interrupts.CPU127.RES:Rescheduling_interrupts 451.67 ± 21% +109.8% 947.50 ± 14% interrupts.CPU127.TLB:TLB_shootdowns 4066 +20.3% 4891 ± 3% interrupts.CPU128.CAL:Function_call_interrupts 5200 ± 2% -23.3% 3986 ± 9% interrupts.CPU128.NMI:Non-maskable_interrupts 5200 ± 2% -23.3% 3986 ± 9% interrupts.CPU128.PMI:Performance_monitoring_interrupts 663.33 ± 4% +74.6% 1158 ± 6% interrupts.CPU128.RES:Rescheduling_interrupts 472.33 ± 17% +102.4% 956.00 ± 8% interrupts.CPU128.TLB:TLB_shootdowns 4075 ± 8% +20.3% 4900 interrupts.CPU129.CAL:Function_call_interrupts 640.33 ± 2% +73.2% 1108 ± 8% interrupts.CPU129.RES:Rescheduling_interrupts 445.33 ± 19% +113.4% 950.25 ± 11% interrupts.CPU129.TLB:TLB_shootdowns 8340 ± 68% -76.0% 2003 ± 74% interrupts.CPU13.34:PCI-MSI.524292-edge.eth0-TxRx-3 4049 ± 7% +20.6% 4885 ± 2% interrupts.CPU13.CAL:Function_call_interrupts 5130 ± 3% -24.2% 3886 ± 5% interrupts.CPU13.NMI:Non-maskable_interrupts 5130 ± 3% -24.2% 3886 ± 5% interrupts.CPU13.PMI:Performance_monitoring_interrupts 724.00 ± 5% +57.8% 1142 ± 5% interrupts.CPU13.RES:Rescheduling_interrupts 532.67 ± 23% +70.5% 908.25 ± 12% interrupts.CPU13.TLB:TLB_shootdowns 3881 ± 6% +30.0% 5044 ± 4% interrupts.CPU130.CAL:Function_call_interrupts 621.33 ± 10% +89.4% 1176 ± 8% interrupts.CPU130.RES:Rescheduling_interrupts 516.33 ± 16% +92.9% 996.25 ± 15% interrupts.CPU130.TLB:TLB_shootdowns 4035 ± 2% +22.0% 4923 ± 3% interrupts.CPU131.CAL:Function_call_interrupts 661.67 ± 7% +69.5% 1121 ± 4% interrupts.CPU131.RES:Rescheduling_interrupts 425.67 ± 11% +116.8% 922.75 ± 15% interrupts.CPU131.TLB:TLB_shootdowns 4345 ± 3% +13.3% 4924 ± 5% interrupts.CPU132.CAL:Function_call_interrupts 694.00 +68.9% 1172 ± 5% interrupts.CPU132.RES:Rescheduling_interrupts 476.00 ± 11% +94.5% 926.00 ± 13% interrupts.CPU132.TLB:TLB_shootdowns 4091 ± 7% +22.7% 5018 ± 4% interrupts.CPU133.CAL:Function_call_interrupts 663.67 ± 6% +68.6% 1119 ± 4% interrupts.CPU133.RES:Rescheduling_interrupts 534.33 ± 9% +78.7% 954.75 ± 13% interrupts.CPU133.TLB:TLB_shootdowns 3856 ± 7% +26.7% 4886 ± 3% interrupts.CPU134.CAL:Function_call_interrupts 5199 ± 2% -34.5% 3406 ± 24% interrupts.CPU134.NMI:Non-maskable_interrupts 5199 ± 2% -34.5% 3406 ± 24% interrupts.CPU134.PMI:Performance_monitoring_interrupts 667.00 ± 13% +74.7% 1165 ± 6% interrupts.CPU134.RES:Rescheduling_interrupts 447.33 ± 9% +116.7% 969.25 ± 3% interrupts.CPU134.TLB:TLB_shootdowns 4120 ± 11% +18.6% 4886 ± 3% interrupts.CPU135.CAL:Function_call_interrupts 5233 ± 3% -24.8% 3934 ± 9% interrupts.CPU135.NMI:Non-maskable_interrupts 5233 ± 3% -24.8% 3934 ± 9% interrupts.CPU135.PMI:Performance_monitoring_interrupts 643.67 ± 5% +81.8% 1170 ± 7% interrupts.CPU135.RES:Rescheduling_interrupts 490.00 ± 17% +88.4% 923.00 ± 18% interrupts.CPU135.TLB:TLB_shootdowns 4092 ± 3% +22.8% 5026 ± 3% interrupts.CPU136.CAL:Function_call_interrupts 5225 ± 3% -34.3% 3430 ± 26% interrupts.CPU136.NMI:Non-maskable_interrupts 5225 ± 3% -34.3% 3430 ± 26% interrupts.CPU136.PMI:Performance_monitoring_interrupts 673.33 ± 4% +80.6% 1216 ± 4% interrupts.CPU136.RES:Rescheduling_interrupts 488.00 ± 8% +87.9% 916.75 ± 13% interrupts.CPU136.TLB:TLB_shootdowns 4234 ± 9% +16.3% 4925 ± 4% interrupts.CPU137.CAL:Function_call_interrupts 5217 ± 4% -34.5% 3418 ± 24% interrupts.CPU137.NMI:Non-maskable_interrupts 5217 ± 4% -34.5% 3418 ± 24% interrupts.CPU137.PMI:Performance_monitoring_interrupts 625.33 ± 14% +87.5% 1172 ± 6% interrupts.CPU137.RES:Rescheduling_interrupts 441.67 ± 10% +115.5% 951.75 ± 13% interrupts.CPU137.TLB:TLB_shootdowns 3987 ± 6% +23.1% 4907 ± 2% interrupts.CPU138.CAL:Function_call_interrupts 5218 ± 3% -42.7% 2992 ± 38% interrupts.CPU138.NMI:Non-maskable_interrupts 5218 ± 3% -42.7% 2992 ± 38% interrupts.CPU138.PMI:Performance_monitoring_interrupts 672.33 ± 3% +76.5% 1186 ± 4% interrupts.CPU138.RES:Rescheduling_interrupts 439.67 ± 8% +113.4% 938.25 ± 11% interrupts.CPU138.TLB:TLB_shootdowns 4040 ± 7% +23.1% 4973 ± 4% interrupts.CPU139.CAL:Function_call_interrupts 635.33 ± 3% +85.3% 1177 ± 7% interrupts.CPU139.RES:Rescheduling_interrupts 425.33 ± 17% +110.7% 896.00 ± 10% interrupts.CPU139.TLB:TLB_shootdowns 3920 ± 2% +21.7% 4771 ± 2% interrupts.CPU14.CAL:Function_call_interrupts 5123 ± 4% -43.3% 2903 ± 30% interrupts.CPU14.NMI:Non-maskable_interrupts 5123 ± 4% -43.3% 2903 ± 30% interrupts.CPU14.PMI:Performance_monitoring_interrupts 725.00 ± 12% +56.2% 1132 ± 6% interrupts.CPU14.RES:Rescheduling_interrupts 402.00 ± 6% +110.0% 844.25 ± 10% interrupts.CPU14.TLB:TLB_shootdowns 4006 ± 11% +19.8% 4800 ± 3% interrupts.CPU140.CAL:Function_call_interrupts 5230 ± 3% -24.8% 3932 ± 10% interrupts.CPU140.NMI:Non-maskable_interrupts 5230 ± 3% -24.8% 3932 ± 10% interrupts.CPU140.PMI:Performance_monitoring_interrupts 578.33 ± 3% +102.5% 1171 ± 5% interrupts.CPU140.RES:Rescheduling_interrupts 506.00 ± 5% +90.3% 963.00 ± 11% interrupts.CPU140.TLB:TLB_shootdowns 4080 ± 6% +25.8% 5131 ± 7% interrupts.CPU141.CAL:Function_call_interrupts 5148 ± 4% -33.6% 3418 ± 25% interrupts.CPU141.NMI:Non-maskable_interrupts 5148 ± 4% -33.6% 3418 ± 25% interrupts.CPU141.PMI:Performance_monitoring_interrupts 695.00 ± 3% +74.7% 1214 ± 7% interrupts.CPU141.RES:Rescheduling_interrupts 503.33 ± 23% +150.9% 1263 ± 44% interrupts.CPU141.TLB:TLB_shootdowns 4155 ± 8% +16.6% 4843 ± 4% interrupts.CPU142.CAL:Function_call_interrupts 638.00 ± 6% +82.1% 1161 ± 6% interrupts.CPU142.RES:Rescheduling_interrupts 509.33 ± 8% +89.0% 962.50 ± 14% interrupts.CPU142.TLB:TLB_shootdowns 4018 ± 6% +24.3% 4993 interrupts.CPU143.CAL:Function_call_interrupts 643.67 ± 2% +86.6% 1201 ± 8% interrupts.CPU143.RES:Rescheduling_interrupts 553.67 ± 7% +83.0% 1013 ± 10% interrupts.CPU143.TLB:TLB_shootdowns 3990 ± 5% +25.0% 4989 ± 4% interrupts.CPU144.CAL:Function_call_interrupts 654.00 ± 10% +78.0% 1164 ± 4% interrupts.CPU144.RES:Rescheduling_interrupts 415.33 ± 4% +124.9% 934.25 ± 9% interrupts.CPU144.TLB:TLB_shootdowns 3875 ± 3% +30.5% 5056 ± 6% interrupts.CPU145.CAL:Function_call_interrupts 647.00 ± 13% +79.9% 1163 ± 4% interrupts.CPU145.RES:Rescheduling_interrupts 445.67 ± 16% +112.7% 947.75 ± 12% interrupts.CPU145.TLB:TLB_shootdowns 3891 ± 7% +24.8% 4857 ± 5% interrupts.CPU146.CAL:Function_call_interrupts 635.00 ± 6% +80.7% 1147 ± 5% interrupts.CPU146.RES:Rescheduling_interrupts 438.67 ± 11% +127.1% 996.25 ± 10% interrupts.CPU146.TLB:TLB_shootdowns 3899 ± 7% +28.0% 4990 ± 4% interrupts.CPU147.CAL:Function_call_interrupts 5189 ± 3% -24.6% 3915 ± 10% interrupts.CPU147.NMI:Non-maskable_interrupts 5189 ± 3% -24.6% 3915 ± 10% interrupts.CPU147.PMI:Performance_monitoring_interrupts 643.33 +80.3% 1160 ± 2% interrupts.CPU147.RES:Rescheduling_interrupts 430.00 ± 16% +116.9% 932.50 ± 17% interrupts.CPU147.TLB:TLB_shootdowns 4129 ± 12% +18.4% 4889 interrupts.CPU148.CAL:Function_call_interrupts 5219 ± 3% -24.7% 3932 ± 9% interrupts.CPU148.NMI:Non-maskable_interrupts 5219 ± 3% -24.7% 3932 ± 9% interrupts.CPU148.PMI:Performance_monitoring_interrupts 588.33 ± 7% +93.6% 1139 ± 5% interrupts.CPU148.RES:Rescheduling_interrupts 501.00 ± 16% +78.7% 895.25 ± 8% interrupts.CPU148.TLB:TLB_shootdowns 4186 ± 9% +18.3% 4953 ± 3% interrupts.CPU149.CAL:Function_call_interrupts 5185 ± 4% -32.3% 3509 ± 31% interrupts.CPU149.NMI:Non-maskable_interrupts 5185 ± 4% -32.3% 3509 ± 31% interrupts.CPU149.PMI:Performance_monitoring_interrupts 638.67 +70.9% 1091 ± 2% interrupts.CPU149.RES:Rescheduling_interrupts 558.33 ± 15% +71.8% 959.25 ± 7% interrupts.CPU149.TLB:TLB_shootdowns 3912 ± 6% +21.4% 4750 ± 4% interrupts.CPU15.CAL:Function_call_interrupts 5197 ± 3% -22.8% 4013 ± 4% interrupts.CPU15.NMI:Non-maskable_interrupts 5197 ± 3% -22.8% 4013 ± 4% interrupts.CPU15.PMI:Performance_monitoring_interrupts 776.33 ± 7% +39.1% 1080 ± 6% interrupts.CPU15.RES:Rescheduling_interrupts 473.00 ± 12% +98.5% 938.75 ± 11% interrupts.CPU15.TLB:TLB_shootdowns 4178 ± 9% +18.1% 4936 ± 4% interrupts.CPU150.CAL:Function_call_interrupts 5192 ± 4% -25.4% 3873 ± 10% interrupts.CPU150.NMI:Non-maskable_interrupts 5192 ± 4% -25.4% 3873 ± 10% interrupts.CPU150.PMI:Performance_monitoring_interrupts 678.67 ± 8% +64.3% 1115 ± 5% interrupts.CPU150.RES:Rescheduling_interrupts 513.33 ± 28% +73.6% 891.00 ± 21% interrupts.CPU150.TLB:TLB_shootdowns 4052 ± 6% +21.9% 4939 ± 3% interrupts.CPU151.CAL:Function_call_interrupts 5260 ± 3% -25.8% 3903 ± 10% interrupts.CPU151.NMI:Non-maskable_interrupts 5260 ± 3% -25.8% 3903 ± 10% interrupts.CPU151.PMI:Performance_monitoring_interrupts 623.33 ± 3% +86.9% 1164 ± 4% interrupts.CPU151.RES:Rescheduling_interrupts 484.67 ± 11% +98.0% 959.50 ± 8% interrupts.CPU151.TLB:TLB_shootdowns 3982 ± 8% +25.1% 4982 ± 4% interrupts.CPU152.CAL:Function_call_interrupts 5183 ± 2% -32.9% 3475 ± 26% interrupts.CPU152.NMI:Non-maskable_interrupts 5183 ± 2% -32.9% 3475 ± 26% interrupts.CPU152.PMI:Performance_monitoring_interrupts 623.33 ± 5% +79.5% 1119 ± 2% interrupts.CPU152.RES:Rescheduling_interrupts 494.00 ± 14% +89.7% 937.25 ± 9% interrupts.CPU152.TLB:TLB_shootdowns 4109 ± 6% +24.9% 5131 ± 10% interrupts.CPU153.CAL:Function_call_interrupts 5179 ± 4% -31.7% 3536 ± 31% interrupts.CPU153.NMI:Non-maskable_interrupts 5179 ± 4% -31.7% 3536 ± 31% interrupts.CPU153.PMI:Performance_monitoring_interrupts 614.67 ± 3% +94.8% 1197 ± 9% interrupts.CPU153.RES:Rescheduling_interrupts 486.00 ± 19% +83.9% 893.75 ± 13% interrupts.CPU153.TLB:TLB_shootdowns 4161 ± 5% +16.5% 4846 ± 2% interrupts.CPU154.CAL:Function_call_interrupts 635.33 ± 3% +74.6% 1109 ± 3% interrupts.CPU154.RES:Rescheduling_interrupts 490.67 ± 21% +87.4% 919.50 ± 8% interrupts.CPU154.TLB:TLB_shootdowns 3946 ± 8% +28.2% 5057 ± 2% interrupts.CPU155.CAL:Function_call_interrupts 631.33 ± 9% +78.6% 1127 ± 3% interrupts.CPU155.RES:Rescheduling_interrupts 489.33 ± 17% +107.9% 1017 ± 11% interrupts.CPU155.TLB:TLB_shootdowns 4028 ± 5% +21.3% 4887 ± 4% interrupts.CPU156.CAL:Function_call_interrupts 627.33 ± 2% +82.2% 1142 ± 2% interrupts.CPU156.RES:Rescheduling_interrupts 452.33 ± 14% +113.0% 963.25 ± 15% interrupts.CPU156.TLB:TLB_shootdowns 3893 ± 8% +28.2% 4993 ± 4% interrupts.CPU157.CAL:Function_call_interrupts 637.33 +80.4% 1149 ± 4% interrupts.CPU157.RES:Rescheduling_interrupts 451.67 ± 20% +105.6% 928.50 ± 11% interrupts.CPU157.TLB:TLB_shootdowns 4155 ± 9% +19.6% 4971 ± 4% interrupts.CPU158.CAL:Function_call_interrupts 628.33 ± 6% +75.8% 1104 ± 2% interrupts.CPU158.RES:Rescheduling_interrupts 468.33 ± 11% +103.4% 952.50 ± 11% interrupts.CPU158.TLB:TLB_shootdowns 3965 ± 8% +23.8% 4910 ± 5% interrupts.CPU159.CAL:Function_call_interrupts 597.33 ± 4% +95.2% 1166 ± 2% interrupts.CPU159.RES:Rescheduling_interrupts 436.00 ± 12% +121.7% 966.50 ± 11% interrupts.CPU159.TLB:TLB_shootdowns 3811 ± 3% +28.3% 4890 ± 6% interrupts.CPU16.CAL:Function_call_interrupts 5211 ± 3% -24.1% 3953 ± 5% interrupts.CPU16.NMI:Non-maskable_interrupts 5211 ± 3% -24.1% 3953 ± 5% interrupts.CPU16.PMI:Performance_monitoring_interrupts 726.67 ± 6% +55.9% 1132 ± 7% interrupts.CPU16.RES:Rescheduling_interrupts 505.67 ± 13% +75.1% 885.50 ± 12% interrupts.CPU16.TLB:TLB_shootdowns 3965 ± 8% +24.8% 4948 ± 6% interrupts.CPU160.CAL:Function_call_interrupts 636.67 ± 4% +74.8% 1113 ± 2% interrupts.CPU160.RES:Rescheduling_interrupts 516.67 ± 17% +88.3% 973.00 ± 14% interrupts.CPU160.TLB:TLB_shootdowns 4054 ± 8% +24.2% 5036 ± 4% interrupts.CPU161.CAL:Function_call_interrupts 601.00 ± 6% +89.6% 1139 ± 3% interrupts.CPU161.RES:Rescheduling_interrupts 514.33 ± 13% +81.9% 935.50 ± 12% interrupts.CPU161.TLB:TLB_shootdowns 4039 ± 11% +19.7% 4836 ± 3% interrupts.CPU162.CAL:Function_call_interrupts 643.33 ± 7% +67.2% 1075 interrupts.CPU162.RES:Rescheduling_interrupts 469.33 ± 18% +107.1% 972.00 ± 8% interrupts.CPU162.TLB:TLB_shootdowns 4022 ± 7% +20.9% 4864 ± 3% interrupts.CPU163.CAL:Function_call_interrupts 609.33 ± 3% +92.5% 1172 interrupts.CPU163.RES:Rescheduling_interrupts 431.00 ± 18% +146.3% 1061 ± 6% interrupts.CPU163.TLB:TLB_shootdowns 4036 +20.7% 4869 ± 4% interrupts.CPU164.CAL:Function_call_interrupts 613.00 ± 4% +86.4% 1142 ± 6% interrupts.CPU164.RES:Rescheduling_interrupts 492.33 ± 19% +87.9% 925.25 ± 10% interrupts.CPU164.TLB:TLB_shootdowns 3957 ± 3% +23.4% 4883 ± 4% interrupts.CPU165.CAL:Function_call_interrupts 4307 ± 27% -42.1% 2492 ± 41% interrupts.CPU165.NMI:Non-maskable_interrupts 4307 ± 27% -42.1% 2492 ± 41% interrupts.CPU165.PMI:Performance_monitoring_interrupts 583.00 ± 10% +88.9% 1101 ± 3% interrupts.CPU165.RES:Rescheduling_interrupts 449.00 ± 22% +108.7% 937.25 ± 13% interrupts.CPU165.TLB:TLB_shootdowns 4219 ± 5% +16.9% 4932 ± 4% interrupts.CPU166.CAL:Function_call_interrupts 624.33 ± 4% +76.9% 1104 ± 5% interrupts.CPU166.RES:Rescheduling_interrupts 484.33 ± 17% +100.6% 971.50 ± 17% interrupts.CPU166.TLB:TLB_shootdowns 4064 ± 10% +21.0% 4918 ± 3% interrupts.CPU167.CAL:Function_call_interrupts 616.67 ± 6% +83.5% 1131 ± 4% interrupts.CPU167.RES:Rescheduling_interrupts 452.00 ± 12% +95.7% 884.50 ± 8% interrupts.CPU167.TLB:TLB_shootdowns 4087 ± 6% +19.4% 4879 ± 6% interrupts.CPU168.CAL:Function_call_interrupts 649.67 +69.1% 1098 ± 4% interrupts.CPU168.RES:Rescheduling_interrupts 478.33 ± 6% +92.4% 920.50 ± 12% interrupts.CPU168.TLB:TLB_shootdowns 3753 ± 7% +20.6% 4524 ± 4% interrupts.CPU169.CAL:Function_call_interrupts 585.67 +81.9% 1065 ± 2% interrupts.CPU169.RES:Rescheduling_interrupts 459.00 ± 4% +104.2% 937.50 ± 3% interrupts.CPU169.TLB:TLB_shootdowns 3764 ± 5% +28.6% 4841 ± 3% interrupts.CPU17.CAL:Function_call_interrupts 5198 ± 3% -43.0% 2964 ± 35% interrupts.CPU17.NMI:Non-maskable_interrupts 5198 ± 3% -43.0% 2964 ± 35% interrupts.CPU17.PMI:Performance_monitoring_interrupts 729.33 ± 5% +52.1% 1109 ± 7% interrupts.CPU17.RES:Rescheduling_interrupts 450.67 ± 10% +104.4% 921.25 ± 7% interrupts.CPU17.TLB:TLB_shootdowns 4099 ± 8% +24.8% 5118 ± 5% interrupts.CPU170.CAL:Function_call_interrupts 590.67 ± 7% +91.4% 1130 interrupts.CPU170.RES:Rescheduling_interrupts 552.33 ± 17% +75.9% 971.75 ± 10% interrupts.CPU170.TLB:TLB_shootdowns 4023 ± 8% +19.5% 4808 interrupts.CPU171.CAL:Function_call_interrupts 594.67 ± 7% +82.6% 1085 ± 5% interrupts.CPU171.RES:Rescheduling_interrupts 468.33 ± 13% +94.0% 908.75 ± 7% interrupts.CPU171.TLB:TLB_shootdowns 3917 ± 9% +25.0% 4895 ± 5% interrupts.CPU172.CAL:Function_call_interrupts 5248 ± 3% -25.4% 3915 ± 10% interrupts.CPU172.NMI:Non-maskable_interrupts 5248 ± 3% -25.4% 3915 ± 10% interrupts.CPU172.PMI:Performance_monitoring_interrupts 543.00 ± 3% +103.6% 1105 ± 5% interrupts.CPU172.RES:Rescheduling_interrupts 468.67 ± 15% +94.0% 909.25 ± 17% interrupts.CPU172.TLB:TLB_shootdowns 4057 ± 6% +22.6% 4975 ± 2% interrupts.CPU173.CAL:Function_call_interrupts 5158 ± 5% -31.7% 3521 ± 31% interrupts.CPU173.NMI:Non-maskable_interrupts 5158 ± 5% -31.7% 3521 ± 31% interrupts.CPU173.PMI:Performance_monitoring_interrupts 597.67 ± 5% +87.9% 1123 ± 3% interrupts.CPU173.RES:Rescheduling_interrupts 498.67 ± 19% +133.2% 1163 ± 26% interrupts.CPU173.TLB:TLB_shootdowns 3833 ± 8% +26.8% 4859 ± 3% interrupts.CPU174.CAL:Function_call_interrupts 5208 ± 4% -24.7% 3920 ± 11% interrupts.CPU174.NMI:Non-maskable_interrupts 5208 ± 4% -24.7% 3920 ± 11% interrupts.CPU174.PMI:Performance_monitoring_interrupts 570.67 ± 2% +91.1% 1090 ± 7% interrupts.CPU174.RES:Rescheduling_interrupts 470.00 ± 19% +108.3% 979.00 ± 12% interrupts.CPU174.TLB:TLB_shootdowns 4117 ± 7% +17.7% 4845 ± 3% interrupts.CPU175.CAL:Function_call_interrupts 5202 ± 4% -25.1% 3896 ± 8% interrupts.CPU175.NMI:Non-maskable_interrupts 5202 ± 4% -25.1% 3896 ± 8% interrupts.CPU175.PMI:Performance_monitoring_interrupts 638.33 ± 3% +70.8% 1090 ± 5% interrupts.CPU175.RES:Rescheduling_interrupts 463.00 ± 17% +104.4% 946.50 ± 8% interrupts.CPU175.TLB:TLB_shootdowns 4021 ± 4% +16.9% 4699 ± 2% interrupts.CPU176.CAL:Function_call_interrupts 608.67 ± 6% +79.4% 1091 ± 6% interrupts.CPU176.RES:Rescheduling_interrupts 477.33 ± 10% +97.2% 941.50 ± 7% interrupts.CPU176.TLB:TLB_shootdowns 4071 ± 7% +15.5% 4702 interrupts.CPU177.CAL:Function_call_interrupts 596.33 ± 4% +82.2% 1086 interrupts.CPU177.RES:Rescheduling_interrupts 435.00 ± 5% +114.7% 934.00 ± 14% interrupts.CPU177.TLB:TLB_shootdowns 4130 ± 7% +16.6% 4815 ± 4% interrupts.CPU178.CAL:Function_call_interrupts 633.33 ± 4% +64.1% 1039 ± 4% interrupts.CPU178.RES:Rescheduling_interrupts 478.67 ± 15% +95.2% 934.50 ± 19% interrupts.CPU178.TLB:TLB_shootdowns 3821 ± 4% +26.8% 4846 ± 3% interrupts.CPU179.CAL:Function_call_interrupts 594.67 +76.6% 1050 ± 4% interrupts.CPU179.RES:Rescheduling_interrupts 479.00 ± 7% +96.5% 941.00 ± 6% interrupts.CPU179.TLB:TLB_shootdowns 4196 ± 4% +16.5% 4890 ± 5% interrupts.CPU18.CAL:Function_call_interrupts 728.33 +51.1% 1100 ± 3% interrupts.CPU18.RES:Rescheduling_interrupts 506.00 ± 11% +71.7% 868.75 ± 6% interrupts.CPU18.TLB:TLB_shootdowns 3950 ± 6% +23.3% 4870 ± 2% interrupts.CPU180.CAL:Function_call_interrupts 606.33 ± 8% +72.5% 1045 ± 2% interrupts.CPU180.RES:Rescheduling_interrupts 498.00 ± 5% +72.3% 858.00 ± 17% interrupts.CPU180.TLB:TLB_shootdowns 4113 ± 11% +18.3% 4864 ± 5% interrupts.CPU181.CAL:Function_call_interrupts 620.33 ± 4% +73.7% 1077 ± 5% interrupts.CPU181.RES:Rescheduling_interrupts 483.33 ± 5% +90.3% 919.75 ± 11% interrupts.CPU181.TLB:TLB_shootdowns 4070 ± 8% +17.0% 4761 ± 2% interrupts.CPU182.CAL:Function_call_interrupts 588.00 ± 7% +82.8% 1075 ± 3% interrupts.CPU182.RES:Rescheduling_interrupts 480.00 ± 17% +124.7% 1078 ± 10% interrupts.CPU182.TLB:TLB_shootdowns 4198 ± 7% +15.9% 4868 ± 2% interrupts.CPU183.CAL:Function_call_interrupts 681.33 ± 6% +59.5% 1087 ± 6% interrupts.CPU183.RES:Rescheduling_interrupts 509.33 ± 16% +78.5% 909.00 ± 15% interrupts.CPU183.TLB:TLB_shootdowns 3955 ± 2% +25.7% 4970 ± 3% interrupts.CPU184.CAL:Function_call_interrupts 565.00 ± 6% +93.8% 1095 ± 6% interrupts.CPU184.RES:Rescheduling_interrupts 443.67 ± 14% +107.0% 918.25 ± 9% interrupts.CPU184.TLB:TLB_shootdowns 4105 ± 6% +16.5% 4781 ± 5% interrupts.CPU185.CAL:Function_call_interrupts 546.67 ± 5% +105.8% 1125 ± 7% interrupts.CPU185.RES:Rescheduling_interrupts 505.00 ± 18% +86.8% 943.50 ± 8% interrupts.CPU185.TLB:TLB_shootdowns 4067 ± 6% +19.9% 4878 ± 3% interrupts.CPU186.CAL:Function_call_interrupts 604.67 ± 6% +71.2% 1035 ± 7% interrupts.CPU186.RES:Rescheduling_interrupts 486.67 ± 12% +89.7% 923.25 ± 8% interrupts.CPU186.TLB:TLB_shootdowns 588.00 ± 6% +77.9% 1046 ± 5% interrupts.CPU187.RES:Rescheduling_interrupts 499.67 ± 15% +86.2% 930.50 ± 15% interrupts.CPU187.TLB:TLB_shootdowns 4186 ± 5% +17.1% 4901 ± 5% interrupts.CPU188.CAL:Function_call_interrupts 616.33 ± 2% +77.1% 1091 ± 4% interrupts.CPU188.RES:Rescheduling_interrupts 461.33 ± 9% +102.1% 932.25 ± 15% interrupts.CPU188.TLB:TLB_shootdowns 3980 ± 6% +21.8% 4849 ± 2% interrupts.CPU189.CAL:Function_call_interrupts 594.33 +87.8% 1116 ± 3% interrupts.CPU189.RES:Rescheduling_interrupts 431.33 ± 10% +126.0% 974.75 ± 5% interrupts.CPU189.TLB:TLB_shootdowns 3937 ± 5% +21.2% 4772 ± 5% interrupts.CPU19.CAL:Function_call_interrupts 5173 ± 3% -31.9% 3525 ± 25% interrupts.CPU19.NMI:Non-maskable_interrupts 5173 ± 3% -31.9% 3525 ± 25% interrupts.CPU19.PMI:Performance_monitoring_interrupts 722.67 ± 9% +48.1% 1070 ± 2% interrupts.CPU19.RES:Rescheduling_interrupts 479.67 ± 18% +95.3% 937.00 ± 9% interrupts.CPU19.TLB:TLB_shootdowns 3905 ± 5% +25.2% 4890 ± 5% interrupts.CPU190.CAL:Function_call_interrupts 5230 ± 2% -24.7% 3937 ± 10% interrupts.CPU190.NMI:Non-maskable_interrupts 5230 ± 2% -24.7% 3937 ± 10% interrupts.CPU190.PMI:Performance_monitoring_interrupts 580.33 ± 3% +84.6% 1071 ± 2% interrupts.CPU190.RES:Rescheduling_interrupts 454.33 ± 12% +111.7% 961.75 ± 14% interrupts.CPU190.TLB:TLB_shootdowns 3985 ± 4% +23.4% 4918 ± 4% interrupts.CPU191.CAL:Function_call_interrupts 5184 ± 4% -34.0% 3422 ± 24% interrupts.CPU191.NMI:Non-maskable_interrupts 5184 ± 4% -34.0% 3422 ± 24% interrupts.CPU191.PMI:Performance_monitoring_interrupts 589.67 ± 2% +91.5% 1129 ± 7% interrupts.CPU191.RES:Rescheduling_interrupts 498.67 ± 25% +102.2% 1008 ± 14% interrupts.CPU191.TLB:TLB_shootdowns 3847 ± 6% +29.1% 4965 ± 8% interrupts.CPU2.CAL:Function_call_interrupts 5162 ± 3% -23.5% 3948 ± 5% interrupts.CPU2.NMI:Non-maskable_interrupts 5162 ± 3% -23.5% 3948 ± 5% interrupts.CPU2.PMI:Performance_monitoring_interrupts 691.33 ± 3% +59.0% 1099 ± 7% interrupts.CPU2.RES:Rescheduling_interrupts 486.67 ± 6% +83.7% 894.25 ± 13% interrupts.CPU2.TLB:TLB_shootdowns 4000 ± 3% +19.6% 4786 ± 5% interrupts.CPU20.CAL:Function_call_interrupts 5181 ± 2% -42.1% 2999 ± 32% interrupts.CPU20.NMI:Non-maskable_interrupts 5181 ± 2% -42.1% 2999 ± 32% interrupts.CPU20.PMI:Performance_monitoring_interrupts 774.00 ± 11% +45.8% 1128 ± 5% interrupts.CPU20.RES:Rescheduling_interrupts 458.33 ± 11% +111.7% 970.25 ± 12% interrupts.CPU20.TLB:TLB_shootdowns 4143 ± 4% +13.1% 4684 ± 3% interrupts.CPU21.CAL:Function_call_interrupts 814.67 ± 19% +35.1% 1100 ± 6% interrupts.CPU21.RES:Rescheduling_interrupts 453.67 ± 12% +97.1% 894.25 ± 13% interrupts.CPU21.TLB:TLB_shootdowns 3936 +26.2% 4968 ± 4% interrupts.CPU22.CAL:Function_call_interrupts 5194 ± 2% -22.7% 4017 ± 5% interrupts.CPU22.NMI:Non-maskable_interrupts 5194 ± 2% -22.7% 4017 ± 5% interrupts.CPU22.PMI:Performance_monitoring_interrupts 754.67 ± 11% +45.8% 1100 ± 7% interrupts.CPU22.RES:Rescheduling_interrupts 467.67 ± 14% +100.0% 935.25 ± 17% interrupts.CPU22.TLB:TLB_shootdowns 4046 ± 4% +17.6% 4758 ± 2% interrupts.CPU23.CAL:Function_call_interrupts 716.67 ± 2% +45.6% 1043 ± 5% interrupts.CPU23.RES:Rescheduling_interrupts 416.33 ± 7% +108.4% 867.50 ± 12% interrupts.CPU23.TLB:TLB_shootdowns 4323 ± 6% +17.2% 5066 ± 5% interrupts.CPU24.CAL:Function_call_interrupts 5170 ± 3% -22.1% 4027 ± 6% interrupts.CPU24.NMI:Non-maskable_interrupts 5170 ± 3% -22.1% 4027 ± 6% interrupts.CPU24.PMI:Performance_monitoring_interrupts 876.33 ± 4% +33.1% 1166 ± 6% interrupts.CPU24.RES:Rescheduling_interrupts 678.33 ± 16% +50.4% 1020 ± 9% interrupts.CPU24.TLB:TLB_shootdowns 4259 ± 7% +18.1% 5027 ± 2% interrupts.CPU25.CAL:Function_call_interrupts 5240 ± 3% -23.8% 3993 ± 8% interrupts.CPU25.NMI:Non-maskable_interrupts 5240 ± 3% -23.8% 3993 ± 8% interrupts.CPU25.PMI:Performance_monitoring_interrupts 791.67 ± 3% +44.3% 1142 ± 7% interrupts.CPU25.RES:Rescheduling_interrupts 594.00 ± 22% +62.4% 964.75 ± 15% interrupts.CPU25.TLB:TLB_shootdowns 4234 ± 13% +20.7% 5111 ± 3% interrupts.CPU26.CAL:Function_call_interrupts 821.33 ± 3% +41.4% 1161 ± 6% interrupts.CPU26.RES:Rescheduling_interrupts 528.00 ± 5% +96.6% 1038 ± 18% interrupts.CPU26.TLB:TLB_shootdowns 4202 ± 4% +21.4% 5101 ± 4% interrupts.CPU27.CAL:Function_call_interrupts 5218 ± 2% -22.5% 4045 ± 8% interrupts.CPU27.NMI:Non-maskable_interrupts 5218 ± 2% -22.5% 4045 ± 8% interrupts.CPU27.PMI:Performance_monitoring_interrupts 720.00 ± 5% +58.6% 1142 ± 5% interrupts.CPU27.RES:Rescheduling_interrupts 502.67 ± 16% +89.7% 953.50 ± 12% interrupts.CPU27.TLB:TLB_shootdowns 4162 ± 14% +18.2% 4921 ± 5% interrupts.CPU28.CAL:Function_call_interrupts 5157 ± 2% -23.4% 3951 ± 7% interrupts.CPU28.NMI:Non-maskable_interrupts 5157 ± 2% -23.4% 3951 ± 7% interrupts.CPU28.PMI:Performance_monitoring_interrupts 755.33 ± 3% +47.4% 1113 ± 5% interrupts.CPU28.RES:Rescheduling_interrupts 497.00 ± 10% +91.9% 953.50 ± 3% interrupts.CPU28.TLB:TLB_shootdowns 4088 ± 5% +24.1% 5072 ± 6% interrupts.CPU29.CAL:Function_call_interrupts 5188 ± 3% -22.5% 4021 ± 6% interrupts.CPU29.NMI:Non-maskable_interrupts 5188 ± 3% -22.5% 4021 ± 6% interrupts.CPU29.PMI:Performance_monitoring_interrupts 719.33 ± 6% +57.0% 1129 ± 6% interrupts.CPU29.RES:Rescheduling_interrupts 464.33 ± 2% +131.1% 1073 ± 26% interrupts.CPU29.TLB:TLB_shootdowns 3770 +25.7% 4739 ± 5% interrupts.CPU3.CAL:Function_call_interrupts 746.33 ± 6% +50.2% 1120 ± 11% interrupts.CPU3.RES:Rescheduling_interrupts 511.67 ± 14% +74.5% 892.75 ± 6% interrupts.CPU3.TLB:TLB_shootdowns 4203 ± 7% +18.9% 4998 ± 3% interrupts.CPU30.CAL:Function_call_interrupts 5183 ± 3% -41.1% 3055 ± 37% interrupts.CPU30.NMI:Non-maskable_interrupts 5183 ± 3% -41.1% 3055 ± 37% interrupts.CPU30.PMI:Performance_monitoring_interrupts 749.33 ± 5% +52.9% 1146 ± 6% interrupts.CPU30.RES:Rescheduling_interrupts 469.33 ± 17% +108.5% 978.75 ± 8% interrupts.CPU30.TLB:TLB_shootdowns 4133 ± 5% +20.3% 4971 ± 2% interrupts.CPU31.CAL:Function_call_interrupts 5174 ± 3% -31.7% 3536 ± 26% interrupts.CPU31.NMI:Non-maskable_interrupts 5174 ± 3% -31.7% 3536 ± 26% interrupts.CPU31.PMI:Performance_monitoring_interrupts 777.33 ± 5% +53.8% 1195 ± 5% interrupts.CPU31.RES:Rescheduling_interrupts 496.00 ± 9% +96.7% 975.75 ± 16% interrupts.CPU31.TLB:TLB_shootdowns 4107 ± 7% +18.1% 4849 ± 2% interrupts.CPU32.CAL:Function_call_interrupts 5163 ± 3% -21.8% 4038 ± 7% interrupts.CPU32.NMI:Non-maskable_interrupts 5163 ± 3% -21.8% 4038 ± 7% interrupts.CPU32.PMI:Performance_monitoring_interrupts 711.67 +52.9% 1088 ± 5% interrupts.CPU32.RES:Rescheduling_interrupts 489.33 ± 18% +115.7% 1055 ± 11% interrupts.CPU32.TLB:TLB_shootdowns 4170 ± 4% +17.4% 4897 ± 2% interrupts.CPU33.CAL:Function_call_interrupts 5215 ± 3% -33.3% 3480 ± 25% interrupts.CPU33.NMI:Non-maskable_interrupts 5215 ± 3% -33.3% 3480 ± 25% interrupts.CPU33.PMI:Performance_monitoring_interrupts 785.33 ± 7% +46.2% 1148 ± 4% interrupts.CPU33.RES:Rescheduling_interrupts 547.67 ± 13% +71.6% 939.75 ± 11% interrupts.CPU33.TLB:TLB_shootdowns 4302 ± 6% +16.0% 4992 ± 4% interrupts.CPU34.CAL:Function_call_interrupts 5214 ± 3% -22.7% 4031 ± 6% interrupts.CPU34.NMI:Non-maskable_interrupts 5214 ± 3% -22.7% 4031 ± 6% interrupts.CPU34.PMI:Performance_monitoring_interrupts 787.33 ± 4% +41.4% 1113 ± 4% interrupts.CPU34.RES:Rescheduling_interrupts 590.33 ± 2% +60.2% 945.50 ± 11% interrupts.CPU34.TLB:TLB_shootdowns 4044 ± 11% +22.9% 4969 ± 4% interrupts.CPU35.CAL:Function_call_interrupts 5220 ± 3% -32.6% 3520 ± 25% interrupts.CPU35.NMI:Non-maskable_interrupts 5220 ± 3% -32.6% 3520 ± 25% interrupts.CPU35.PMI:Performance_monitoring_interrupts 735.67 ± 4% +56.9% 1154 ± 9% interrupts.CPU35.RES:Rescheduling_interrupts 485.00 ± 12% +101.3% 976.50 ± 11% interrupts.CPU35.TLB:TLB_shootdowns 4291 ± 8% +14.9% 4930 ± 5% interrupts.CPU36.CAL:Function_call_interrupts 782.67 ± 4% +51.0% 1182 ± 4% interrupts.CPU36.RES:Rescheduling_interrupts 491.00 ± 16% +84.3% 904.75 ± 16% interrupts.CPU36.TLB:TLB_shootdowns 3949 ± 5% +24.1% 4898 ± 4% interrupts.CPU37.CAL:Function_call_interrupts 723.67 ± 3% +54.0% 1114 ± 7% interrupts.CPU37.RES:Rescheduling_interrupts 490.00 ± 9% +111.4% 1036 ± 8% interrupts.CPU37.TLB:TLB_shootdowns 5218 ± 2% -23.3% 4000 ± 7% interrupts.CPU38.NMI:Non-maskable_interrupts 5218 ± 2% -23.3% 4000 ± 7% interrupts.CPU38.PMI:Performance_monitoring_interrupts 797.67 ± 10% +40.3% 1119 ± 6% interrupts.CPU38.RES:Rescheduling_interrupts 500.33 ± 16% +89.6% 948.50 ± 12% interrupts.CPU38.TLB:TLB_shootdowns 3987 ± 5% +26.0% 5023 ± 5% interrupts.CPU39.CAL:Function_call_interrupts 772.00 +47.0% 1134 ± 6% interrupts.CPU39.RES:Rescheduling_interrupts 483.00 ± 10% +102.2% 976.75 ± 17% interrupts.CPU39.TLB:TLB_shootdowns 3933 ± 6% +38.0% 5428 ± 14% interrupts.CPU4.CAL:Function_call_interrupts 5183 ± 4% -43.3% 2939 ± 31% interrupts.CPU4.NMI:Non-maskable_interrupts 5183 ± 4% -43.3% 2939 ± 31% interrupts.CPU4.PMI:Performance_monitoring_interrupts 799.33 ± 5% +35.5% 1083 ± 4% interrupts.CPU4.RES:Rescheduling_interrupts 489.67 ± 14% +100.9% 983.50 ± 11% interrupts.CPU4.TLB:TLB_shootdowns 4034 ± 6% +23.7% 4991 interrupts.CPU40.CAL:Function_call_interrupts 5212 ± 2% -24.0% 3963 ± 7% interrupts.CPU40.NMI:Non-maskable_interrupts 5212 ± 2% -24.0% 3963 ± 7% interrupts.CPU40.PMI:Performance_monitoring_interrupts 745.67 ± 5% +53.6% 1145 ± 6% interrupts.CPU40.RES:Rescheduling_interrupts 407.67 ± 11% +140.6% 981.00 ± 13% interrupts.CPU40.TLB:TLB_shootdowns 4029 ± 3% +25.1% 5040 ± 4% interrupts.CPU41.CAL:Function_call_interrupts 5237 ± 2% -24.0% 3980 ± 7% interrupts.CPU41.NMI:Non-maskable_interrupts 5237 ± 2% -24.0% 3980 ± 7% interrupts.CPU41.PMI:Performance_monitoring_interrupts 764.00 ± 11% +49.6% 1143 ± 10% interrupts.CPU41.RES:Rescheduling_interrupts 480.33 ± 15% +102.8% 974.00 ± 14% interrupts.CPU41.TLB:TLB_shootdowns 4158 ± 9% +19.1% 4950 ± 5% interrupts.CPU42.CAL:Function_call_interrupts 5205 ± 2% -23.9% 3963 ± 7% interrupts.CPU42.NMI:Non-maskable_interrupts 5205 ± 2% -23.9% 3963 ± 7% interrupts.CPU42.PMI:Performance_monitoring_interrupts 777.00 +48.0% 1150 ± 7% interrupts.CPU42.RES:Rescheduling_interrupts 494.67 ± 7% +85.4% 917.25 ± 6% interrupts.CPU42.TLB:TLB_shootdowns 4145 ± 5% +20.0% 4974 ± 2% interrupts.CPU43.CAL:Function_call_interrupts 5199 ± 3% -23.6% 3971 ± 6% interrupts.CPU43.NMI:Non-maskable_interrupts 5199 ± 3% -23.6% 3971 ± 6% interrupts.CPU43.PMI:Performance_monitoring_interrupts 734.00 ± 4% +54.8% 1136 ± 3% interrupts.CPU43.RES:Rescheduling_interrupts 479.33 ± 21% +116.7% 1038 ± 12% interrupts.CPU43.TLB:TLB_shootdowns 4038 ± 6% +20.5% 4867 ± 2% interrupts.CPU44.CAL:Function_call_interrupts 5236 ± 3% -34.3% 3438 ± 24% interrupts.CPU44.NMI:Non-maskable_interrupts 5236 ± 3% -34.3% 3438 ± 24% interrupts.CPU44.PMI:Performance_monitoring_interrupts 721.67 +57.3% 1135 ± 6% interrupts.CPU44.RES:Rescheduling_interrupts 486.67 ± 12% +94.9% 948.50 ± 11% interrupts.CPU44.TLB:TLB_shootdowns 4089 ± 7% +19.7% 4895 ± 4% interrupts.CPU45.CAL:Function_call_interrupts 744.67 ± 4% +45.4% 1083 ± 2% interrupts.CPU45.RES:Rescheduling_interrupts 450.33 ± 17% +114.5% 966.00 ± 19% interrupts.CPU45.TLB:TLB_shootdowns 3816 ± 5% +30.8% 4991 ± 5% interrupts.CPU46.CAL:Function_call_interrupts 5219 ± 3% -32.9% 3502 ± 23% interrupts.CPU46.NMI:Non-maskable_interrupts 5219 ± 3% -32.9% 3502 ± 23% interrupts.CPU46.PMI:Performance_monitoring_interrupts 740.33 ± 8% +61.8% 1197 ± 5% interrupts.CPU46.RES:Rescheduling_interrupts 455.00 ± 6% +107.6% 944.75 ± 15% interrupts.CPU46.TLB:TLB_shootdowns 3989 ± 2% +24.0% 4947 ± 2% interrupts.CPU47.CAL:Function_call_interrupts 5204 ± 3% -32.6% 3506 ± 24% interrupts.CPU47.NMI:Non-maskable_interrupts 5204 ± 3% -32.6% 3506 ± 24% interrupts.CPU47.PMI:Performance_monitoring_interrupts 741.67 ± 4% +53.1% 1135 ± 12% interrupts.CPU47.RES:Rescheduling_interrupts 437.33 ± 17% +120.8% 965.75 ± 16% interrupts.CPU47.TLB:TLB_shootdowns 4165 ± 2% +22.3% 5095 ± 3% interrupts.CPU48.CAL:Function_call_interrupts 5176 ± 4% -21.7% 4053 ± 8% interrupts.CPU48.NMI:Non-maskable_interrupts 5176 ± 4% -21.7% 4053 ± 8% interrupts.CPU48.PMI:Performance_monitoring_interrupts 835.00 ± 2% +29.0% 1077 ± 2% interrupts.CPU48.RES:Rescheduling_interrupts 594.67 ± 17% +62.2% 964.50 ± 5% interrupts.CPU48.TLB:TLB_shootdowns 4171 ± 9% +18.7% 4950 ± 6% interrupts.CPU49.CAL:Function_call_interrupts 5186 ± 4% -33.4% 3452 ± 24% interrupts.CPU49.NMI:Non-maskable_interrupts 5186 ± 4% -33.4% 3452 ± 24% interrupts.CPU49.PMI:Performance_monitoring_interrupts 710.67 ± 4% +55.6% 1105 ± 4% interrupts.CPU49.RES:Rescheduling_interrupts 553.67 ± 5% +74.0% 963.25 ± 10% interrupts.CPU49.TLB:TLB_shootdowns 4064 ± 6% +21.6% 4944 ± 5% interrupts.CPU5.CAL:Function_call_interrupts 772.33 ± 2% +45.7% 1125 ± 4% interrupts.CPU5.RES:Rescheduling_interrupts 491.00 ± 14% +95.2% 958.50 ± 10% interrupts.CPU5.TLB:TLB_shootdowns 3929 ± 4% +26.4% 4966 ± 2% interrupts.CPU50.CAL:Function_call_interrupts 5201 ± 4% -22.9% 4011 ± 7% interrupts.CPU50.NMI:Non-maskable_interrupts 5201 ± 4% -22.9% 4011 ± 7% interrupts.CPU50.PMI:Performance_monitoring_interrupts 747.00 ± 4% +40.6% 1050 ± 3% interrupts.CPU50.RES:Rescheduling_interrupts 482.33 ± 17% +103.1% 979.75 ± 12% interrupts.CPU50.TLB:TLB_shootdowns 4192 ± 4% +20.3% 5043 ± 4% interrupts.CPU51.CAL:Function_call_interrupts 5249 ± 3% -24.0% 3987 ± 7% interrupts.CPU51.NMI:Non-maskable_interrupts 5249 ± 3% -24.0% 3987 ± 7% interrupts.CPU51.PMI:Performance_monitoring_interrupts 780.33 ± 7% +54.9% 1209 ± 9% interrupts.CPU51.RES:Rescheduling_interrupts 504.00 ± 11% +95.9% 987.50 ± 9% interrupts.CPU51.TLB:TLB_shootdowns 4084 ± 4% +21.8% 4972 ± 4% interrupts.CPU52.CAL:Function_call_interrupts 5208 ± 4% -23.1% 4006 ± 11% interrupts.CPU52.NMI:Non-maskable_interrupts 5208 ± 4% -23.1% 4006 ± 11% interrupts.CPU52.PMI:Performance_monitoring_interrupts 724.33 ± 3% +48.6% 1076 ± 4% interrupts.CPU52.RES:Rescheduling_interrupts 536.00 ± 13% +91.7% 1027 ± 7% interrupts.CPU52.TLB:TLB_shootdowns 5184 ± 3% -24.1% 3933 ± 10% interrupts.CPU53.NMI:Non-maskable_interrupts 5184 ± 3% -24.1% 3933 ± 10% interrupts.CPU53.PMI:Performance_monitoring_interrupts 722.67 ± 4% +49.1% 1077 ± 5% interrupts.CPU53.RES:Rescheduling_interrupts 447.33 ± 20% +118.6% 978.00 ± 11% interrupts.CPU53.TLB:TLB_shootdowns 4057 ± 3% +25.0% 5073 ± 5% interrupts.CPU54.CAL:Function_call_interrupts 5172 ± 4% -32.6% 3487 ± 24% interrupts.CPU54.NMI:Non-maskable_interrupts 5172 ± 4% -32.6% 3487 ± 24% interrupts.CPU54.PMI:Performance_monitoring_interrupts 722.67 +50.7% 1088 ± 7% interrupts.CPU54.RES:Rescheduling_interrupts 491.33 ± 14% +382.4% 2370 ±102% interrupts.CPU54.TLB:TLB_shootdowns 4092 ± 5% +17.9% 4825 interrupts.CPU55.CAL:Function_call_interrupts 755.67 ± 10% +49.2% 1127 ± 4% interrupts.CPU55.RES:Rescheduling_interrupts 445.67 +117.2% 968.00 ± 11% interrupts.CPU55.TLB:TLB_shootdowns 4116 ± 4% +20.0% 4940 ± 5% interrupts.CPU56.CAL:Function_call_interrupts 5144 ± 5% -33.4% 3427 ± 23% interrupts.CPU56.NMI:Non-maskable_interrupts 5144 ± 5% -33.4% 3427 ± 23% interrupts.CPU56.PMI:Performance_monitoring_interrupts 707.67 +55.5% 1100 interrupts.CPU56.RES:Rescheduling_interrupts 448.00 ± 16% +120.1% 986.00 ± 13% interrupts.CPU56.TLB:TLB_shootdowns 3861 +26.2% 4871 ± 3% interrupts.CPU57.CAL:Function_call_interrupts 5187 ± 3% -33.0% 3474 ± 25% interrupts.CPU57.NMI:Non-maskable_interrupts 5187 ± 3% -33.0% 3474 ± 25% interrupts.CPU57.PMI:Performance_monitoring_interrupts 703.00 ± 3% +55.6% 1094 ± 4% interrupts.CPU57.RES:Rescheduling_interrupts 495.67 ± 19% +106.5% 1023 ± 8% interrupts.CPU57.TLB:TLB_shootdowns 4003 ± 6% +25.3% 5016 ± 4% interrupts.CPU58.CAL:Function_call_interrupts 5267 -32.7% 3543 ± 30% interrupts.CPU58.NMI:Non-maskable_interrupts 5267 -32.7% 3543 ± 30% interrupts.CPU58.PMI:Performance_monitoring_interrupts 692.00 +61.0% 1114 interrupts.CPU58.RES:Rescheduling_interrupts 467.67 ± 16% +109.8% 981.25 ± 9% interrupts.CPU58.TLB:TLB_shootdowns 4147 ± 7% +21.2% 5024 ± 4% interrupts.CPU59.CAL:Function_call_interrupts 5175 ± 3% -33.9% 3419 ± 24% interrupts.CPU59.NMI:Non-maskable_interrupts 5175 ± 3% -33.9% 3419 ± 24% interrupts.CPU59.PMI:Performance_monitoring_interrupts 765.00 ± 2% +40.8% 1077 ± 5% interrupts.CPU59.RES:Rescheduling_interrupts 477.67 ± 23% +97.7% 944.25 ± 9% interrupts.CPU59.TLB:TLB_shootdowns 4121 ± 7% +19.7% 4932 ± 4% interrupts.CPU6.CAL:Function_call_interrupts 5158 ± 4% -31.8% 3518 ± 25% interrupts.CPU6.NMI:Non-maskable_interrupts 5158 ± 4% -31.8% 3518 ± 25% interrupts.CPU6.PMI:Performance_monitoring_interrupts 735.33 ± 10% +48.5% 1091 ± 5% interrupts.CPU6.RES:Rescheduling_interrupts 535.33 ± 13% +72.5% 923.25 ± 14% interrupts.CPU6.TLB:TLB_shootdowns 4122 ± 4% +32.7% 5471 ± 18% interrupts.CPU60.CAL:Function_call_interrupts 746.67 ± 4% +48.7% 1110 ± 4% interrupts.CPU60.RES:Rescheduling_interrupts 496.00 ± 23% +92.2% 953.25 ± 13% interrupts.CPU60.TLB:TLB_shootdowns 4022 ± 4% +33.7% 5376 ± 14% interrupts.CPU61.CAL:Function_call_interrupts 5190 ± 4% -34.9% 3378 ± 24% interrupts.CPU61.NMI:Non-maskable_interrupts 5190 ± 4% -34.9% 3378 ± 24% interrupts.CPU61.PMI:Performance_monitoring_interrupts 734.33 ± 4% +48.2% 1088 ± 2% interrupts.CPU61.RES:Rescheduling_interrupts 484.67 ± 15% +109.0% 1013 ± 9% interrupts.CPU61.TLB:TLB_shootdowns 3917 ± 5% +26.4% 4953 ± 3% interrupts.CPU62.CAL:Function_call_interrupts 5189 ± 4% -32.8% 3489 ± 25% interrupts.CPU62.NMI:Non-maskable_interrupts 5189 ± 4% -32.8% 3489 ± 25% interrupts.CPU62.PMI:Performance_monitoring_interrupts 778.00 ± 3% +42.6% 1109 ± 2% interrupts.CPU62.RES:Rescheduling_interrupts 486.33 ± 23% +110.0% 1021 ± 17% interrupts.CPU62.TLB:TLB_shootdowns 4163 ± 8% +20.8% 5029 interrupts.CPU63.CAL:Function_call_interrupts 5231 ± 2% -34.6% 3419 ± 24% interrupts.CPU63.NMI:Non-maskable_interrupts 5231 ± 2% -34.6% 3419 ± 24% interrupts.CPU63.PMI:Performance_monitoring_interrupts 775.67 ± 6% +39.5% 1082 interrupts.CPU63.RES:Rescheduling_interrupts 491.00 ± 22% +95.8% 961.25 ± 16% interrupts.CPU63.TLB:TLB_shootdowns 4016 ± 2% +24.2% 4990 ± 3% interrupts.CPU64.CAL:Function_call_interrupts 5129 ± 5% -42.0% 2973 ± 36% interrupts.CPU64.NMI:Non-maskable_interrupts 5129 ± 5% -42.0% 2973 ± 36% interrupts.CPU64.PMI:Performance_monitoring_interrupts 757.67 ± 4% +47.7% 1119 ± 3% interrupts.CPU64.RES:Rescheduling_interrupts 453.67 ± 11% +119.8% 997.00 ± 11% interrupts.CPU64.TLB:TLB_shootdowns 3854 ± 2% +26.3% 4868 ± 7% interrupts.CPU65.CAL:Function_call_interrupts 767.33 ± 7% +37.7% 1056 ± 3% interrupts.CPU65.RES:Rescheduling_interrupts 519.67 ± 14% +85.3% 962.75 ± 13% interrupts.CPU65.TLB:TLB_shootdowns 3915 ± 8% +24.8% 4888 ± 3% interrupts.CPU66.CAL:Function_call_interrupts 5199 ± 3% -34.4% 3409 ± 25% interrupts.CPU66.NMI:Non-maskable_interrupts 5199 ± 3% -34.4% 3409 ± 25% interrupts.CPU66.PMI:Performance_monitoring_interrupts 712.67 ± 3% +56.9% 1118 ± 6% interrupts.CPU66.RES:Rescheduling_interrupts 431.67 ± 30% +138.8% 1030 ± 14% interrupts.CPU66.TLB:TLB_shootdowns 4026 ± 9% +21.0% 4870 ± 3% interrupts.CPU67.CAL:Function_call_interrupts 5157 ± 5% -23.4% 3950 ± 9% interrupts.CPU67.NMI:Non-maskable_interrupts 5157 ± 5% -23.4% 3950 ± 9% interrupts.CPU67.PMI:Performance_monitoring_interrupts 671.00 +56.9% 1053 ± 2% interrupts.CPU67.RES:Rescheduling_interrupts 489.67 ± 16% +99.6% 977.50 ± 12% interrupts.CPU67.TLB:TLB_shootdowns 4034 ± 4% +22.0% 4921 ± 2% interrupts.CPU68.CAL:Function_call_interrupts 5175 ± 4% -31.2% 3561 ± 30% interrupts.CPU68.NMI:Non-maskable_interrupts 5175 ± 4% -31.2% 3561 ± 30% interrupts.CPU68.PMI:Performance_monitoring_interrupts 709.00 ± 4% +56.2% 1107 ± 3% interrupts.CPU68.RES:Rescheduling_interrupts 493.00 ± 15% +95.8% 965.25 ± 12% interrupts.CPU68.TLB:TLB_shootdowns 4014 ± 10% +24.6% 5001 ± 2% interrupts.CPU69.CAL:Function_call_interrupts 5152 ± 4% -32.5% 3476 ± 25% interrupts.CPU69.NMI:Non-maskable_interrupts 5152 ± 4% -32.5% 3476 ± 25% interrupts.CPU69.PMI:Performance_monitoring_interrupts 717.33 ± 3% +50.3% 1078 ± 7% interrupts.CPU69.RES:Rescheduling_interrupts 434.67 ± 26% +123.0% 969.25 ± 8% interrupts.CPU69.TLB:TLB_shootdowns 3972 ± 8% +23.1% 4892 interrupts.CPU7.CAL:Function_call_interrupts 776.67 ± 5% +40.6% 1091 ± 4% interrupts.CPU7.RES:Rescheduling_interrupts 467.33 ± 11% +102.8% 947.75 ± 16% interrupts.CPU7.TLB:TLB_shootdowns 4068 ± 11% +26.2% 5134 interrupts.CPU70.CAL:Function_call_interrupts 5188 ± 4% -42.6% 2975 ± 37% interrupts.CPU70.NMI:Non-maskable_interrupts 5188 ± 4% -42.6% 2975 ± 37% interrupts.CPU70.PMI:Performance_monitoring_interrupts 718.00 ± 4% +54.3% 1107 ± 2% interrupts.CPU70.RES:Rescheduling_interrupts 494.00 ± 11% +104.5% 1010 ± 6% interrupts.CPU70.TLB:TLB_shootdowns 3920 ± 4% +29.5% 5078 ± 4% interrupts.CPU71.CAL:Function_call_interrupts 5112 ± 4% -23.3% 3920 ± 11% interrupts.CPU71.NMI:Non-maskable_interrupts 5112 ± 4% -23.3% 3920 ± 11% interrupts.CPU71.PMI:Performance_monitoring_interrupts 667.67 +64.9% 1101 ± 5% interrupts.CPU71.RES:Rescheduling_interrupts 473.00 ± 13% +103.8% 963.75 ± 13% interrupts.CPU71.TLB:TLB_shootdowns 3913 ± 3% +26.8% 4963 ± 2% interrupts.CPU72.CAL:Function_call_interrupts 5206 ± 3% -24.5% 3932 ± 10% interrupts.CPU72.NMI:Non-maskable_interrupts 5206 ± 3% -24.5% 3932 ± 10% interrupts.CPU72.PMI:Performance_monitoring_interrupts 811.67 ± 3% +33.3% 1081 ± 4% interrupts.CPU72.RES:Rescheduling_interrupts 3939 ± 3% +26.0% 4962 ± 6% interrupts.CPU73.CAL:Function_call_interrupts 5184 ± 2% -34.3% 3408 ± 25% interrupts.CPU73.NMI:Non-maskable_interrupts 5184 ± 2% -34.3% 3408 ± 25% interrupts.CPU73.PMI:Performance_monitoring_interrupts 763.00 ± 4% +40.6% 1072 ± 4% interrupts.CPU73.RES:Rescheduling_interrupts 570.00 ± 5% +97.1% 1123 ± 25% interrupts.CPU73.TLB:TLB_shootdowns 4069 ± 6% +21.7% 4954 ± 3% interrupts.CPU74.CAL:Function_call_interrupts 5223 ± 3% -23.9% 3972 ± 10% interrupts.CPU74.NMI:Non-maskable_interrupts 5223 ± 3% -23.9% 3972 ± 10% interrupts.CPU74.PMI:Performance_monitoring_interrupts 715.33 +53.9% 1101 ± 5% interrupts.CPU74.RES:Rescheduling_interrupts 526.00 ± 14% +90.9% 1004 ± 11% interrupts.CPU74.TLB:TLB_shootdowns 4034 ± 10% +21.5% 4900 ± 4% interrupts.CPU75.CAL:Function_call_interrupts 5241 ± 2% -42.9% 2995 ± 37% interrupts.CPU75.NMI:Non-maskable_interrupts 5241 ± 2% -42.9% 2995 ± 37% interrupts.CPU75.PMI:Performance_monitoring_interrupts 712.00 ± 2% +49.6% 1065 ± 6% interrupts.CPU75.RES:Rescheduling_interrupts 4203 ± 8% +18.8% 4995 ± 5% interrupts.CPU76.CAL:Function_call_interrupts 5216 ± 2% -32.4% 3525 ± 31% interrupts.CPU76.NMI:Non-maskable_interrupts 5216 ± 2% -32.4% 3525 ± 31% interrupts.CPU76.PMI:Performance_monitoring_interrupts 719.00 ± 2% +44.5% 1039 ± 5% interrupts.CPU76.RES:Rescheduling_interrupts 488.00 ± 10% +87.1% 913.25 ± 9% interrupts.CPU76.TLB:TLB_shootdowns 3955 ± 7% +23.9% 4901 ± 3% interrupts.CPU77.CAL:Function_call_interrupts 5224 ± 3% -24.5% 3944 ± 11% interrupts.CPU77.NMI:Non-maskable_interrupts 5224 ± 3% -24.5% 3944 ± 11% interrupts.CPU77.PMI:Performance_monitoring_interrupts 703.67 ± 8% +50.9% 1062 ± 3% interrupts.CPU77.RES:Rescheduling_interrupts 466.67 ± 7% +125.8% 1053 ± 13% interrupts.CPU77.TLB:TLB_shootdowns 4189 ± 6% +15.8% 4852 ± 6% interrupts.CPU78.CAL:Function_call_interrupts 5190 ± 4% -33.4% 3455 ± 24% interrupts.CPU78.NMI:Non-maskable_interrupts 5190 ± 4% -33.4% 3455 ± 24% interrupts.CPU78.PMI:Performance_monitoring_interrupts 706.00 +49.5% 1055 ± 4% interrupts.CPU78.RES:Rescheduling_interrupts 442.67 ± 8% +135.9% 1044 ± 15% interrupts.CPU78.TLB:TLB_shootdowns 3902 ± 3% +24.7% 4865 ± 3% interrupts.CPU79.CAL:Function_call_interrupts 5225 ± 3% -35.1% 3390 ± 24% interrupts.CPU79.NMI:Non-maskable_interrupts 5225 ± 3% -35.1% 3390 ± 24% interrupts.CPU79.PMI:Performance_monitoring_interrupts 704.67 ± 4% +58.3% 1115 ± 7% interrupts.CPU79.RES:Rescheduling_interrupts 444.00 ± 13% +111.1% 937.25 ± 11% interrupts.CPU79.TLB:TLB_shootdowns 4089 ± 4% +19.8% 4898 interrupts.CPU8.CAL:Function_call_interrupts 5181 ± 4% -22.3% 4024 ± 5% interrupts.CPU8.NMI:Non-maskable_interrupts 5181 ± 4% -22.3% 4024 ± 5% interrupts.CPU8.PMI:Performance_monitoring_interrupts 785.33 ± 4% +41.3% 1110 ± 6% interrupts.CPU8.RES:Rescheduling_interrupts 480.00 ± 9% +94.0% 931.00 ± 17% interrupts.CPU8.TLB:TLB_shootdowns 4093 ± 6% +22.6% 5018 ± 4% interrupts.CPU80.CAL:Function_call_interrupts 721.33 ± 5% +44.9% 1045 ± 2% interrupts.CPU80.RES:Rescheduling_interrupts 485.33 ± 10% +101.9% 980.00 ± 6% interrupts.CPU80.TLB:TLB_shootdowns 4059 ± 9% +19.3% 4843 ± 4% interrupts.CPU81.CAL:Function_call_interrupts 5243 ± 3% -25.7% 3894 ± 10% interrupts.CPU81.NMI:Non-maskable_interrupts 5243 ± 3% -25.7% 3894 ± 10% interrupts.CPU81.PMI:Performance_monitoring_interrupts 689.67 ± 7% +53.0% 1055 ± 7% interrupts.CPU81.RES:Rescheduling_interrupts 553.67 ± 16% +87.9% 1040 ± 13% interrupts.CPU81.TLB:TLB_shootdowns 3950 ± 8% +23.1% 4863 ± 6% interrupts.CPU82.CAL:Function_call_interrupts 5207 ± 3% -33.8% 3447 ± 25% interrupts.CPU82.NMI:Non-maskable_interrupts 5207 ± 3% -33.8% 3447 ± 25% interrupts.CPU82.PMI:Performance_monitoring_interrupts 723.33 +45.0% 1048 ± 2% interrupts.CPU82.RES:Rescheduling_interrupts 424.67 ± 12% +143.4% 1033 ± 11% interrupts.CPU82.TLB:TLB_shootdowns 4227 ± 9% +20.3% 5085 ± 6% interrupts.CPU83.CAL:Function_call_interrupts 5224 ± 3% -42.6% 2998 ± 38% interrupts.CPU83.NMI:Non-maskable_interrupts 5224 ± 3% -42.6% 2998 ± 38% interrupts.CPU83.PMI:Performance_monitoring_interrupts 690.00 ± 7% +57.2% 1084 ± 3% interrupts.CPU83.RES:Rescheduling_interrupts 437.33 ± 9% +170.6% 1183 ± 19% interrupts.CPU83.TLB:TLB_shootdowns 4122 ± 10% +19.3% 4918 ± 3% interrupts.CPU84.CAL:Function_call_interrupts 5236 ± 3% -44.5% 2906 ± 29% interrupts.CPU84.NMI:Non-maskable_interrupts 5236 ± 3% -44.5% 2906 ± 29% interrupts.CPU84.PMI:Performance_monitoring_interrupts 714.00 ± 2% +49.4% 1066 ± 4% interrupts.CPU84.RES:Rescheduling_interrupts 460.00 ± 17% +124.9% 1034 ± 11% interrupts.CPU84.TLB:TLB_shootdowns 4072 ± 5% +19.5% 4864 ± 4% interrupts.CPU85.CAL:Function_call_interrupts 5256 ± 3% -24.5% 3967 ± 9% interrupts.CPU85.NMI:Non-maskable_interrupts 5256 ± 3% -24.5% 3967 ± 9% interrupts.CPU85.PMI:Performance_monitoring_interrupts 696.67 ± 5% +53.2% 1067 ± 5% interrupts.CPU85.RES:Rescheduling_interrupts 445.67 ± 13% +112.0% 945.00 ± 2% interrupts.CPU85.TLB:TLB_shootdowns 4091 ± 3% +21.3% 4964 ± 4% interrupts.CPU86.CAL:Function_call_interrupts 699.33 ± 5% +56.4% 1093 ± 4% interrupts.CPU86.RES:Rescheduling_interrupts 466.00 ± 14% +126.0% 1053 ± 4% interrupts.CPU86.TLB:TLB_shootdowns 4003 ± 8% +25.3% 5015 ± 4% interrupts.CPU87.CAL:Function_call_interrupts 687.00 ± 3% +54.1% 1058 ± 5% interrupts.CPU87.RES:Rescheduling_interrupts 474.33 ± 18% +116.1% 1025 ± 9% interrupts.CPU87.TLB:TLB_shootdowns 4087 ± 8% +21.9% 4982 ± 3% interrupts.CPU88.CAL:Function_call_interrupts 695.67 +48.5% 1033 ± 2% interrupts.CPU88.RES:Rescheduling_interrupts 482.00 ± 12% +114.2% 1032 ± 7% interrupts.CPU88.TLB:TLB_shootdowns 3940 ± 8% +25.5% 4944 ± 5% interrupts.CPU89.CAL:Function_call_interrupts 5209 ± 3% -25.2% 3895 ± 10% interrupts.CPU89.NMI:Non-maskable_interrupts 5209 ± 3% -25.2% 3895 ± 10% interrupts.CPU89.PMI:Performance_monitoring_interrupts 695.67 ± 4% +51.6% 1054 ± 4% interrupts.CPU89.RES:Rescheduling_interrupts 434.00 ± 15% +131.6% 1005 ± 9% interrupts.CPU89.TLB:TLB_shootdowns 3991 ± 2% +18.5% 4728 ± 3% interrupts.CPU9.CAL:Function_call_interrupts 5149 ± 5% -33.6% 3418 ± 25% interrupts.CPU9.NMI:Non-maskable_interrupts 5149 ± 5% -33.6% 3418 ± 25% interrupts.CPU9.PMI:Performance_monitoring_interrupts 704.67 ± 7% +56.2% 1100 ± 4% interrupts.CPU9.RES:Rescheduling_interrupts 433.67 ± 8% +107.6% 900.25 ± 12% interrupts.CPU9.TLB:TLB_shootdowns 4145 ± 6% +17.4% 4868 ± 6% interrupts.CPU90.CAL:Function_call_interrupts 5217 ± 3% -42.9% 2977 ± 40% interrupts.CPU90.NMI:Non-maskable_interrupts 5217 ± 3% -42.9% 2977 ± 40% interrupts.CPU90.PMI:Performance_monitoring_interrupts 672.33 ± 4% +61.4% 1085 ± 2% interrupts.CPU90.RES:Rescheduling_interrupts 491.33 ± 14% +90.1% 934.00 ± 9% interrupts.CPU90.TLB:TLB_shootdowns 4304 ± 7% +17.4% 5051 ± 3% interrupts.CPU91.CAL:Function_call_interrupts 799.00 ± 4% +34.7% 1076 ± 3% interrupts.CPU91.RES:Rescheduling_interrupts 458.33 ± 13% +112.6% 974.50 ± 3% interrupts.CPU91.TLB:TLB_shootdowns 3978 ± 4% +21.1% 4816 ± 3% interrupts.CPU92.CAL:Function_call_interrupts 5190 ± 4% -54.3% 2371 ± 21% interrupts.CPU92.NMI:Non-maskable_interrupts 5190 ± 4% -54.3% 2371 ± 21% interrupts.CPU92.PMI:Performance_monitoring_interrupts 648.00 +66.6% 1079 ± 4% interrupts.CPU92.RES:Rescheduling_interrupts 470.67 ± 14% +99.7% 940.00 ± 17% interrupts.CPU92.TLB:TLB_shootdowns 3937 ± 6% +23.5% 4863 ± 5% interrupts.CPU93.CAL:Function_call_interrupts 5221 ± 3% -35.6% 3365 ± 23% interrupts.CPU93.NMI:Non-maskable_interrupts 5221 ± 3% -35.6% 3365 ± 23% interrupts.CPU93.PMI:Performance_monitoring_interrupts 677.67 ± 6% +53.6% 1041 ± 5% interrupts.CPU93.RES:Rescheduling_interrupts 481.00 ± 4% +123.9% 1077 ± 4% interrupts.CPU93.TLB:TLB_shootdowns 4005 ± 5% +22.8% 4919 ± 6% interrupts.CPU94.CAL:Function_call_interrupts 648.00 ± 2% +61.7% 1047 ± 6% interrupts.CPU94.RES:Rescheduling_interrupts 469.67 ± 9% +103.2% 954.25 ± 17% interrupts.CPU94.TLB:TLB_shootdowns 4039 ± 2% +26.0% 5088 ± 5% interrupts.CPU95.CAL:Function_call_interrupts 664.00 ± 8% +65.4% 1098 ± 8% interrupts.CPU95.RES:Rescheduling_interrupts 458.00 ± 18% +119.0% 1003 ± 8% interrupts.CPU95.TLB:TLB_shootdowns 3941 ± 2% +20.5% 4750 ± 3% interrupts.CPU96.CAL:Function_call_interrupts 5213 ± 5% -26.6% 3824 ± 9% interrupts.CPU96.NMI:Non-maskable_interrupts 5213 ± 5% -26.6% 3824 ± 9% interrupts.CPU96.PMI:Performance_monitoring_interrupts 707.67 ± 4% +69.0% 1196 ± 4% interrupts.CPU96.RES:Rescheduling_interrupts 453.00 ± 5% +111.2% 956.75 ± 9% interrupts.CPU96.TLB:TLB_shootdowns 3892 ± 3% +29.5% 5041 ± 8% interrupts.CPU97.CAL:Function_call_interrupts 5166 ± 4% -25.1% 3867 ± 9% interrupts.CPU97.NMI:Non-maskable_interrupts 5166 ± 4% -25.1% 3867 ± 9% interrupts.CPU97.PMI:Performance_monitoring_interrupts 755.67 ± 8% +55.6% 1175 ± 5% interrupts.CPU97.RES:Rescheduling_interrupts 487.00 ± 10% +86.1% 906.25 ± 8% interrupts.CPU97.TLB:TLB_shootdowns 3869 ± 3% +23.6% 4782 interrupts.CPU98.CAL:Function_call_interrupts 5178 ± 5% -34.9% 3369 ± 24% interrupts.CPU98.NMI:Non-maskable_interrupts 5178 ± 5% -34.9% 3369 ± 24% interrupts.CPU98.PMI:Performance_monitoring_interrupts 687.33 ± 5% +68.1% 1155 ± 4% interrupts.CPU98.RES:Rescheduling_interrupts 389.00 ± 13% +121.1% 860.25 ± 8% interrupts.CPU98.TLB:TLB_shootdowns 4000 +21.9% 4876 ± 6% interrupts.CPU99.CAL:Function_call_interrupts 719.67 +67.0% 1202 ± 2% interrupts.CPU99.RES:Rescheduling_interrupts 463.00 ± 8% +76.1% 815.50 ± 10% interrupts.CPU99.TLB:TLB_shootdowns 913220 ± 2% -24.1% 693121 ± 9% interrupts.NMI:Non-maskable_interrupts 913220 ± 2% -24.1% 693121 ± 9% interrupts.PMI:Performance_monitoring_interrupts 132379 +62.4% 215045 interrupts.RES:Rescheduling_interrupts 94465 ± 13% +95.5% 184704 ± 9% interrupts.TLB:TLB_shootdowns Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Oliver Sang

6 months, 1 week

2
2
0 / 0

[btrfs] 196d59ab9c: fxmark.hdd_btrfs_MWCL_9_bufferedio.works/sec -16.4% regression

by kernel test robot

Greeting, FYI, we noticed a -16.4% regression of fxmark.hdd_btrfs_MWCL_9_bufferedio.works/sec due to commit: please be noted there are also other regressions in fxmark tests. e.g. 56097 -29.1% 39797 fxmark.hdd_btrfs_MWCL_18_bufferedio.works/sec 53599 -13.7% 46230 ± 3% fxmark.hdd_btrfs_MWCL_72_bufferedio.works/sec commit: 196d59ab9ccc975d8d29292845d227cdf4423ef8 ("btrfs: switch extent buffer tree lock to rw_semaphore") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: fxmark on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory with following parameters: disk: 1HDD media: hdd test: MWCL fstype: btrfs directio: bufferedio cpufreq_governor: performance ucode: 0x11 If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/directio/disk/fstype/kconfig/media/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/bufferedio/1HDD/btrfs/x86_64-rhel-8.3/hdd/debian-10.4-x86_64-20200603.cgz/lkp-knm01/MWCL/fxmark/0x11 commit: ecdcf3c259 ("btrfs: open code insert_orphan_item") 196d59ab9c ("btrfs: switch extent buffer tree lock to rw_semaphore") ecdcf3c259e4c36e 196d59ab9ccc975d8d29292845d ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 8% 0:4 perf-profile.children.cycles-pp.error_return 0:4 12% 0:4 perf-profile.children.cycles-pp.error_entry 0:4 11% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 123.68 +88.8% 233.54 fxmark.hdd_btrfs_MWCL_18_bufferedio.idle_sec 24.30 +89.1% 45.95 fxmark.hdd_btrfs_MWCL_18_bufferedio.idle_util 0.51 ± 13% +46.3% 0.75 ± 4% fxmark.hdd_btrfs_MWCL_18_bufferedio.iowait_sec 0.10 ± 13% +46.6% 0.15 ± 5% fxmark.hdd_btrfs_MWCL_18_bufferedio.iowait_util 4.79 ± 3% -14.1% 4.11 ± 2% fxmark.hdd_btrfs_MWCL_18_bufferedio.softirq_sec 0.94 ± 3% -14.0% 0.81 ± 2% fxmark.hdd_btrfs_MWCL_18_bufferedio.softirq_util 338.07 -31.2% 232.52 fxmark.hdd_btrfs_MWCL_18_bufferedio.sys_sec 66.42 -31.1% 45.75 fxmark.hdd_btrfs_MWCL_18_bufferedio.sys_util 10.98 -21.0% 8.66 fxmark.hdd_btrfs_MWCL_18_bufferedio.user_sec 2.16 -20.9% 1.70 fxmark.hdd_btrfs_MWCL_18_bufferedio.user_util 1683695 -29.1% 1194164 fxmark.hdd_btrfs_MWCL_18_bufferedio.works 56097 -29.1% 39797 fxmark.hdd_btrfs_MWCL_18_bufferedio.works/sec 241.75 ± 3% +71.4% 414.43 fxmark.hdd_btrfs_MWCL_27_bufferedio.idle_sec 31.25 ± 3% +71.3% 53.52 fxmark.hdd_btrfs_MWCL_27_bufferedio.idle_util 478.99 ± 2% -35.8% 307.43 fxmark.hdd_btrfs_MWCL_27_bufferedio.sys_sec 61.90 -35.9% 39.71 fxmark.hdd_btrfs_MWCL_27_bufferedio.sys_util 11.25 -12.8% 9.81 ± 3% fxmark.hdd_btrfs_MWCL_27_bufferedio.user_sec 1.45 -12.8% 1.27 ± 3% fxmark.hdd_btrfs_MWCL_27_bufferedio.user_util 1707056 -22.6% 1321210 fxmark.hdd_btrfs_MWCL_27_bufferedio.works 56877 -22.6% 44009 fxmark.hdd_btrfs_MWCL_27_bufferedio.works/sec 1.37 ± 5% -77.9% 0.30 ± 30% fxmark.hdd_btrfs_MWCL_2_bufferedio.idle_sec 2.29 ± 5% -78.1% 0.50 ± 30% fxmark.hdd_btrfs_MWCL_2_bufferedio.idle_util 1.11 ± 11% -13.9% 0.96 ± 9% fxmark.hdd_btrfs_MWCL_2_bufferedio.softirq_sec 1.86 ± 11% -14.9% 1.58 ± 9% fxmark.hdd_btrfs_MWCL_2_bufferedio.softirq_util 341.20 ± 2% +75.6% 598.98 fxmark.hdd_btrfs_MWCL_36_bufferedio.idle_sec 32.89 ± 2% +75.5% 57.71 fxmark.hdd_btrfs_MWCL_36_bufferedio.idle_util 0.46 ± 27% +138.5% 1.08 ± 19% fxmark.hdd_btrfs_MWCL_36_bufferedio.iowait_sec 0.04 ± 27% +138.0% 0.10 ± 19% fxmark.hdd_btrfs_MWCL_36_bufferedio.iowait_util 635.07 -40.5% 377.89 fxmark.hdd_btrfs_MWCL_36_bufferedio.sys_sec 61.22 -40.5% 36.41 fxmark.hdd_btrfs_MWCL_36_bufferedio.sys_util 1747939 -15.5% 1476154 fxmark.hdd_btrfs_MWCL_36_bufferedio.works 58241 -15.6% 49175 fxmark.hdd_btrfs_MWCL_36_bufferedio.works/sec 487.29 +62.8% 793.11 ± 2% fxmark.hdd_btrfs_MWCL_45_bufferedio.idle_sec 37.52 +62.7% 61.04 ± 2% fxmark.hdd_btrfs_MWCL_45_bufferedio.idle_util 744.34 -41.0% 439.31 ± 4% fxmark.hdd_btrfs_MWCL_45_bufferedio.sys_sec 57.31 -41.0% 33.81 ± 4% fxmark.hdd_btrfs_MWCL_45_bufferedio.sys_util 1759079 -10.8% 1568784 ± 3% fxmark.hdd_btrfs_MWCL_45_bufferedio.works 58631 -10.9% 52267 ± 3% fxmark.hdd_btrfs_MWCL_45_bufferedio.works/sec 6.38 -18.0% 5.23 ± 7% fxmark.hdd_btrfs_MWCL_4_bufferedio.idle_sec 5.47 -20.5% 4.35 ± 7% fxmark.hdd_btrfs_MWCL_4_bufferedio.idle_util 1.75 ± 5% -33.2% 1.17 ± 8% fxmark.hdd_btrfs_MWCL_4_bufferedio.softirq_sec 1.50 ± 5% -35.3% 0.97 ± 8% fxmark.hdd_btrfs_MWCL_4_bufferedio.softirq_util 659.89 +52.6% 1007 fxmark.hdd_btrfs_MWCL_54_bufferedio.idle_sec 42.16 +53.0% 64.49 fxmark.hdd_btrfs_MWCL_54_bufferedio.idle_util 8.08 +13.2% 9.14 ± 2% fxmark.hdd_btrfs_MWCL_54_bufferedio.softirq_sec 0.52 +13.5% 0.59 ± 2% fxmark.hdd_btrfs_MWCL_54_bufferedio.softirq_util 833.14 -42.2% 481.74 fxmark.hdd_btrfs_MWCL_54_bufferedio.sys_sec 53.22 -42.0% 30.85 fxmark.hdd_btrfs_MWCL_54_bufferedio.sys_util 827.45 +47.9% 1223 fxmark.hdd_btrfs_MWCL_63_bufferedio.idle_sec 45.34 +47.9% 67.04 fxmark.hdd_btrfs_MWCL_63_bufferedio.idle_util 8.54 +16.8% 9.98 fxmark.hdd_btrfs_MWCL_63_bufferedio.softirq_sec 0.47 +16.8% 0.55 fxmark.hdd_btrfs_MWCL_63_bufferedio.softirq_util 919.60 -43.1% 522.80 ± 2% fxmark.hdd_btrfs_MWCL_63_bufferedio.sys_sec 50.38 -43.2% 28.64 ± 2% fxmark.hdd_btrfs_MWCL_63_bufferedio.sys_util 1017 +54.2% 1569 fxmark.hdd_btrfs_MWCL_72_bufferedio.idle_sec 48.62 +53.9% 74.84 fxmark.hdd_btrfs_MWCL_72_bufferedio.idle_util 983.26 -55.2% 440.30 ± 4% fxmark.hdd_btrfs_MWCL_72_bufferedio.sys_sec 46.99 -55.3% 21.00 ± 3% fxmark.hdd_btrfs_MWCL_72_bufferedio.sys_util 1610685 -13.9% 1387293 ± 3% fxmark.hdd_btrfs_MWCL_72_bufferedio.works 53599 -13.7% 46230 ± 3% fxmark.hdd_btrfs_MWCL_72_bufferedio.works/sec 29.75 +89.7% 56.45 ± 2% fxmark.hdd_btrfs_MWCL_9_bufferedio.idle_sec 11.62 +86.9% 21.72 ± 2% fxmark.hdd_btrfs_MWCL_9_bufferedio.idle_util 7.64 -10.8% 6.82 fxmark.hdd_btrfs_MWCL_9_bufferedio.irq_util 3.10 ± 6% -15.1% 2.64 ± 3% fxmark.hdd_btrfs_MWCL_9_bufferedio.softirq_sec 1.21 ± 6% -16.4% 1.01 ± 3% fxmark.hdd_btrfs_MWCL_9_bufferedio.softirq_util 194.38 -10.0% 174.90 fxmark.hdd_btrfs_MWCL_9_bufferedio.sys_sec 75.94 -11.4% 67.29 fxmark.hdd_btrfs_MWCL_9_bufferedio.sys_util 8.95 -11.7% 7.91 fxmark.hdd_btrfs_MWCL_9_bufferedio.user_sec 3.50 -13.1% 3.04 fxmark.hdd_btrfs_MWCL_9_bufferedio.user_util 1359770 -16.4% 1136680 fxmark.hdd_btrfs_MWCL_9_bufferedio.works 45317 -16.4% 37885 fxmark.hdd_btrfs_MWCL_9_bufferedio.works/sec 549.29 -3.3% 531.11 fxmark.time.elapsed_time 549.29 -3.3% 531.11 fxmark.time.elapsed_time.max 1096944 -15.4% 927632 ± 2% fxmark.time.file_system_outputs 67.00 -22.4% 52.00 fxmark.time.percent_of_cpu_this_job_got 356.30 -25.2% 266.46 fxmark.time.system_time 13.97 -7.7% 12.90 fxmark.time.user_time 687910 ± 2% -14.9% 585190 fxmark.time.voluntary_context_switches 92480 +57.6% 145791 cpuidle.POLL.usage 45.12 +17.7% 53.12 iostat.cpu.idle 47.26 -17.5% 39.01 iostat.cpu.system 4465896 -11.0% 3976872 numa-numastat.node0.local_node 4465847 -10.9% 3976837 numa-numastat.node0.numa_hit 48.04 +8.2 56.24 mpstat.cpu.all.idle% 1.00 ± 5% -0.1 0.94 ± 4% mpstat.cpu.all.soft% 43.86 -8.1 35.72 mpstat.cpu.all.sys% 44.75 +17.9% 52.75 vmstat.cpu.id 51.00 -16.7% 42.50 vmstat.cpu.sy 23992 -12.0% 21119 vmstat.io.bo 2338252 -9.9% 2106851 vmstat.memory.cache 11.50 ± 4% -63.0% 4.25 ± 10% vmstat.procs.r 92744 +6.5% 98768 vmstat.system.cs 175350 -18.3% 143184 meminfo.Active 174192 -18.4% 142148 meminfo.Active(file) 214134 -21.0% 169130 ± 3% meminfo.Dirty 152957 -23.9% 116365 ± 4% meminfo.Inactive(file) 914555 -16.8% 760508 meminfo.KReclaimable 914555 -16.8% 760508 meminfo.SReclaimable 441392 -9.9% 397727 meminfo.SUnreclaim 28606 ± 3% -19.0% 23181 ± 3% meminfo.Shmem 1355948 -14.6% 1158236 meminfo.Slab 1683 ± 4% -8.9% 1532 ± 4% meminfo.Writeback 176261 -18.5% 143572 numa-meminfo.node0.Active 175123 -18.6% 142537 numa-meminfo.node0.Active(file) 214487 -21.0% 169509 ± 4% numa-meminfo.node0.Dirty 152258 -23.1% 117060 ± 4% numa-meminfo.node0.Inactive(file) 897715 -17.0% 744913 numa-meminfo.node0.KReclaimable 897715 -17.0% 744913 numa-meminfo.node0.SReclaimable 429290 -9.9% 386596 numa-meminfo.node0.SUnreclaim 28605 ± 3% -19.0% 23175 ± 3% numa-meminfo.node0.Shmem 1327006 -14.7% 1131510 numa-meminfo.node0.Slab 1752 ± 5% -11.4% 1552 numa-meminfo.node0.Writeback 43694 -18.5% 35593 numa-vmstat.node0.nr_active_file 916940 -14.6% 783445 numa-vmstat.node0.nr_dirtied 53663 -21.0% 42371 ± 3% numa-vmstat.node0.nr_dirty 38292 -23.2% 29417 ± 4% numa-vmstat.node0.nr_inactive_file 7144 ± 2% -19.0% 5789 ± 3% numa-vmstat.node0.nr_shmem 224840 -17.1% 186437 numa-vmstat.node0.nr_slab_reclaimable 107449 -10.0% 96654 numa-vmstat.node0.nr_slab_unreclaimable 449.50 ± 4% -14.6% 384.00 ± 4% numa-vmstat.node0.nr_writeback 862673 -14.1% 740618 numa-vmstat.node0.nr_written 43695 -18.5% 35593 numa-vmstat.node0.nr_zone_active_file 38291 -23.2% 29417 ± 4% numa-vmstat.node0.nr_zone_inactive_file 54266 -21.1% 42827 ± 3% numa-vmstat.node0.nr_zone_write_pending 642101 -18.1% 526175 slabinfo.btrfs_delayed_node.active_objs 12361 -18.0% 10131 slabinfo.btrfs_delayed_node.active_slabs 642824 -18.0% 526856 slabinfo.btrfs_delayed_node.num_objs 12361 -18.0% 10131 slabinfo.btrfs_delayed_node.num_slabs 641642 -18.1% 525750 slabinfo.btrfs_inode.active_objs 22930 -18.1% 18790 slabinfo.btrfs_inode.active_slabs 642066 -18.1% 526149 slabinfo.btrfs_inode.num_objs 22930 -18.1% 18790 slabinfo.btrfs_inode.num_slabs 614342 -15.8% 517367 slabinfo.dentry.active_objs 14843 -15.7% 12518 slabinfo.dentry.active_slabs 623419 -15.7% 525802 slabinfo.dentry.num_objs 14843 -15.7% 12518 slabinfo.dentry.num_slabs 26554 -33.0% 17795 slabinfo.kmalloc-192.active_objs 788.50 -26.9% 576.50 ± 2% slabinfo.kmalloc-192.active_slabs 33135 -26.8% 24238 ± 2% slabinfo.kmalloc-192.num_objs 788.50 -26.9% 576.50 ± 2% slabinfo.kmalloc-192.num_slabs 35021 -17.4% 28941 slabinfo.kmalloc-256.active_objs 39465 -13.8% 34015 slabinfo.kmalloc-256.num_objs 38834 -11.0% 34576 slabinfo.kmalloc-512.active_objs 3822 ± 4% -19.0% 3096 ± 9% slabinfo.mnt_cache.active_objs 4085 ± 4% -16.9% 3395 ± 8% slabinfo.mnt_cache.num_objs 22177 -98.4% 345.50 ± 2% slabinfo.numa_policy.active_objs 370.25 -98.2% 6.75 ± 6% slabinfo.numa_policy.active_slabs 22974 -98.2% 418.50 ± 6% slabinfo.numa_policy.num_objs 370.25 -98.2% 6.75 ± 6% slabinfo.numa_policy.num_slabs 30778 -11.4% 27258 slabinfo.radix_tree_node.active_objs 287.50 -10.2% 258.25 ± 2% proc-vmstat.nr_active_anon 44012 -18.2% 36011 proc-vmstat.nr_active_file 1641867 -14.6% 1402146 proc-vmstat.nr_dirtied 54266 -21.0% 42844 ± 3% proc-vmstat.nr_dirty 354597 -5.3% 335913 proc-vmstat.nr_file_pages 68032 -1.7% 66880 proc-vmstat.nr_inactive_anon 38874 -23.7% 29657 ± 4% proc-vmstat.nr_inactive_file 7185 ± 3% -19.0% 5817 ± 3% proc-vmstat.nr_shmem 231482 -16.9% 192443 proc-vmstat.nr_slab_reclaimable 110865 -10.0% 99807 proc-vmstat.nr_slab_unreclaimable 447.00 -11.0% 398.00 proc-vmstat.nr_writeback 1641866 -14.6% 1402143 proc-vmstat.nr_written 287.50 -10.2% 258.25 ± 2% proc-vmstat.nr_zone_active_anon 44012 -18.2% 36011 proc-vmstat.nr_zone_active_file 68032 -1.7% 66880 proc-vmstat.nr_zone_inactive_anon 38874 -23.7% 29657 ± 4% proc-vmstat.nr_zone_inactive_file 54890 -21.1% 43319 ± 3% proc-vmstat.nr_zone_write_pending 4487469 -10.8% 4001195 proc-vmstat.numa_hit 4487468 -10.8% 4001193 proc-vmstat.numa_local 645936 +8.8% 702580 proc-vmstat.pgactivate 9776528 -12.1% 8593562 proc-vmstat.pgalloc_normal 1323917 -14.8% 1127396 ± 3% proc-vmstat.pgdeactivate 1852505 -3.3% 1792262 proc-vmstat.pgfault 9778333 -12.1% 8596857 proc-vmstat.pgfree 13064555 -14.7% 11146070 proc-vmstat.pgpgout 1355099 -15.6% 1143590 ± 3% proc-vmstat.pgrotated 29192165 -12.6% 25511450 proc-vmstat.slabs_scanned 2682624 -2.3% 2622144 proc-vmstat.unevictable_pgs_scanned 11918547 ± 5% +7.8% 12843186 perf-stat.i.branch-instructions 0.08 ± 6% +0.0 0.09 ± 2% perf-stat.i.branch-miss-rate% 924883 ± 5% +8.7% 1004974 ± 3% perf-stat.i.branch-misses 0.16 ± 7% +0.0 0.17 perf-stat.i.cache-miss-rate% 194655 ± 8% +10.9% 215884 perf-stat.i.cache-misses 1307774 ± 8% +8.8% 1423352 perf-stat.i.cache-references 91889 +7.0% 98361 perf-stat.i.context-switches 0.09 ± 9% +8.5% 0.10 perf-stat.i.cpi 39978 +0.8% 40304 perf-stat.i.cpu-clock 4.778e+08 ± 7% +8.6% 5.187e+08 perf-stat.i.cpu-cycles 900.48 +26.4% 1138 perf-stat.i.cpu-migrations 630084 ± 7% +8.2% 681691 perf-stat.i.iTLB-load-misses 56704882 ± 5% +7.9% 61157553 perf-stat.i.iTLB-loads 56801859 ± 5% +7.9% 61262751 perf-stat.i.instructions 0.96 ± 5% +7.4% 1.03 perf-stat.i.instructions-per-iTLB-miss 0.00 ± 6% +7.0% 0.00 perf-stat.i.ipc 1.78 ± 2% +8.1% 1.93 ± 2% perf-stat.i.major-faults 0.00 ± 7% +8.5% 0.00 perf-stat.i.metric.GHz 0.33 +3.5% 0.34 perf-stat.i.metric.K/sec 0.25 ± 5% +7.7% 0.27 perf-stat.i.metric.M/sec 39978 +0.8% 40304 perf-stat.i.task-clock 12147873 ± 5% +8.2% 13143736 perf-stat.ps.branch-instructions 942554 ± 5% +9.1% 1028476 ± 3% perf-stat.ps.branch-misses 198339 ± 8% +11.4% 220964 perf-stat.ps.cache-misses 1332481 ± 8% +9.3% 1456578 perf-stat.ps.cache-references 91580 +6.7% 97730 perf-stat.ps.context-switches 4.868e+08 ± 7% +9.0% 5.308e+08 perf-stat.ps.cpu-cycles 896.06 +26.2% 1131 perf-stat.ps.cpu-migrations 641967 ± 7% +8.7% 697566 perf-stat.ps.iTLB-load-misses 57794217 ± 5% +8.3% 62587387 perf-stat.ps.iTLB-loads 57894864 ± 5% +8.3% 62696692 perf-stat.ps.instructions 1.78 ± 2% +8.4% 1.93 ± 2% perf-stat.ps.major-faults 76331 -14.9% 64991 sched_debug.cfs_rq:/.exec_clock.avg 131652 -45.5% 71764 sched_debug.cfs_rq:/.exec_clock.max 19235 -88.8% 2152 ± 10% sched_debug.cfs_rq:/.exec_clock.stddev 29025 ± 23% +115.9% 62654 ± 25% sched_debug.cfs_rq:/.load.min 228411 ± 11% -38.6% 140254 ± 44% sched_debug.cfs_rq:/.load.stddev 43.60 ± 29% +86.5% 81.33 ± 17% sched_debug.cfs_rq:/.load_avg.min 1523223 ± 3% -19.2% 1230395 ± 6% sched_debug.cfs_rq:/.min_vruntime.avg 2877263 ± 3% -54.9% 1297137 ± 5% sched_debug.cfs_rq:/.min_vruntime.max 821701 ± 6% +33.4% 1096067 ± 8% sched_debug.cfs_rq:/.min_vruntime.min 639729 ± 3% -93.7% 40423 ± 26% sched_debug.cfs_rq:/.min_vruntime.stddev 0.43 ± 2% -26.0% 0.32 ± 13% sched_debug.cfs_rq:/.nr_running.avg 0.12 ± 34% +33.3% 0.17 ± 33% sched_debug.cfs_rq:/.nr_running.min 21.91 ± 7% +83.3% 40.17 ± 8% sched_debug.cfs_rq:/.nr_spread_over.avg 6.25 ± 33% +379.6% 29.97 ± 6% sched_debug.cfs_rq:/.nr_spread_over.min 224.08 ± 12% +74.5% 390.97 ± 12% sched_debug.cfs_rq:/.runnable_avg.min 222.26 ± 12% -22.6% 171.99 ± 13% sched_debug.cfs_rq:/.runnable_avg.stddev -1308743 -104.8% 62240 ±123% sched_debug.cfs_rq:/.spread0.avg -2010183 -96.4% -72085 sched_debug.cfs_rq:/.spread0.min 639697 ± 3% -93.7% 40422 ± 26% sched_debug.cfs_rq:/.spread0.stddev 408.48 ± 5% -13.0% 355.56 ± 3% sched_debug.cfs_rq:/.util_avg.avg 1055 ± 3% -10.6% 943.19 ± 3% sched_debug.cfs_rq:/.util_avg.max 162.68 ± 12% +53.0% 248.97 ± 15% sched_debug.cfs_rq:/.util_avg.min 205.13 ± 7% -25.5% 152.83 ± 13% sched_debug.cfs_rq:/.util_avg.stddev 244.43 ± 5% -66.9% 80.95 ± 39% sched_debug.cfs_rq:/.util_est_enqueued.avg 709.90 ± 13% -39.9% 426.36 ± 11% sched_debug.cfs_rq:/.util_est_enqueued.max 203.06 ± 15% -58.6% 84.00 ± 15% sched_debug.cfs_rq:/.util_est_enqueued.stddev 848045 ± 9% +34.7% 1142214 ± 10% sched_debug.cpu.avg_idle.avg 188030 ± 23% +140.0% 451192 ± 14% sched_debug.cpu.avg_idle.min 345409 ± 8% -25.4% 257601 ± 12% sched_debug.cpu.avg_idle.stddev 347803 -9.9% 313357 sched_debug.cpu.clock.avg 347858 -9.9% 313400 sched_debug.cpu.clock.max 347747 -9.9% 313310 sched_debug.cpu.clock.min 31.60 -18.3% 25.83 ± 3% sched_debug.cpu.clock.stddev 338985 -10.5% 303239 sched_debug.cpu.clock_task.avg 340608 -10.8% 303972 sched_debug.cpu.clock_task.max 329665 -9.8% 297262 sched_debug.cpu.clock_task.min 2108 ± 4% -39.3% 1280 ± 5% sched_debug.cpu.clock_task.stddev 939.85 ± 81% +165.3% 2493 ± 27% sched_debug.cpu.curr->pid.min 3549 ± 10% -29.0% 2520 ± 15% sched_debug.cpu.curr->pid.stddev 0.00 ± 97% -98.3% 0.00 ± 4% sched_debug.cpu.next_balance.stddev 0.12 ± 34% +144.4% 0.31 ± 15% sched_debug.cpu.nr_running.min 654832 +18.8% 777815 sched_debug.cpu.nr_switches.avg 904162 ± 2% -9.8% 815631 ± 2% sched_debug.cpu.nr_switches.max 574858 +31.5% 755656 sched_debug.cpu.nr_switches.min 82240 ± 3% -81.8% 14938 ± 13% sched_debug.cpu.nr_switches.stddev 263.38 ± 26% -67.9% 84.44 ± 16% sched_debug.cpu.nr_uninterruptible.max -218.23 -78.1% -47.78 sched_debug.cpu.nr_uninterruptible.min 128.55 ± 24% -77.9% 28.46 ± 22% sched_debug.cpu.nr_uninterruptible.stddev 653092 +18.6% 774865 sched_debug.cpu.sched_count.avg 913676 ± 2% -11.5% 808187 ± 2% sched_debug.cpu.sched_count.max 573366 +31.5% 753744 sched_debug.cpu.sched_count.min 83073 ± 3% -83.4% 13777 ± 12% sched_debug.cpu.sched_count.stddev 285707 +18.5% 338620 sched_debug.cpu.sched_goidle.avg 397157 -11.6% 351276 ± 2% sched_debug.cpu.sched_goidle.max 243238 +36.3% 331500 sched_debug.cpu.sched_goidle.min 43632 ± 3% -88.0% 5215 ± 22% sched_debug.cpu.sched_goidle.stddev 276633 +183.4% 783865 ± 3% sched_debug.cpu.ttwu_count.avg 615804 ± 2% +249.5% 2152323 ± 6% sched_debug.cpu.ttwu_count.max 144528 ± 2% +324.1% 612922 ± 4% sched_debug.cpu.ttwu_count.stddev 7838 ± 4% +62.0% 12696 ± 6% sched_debug.cpu.ttwu_local.avg 23472 ± 2% -36.2% 14981 ± 4% sched_debug.cpu.ttwu_local.max 6517 ± 3% +77.0% 11535 ± 6% sched_debug.cpu.ttwu_local.min 1978 ± 8% -47.1% 1047 ± 21% sched_debug.cpu.ttwu_local.stddev 347742 -9.9% 313303 sched_debug.cpu_clk 347083 -9.9% 312643 sched_debug.ktime 348036 -9.9% 313599 sched_debug.sched_clk 116128 ± 2% -38.5% 71410 softirqs.CPU0.SCHED 91878 -27.9% 66231 softirqs.CPU1.SCHED 70366 ± 2% -21.3% 55400 softirqs.CPU10.SCHED 71066 ± 2% -22.0% 55446 softirqs.CPU11.SCHED 70819 ± 2% -21.8% 55357 softirqs.CPU12.SCHED 72824 ± 2% -22.9% 56169 ± 3% softirqs.CPU13.SCHED 72347 ± 2% -23.0% 55736 ± 3% softirqs.CPU14.SCHED 71040 -22.6% 54996 softirqs.CPU15.SCHED 73832 ± 2% -25.7% 54822 softirqs.CPU16.SCHED 73531 -24.7% 55359 softirqs.CPU17.SCHED 61336 -23.2% 47097 softirqs.CPU18.SCHED 61263 -23.3% 46993 softirqs.CPU19.SCHED 90645 ± 2% -24.7% 68276 softirqs.CPU2.SCHED 61313 ± 2% -23.3% 47013 softirqs.CPU20.SCHED 62197 -24.2% 47163 softirqs.CPU21.SCHED 64716 ± 2% -27.6% 46834 softirqs.CPU22.SCHED 63504 -26.3% 46803 softirqs.CPU23.SCHED 64003 ± 2% -26.5% 47071 softirqs.CPU24.SCHED 64911 -27.8% 46890 softirqs.CPU25.SCHED 55809 -27.1% 40707 softirqs.CPU26.SCHED 54152 -26.6% 39754 softirqs.CPU27.SCHED 54386 ± 2% -27.4% 39499 softirqs.CPU28.SCHED 54236 -27.4% 39401 softirqs.CPU29.SCHED 87173 -21.4% 68485 softirqs.CPU3.SCHED 55503 ± 2% -29.2% 39293 softirqs.CPU30.SCHED 56079 -29.9% 39303 softirqs.CPU31.SCHED 57664 -31.4% 39583 softirqs.CPU32.SCHED 55860 -29.6% 39347 softirqs.CPU33.SCHED 54670 -29.8% 38364 softirqs.CPU34.SCHED 57222 ± 2% -31.7% 39072 softirqs.CPU35.SCHED 45803 -30.9% 31647 softirqs.CPU36.SCHED 45558 ± 2% -30.5% 31645 softirqs.CPU37.SCHED 46190 ± 2% -32.1% 31368 softirqs.CPU38.SCHED 43936 ± 7% -28.9% 31240 softirqs.CPU39.SCHED 79246 -17.9% 65045 softirqs.CPU4.SCHED 46593 ± 2% -30.6% 32330 softirqs.CPU40.SCHED 46935 -31.7% 32080 softirqs.CPU41.SCHED 46761 -32.1% 31771 softirqs.CPU42.SCHED 44507 ± 2% -29.3% 31454 ± 2% softirqs.CPU43.SCHED 36826 ± 3% -32.9% 24725 softirqs.CPU44.SCHED 34982 ± 3% -30.7% 24230 softirqs.CPU45.SCHED 35262 ± 4% -30.9% 24363 softirqs.CPU46.SCHED 35716 -31.7% 24388 softirqs.CPU47.SCHED 34721 ± 3% -30.5% 24144 ± 2% softirqs.CPU48.SCHED 36083 ± 4% -32.6% 24324 softirqs.CPU49.SCHED 81693 ± 2% -20.4% 65005 softirqs.CPU5.SCHED 35183 -29.8% 24699 softirqs.CPU50.SCHED 35820 ± 2% -32.2% 24290 softirqs.CPU51.SCHED 33069 -33.1% 22117 ± 4% softirqs.CPU52.SCHED 34535 -29.6% 24296 softirqs.CPU53.SCHED 25349 -34.8% 16522 ± 6% softirqs.CPU54.SCHED 23599 ± 3% -27.7% 17051 ± 2% softirqs.CPU55.SCHED 24760 -30.9% 17107 ± 2% softirqs.CPU56.SCHED 24178 ± 4% -27.7% 17470 ± 3% softirqs.CPU57.SCHED 24307 ± 2% -30.2% 16973 softirqs.CPU58.SCHED 23460 ± 4% -27.2% 17090 softirqs.CPU59.SCHED 79700 -19.3% 64305 softirqs.CPU6.SCHED 24681 -33.2% 16485 ± 3% softirqs.CPU60.SCHED 24529 ± 3% -31.0% 16925 ± 2% softirqs.CPU61.SCHED 14304 ± 5% -29.3% 10109 softirqs.CPU62.SCHED 13347 ± 3% -29.5% 9408 ± 2% softirqs.CPU63.SCHED 10558 ± 2% -9.0% 9612 ± 3% softirqs.CPU64.RCU 14104 ± 4% -31.8% 9623 ± 2% softirqs.CPU64.SCHED 13844 ± 5% -28.8% 9862 softirqs.CPU65.SCHED 12902 ± 3% -25.5% 9610 softirqs.CPU66.SCHED 10891 ± 7% -9.6% 9842 ± 3% softirqs.CPU67.RCU 13872 ± 7% -31.3% 9526 ± 3% softirqs.CPU67.SCHED 13213 ± 8% -26.1% 9771 ± 2% softirqs.CPU68.SCHED 14232 ± 5% -32.4% 9625 ± 2% softirqs.CPU69.SCHED 81684 -21.4% 64189 softirqs.CPU7.SCHED 10183 ± 15% -25.0% 7633 ± 6% softirqs.CPU70.SCHED 13274 ± 6% -28.9% 9434 ± 3% softirqs.CPU71.SCHED 75679 -22.7% 58521 softirqs.CPU8.SCHED 68854 -20.6% 54638 softirqs.CPU9.SCHED 4101011 -22.9% 3160637 softirqs.SCHED 12836 -11.9% 11304 interrupts.180:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2] 4431149 -1.7% 4357713 interrupts.CAL:Function_call_interrupts 1266 ± 45% -46.8% 674.00 ± 19% interrupts.CPU0.NMI:Non-maskable_interrupts 1266 ± 45% -46.8% 674.00 ± 19% interrupts.CPU0.PMI:Performance_monitoring_interrupts 217128 ± 7% -30.5% 150952 ± 2% interrupts.CPU1.CAL:Function_call_interrupts 30529 ± 6% -38.9% 18640 ± 3% interrupts.CPU1.RES:Rescheduling_interrupts 3405 ± 8% -69.7% 1033 ± 7% interrupts.CPU10.RES:Rescheduling_interrupts 703.75 ± 21% -54.3% 321.75 ± 41% interrupts.CPU11.NMI:Non-maskable_interrupts 703.75 ± 21% -54.3% 321.75 ± 41% interrupts.CPU11.PMI:Performance_monitoring_interrupts 3372 ± 5% -67.9% 1081 ± 9% interrupts.CPU11.RES:Rescheduling_interrupts 3289 ± 10% -71.6% 934.50 ± 4% interrupts.CPU12.RES:Rescheduling_interrupts 102804 ± 6% +15.4% 118611 ± 8% interrupts.CPU13.CAL:Function_call_interrupts 3233 ± 8% -69.3% 994.25 ± 5% interrupts.CPU13.RES:Rescheduling_interrupts 1071 ± 57% -69.6% 325.25 ± 42% interrupts.CPU14.NMI:Non-maskable_interrupts 1071 ± 57% -69.6% 325.25 ± 42% interrupts.CPU14.PMI:Performance_monitoring_interrupts 3502 ± 8% -76.1% 838.50 ± 4% interrupts.CPU14.RES:Rescheduling_interrupts 820.25 ± 26% -58.6% 339.25 ± 36% interrupts.CPU15.NMI:Non-maskable_interrupts 820.25 ± 26% -58.6% 339.25 ± 36% interrupts.CPU15.PMI:Performance_monitoring_interrupts 3377 ± 8% -73.3% 901.25 ± 2% interrupts.CPU15.RES:Rescheduling_interrupts 9914 -57.3% 4237 ±100% interrupts.CPU16.180:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2] 850.25 ± 26% -56.5% 369.75 ± 55% interrupts.CPU16.NMI:Non-maskable_interrupts 850.25 ± 26% -56.5% 369.75 ± 55% interrupts.CPU16.PMI:Performance_monitoring_interrupts 3510 ± 7% -75.0% 876.00 ± 10% interrupts.CPU16.RES:Rescheduling_interrupts 1201 ± 40% -76.7% 280.00 ± 22% interrupts.CPU17.NMI:Non-maskable_interrupts 1201 ± 40% -76.7% 280.00 ± 22% interrupts.CPU17.PMI:Performance_monitoring_interrupts 3545 ± 9% -75.3% 875.50 ± 6% interrupts.CPU17.RES:Rescheduling_interrupts 683.00 ± 52% -49.2% 347.25 ± 29% interrupts.CPU18.NMI:Non-maskable_interrupts 683.00 ± 52% -49.2% 347.25 ± 29% interrupts.CPU18.PMI:Performance_monitoring_interrupts 2080 ± 12% -80.9% 398.00 ± 8% interrupts.CPU18.RES:Rescheduling_interrupts 488.75 ± 23% -47.6% 256.00 ± 12% interrupts.CPU19.NMI:Non-maskable_interrupts 488.75 ± 23% -47.6% 256.00 ± 12% interrupts.CPU19.PMI:Performance_monitoring_interrupts 2009 ± 7% -77.6% 450.50 ± 12% interrupts.CPU19.RES:Rescheduling_interrupts 191815 ± 8% -22.4% 148909 ± 4% interrupts.CPU2.CAL:Function_call_interrupts 611.25 ± 29% -58.6% 253.25 ± 26% interrupts.CPU2.NMI:Non-maskable_interrupts 611.25 ± 29% -58.6% 253.25 ± 26% interrupts.CPU2.PMI:Performance_monitoring_interrupts 774.75 ± 38% -67.3% 253.25 ± 32% interrupts.CPU20.NMI:Non-maskable_interrupts 774.75 ± 38% -67.3% 253.25 ± 32% interrupts.CPU20.PMI:Performance_monitoring_interrupts 2025 ± 3% -81.8% 369.50 ± 15% interrupts.CPU20.RES:Rescheduling_interrupts 2088 ± 3% -83.5% 345.00 ± 9% interrupts.CPU21.RES:Rescheduling_interrupts 2212 ± 11% -85.3% 325.25 ± 3% interrupts.CPU22.RES:Rescheduling_interrupts 892.50 ± 44% -60.7% 351.00 ± 59% interrupts.CPU23.NMI:Non-maskable_interrupts 892.50 ± 44% -60.7% 351.00 ± 59% interrupts.CPU23.PMI:Performance_monitoring_interrupts 2264 ± 10% -85.1% 337.25 ± 10% interrupts.CPU23.RES:Rescheduling_interrupts 65733 ± 5% +18.9% 78175 ± 5% interrupts.CPU24.CAL:Function_call_interrupts 1410 ± 26% -73.1% 379.50 ± 42% interrupts.CPU24.NMI:Non-maskable_interrupts 1410 ± 26% -73.1% 379.50 ± 42% interrupts.CPU24.PMI:Performance_monitoring_interrupts 2309 ± 2% -86.3% 315.25 ± 3% interrupts.CPU24.RES:Rescheduling_interrupts 63928 ± 2% +21.4% 77636 ± 5% interrupts.CPU25.CAL:Function_call_interrupts 870.50 ± 32% -58.4% 362.00 ± 31% interrupts.CPU25.NMI:Non-maskable_interrupts 870.50 ± 32% -58.4% 362.00 ± 31% interrupts.CPU25.PMI:Performance_monitoring_interrupts 2490 ± 10% -86.4% 338.50 ± 9% interrupts.CPU25.RES:Rescheduling_interrupts 808.75 ± 16% -44.3% 450.50 ± 63% interrupts.CPU26.NMI:Non-maskable_interrupts 808.75 ± 16% -44.3% 450.50 ± 63% interrupts.CPU26.PMI:Performance_monitoring_interrupts 1312 ± 9% -84.1% 208.25 ± 4% interrupts.CPU26.RES:Rescheduling_interrupts 1458 ± 44% -78.3% 316.75 ± 46% interrupts.CPU27.NMI:Non-maskable_interrupts 1458 ± 44% -78.3% 316.75 ± 46% interrupts.CPU27.PMI:Performance_monitoring_interrupts 1337 ± 5% -84.5% 207.25 ± 11% interrupts.CPU27.RES:Rescheduling_interrupts 1270 ± 4% -5.8% 1196 interrupts.CPU275.CAL:Function_call_interrupts 1118 ± 33% -73.0% 302.25 ± 17% interrupts.CPU28.NMI:Non-maskable_interrupts 1118 ± 33% -73.0% 302.25 ± 17% interrupts.CPU28.PMI:Performance_monitoring_interrupts 1195 ± 9% -82.0% 215.00 ± 4% interrupts.CPU28.RES:Rescheduling_interrupts 854.00 ± 19% -60.5% 337.25 ± 10% interrupts.CPU29.NMI:Non-maskable_interrupts 854.00 ± 19% -60.5% 337.25 ± 10% interrupts.CPU29.PMI:Performance_monitoring_interrupts 1190 ± 9% -80.2% 235.75 ± 14% interrupts.CPU29.RES:Rescheduling_interrupts 198710 ± 10% -22.2% 154622 ± 2% interrupts.CPU3.CAL:Function_call_interrupts 1122 ± 43% -51.0% 550.25 ± 23% interrupts.CPU30.NMI:Non-maskable_interrupts 1122 ± 43% -51.0% 550.25 ± 23% interrupts.CPU30.PMI:Performance_monitoring_interrupts 1369 ± 11% -85.7% 195.25 ± 12% interrupts.CPU30.RES:Rescheduling_interrupts 1307 ± 38% -54.7% 591.75 ± 65% interrupts.CPU31.NMI:Non-maskable_interrupts 1307 ± 38% -54.7% 591.75 ± 65% interrupts.CPU31.PMI:Performance_monitoring_interrupts 1316 ± 9% -84.4% 205.25 ± 10% interrupts.CPU31.RES:Rescheduling_interrupts 1303 ± 29% -79.1% 272.25 ± 20% interrupts.CPU32.NMI:Non-maskable_interrupts 1303 ± 29% -79.1% 272.25 ± 20% interrupts.CPU32.PMI:Performance_monitoring_interrupts 1361 ± 4% -84.5% 210.75 ± 8% interrupts.CPU32.RES:Rescheduling_interrupts 863.25 ± 16% -63.1% 318.25 ± 34% interrupts.CPU33.NMI:Non-maskable_interrupts 863.25 ± 16% -63.1% 318.25 ± 34% interrupts.CPU33.PMI:Performance_monitoring_interrupts 1424 ± 7% -81.6% 261.50 ± 35% interrupts.CPU33.RES:Rescheduling_interrupts 40521 ± 8% +34.8% 54611 ± 13% interrupts.CPU34.CAL:Function_call_interrupts 1060 ± 49% -50.9% 520.75 ± 6% interrupts.CPU34.NMI:Non-maskable_interrupts 1060 ± 49% -50.9% 520.75 ± 6% interrupts.CPU34.PMI:Performance_monitoring_interrupts 1460 ± 8% -83.4% 242.50 ± 26% interrupts.CPU34.RES:Rescheduling_interrupts 42549 ± 6% +27.2% 54118 ± 15% interrupts.CPU35.CAL:Function_call_interrupts 1108 ± 21% -45.5% 604.25 ± 38% interrupts.CPU35.NMI:Non-maskable_interrupts 1108 ± 21% -45.5% 604.25 ± 38% interrupts.CPU35.PMI:Performance_monitoring_interrupts 1490 ± 11% -84.3% 234.25 ± 21% interrupts.CPU35.RES:Rescheduling_interrupts 857.25 ± 17% -48.6% 441.00 ± 39% interrupts.CPU36.NMI:Non-maskable_interrupts 857.25 ± 17% -48.6% 441.00 ± 39% interrupts.CPU36.PMI:Performance_monitoring_interrupts 921.50 ± 2% -85.5% 133.75 ± 2% interrupts.CPU36.RES:Rescheduling_interrupts 1107 ± 44% -55.3% 494.75 ± 49% interrupts.CPU37.NMI:Non-maskable_interrupts 1107 ± 44% -55.3% 494.75 ± 49% interrupts.CPU37.PMI:Performance_monitoring_interrupts 918.50 ± 3% -83.8% 149.00 ± 15% interrupts.CPU37.RES:Rescheduling_interrupts 982.00 ± 3% -85.0% 147.25 ± 19% interrupts.CPU38.RES:Rescheduling_interrupts 990.50 ± 4% -86.0% 139.00 ± 17% interrupts.CPU39.RES:Rescheduling_interrupts 170783 ± 10% -14.4% 146206 ± 6% interrupts.CPU4.CAL:Function_call_interrupts 1628 ± 35% -79.3% 337.75 ± 47% interrupts.CPU40.NMI:Non-maskable_interrupts 1628 ± 35% -79.3% 337.75 ± 47% interrupts.CPU40.PMI:Performance_monitoring_interrupts 984.00 ± 6% -86.0% 138.25 ± 11% interrupts.CPU40.RES:Rescheduling_interrupts 1080 ± 36% -63.9% 389.75 ± 41% interrupts.CPU41.NMI:Non-maskable_interrupts 1080 ± 36% -63.9% 389.75 ± 41% interrupts.CPU41.PMI:Performance_monitoring_interrupts 952.75 ± 7% -84.2% 150.25 ± 8% interrupts.CPU41.RES:Rescheduling_interrupts 1045 ± 35% -56.9% 450.25 ± 44% interrupts.CPU42.NMI:Non-maskable_interrupts 1045 ± 35% -56.9% 450.25 ± 44% interrupts.CPU42.PMI:Performance_monitoring_interrupts 983.75 ± 2% -86.7% 131.00 ± 6% interrupts.CPU42.RES:Rescheduling_interrupts 939.50 ± 29% -53.6% 435.75 ± 44% interrupts.CPU43.NMI:Non-maskable_interrupts 939.50 ± 29% -53.6% 435.75 ± 44% interrupts.CPU43.PMI:Performance_monitoring_interrupts 963.50 ± 3% -86.8% 126.75 ± 15% interrupts.CPU43.RES:Rescheduling_interrupts 27228 -33.3% 18149 ± 6% interrupts.CPU44.CAL:Function_call_interrupts 1334 ± 32% -67.4% 434.25 ± 40% interrupts.CPU44.NMI:Non-maskable_interrupts 1334 ± 32% -67.4% 434.25 ± 40% interrupts.CPU44.PMI:Performance_monitoring_interrupts 668.25 ± 8% -87.2% 85.75 ± 6% interrupts.CPU44.RES:Rescheduling_interrupts 20504 ± 6% -25.8% 15212 ± 2% interrupts.CPU45.CAL:Function_call_interrupts 869.75 ± 41% -62.5% 326.25 ± 43% interrupts.CPU45.NMI:Non-maskable_interrupts 869.75 ± 41% -62.5% 326.25 ± 43% interrupts.CPU45.PMI:Performance_monitoring_interrupts 654.75 ± 2% -89.5% 68.75 ± 12% interrupts.CPU45.RES:Rescheduling_interrupts 803.25 ± 15% -50.6% 397.00 ± 54% interrupts.CPU46.NMI:Non-maskable_interrupts 803.25 ± 15% -50.6% 397.00 ± 54% interrupts.CPU46.PMI:Performance_monitoring_interrupts 687.25 ± 10% -87.3% 87.25 ± 16% interrupts.CPU46.RES:Rescheduling_interrupts 1364 ± 15% -72.6% 374.50 ± 48% interrupts.CPU47.NMI:Non-maskable_interrupts 1364 ± 15% -72.6% 374.50 ± 48% interrupts.CPU47.PMI:Performance_monitoring_interrupts 688.75 ± 4% -84.4% 107.25 ± 16% interrupts.CPU47.RES:Rescheduling_interrupts 1290 ± 40% -70.4% 382.25 ± 51% interrupts.CPU48.NMI:Non-maskable_interrupts 1290 ± 40% -70.4% 382.25 ± 51% interrupts.CPU48.PMI:Performance_monitoring_interrupts 701.75 ± 5% -88.3% 82.25 ± 18% interrupts.CPU48.RES:Rescheduling_interrupts 1163 ± 31% -76.9% 268.50 ± 31% interrupts.CPU49.NMI:Non-maskable_interrupts 1163 ± 31% -76.9% 268.50 ± 31% interrupts.CPU49.PMI:Performance_monitoring_interrupts 704.75 ± 5% -88.6% 80.25 ± 6% interrupts.CPU49.RES:Rescheduling_interrupts 166242 ± 6% -13.7% 143496 ± 6% interrupts.CPU5.CAL:Function_call_interrupts 7461 ± 8% +25.9% 9396 ± 11% interrupts.CPU5.RES:Rescheduling_interrupts 706.25 ± 2% -88.1% 83.75 ± 15% interrupts.CPU50.RES:Rescheduling_interrupts 21177 ± 4% +11.3% 23562 ± 4% interrupts.CPU51.CAL:Function_call_interrupts 1075 ± 32% -63.1% 397.25 ± 46% interrupts.CPU51.NMI:Non-maskable_interrupts 1075 ± 32% -63.1% 397.25 ± 46% interrupts.CPU51.PMI:Performance_monitoring_interrupts 718.00 ± 5% -86.4% 97.50 ± 20% interrupts.CPU51.RES:Rescheduling_interrupts 680.75 ± 4% -86.7% 90.75 ± 22% interrupts.CPU52.RES:Rescheduling_interrupts 702.00 ± 5% -88.2% 83.00 ± 10% interrupts.CPU53.RES:Rescheduling_interrupts 1638 ± 39% -72.0% 458.25 ± 55% interrupts.CPU54.NMI:Non-maskable_interrupts 1638 ± 39% -72.0% 458.25 ± 55% interrupts.CPU54.PMI:Performance_monitoring_interrupts 388.75 ± 7% -86.9% 50.75 ± 7% interrupts.CPU54.RES:Rescheduling_interrupts 993.50 ± 26% -47.5% 521.50 ± 24% interrupts.CPU55.NMI:Non-maskable_interrupts 993.50 ± 26% -47.5% 521.50 ± 24% interrupts.CPU55.PMI:Performance_monitoring_interrupts 417.50 ± 7% -86.9% 54.75 ± 22% interrupts.CPU55.RES:Rescheduling_interrupts 1356 ± 22% -70.2% 404.00 ± 52% interrupts.CPU56.NMI:Non-maskable_interrupts 1356 ± 22% -70.2% 404.00 ± 52% interrupts.CPU56.PMI:Performance_monitoring_interrupts 394.50 ± 9% -87.8% 48.25 ± 11% interrupts.CPU56.RES:Rescheduling_interrupts 1213 ± 40% -64.4% 432.00 ± 43% interrupts.CPU57.NMI:Non-maskable_interrupts 1213 ± 40% -64.4% 432.00 ± 43% interrupts.CPU57.PMI:Performance_monitoring_interrupts 399.25 -85.0% 59.75 ± 20% interrupts.CPU57.RES:Rescheduling_interrupts 1067 ± 65% -72.4% 295.00 ± 57% interrupts.CPU58.NMI:Non-maskable_interrupts 1067 ± 65% -72.4% 295.00 ± 57% interrupts.CPU58.PMI:Performance_monitoring_interrupts 479.25 ± 2% -87.6% 59.25 ± 17% interrupts.CPU58.RES:Rescheduling_interrupts 1127 ± 41% -69.8% 341.00 ± 42% interrupts.CPU59.NMI:Non-maskable_interrupts 1127 ± 41% -69.8% 341.00 ± 42% interrupts.CPU59.PMI:Performance_monitoring_interrupts 437.25 ± 2% -88.3% 51.25 ± 32% interrupts.CPU59.RES:Rescheduling_interrupts 165868 ± 4% -11.1% 147461 ± 3% interrupts.CPU6.CAL:Function_call_interrupts 1195 ± 23% -67.7% 386.50 ± 61% interrupts.CPU6.NMI:Non-maskable_interrupts 1195 ± 23% -67.7% 386.50 ± 61% interrupts.CPU6.PMI:Performance_monitoring_interrupts 7147 ± 7% -30.6% 4959 ± 15% interrupts.CPU6.RES:Rescheduling_interrupts 111.75 ± 4% -28.6% 79.75 ± 27% interrupts.CPU6.TLB:TLB_shootdowns 1426 ± 21% -58.7% 589.00 ± 44% interrupts.CPU60.NMI:Non-maskable_interrupts 1426 ± 21% -58.7% 589.00 ± 44% interrupts.CPU60.PMI:Performance_monitoring_interrupts 410.25 ± 9% -88.0% 49.25 ± 10% interrupts.CPU60.RES:Rescheduling_interrupts 1022 ± 29% -68.2% 325.50 ± 43% interrupts.CPU61.NMI:Non-maskable_interrupts 1022 ± 29% -68.2% 325.50 ± 43% interrupts.CPU61.PMI:Performance_monitoring_interrupts 385.75 ± 8% -88.0% 46.25 ± 8% interrupts.CPU61.RES:Rescheduling_interrupts 12518 ± 11% -40.4% 7455 ± 29% interrupts.CPU62.CAL:Function_call_interrupts 1018 ± 20% -71.2% 293.00 ± 46% interrupts.CPU62.NMI:Non-maskable_interrupts 1018 ± 20% -71.2% 293.00 ± 46% interrupts.CPU62.PMI:Performance_monitoring_interrupts 207.25 ± 6% -82.8% 35.75 ± 13% interrupts.CPU62.RES:Rescheduling_interrupts 186.75 ± 3% -77.6% 41.75 ± 49% interrupts.CPU63.RES:Rescheduling_interrupts 7639 ± 3% -16.4% 6387 ± 11% interrupts.CPU64.CAL:Function_call_interrupts 194.00 ± 11% -86.1% 27.00 ± 4% interrupts.CPU64.RES:Rescheduling_interrupts 7523 ± 2% -16.6% 6277 ± 8% interrupts.CPU65.CAL:Function_call_interrupts 198.25 ± 12% -89.7% 20.50 ± 24% interrupts.CPU65.RES:Rescheduling_interrupts 7440 ± 11% -39.0% 4540 ± 26% interrupts.CPU66.CAL:Function_call_interrupts 201.50 ± 12% -90.8% 18.50 ± 9% interrupts.CPU66.RES:Rescheduling_interrupts 8240 ± 17% -43.8% 4631 ± 26% interrupts.CPU67.CAL:Function_call_interrupts 197.25 ± 14% -85.4% 28.75 ± 18% interrupts.CPU67.RES:Rescheduling_interrupts 181.75 ± 17% -84.2% 28.75 ± 27% interrupts.CPU68.RES:Rescheduling_interrupts 168.25 ± 19% -83.1% 28.50 ± 14% interrupts.CPU69.RES:Rescheduling_interrupts 161290 ± 3% -8.3% 147840 ± 5% interrupts.CPU7.CAL:Function_call_interrupts 705.75 ± 16% -54.2% 323.25 ± 9% interrupts.CPU7.NMI:Non-maskable_interrupts 705.75 ± 16% -54.2% 323.25 ± 9% interrupts.CPU7.PMI:Performance_monitoring_interrupts 7207 ± 8% -37.0% 4541 ± 10% interrupts.CPU7.RES:Rescheduling_interrupts 155.25 ± 24% -78.4% 33.50 ± 20% interrupts.CPU70.RES:Rescheduling_interrupts 132.00 ± 20% -77.5% 29.75 ± 23% interrupts.CPU71.RES:Rescheduling_interrupts 18308 ± 4% +12.9% 20662 ± 5% interrupts.CPU73.LOC:Local_timer_interrupts 3295 ± 17% -59.6% 1332 ± 14% interrupts.CPU8.RES:Rescheduling_interrupts 27403 ± 11% -14.1% 23549 ± 3% interrupts.CPU80.LOC:Local_timer_interrupts 26422 ± 2% +11.4% 29433 ± 7% interrupts.CPU89.LOC:Local_timer_interrupts 3387 ± 16% -64.7% 1194 ± 12% interrupts.CPU9.RES:Rescheduling_interrupts 63112 ± 9% -57.3% 26977 ± 21% interrupts.NMI:Non-maskable_interrupts 63112 ± 9% -57.3% 26977 ± 21% interrupts.PMI:Performance_monitoring_interrupts 196263 -39.9% 117875 ± 2% interrupts.RES:Rescheduling_interrupts 58.40 ± 4% -29.2 29.23 ± 35% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 58.38 ± 4% -29.2 29.22 ± 35% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 58.04 ± 4% -29.0 29.02 ± 35% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 58.01 ± 4% -29.0 29.00 ± 35% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 59.31 ± 4% -29.0 30.33 ± 35% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 58.76 ± 4% -28.9 29.88 ± 34% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 54.36 ± 4% -28.1 26.21 ± 34% perf-profile.calltrace.cycles-pp.btrfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open 39.06 ± 4% -23.6 15.48 ± 39% perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.btrfs_new_inode.btrfs_create.path_openat.do_filp_open 38.60 ± 4% -23.3 15.30 ± 39% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode.btrfs_create.path_openat 40.56 ± 4% -22.0 18.57 ± 30% perf-profile.calltrace.cycles-pp.btrfs_new_inode.btrfs_create.path_openat.do_filp_open.do_sys_openat2 12.21 ± 4% -12.2 0.00 perf-profile.calltrace.cycles-pp.btrfs_try_tree_write_lock.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode.btrfs_create 12.14 ± 4% -12.1 0.00 perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.btrfs_try_tree_write_lock.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode 11.54 ± 4% -11.5 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.btrfs_try_tree_write_lock.btrfs_search_slot.btrfs_insert_empty_items 11.54 ± 8% -11.5 0.00 perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode 10.81 ± 8% -10.8 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items 12.88 ± 8% -9.9 3.00 ± 22% perf-profile.calltrace.cycles-pp.__btrfs_commit_inode_delayed_items.btrfs_async_run_delayed_root.btrfs_work_helper.process_one_work.worker_thread 23.95 ± 5% -9.8 14.11 ± 38% perf-profile.calltrace.cycles-pp.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode.btrfs_create 12.14 ± 8% -9.8 2.36 ± 25% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_inode.__btrfs_update_delayed_inode.__btrfs_commit_inode_delayed_items.btrfs_async_run_delayed_root 12.14 ± 8% -9.8 2.38 ± 25% perf-profile.calltrace.cycles-pp.btrfs_lookup_inode.__btrfs_update_delayed_inode.__btrfs_commit_inode_delayed_items.btrfs_async_run_delayed_root.btrfs_work_helper 12.55 ± 8% -9.6 2.91 ± 23% perf-profile.calltrace.cycles-pp.__btrfs_update_delayed_inode.__btrfs_commit_inode_delayed_items.btrfs_async_run_delayed_root.btrfs_work_helper.process_one_work 13.85 ± 8% -9.4 4.47 ± 25% perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork 13.84 ± 8% -9.4 4.47 ± 26% perf-profile.calltrace.cycles-pp.btrfs_async_run_delayed_root.btrfs_work_helper.process_one_work.worker_thread.kthread 14.60 ± 8% -8.7 5.94 ± 19% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 14.62 ± 8% -8.6 5.99 ± 19% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 10.52 ± 3% -7.9 2.60 ± 46% perf-profile.calltrace.cycles-pp.insert_with_overflow.btrfs_insert_dir_item.btrfs_add_link.btrfs_create.path_openat 10.49 ± 3% -7.9 2.58 ± 46% perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.insert_with_overflow.btrfs_insert_dir_item.btrfs_add_link.btrfs_create 9.61 ± 3% -7.7 1.92 ± 45% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_insert_empty_items.insert_with_overflow.btrfs_insert_dir_item.btrfs_add_link 7.57 ± 5% -7.6 0.00 perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode 11.34 ± 3% -7.2 4.13 ± 49% perf-profile.calltrace.cycles-pp.btrfs_insert_dir_item.btrfs_add_link.btrfs_create.path_openat.do_filp_open 7.18 ± 5% -7.2 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items 7.11 ± 5% -7.1 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__btrfs_tree_lock.btrfs_search_slot 7.01 ± 2% -7.0 0.00 perf-profile.calltrace.cycles-pp.__btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_insert_empty_items.insert_with_overflow 7.01 ± 2% -7.0 0.00 perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_insert_empty_items.insert_with_overflow.btrfs_insert_dir_item 11.72 ± 3% -6.2 5.53 ± 55% perf-profile.calltrace.cycles-pp.btrfs_add_link.btrfs_create.path_openat.do_filp_open.do_sys_openat2 5.93 ± 9% -4.9 0.98 ± 70% perf-profile.calltrace.cycles-pp.__btrfs_tree_read_lock.btrfs_search_slot.btrfs_lookup_inode.__btrfs_update_delayed_inode.__btrfs_commit_inode_delayed_items 17.35 ± 8% -3.5 13.82 ± 6% perf-profile.calltrace.cycles-pp.ret_from_fork 17.35 ± 8% -3.5 13.82 ± 6% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 1.27 ± 18% -0.8 0.42 ±101% perf-profile.calltrace.cycles-pp.__btrfs_read_lock_root_node.btrfs_search_slot.btrfs_insert_empty_items.insert_with_overflow.btrfs_insert_dir_item 1.23 ± 20% -0.8 0.40 ±101% perf-profile.calltrace.cycles-pp.__btrfs_tree_read_lock.__btrfs_read_lock_root_node.btrfs_search_slot.btrfs_insert_empty_items.insert_with_overflow 0.00 +0.6 0.62 ± 13% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack 0.00 +0.6 0.63 ± 16% perf-profile.calltrace.cycles-pp._raw_spin_trylock.shrink_lock_dentry.shrink_dentry_list.prune_dcache_sb.super_cache_scan 0.47 ± 58% +0.8 1.31 ± 44% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +0.9 0.85 ± 24% perf-profile.calltrace.cycles-pp.list_lru_add.inode_lru_list_add.iput.__dentry_kill.shrink_dentry_list 0.00 +0.9 0.87 ± 24% perf-profile.calltrace.cycles-pp.inode_lru_list_add.iput.__dentry_kill.shrink_dentry_list.prune_dcache_sb 0.00 +0.9 0.90 ± 13% perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack 0.00 +0.9 0.90 ± 16% perf-profile.calltrace.cycles-pp.dentry_lru_isolate.__list_lru_walk_one.list_lru_walk_one.prune_dcache_sb.super_cache_scan 0.28 ±100% +0.9 1.19 ± 12% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 0.00 +0.9 0.94 ± 17% perf-profile.calltrace.cycles-pp.__list_lru_walk_one.list_lru_walk_one.prune_dcache_sb.super_cache_scan.do_shrink_slab 0.00 +0.9 0.94 ± 17% perf-profile.calltrace.cycles-pp.list_lru_walk_one.prune_dcache_sb.super_cache_scan.do_shrink_slab.shrink_slab 0.00 +0.9 0.94 ± 19% perf-profile.calltrace.cycles-pp.___d_drop.__d_drop.__dentry_kill.shrink_dentry_list.prune_dcache_sb 0.00 +0.9 0.95 ± 19% perf-profile.calltrace.cycles-pp.shrink_lock_dentry.shrink_dentry_list.prune_dcache_sb.super_cache_scan.do_shrink_slab 0.14 ±173% +0.9 1.08 ± 13% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu 0.00 +0.9 0.95 ± 19% perf-profile.calltrace.cycles-pp.__d_drop.__dentry_kill.shrink_dentry_list.prune_dcache_sb.super_cache_scan 0.22 ±173% +1.0 1.20 ± 33% perf-profile.calltrace.cycles-pp.btrfs_get_32.check_leaf.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio 0.00 +1.0 1.02 ± 23% perf-profile.calltrace.cycles-pp.btrfs_drop_extent_cache.btrfs_destroy_inode.destroy_inode.dispose_list.prune_icache_sb 0.80 ± 9% +1.1 1.91 ± 13% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.00 +1.1 1.14 ± 25% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack 0.26 ±173% +1.1 1.40 ± 33% perf-profile.calltrace.cycles-pp.check_dir_item.check_leaf.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio 0.94 ± 9% +1.2 2.12 ± 13% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt 0.40 ± 58% +1.2 1.59 ± 25% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt 0.94 ± 9% +1.2 2.13 ± 13% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.95 ± 9% +1.2 2.17 ± 13% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 0.00 +1.3 1.26 ± 26% perf-profile.calltrace.cycles-pp.__btrfs_release_delayed_node.btrfs_evict_inode.evict.dispose_list.prune_icache_sb 0.00 +1.3 1.33 ± 26% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 0.28 ±100% +1.3 1.62 ± 23% perf-profile.calltrace.cycles-pp.kmem_cache_free.rcu_do_batch.rcu_core.__softirqentry_text_start.run_ksoftirqd 0.46 ± 58% +1.5 1.92 ± 21% perf-profile.calltrace.cycles-pp.iput.__dentry_kill.shrink_dentry_list.prune_dcache_sb.super_cache_scan 1.12 ± 9% +1.5 2.65 ± 16% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.56 ± 58% +1.7 2.23 ± 21% perf-profile.calltrace.cycles-pp.rcu_do_batch.rcu_core.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn 0.56 ± 58% +1.7 2.25 ± 21% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn.kthread 0.78 ± 21% +1.7 2.50 ± 20% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork 0.94 ± 5% +1.7 2.68 ± 24% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 0.62 ± 59% +1.8 2.44 ± 21% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork 0.62 ± 58% +1.8 2.44 ± 21% perf-profile.calltrace.cycles-pp.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork 1.02 ± 5% +1.9 2.92 ± 23% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt 0.96 ± 26% +2.1 3.03 ± 25% perf-profile.calltrace.cycles-pp.btrfs_destroy_inode.destroy_inode.dispose_list.prune_icache_sb.super_cache_scan 0.81 ± 22% +2.1 2.93 ± 26% perf-profile.calltrace.cycles-pp.btrfs_evict_inode.evict.dispose_list.prune_icache_sb.super_cache_scan 1.81 ± 2% +2.3 4.13 ± 12% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 1.33 ± 9% +2.4 3.74 ± 25% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack 1.10 ± 25% +2.4 3.54 ± 26% perf-profile.calltrace.cycles-pp.destroy_inode.dispose_list.prune_icache_sb.super_cache_scan.do_shrink_slab 1.51 ± 63% +2.7 4.24 ± 32% perf-profile.calltrace.cycles-pp.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range 1.35 ± 14% +2.7 4.10 ± 20% perf-profile.calltrace.cycles-pp.__dentry_kill.shrink_dentry_list.prune_dcache_sb.super_cache_scan.do_shrink_slab 1.25 ± 80% +2.8 4.01 ± 28% perf-profile.calltrace.cycles-pp.check_leaf.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.submit_extent_page 1.58 ± 63% +2.8 4.43 ± 32% perf-profile.calltrace.cycles-pp.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents 1.30 ± 80% +2.9 4.16 ± 28% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.submit_extent_page.write_one_eb 1.15 ± 21% +2.9 4.04 ± 26% perf-profile.calltrace.cycles-pp.evict.dispose_list.prune_icache_sb.super_cache_scan.do_shrink_slab 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.transaction_kthread 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.calltrace.cycles-pp.btrfs_write_and_wait_transaction.btrfs_commit_transaction.transaction_kthread.kthread.ret_from_fork 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.transaction_kthread.kthread 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction 1.36 ± 80% +3.0 4.39 ± 27% perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages 1.36 ± 80% +3.0 4.39 ± 27% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages 1.90 ± 60% +3.3 5.20 ± 29% perf-profile.calltrace.cycles-pp.transaction_kthread.kthread.ret_from_fork 1.90 ± 60% +3.3 5.20 ± 29% perf-profile.calltrace.cycles-pp.btrfs_commit_transaction.transaction_kthread.kthread.ret_from_fork 2.09 ± 8% +3.8 5.86 ± 25% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt 1.88 ± 15% +3.8 5.71 ± 20% perf-profile.calltrace.cycles-pp.shrink_dentry_list.prune_dcache_sb.super_cache_scan.do_shrink_slab.shrink_slab 2.18 ± 15% +4.5 6.66 ± 19% perf-profile.calltrace.cycles-pp.prune_dcache_sb.super_cache_scan.do_shrink_slab.shrink_slab.drop_slab_node 2.97 ± 10% +5.5 8.45 ± 20% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 2.37 ± 23% +5.7 8.06 ± 26% perf-profile.calltrace.cycles-pp.dispose_list.prune_icache_sb.super_cache_scan.do_shrink_slab.shrink_slab 3.33 ± 10% +6.0 9.29 ± 25% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 2.56 ± 23% +6.1 8.66 ± 25% perf-profile.calltrace.cycles-pp.prune_icache_sb.super_cache_scan.do_shrink_slab.shrink_slab.drop_slab_node 3.50 ± 10% +6.2 9.73 ± 25% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 3.53 ± 10% +6.3 9.84 ± 25% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 5.45 ± 11% +9.1 14.58 ± 23% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 5.72 ± 11% +9.9 15.63 ± 24% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 4.74 ± 19% +10.6 15.33 ± 23% perf-profile.calltrace.cycles-pp.super_cache_scan.do_shrink_slab.shrink_slab.drop_slab_node.drop_slab 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.calltrace.cycles-pp.drop_slab.drop_caches_sysctl_handler.proc_sys_call_handler.new_sync_write.vfs_write 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.calltrace.cycles-pp.drop_slab_node.drop_slab.drop_caches_sysctl_handler.proc_sys_call_handler.new_sync_write 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.calltrace.cycles-pp.shrink_slab.drop_slab_node.drop_slab.drop_caches_sysctl_handler.proc_sys_call_handler 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.calltrace.cycles-pp.do_shrink_slab.shrink_slab.drop_slab_node.drop_slab.drop_caches_sysctl_handler 5.67 ± 21% +12.2 17.87 ± 24% perf-profile.calltrace.cycles-pp.proc_sys_call_handler.new_sync_write.vfs_write.ksys_write.do_syscall_64 5.67 ± 21% +12.2 17.87 ± 24% perf-profile.calltrace.cycles-pp.drop_caches_sysctl_handler.proc_sys_call_handler.new_sync_write.vfs_write.ksys_write 5.72 ± 21% +12.3 17.99 ± 24% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.72 ± 21% +12.3 18.00 ± 24% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 5.72 ± 21% +12.3 18.00 ± 24% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 5.72 ± 21% +12.3 18.00 ± 24% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 5.72 ± 21% +12.3 18.00 ± 24% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 5.73 ± 21% +12.3 18.02 ± 24% perf-profile.calltrace.cycles-pp.write 0.00 +13.3 13.27 ± 37% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_search_slot 0.00 +14.0 13.98 ± 38% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items 0.00 +14.1 14.08 ± 38% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_search_slot.btrfs_insert_empty_items.btrfs_new_inode 9.40 ± 10% +15.7 25.15 ± 21% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 9.62 ± 10% +16.1 25.75 ± 21% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 15.73 ± 5% +18.0 33.75 ± 15% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 15.76 ± 5% +18.1 33.82 ± 15% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify 15.76 ± 5% +18.1 33.82 ± 15% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 15.99 ± 5% +18.4 34.38 ± 15% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 53.31 ± 3% -46.2 7.08 ± 42% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 62.27 ± 4% -41.1 21.16 ± 36% perf-profile.children.cycles-pp.btrfs_search_slot 50.06 ± 4% -31.6 18.44 ± 39% perf-profile.children.cycles-pp.btrfs_insert_empty_items 58.46 ± 4% -29.1 29.38 ± 35% perf-profile.children.cycles-pp.do_sys_open 58.45 ± 4% -29.1 29.36 ± 35% perf-profile.children.cycles-pp.do_sys_openat2 58.10 ± 4% -28.9 29.18 ± 35% perf-profile.children.cycles-pp.do_filp_open 58.07 ± 4% -28.9 29.16 ± 35% perf-profile.children.cycles-pp.path_openat 54.36 ± 4% -28.1 26.22 ± 34% perf-profile.children.cycles-pp.btrfs_create 27.83 ± 3% -27.8 0.00 perf-profile.children.cycles-pp.queued_write_lock_slowpath 40.57 ± 4% -22.0 18.57 ± 30% perf-profile.children.cycles-pp.btrfs_new_inode 31.53 ± 4% -16.9 14.66 ± 37% perf-profile.children.cycles-pp.__btrfs_tree_lock 17.10 ± 5% -16.3 0.81 ± 13% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 65.59 ± 3% -15.9 49.73 ± 12% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 65.01 ± 2% -15.8 49.22 ± 11% perf-profile.children.cycles-pp.do_syscall_64 12.58 ± 4% -12.5 0.06 ± 34% perf-profile.children.cycles-pp.btrfs_try_tree_write_lock 11.61 ± 5% -11.6 0.00 perf-profile.children.cycles-pp.prepare_to_wait_event 13.37 ± 8% -10.0 3.40 ± 23% perf-profile.children.cycles-pp.__btrfs_commit_inode_delayed_items 12.15 ± 8% -9.8 2.38 ± 25% perf-profile.children.cycles-pp.btrfs_lookup_inode 9.67 ± 7% -9.7 0.00 perf-profile.children.cycles-pp.queued_read_lock_slowpath 12.56 ± 8% -9.6 2.92 ± 22% perf-profile.children.cycles-pp.__btrfs_update_delayed_inode 13.85 ± 8% -9.4 4.47 ± 26% perf-profile.children.cycles-pp.btrfs_async_run_delayed_root 13.85 ± 8% -9.4 4.47 ± 25% perf-profile.children.cycles-pp.btrfs_work_helper 14.60 ± 8% -8.7 5.94 ± 19% perf-profile.children.cycles-pp.process_one_work 14.62 ± 8% -8.6 5.99 ± 19% perf-profile.children.cycles-pp.worker_thread 10.52 ± 3% -7.9 2.60 ± 46% perf-profile.children.cycles-pp.insert_with_overflow 7.55 ± 2% -7.4 0.12 ± 47% perf-profile.children.cycles-pp.btrfs_lock_root_node 11.34 ± 3% -7.2 4.13 ± 49% perf-profile.children.cycles-pp.btrfs_insert_dir_item 11.72 ± 3% -6.2 5.53 ± 55% perf-profile.children.cycles-pp.btrfs_add_link 8.69 ± 7% -5.8 2.89 ± 38% perf-profile.children.cycles-pp.__btrfs_tree_read_lock 5.59 ± 6% -5.6 0.00 perf-profile.children.cycles-pp.finish_wait 17.35 ± 8% -3.5 13.82 ± 6% perf-profile.children.cycles-pp.kthread 17.36 ± 8% -3.5 13.83 ± 6% perf-profile.children.cycles-pp.ret_from_fork 0.80 ± 5% -0.7 0.12 ± 27% perf-profile.children.cycles-pp.__wake_up_common_lock 0.69 ± 5% -0.6 0.10 ± 33% perf-profile.children.cycles-pp.__wake_up_common 0.63 ± 6% -0.5 0.08 ± 40% perf-profile.children.cycles-pp.autoremove_wake_function 0.45 ± 13% -0.3 0.19 ± 73% perf-profile.children.cycles-pp.unwind_get_return_address 0.40 ± 13% -0.2 0.16 ± 72% perf-profile.children.cycles-pp.__kernel_text_address 0.37 ± 14% -0.2 0.14 ± 74% perf-profile.children.cycles-pp.kernel_text_address 1.13 ± 7% -0.2 0.93 ± 7% perf-profile.children.cycles-pp.pick_next_task_fair 0.69 ± 7% -0.2 0.49 ± 21% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.49 ± 12% -0.2 0.30 ± 52% perf-profile.children.cycles-pp.btrfs_get_token_32 0.38 ± 9% -0.2 0.21 ± 54% perf-profile.children.cycles-pp.__sysvec_call_function_single 0.25 ± 26% -0.1 0.11 ± 85% perf-profile.children.cycles-pp.__module_address 0.19 ± 20% -0.1 0.07 ±116% perf-profile.children.cycles-pp.__module_text_address 0.14 ± 7% -0.1 0.04 ±107% perf-profile.children.cycles-pp.btrfs_tree_read_unlock 0.24 ± 6% -0.1 0.17 ± 22% perf-profile.children.cycles-pp.__list_add_valid 0.13 ± 9% -0.1 0.07 ± 70% perf-profile.children.cycles-pp.inode_permission 0.10 ± 11% -0.1 0.04 ±101% perf-profile.children.cycles-pp.btrfs_alloc_delayed_item 0.15 ± 7% -0.1 0.10 ± 40% perf-profile.children.cycles-pp.push_leaf_left 0.10 ± 8% -0.1 0.04 ±100% perf-profile.children.cycles-pp.send_call_function_single_ipi 0.09 ± 13% -0.1 0.04 ±102% perf-profile.children.cycles-pp.flush_smp_call_function_queue 0.08 -0.1 0.03 ±100% perf-profile.children.cycles-pp.btrfs_init_acl 0.08 ± 5% -0.0 0.04 ±100% perf-profile.children.cycles-pp.btrfs_init_inode_security 0.11 ± 4% -0.0 0.06 ± 62% perf-profile.children.cycles-pp.copy_pages 0.06 ± 6% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.rcu_all_qs 0.10 ± 8% +0.0 0.14 ± 11% perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.04 ± 57% +0.0 0.07 ± 17% perf-profile.children.cycles-pp.select_task_rq_fair 0.06 ± 15% +0.0 0.09 ± 13% perf-profile.children.cycles-pp.__mod_memcg_state 0.04 ± 59% +0.0 0.08 ± 13% perf-profile.children.cycles-pp.note_gp_changes 0.07 ± 10% +0.0 0.11 ± 26% perf-profile.children.cycles-pp.update_dl_rq_load_avg 0.14 ± 11% +0.0 0.18 ± 16% perf-profile.children.cycles-pp.cpumask_next_and 0.06 ± 20% +0.0 0.11 ± 17% perf-profile.children.cycles-pp.rcu_needs_cpu 0.03 ±100% +0.1 0.08 ± 26% perf-profile.children.cycles-pp.pm_qos_read_value 0.06 ± 13% +0.1 0.12 ± 24% perf-profile.children.cycles-pp.update_ts_time_stats 0.06 +0.1 0.11 ± 17% perf-profile.children.cycles-pp.get_cpu_device 0.03 ±100% +0.1 0.08 ± 17% perf-profile.children.cycles-pp.kfree 0.09 ± 13% +0.1 0.15 ± 17% perf-profile.children.cycles-pp.rb_next 0.12 ± 8% +0.1 0.18 ± 9% perf-profile.children.cycles-pp._cond_resched 0.06 ± 20% +0.1 0.12 ± 15% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.03 ±100% +0.1 0.09 ± 16% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter 0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.blk_flush_plug_list 0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.blk_mq_flush_plug_list 0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.blk_mq_sched_insert_requests 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.perf_read 0.03 ±100% +0.1 0.09 ± 24% perf-profile.children.cycles-pp.x86_pmu_disable 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.__x86_retpoline_rsi 0.01 ±173% +0.1 0.07 ± 26% perf-profile.children.cycles-pp.run_timer_softirq 0.06 ± 60% +0.1 0.12 ± 10% perf-profile.children.cycles-pp.update_rt_rq_load_avg 0.04 ± 58% +0.1 0.10 ± 19% perf-profile.children.cycles-pp.hrtimer_forward 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.pagevec_move_tail 0.06 ± 26% +0.1 0.13 ± 15% perf-profile.children.cycles-pp.__libc_read 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__free_slab 0.00 +0.1 0.07 ± 39% perf-profile.children.cycles-pp.propagate_protected_usage 0.00 +0.1 0.07 ± 31% perf-profile.children.cycles-pp.free_one_page 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.sched_clock_idle_wakeup_event 0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.call_timer_fn 0.06 ± 14% +0.1 0.12 ± 20% perf-profile.children.cycles-pp.can_stop_idle_tick 0.01 ±173% +0.1 0.08 ± 43% perf-profile.children.cycles-pp.btrfs_get_8 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.dup_mmap 0.04 ± 58% +0.1 0.11 ± 45% perf-profile.children.cycles-pp.pipe_write 0.06 ± 7% +0.1 0.13 ± 20% perf-profile.children.cycles-pp.rcu_eqs_exit 0.04 ± 60% +0.1 0.11 ± 13% perf-profile.children.cycles-pp.seq_read_iter 0.01 ±173% +0.1 0.08 ± 17% perf-profile.children.cycles-pp.local_touch_nmi 0.15 ± 4% +0.1 0.22 ± 5% perf-profile.children.cycles-pp.rb_insert_color 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.__lookup_extent_mapping 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.dup_mm 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__dput_to_list 0.01 ±173% +0.1 0.09 ± 21% perf-profile.children.cycles-pp.rotate_reclaimable_page 0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.profile_tick 0.02 ±173% +0.1 0.10 ± 18% perf-profile.children.cycles-pp.perf_evsel__read 0.14 ± 5% +0.1 0.22 ± 15% perf-profile.children.cycles-pp.__might_sleep 0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.call_cpuidle 0.07 ± 22% +0.1 0.15 ± 14% perf-profile.children.cycles-pp.run_local_timers 0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.tlb_finish_mmu 0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.irq_work_needs_cpu 0.06 ± 14% +0.1 0.14 ± 12% perf-profile.children.cycles-pp.nr_iowait_cpu 0.06 ± 11% +0.1 0.14 ± 20% perf-profile.children.cycles-pp.rcu_nmi_enter 0.06 ± 14% +0.1 0.14 ± 31% perf-profile.children.cycles-pp.tick_check_broadcast_expired 0.03 ±100% +0.1 0.11 ± 28% perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu 0.03 ±100% +0.1 0.11 ± 12% perf-profile.children.cycles-pp.cpuidle_not_available 0.07 ± 11% +0.1 0.16 ± 22% perf-profile.children.cycles-pp.mmap_region 0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.up_read 0.01 ±173% +0.1 0.10 ± 28% perf-profile.children.cycles-pp.sched_setaffinity 0.01 ±173% +0.1 0.10 ± 28% perf-profile.children.cycles-pp.tick_nohz_idle_got_tick 0.06 ± 20% +0.1 0.14 ± 41% perf-profile.children.cycles-pp.setlocale 0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.__radix_tree_delete 0.05 +0.1 0.14 ± 33% perf-profile.children.cycles-pp.begin_new_exec 0.00 +0.1 0.09 ± 26% perf-profile.children.cycles-pp.tlb_flush_mmu 0.12 ± 5% +0.1 0.21 ± 5% perf-profile.children.cycles-pp.memset_erms 0.03 ±100% +0.1 0.11 ± 18% perf-profile.children.cycles-pp.tick_nohz_tick_stopped 0.03 ±100% +0.1 0.11 ± 25% perf-profile.children.cycles-pp.__etree_search 0.00 +0.1 0.09 ± 32% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.free_extent_map 0.02 ±173% +0.1 0.11 ± 41% perf-profile.children.cycles-pp.test_clear_page_writeback 0.03 ±100% +0.1 0.11 ± 37% perf-profile.children.cycles-pp.intel_pmu_disable_all 0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.__do_munmap 0.01 ±173% +0.1 0.10 ± 18% perf-profile.children.cycles-pp.rcu_segcblist_enqueue 0.03 ±100% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.rcu_gp_kthread 0.08 ± 8% +0.1 0.17 ± 22% perf-profile.children.cycles-pp.ksys_mmap_pgoff 0.03 ±100% +0.1 0.12 ± 14% perf-profile.children.cycles-pp._atomic_dec_and_lock 0.07 ± 11% +0.1 0.17 ± 23% perf-profile.children.cycles-pp.perf_event_task_tick 0.03 ±102% +0.1 0.13 ± 14% perf-profile.children.cycles-pp.rcu_nocb_try_bypass 0.03 ±100% +0.1 0.12 ± 26% perf-profile.children.cycles-pp.zap_pte_range 0.04 ± 58% +0.1 0.14 ± 18% perf-profile.children.cycles-pp.copy_process 0.07 ± 5% +0.1 0.17 ± 35% perf-profile.children.cycles-pp.do_fault 0.08 ± 6% +0.1 0.18 ± 21% perf-profile.children.cycles-pp.trigger_load_balance 0.09 ± 12% +0.1 0.19 ± 20% perf-profile.children.cycles-pp.do_mmap 0.03 ±100% +0.1 0.13 ± 20% perf-profile.children.cycles-pp.__free_pages_ok 0.11 ± 6% +0.1 0.21 ± 21% perf-profile.children.cycles-pp.rcu_eqs_enter 0.07 ± 16% +0.1 0.17 ± 18% perf-profile.children.cycles-pp.run_posix_cpu_timers 0.10 ± 21% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.cmd_stat 0.10 ± 21% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.__run_perf_stat 0.10 ± 21% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.dispatch_events 0.10 ± 18% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.process_interval 0.05 ± 62% +0.1 0.15 ± 18% perf-profile.children.cycles-pp.new_sync_read 0.07 ± 7% +0.1 0.17 ± 31% perf-profile.children.cycles-pp.__wake_up_bit 0.02 ±173% +0.1 0.12 ± 36% perf-profile.children.cycles-pp.__test_set_page_writeback 0.10 ± 22% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.read_counters 0.03 ±100% +0.1 0.13 ± 20% perf-profile.children.cycles-pp.__memcg_kmem_uncharge 0.00 +0.1 0.11 ± 42% perf-profile.children.cycles-pp.rwsem_mark_wake 0.11 ± 22% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.__libc_start_main 0.06 ± 11% +0.1 0.17 ± 17% perf-profile.children.cycles-pp.kernel_clone 0.00 +0.1 0.11 ± 30% perf-profile.children.cycles-pp.down_read 0.10 ± 9% +0.1 0.20 ± 22% perf-profile.children.cycles-pp.vm_mmap_pgoff 0.03 ±100% +0.1 0.14 ± 27% perf-profile.children.cycles-pp.unmap_page_range 0.00 +0.1 0.11 ± 26% perf-profile.children.cycles-pp.tick_sched_do_timer 0.10 ± 21% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.main 0.10 ± 21% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.run_builtin 0.22 ± 6% +0.1 0.33 ± 29% perf-profile.children.cycles-pp.idle_cpu 0.07 ± 10% +0.1 0.18 ± 10% perf-profile.children.cycles-pp.irqentry_exit 0.06 ± 7% +0.1 0.17 ± 17% perf-profile.children.cycles-pp.__do_sys_clone 0.06 ± 66% +0.1 0.17 ± 21% perf-profile.children.cycles-pp.release_pages 0.01 ±173% +0.1 0.12 ± 37% perf-profile.children.cycles-pp.clear_inode 0.04 ± 59% +0.1 0.16 ± 23% perf-profile.children.cycles-pp.truncate_inode_pages_final 0.01 ±173% +0.1 0.13 ± 15% perf-profile.children.cycles-pp.rcu_nmi_exit 0.02 ±173% +0.1 0.13 ± 18% perf-profile.children.cycles-pp.blk_mq_submit_bio 0.10 ± 7% +0.1 0.22 ± 16% perf-profile.children.cycles-pp.irqentry_enter 0.07 ± 60% +0.1 0.18 ± 21% perf-profile.children.cycles-pp.btrfs_lookup_first_ordered_extent 0.03 ±100% +0.1 0.15 ± 25% perf-profile.children.cycles-pp.unmap_vmas 0.04 ± 59% +0.1 0.17 ± 23% perf-profile.children.cycles-pp.page_counter_cancel 0.06 ± 16% +0.1 0.18 ± 20% perf-profile.children.cycles-pp.page_counter_uncharge 0.12 ± 12% +0.1 0.24 ± 22% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.11 ± 13% +0.1 0.23 ± 22% perf-profile.children.cycles-pp.native_apic_msr_eoi_write 0.05 ± 63% +0.1 0.18 ± 36% perf-profile.children.cycles-pp.deactivate_file_page 0.08 ± 10% +0.1 0.21 ± 21% perf-profile.children.cycles-pp.__libc_fork 0.02 ±173% +0.1 0.15 ± 21% perf-profile.children.cycles-pp.submit_bio_noacct 0.02 ±173% +0.1 0.15 ± 23% perf-profile.children.cycles-pp.submit_bio 0.10 ± 11% +0.1 0.23 ± 29% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.07 ± 26% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.irqtime_account_process_tick 0.10 ± 28% +0.1 0.23 ± 9% perf-profile.children.cycles-pp.list_lru_isolate_move 0.00 +0.1 0.14 ± 24% perf-profile.children.cycles-pp.inode_wait_for_writeback 0.14 ± 8% +0.1 0.28 ± 12% perf-profile.children.cycles-pp.__x86_retpoline_rax 0.05 ± 59% +0.1 0.20 ± 48% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.12 ± 15% +0.2 0.27 ± 20% perf-profile.children.cycles-pp.read 0.06 ± 80% +0.2 0.21 ± 27% perf-profile.children.cycles-pp.end_page_writeback 0.07 ± 72% +0.2 0.22 ± 27% perf-profile.children.cycles-pp.btrfs_get_16 0.07 ± 14% +0.2 0.23 ± 20% perf-profile.children.cycles-pp.drain_obj_stock 0.11 ± 4% +0.2 0.28 ± 7% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.12 ± 12% +0.2 0.28 ± 16% perf-profile.children.cycles-pp.rcu_idle_exit 0.10 ± 14% +0.2 0.27 ± 26% perf-profile.children.cycles-pp.load_elf_binary 0.17 ± 13% +0.2 0.33 ± 15% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 0.12 ± 5% +0.2 0.29 ± 18% perf-profile.children.cycles-pp.native_irq_return_iret 0.09 ± 13% +0.2 0.26 ± 28% perf-profile.children.cycles-pp.menu_reflect 0.01 ±173% +0.2 0.18 ± 25% perf-profile.children.cycles-pp.d_shrink_del 0.10 ± 17% +0.2 0.28 ± 25% perf-profile.children.cycles-pp.exec_binprm 0.06 ± 74% +0.2 0.23 ± 15% perf-profile.children.cycles-pp.btrfs_map_bio 0.04 ± 58% +0.2 0.22 ± 39% perf-profile.children.cycles-pp.fsnotify_grab_connector 0.14 ± 7% +0.2 0.32 ± 27% perf-profile.children.cycles-pp.__hrtimer_get_next_event 0.14 ± 19% +0.2 0.32 ± 11% perf-profile.children.cycles-pp.serial8250_console_putchar 0.15 ± 7% +0.2 0.33 ± 13% perf-profile.children.cycles-pp.timerqueue_add 0.07 ± 76% +0.2 0.25 ± 28% perf-profile.children.cycles-pp.end_bio_extent_buffer_writepage 0.10 ± 5% +0.2 0.28 ± 27% perf-profile.children.cycles-pp.__x64_sys_exit_group 0.10 ± 5% +0.2 0.28 ± 27% perf-profile.children.cycles-pp.do_group_exit 0.10 ± 5% +0.2 0.28 ± 27% perf-profile.children.cycles-pp.do_exit 0.10 ± 18% +0.2 0.28 ± 18% perf-profile.children.cycles-pp.radix_tree_delete_item 0.14 ± 19% +0.2 0.32 ± 11% perf-profile.children.cycles-pp.wait_for_xmitr 0.17 ± 9% +0.2 0.35 ± 27% perf-profile.children.cycles-pp.lapic_next_deadline 0.14 ± 18% +0.2 0.33 ± 11% perf-profile.children.cycles-pp.uart_console_write 0.12 ± 22% +0.2 0.31 ± 25% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.15 ± 16% +0.2 0.34 ± 19% perf-profile.children.cycles-pp.vfs_read 0.17 ± 16% +0.2 0.36 ± 19% perf-profile.children.cycles-pp.ksys_read 0.23 ± 10% +0.2 0.42 ± 13% perf-profile.children.cycles-pp.mutex_lock 0.14 ± 18% +0.2 0.34 ± 11% perf-profile.children.cycles-pp.serial8250_console_write 0.07 ± 76% +0.2 0.27 ± 27% perf-profile.children.cycles-pp.btrfs_end_bio 0.12 ± 15% +0.2 0.32 ± 26% perf-profile.children.cycles-pp.bprm_execve 0.23 ± 7% +0.2 0.43 ± 23% perf-profile.children.cycles-pp.update_irq_load_avg 0.14 ± 7% +0.2 0.34 ± 12% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.04 ±107% +0.2 0.24 ± 50% perf-profile.children.cycles-pp.calc_global_load_tick 0.06 ± 58% +0.2 0.26 ± 34% perf-profile.children.cycles-pp.fsnotify_destroy_marks 0.15 ± 12% +0.2 0.35 ± 19% perf-profile.children.cycles-pp.io_serial_in 0.11 ± 4% +0.2 0.32 ± 23% perf-profile.children.cycles-pp.exit_mmap 0.08 ± 71% +0.2 0.29 ± 28% perf-profile.children.cycles-pp.blk_update_request 0.13 ± 16% +0.2 0.34 ± 28% perf-profile.children.cycles-pp.dentry_unlink_inode 0.16 ± 4% +0.2 0.38 ± 34% perf-profile.children.cycles-pp.__handle_mm_fault 0.08 ± 75% +0.2 0.31 ± 29% perf-profile.children.cycles-pp.scsi_io_completion 0.08 ± 75% +0.2 0.31 ± 29% perf-profile.children.cycles-pp.scsi_end_request 0.11 ± 4% +0.2 0.33 ± 27% perf-profile.children.cycles-pp.mmput 0.09 ± 72% +0.2 0.32 ± 29% perf-profile.children.cycles-pp.blk_done_softirq 0.27 ± 5% +0.2 0.50 ± 9% perf-profile.children.cycles-pp.___might_sleep 0.20 ± 5% +0.2 0.42 ± 14% perf-profile.children.cycles-pp.enqueue_hrtimer 0.17 ± 4% +0.2 0.40 ± 32% perf-profile.children.cycles-pp.handle_mm_fault 0.11 ± 25% +0.2 0.34 ± 26% perf-profile.children.cycles-pp.__remove_inode_hash 0.35 ± 8% +0.2 0.59 ± 12% perf-profile.children.cycles-pp.update_blocked_averages 0.14 ± 16% +0.2 0.38 ± 26% perf-profile.children.cycles-pp.execve 0.17 ± 13% +0.2 0.42 ± 22% perf-profile.children.cycles-pp.timerqueue_del 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.memcpy_toio 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.drm_fb_memcpy_dstclip 0.15 ± 18% +0.2 0.40 ± 26% perf-profile.children.cycles-pp.__x64_sys_execve 0.20 ± 14% +0.2 0.45 ± 15% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.15 ± 18% +0.2 0.40 ± 27% perf-profile.children.cycles-pp.do_execveat_common 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.drm_atomic_helper_commit 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.commit_tail 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.drm_atomic_helper_commit_tail 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.drm_atomic_helper_commit_planes 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.mgag200_simple_display_pipe_update 0.18 ± 15% +0.2 0.43 ± 24% perf-profile.children.cycles-pp.mgag200_handle_damage 0.18 ± 15% +0.3 0.44 ± 24% perf-profile.children.cycles-pp.drm_atomic_helper_dirtyfb 0.20 ± 5% +0.3 0.46 ± 27% perf-profile.children.cycles-pp.asm_exc_page_fault 0.10 ± 22% +0.3 0.35 ± 16% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.19 ± 5% +0.3 0.45 ± 29% perf-profile.children.cycles-pp.exc_page_fault 0.20 ± 13% +0.3 0.46 ± 23% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.19 ± 4% +0.3 0.45 ± 29% perf-profile.children.cycles-pp.do_user_addr_fault 0.16 ± 17% +0.3 0.42 ± 22% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.34 ± 7% +0.3 0.61 ± 13% perf-profile.children.cycles-pp.run_rebalance_domains 0.16 ± 21% +0.3 0.43 ± 28% perf-profile.children.cycles-pp.__slab_free 0.21 ± 12% +0.3 0.49 ± 17% perf-profile.children.cycles-pp.console_unlock 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.asm_sysvec_irq_work 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.sysvec_irq_work 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.__sysvec_irq_work 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.irq_work_run 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.irq_work_single 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.printk 0.22 ± 13% +0.3 0.50 ± 17% perf-profile.children.cycles-pp.vprintk_emit 0.17 ± 37% +0.3 0.45 ± 13% perf-profile.children.cycles-pp.btrfs_run_delayed_refs_for_head 0.13 ± 31% +0.3 0.42 ± 24% perf-profile.children.cycles-pp.alloc_extent_state 0.22 ± 5% +0.3 0.51 ± 13% perf-profile.children.cycles-pp.read_tsc 0.89 ± 2% +0.3 1.19 ± 10% perf-profile.children.cycles-pp.update_sd_lb_stats 0.24 ± 12% +0.3 0.54 ± 16% perf-profile.children.cycles-pp.irq_work_run_list 0.11 ± 21% +0.3 0.41 ± 32% perf-profile.children.cycles-pp.__destroy_inode 0.20 ± 18% +0.3 0.51 ± 28% perf-profile.children.cycles-pp.drm_fb_helper_dirty_work 0.19 ± 62% +0.3 0.51 ± 23% perf-profile.children.cycles-pp.check_inode_key 0.23 ± 11% +0.3 0.54 ± 24% perf-profile.children.cycles-pp.__remove_hrtimer 0.24 ± 8% +0.3 0.56 ± 16% perf-profile.children.cycles-pp.irqtime_account_irq 0.20 ± 15% +0.3 0.52 ± 19% perf-profile.children.cycles-pp.rb_erase 0.47 ± 5% +0.3 0.79 ± 15% perf-profile.children.cycles-pp.update_rq_clock 0.13 ± 21% +0.3 0.46 ± 16% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.92 ± 2% +0.3 1.25 ± 10% perf-profile.children.cycles-pp.find_busiest_group 0.23 ± 38% +0.3 0.56 ± 32% perf-profile.children.cycles-pp.start_kernel 0.00 +0.3 0.34 ± 45% perf-profile.children.cycles-pp.wake_up_q 0.26 ± 7% +0.3 0.59 ± 20% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.24 ± 36% +0.4 0.59 ± 14% perf-profile.children.cycles-pp.btrfs_run_delayed_refs 0.23 ± 35% +0.4 0.59 ± 14% perf-profile.children.cycles-pp.__btrfs_run_delayed_refs 0.18 ± 23% +0.4 0.55 ± 16% perf-profile.children.cycles-pp.rcu_cblist_dequeue 0.18 ± 21% +0.4 0.54 ± 16% perf-profile.children.cycles-pp.refill_obj_stock 0.32 ± 7% +0.4 0.69 ± 11% perf-profile.children.cycles-pp.native_sched_clock 0.12 ± 10% +0.4 0.49 ± 26% perf-profile.children.cycles-pp.mem_cgroup_from_obj 0.33 ± 7% +0.4 0.71 ± 11% perf-profile.children.cycles-pp.sched_clock 0.20 ± 31% +0.4 0.58 ± 25% perf-profile.children.cycles-pp.clear_record_extent_bits 0.17 ± 15% +0.4 0.55 ± 17% perf-profile.children.cycles-pp.inode_lru_isolate 0.18 ± 28% +0.4 0.58 ± 24% perf-profile.children.cycles-pp.alloc_extent_map 0.00 +0.4 0.41 ± 44% perf-profile.children.cycles-pp.rwsem_wake 0.16 ± 21% +0.4 0.57 ± 28% perf-profile.children.cycles-pp.clear_extent_bit 0.27 ± 14% +0.4 0.68 ± 16% perf-profile.children.cycles-pp.call_rcu 0.17 ± 20% +0.4 0.61 ± 27% perf-profile.children.cycles-pp.btrfs_inode_clear_file_extent_range 0.36 ± 5% +0.5 0.82 ± 18% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 1.14 ± 3% +0.5 1.60 ± 11% perf-profile.children.cycles-pp.load_balance 0.23 ± 29% +0.5 0.70 ± 27% perf-profile.children.cycles-pp.btrfs_qgroup_check_reserved_leak 0.41 ± 7% +0.5 0.88 ± 16% perf-profile.children.cycles-pp.sched_clock_cpu 0.21 ± 16% +0.5 0.70 ± 19% perf-profile.children.cycles-pp.btrfs_drop_inode 0.46 ± 9% +0.5 0.96 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid 1.12 ± 3% +0.5 1.62 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc 0.36 ± 16% +0.6 0.94 ± 19% perf-profile.children.cycles-pp.___d_drop 0.36 ± 17% +0.6 0.96 ± 19% perf-profile.children.cycles-pp.__d_drop 0.53 ± 13% +0.6 1.14 ± 12% perf-profile.children.cycles-pp.rebalance_domains 0.29 ± 14% +0.6 0.91 ± 16% perf-profile.children.cycles-pp.dentry_lru_isolate 0.33 ± 6% +0.6 0.97 ± 15% perf-profile.children.cycles-pp.list_lru_add 0.23 ± 14% +0.6 0.87 ± 24% perf-profile.children.cycles-pp.inode_lru_list_add 0.30 ± 19% +0.7 0.95 ± 19% perf-profile.children.cycles-pp.shrink_lock_dentry 0.52 ± 42% +0.7 1.20 ± 19% perf-profile.children.cycles-pp.read_extent_buffer 0.32 ± 28% +0.7 1.03 ± 24% perf-profile.children.cycles-pp.btrfs_drop_extent_cache 0.53 ± 8% +0.8 1.29 ± 13% perf-profile.children.cycles-pp.tick_nohz_next_event 0.34 ± 24% +0.8 1.11 ± 26% perf-profile.children.cycles-pp.__clear_extent_bit 0.62 ± 25% +0.8 1.42 ± 40% perf-profile.children.cycles-pp.irq_enter_rcu 0.38 ± 13% +0.8 1.23 ± 16% perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.9 0.85 ± 50% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.83 ± 2% +0.9 1.77 ± 20% perf-profile.children.cycles-pp.scheduler_tick 0.71 ± 38% +1.0 1.67 ± 22% perf-profile.children.cycles-pp.btrfs_get_32 0.54 ± 57% +1.0 1.54 ± 28% perf-profile.children.cycles-pp.check_dir_item 0.48 ± 13% +1.1 1.53 ± 17% perf-profile.children.cycles-pp.__list_lru_walk_one 0.48 ± 13% +1.1 1.54 ± 17% perf-profile.children.cycles-pp.list_lru_walk_one 0.63 ± 3% +1.1 1.69 ± 24% perf-profile.children.cycles-pp.clockevents_program_event 0.81 ± 9% +1.1 1.96 ± 13% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.57 ± 14% +1.3 1.92 ± 21% perf-profile.children.cycles-pp.iput 1.56 ± 9% +1.5 3.10 ± 14% perf-profile.children.cycles-pp.do_softirq_own_stack 1.11 ± 18% +1.7 2.79 ± 31% perf-profile.children.cycles-pp.ktime_get 0.74 ± 22% +1.7 2.44 ± 21% perf-profile.children.cycles-pp.run_ksoftirqd 0.78 ± 21% +1.7 2.50 ± 20% perf-profile.children.cycles-pp.smpboot_thread_fn 1.57 ± 3% +1.8 3.38 ± 19% perf-profile.children.cycles-pp.update_process_times 1.81 ± 7% +1.9 3.68 ± 15% perf-profile.children.cycles-pp.irq_exit_rcu 1.68 ± 3% +2.0 3.65 ± 18% perf-profile.children.cycles-pp.tick_sched_handle 0.99 ± 17% +2.0 2.98 ± 20% perf-profile.children.cycles-pp.rcu_do_batch 1.13 ± 14% +2.0 3.14 ± 19% perf-profile.children.cycles-pp.rcu_core 0.96 ± 25% +2.1 3.04 ± 25% perf-profile.children.cycles-pp.btrfs_destroy_inode 1.11 ± 16% +2.1 3.21 ± 20% perf-profile.children.cycles-pp.kmem_cache_free 0.81 ± 22% +2.1 2.94 ± 26% perf-profile.children.cycles-pp.btrfs_evict_inode 1.85 ± 2% +2.4 4.25 ± 12% perf-profile.children.cycles-pp.menu_select 1.10 ± 25% +2.4 3.54 ± 25% perf-profile.children.cycles-pp.destroy_inode 2.08 ± 6% +2.5 4.58 ± 21% perf-profile.children.cycles-pp.tick_sched_timer 1.47 ± 57% +2.7 4.17 ± 25% perf-profile.children.cycles-pp.check_leaf 1.49 ± 57% +2.7 4.23 ± 25% perf-profile.children.cycles-pp.btree_csum_one_bio 1.37 ± 14% +2.8 4.12 ± 20% perf-profile.children.cycles-pp.__dentry_kill 0.00 +2.8 2.77 ± 39% perf-profile.children.cycles-pp.rwsem_down_read_slowpath 1.56 ± 57% +2.9 4.46 ± 25% perf-profile.children.cycles-pp.btrfs_submit_metadata_bio 1.56 ± 57% +2.9 4.47 ± 25% perf-profile.children.cycles-pp.submit_one_bio 1.15 ± 21% +2.9 4.06 ± 26% perf-profile.children.cycles-pp.evict 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.children.cycles-pp.btrfs_write_marked_extents 1.64 ± 63% +3.0 4.60 ± 32% perf-profile.children.cycles-pp.__filemap_fdatawrite_range 1.59 ± 57% +3.0 4.57 ± 24% perf-profile.children.cycles-pp.submit_extent_page 1.67 ± 57% +3.1 4.79 ± 24% perf-profile.children.cycles-pp.write_one_eb 2.28 ± 13% +3.2 5.49 ± 16% perf-profile.children.cycles-pp.__softirqentry_text_start 1.73 ± 56% +3.2 4.96 ± 24% perf-profile.children.cycles-pp.btree_write_cache_pages 1.73 ± 56% +3.2 4.96 ± 24% perf-profile.children.cycles-pp.do_writepages 1.90 ± 60% +3.3 5.20 ± 29% perf-profile.children.cycles-pp.transaction_kthread 1.90 ± 60% +3.3 5.20 ± 29% perf-profile.children.cycles-pp.btrfs_commit_transaction 1.19 ± 7% +3.6 4.75 ± 49% perf-profile.children.cycles-pp.__btrfs_release_delayed_node 1.88 ± 15% +3.8 5.72 ± 20% perf-profile.children.cycles-pp.shrink_dentry_list 3.18 ± 6% +3.9 7.07 ± 21% perf-profile.children.cycles-pp.__hrtimer_run_queues 2.18 ± 15% +4.5 6.66 ± 19% perf-profile.children.cycles-pp.prune_dcache_sb 2.99 ± 10% +5.5 8.51 ± 20% perf-profile.children.cycles-pp.intel_idle 2.37 ± 23% +5.7 8.07 ± 26% perf-profile.children.cycles-pp.dispose_list 4.75 ± 7% +6.1 10.82 ± 23% perf-profile.children.cycles-pp.hrtimer_interrupt 2.56 ± 23% +6.1 8.66 ± 25% perf-profile.children.cycles-pp.prune_icache_sb 4.96 ± 7% +6.3 11.31 ± 22% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 2.52 ± 11% +6.6 9.11 ± 31% perf-profile.children.cycles-pp._raw_spin_lock 7.09 ± 7% +8.0 15.13 ± 19% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack 7.68 ± 8% +9.5 17.19 ± 21% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 8.17 ± 9% +10.2 18.41 ± 20% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 4.74 ± 19% +10.6 15.33 ± 23% perf-profile.children.cycles-pp.super_cache_scan 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.children.cycles-pp.drop_slab 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.children.cycles-pp.drop_slab_node 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.children.cycles-pp.shrink_slab 4.74 ± 19% +10.6 15.34 ± 23% perf-profile.children.cycles-pp.do_shrink_slab 5.67 ± 21% +12.2 17.87 ± 24% perf-profile.children.cycles-pp.proc_sys_call_handler 5.67 ± 21% +12.2 17.87 ± 24% perf-profile.children.cycles-pp.drop_caches_sysctl_handler 5.72 ± 21% +12.3 17.99 ± 24% perf-profile.children.cycles-pp.new_sync_write 5.73 ± 21% +12.3 18.00 ± 24% perf-profile.children.cycles-pp.vfs_write 5.73 ± 21% +12.3 18.00 ± 24% perf-profile.children.cycles-pp.ksys_write 5.73 ± 21% +12.3 18.02 ± 24% perf-profile.children.cycles-pp.write 0.01 ±173% +14.6 14.59 ± 35% perf-profile.children.cycles-pp.osq_lock 0.00 +14.6 14.60 ± 37% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 0.00 +15.5 15.53 ± 36% perf-profile.children.cycles-pp.rwsem_optimistic_spin 9.72 ± 10% +16.4 26.11 ± 21% perf-profile.children.cycles-pp.cpuidle_enter_state 9.75 ± 10% +16.4 26.18 ± 21% perf-profile.children.cycles-pp.cpuidle_enter 15.76 ± 5% +18.1 33.82 ± 15% perf-profile.children.cycles-pp.start_secondary 15.99 ± 5% +18.4 34.38 ± 15% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 15.99 ± 5% +18.4 34.38 ± 15% perf-profile.children.cycles-pp.cpu_startup_entry 15.98 ± 5% +18.4 34.38 ± 15% perf-profile.children.cycles-pp.do_idle 52.28 ± 4% -45.4 6.86 ± 42% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.42 ± 12% -0.2 0.25 ± 50% perf-profile.self.cycles-pp.btrfs_get_token_32 0.25 ± 25% -0.1 0.11 ± 86% perf-profile.self.cycles-pp.__module_address 0.26 ± 15% -0.1 0.15 ± 56% perf-profile.self.cycles-pp.__account_scheduler_latency 0.14 ± 5% -0.1 0.03 ±105% perf-profile.self.cycles-pp.btrfs_tree_read_unlock 0.28 ± 4% -0.1 0.18 ± 47% perf-profile.self.cycles-pp.memmove 0.25 ± 7% -0.1 0.16 ± 18% perf-profile.self.cycles-pp.generic_bin_search 0.23 ± 6% -0.1 0.17 ± 24% perf-profile.self.cycles-pp.__list_add_valid 0.10 ± 8% -0.1 0.04 ±100% perf-profile.self.cycles-pp.send_call_function_single_ipi 0.07 ± 14% -0.0 0.03 ±100% perf-profile.self.cycles-pp.newidle_balance 0.08 ± 19% -0.0 0.03 ±105% perf-profile.self.cycles-pp.___perf_sw_event 0.12 ± 5% -0.0 0.08 ± 58% perf-profile.self.cycles-pp.__d_lookup_rcu 0.05 ± 8% +0.0 0.08 ± 14% perf-profile.self.cycles-pp.rcu_all_qs 0.07 ± 17% +0.0 0.11 ± 19% perf-profile.self.cycles-pp.__softirqentry_text_start 0.05 ± 8% +0.0 0.09 ± 13% perf-profile.self.cycles-pp.__mod_memcg_state 0.07 ± 10% +0.0 0.11 ± 26% perf-profile.self.cycles-pp.update_dl_rq_load_avg 0.05 ± 8% +0.0 0.10 ± 24% perf-profile.self.cycles-pp.cpuidle_governor_latency_req 0.06 ± 14% +0.0 0.10 ± 21% perf-profile.self.cycles-pp.rcu_needs_cpu 0.08 ± 13% +0.1 0.14 ± 20% perf-profile.self.cycles-pp.rb_next 0.06 ± 7% +0.1 0.11 ± 14% perf-profile.self.cycles-pp.get_cpu_device 0.04 ± 57% +0.1 0.10 ± 27% perf-profile.self.cycles-pp.enqueue_hrtimer 0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.__free_pages_ok 0.03 ±100% +0.1 0.08 ± 23% perf-profile.self.cycles-pp.x86_pmu_disable 0.07 ± 17% +0.1 0.12 ± 26% perf-profile.self.cycles-pp.rcu_eqs_enter 0.04 ± 58% +0.1 0.10 ± 18% perf-profile.self.cycles-pp.hrtimer_forward 0.03 ±100% +0.1 0.09 ± 16% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter 0.01 ±173% +0.1 0.07 ± 22% perf-profile.self.cycles-pp.pm_qos_read_value 0.08 ± 5% +0.1 0.14 ± 13% perf-profile.self.cycles-pp.update_blocked_averages 0.06 ± 60% +0.1 0.12 ± 10% perf-profile.self.cycles-pp.update_rt_rq_load_avg 0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.cpuidle_enter 0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.__dput_to_list 0.00 +0.1 0.06 ± 34% perf-profile.self.cycles-pp.propagate_protected_usage 0.01 ±173% +0.1 0.08 ± 10% perf-profile.self.cycles-pp.irqentry_enter 0.04 ± 57% +0.1 0.10 ± 8% perf-profile.self.cycles-pp.asm_call_sysvec_on_stack 0.00 +0.1 0.07 ± 21% perf-profile.self.cycles-pp.release_pages 0.00 +0.1 0.07 ± 19% perf-profile.self.cycles-pp.tick_nohz_irq_exit 0.14 ± 5% +0.1 0.21 ± 6% perf-profile.self.cycles-pp.rb_insert_color 0.13 ± 6% +0.1 0.20 ± 18% perf-profile.self.cycles-pp.__might_sleep 0.05 ± 9% +0.1 0.12 ± 20% perf-profile.self.cycles-pp.can_stop_idle_tick 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.call_cpuidle 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.hrtimer_next_event_without 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.__lookup_extent_mapping 0.11 ± 6% +0.1 0.18 ± 8% perf-profile.self.cycles-pp.memset_erms 0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.profile_tick 0.06 ± 14% +0.1 0.13 ± 11% perf-profile.self.cycles-pp.nr_iowait_cpu 0.03 ±100% +0.1 0.10 ± 31% perf-profile.self.cycles-pp.tick_check_oneshot_broadcast_this_cpu 0.00 +0.1 0.08 ± 27% perf-profile.self.cycles-pp.arch_cpu_idle_enter 0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.local_touch_nmi 0.00 +0.1 0.08 ± 30% perf-profile.self.cycles-pp.up_read 0.00 +0.1 0.08 ± 34% perf-profile.self.cycles-pp.free_extent_map 0.01 ±173% +0.1 0.09 ± 32% perf-profile.self.cycles-pp.tick_nohz_idle_got_tick 0.00 +0.1 0.08 ± 19% perf-profile.self.cycles-pp.sched_clock 0.03 ±100% +0.1 0.10 ± 14% perf-profile.self.cycles-pp.cpuidle_not_available 0.05 ± 8% +0.1 0.13 ± 28% perf-profile.self.cycles-pp.trigger_load_balance 0.01 ±173% +0.1 0.09 ± 23% perf-profile.self.cycles-pp.btrfs_drop_extent_cache 0.04 ± 58% +0.1 0.12 ± 21% perf-profile.self.cycles-pp.rcu_nmi_enter 0.05 ± 8% +0.1 0.14 ± 13% perf-profile.self.cycles-pp.tick_irq_enter 0.01 ±173% +0.1 0.10 ± 15% perf-profile.self.cycles-pp.rcu_segcblist_enqueue 0.06 ± 11% +0.1 0.14 ± 14% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt 0.08 ± 24% +0.1 0.16 ± 24% perf-profile.self.cycles-pp.irq_exit_rcu 0.04 ± 59% +0.1 0.13 ± 36% perf-profile.self.cycles-pp.tick_check_broadcast_expired 0.01 ±173% +0.1 0.10 ± 25% perf-profile.self.cycles-pp.__etree_search 0.07 ± 21% +0.1 0.15 ± 33% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.1 0.09 ± 16% perf-profile.self.cycles-pp.tick_sched_handle 0.00 +0.1 0.09 ± 16% perf-profile.self.cycles-pp.rcu_nocb_try_bypass 0.00 +0.1 0.09 ± 32% perf-profile.self.cycles-pp.__intel_pmu_enable_all 0.08 ± 16% +0.1 0.17 ± 10% perf-profile.self.cycles-pp.timerqueue_add 0.06 ± 11% +0.1 0.15 ± 20% perf-profile.self.cycles-pp.rcu_idle_exit 0.03 ±100% +0.1 0.11 ± 21% perf-profile.self.cycles-pp.page_counter_cancel 0.10 ± 15% +0.1 0.19 ± 12% perf-profile.self.cycles-pp.rebalance_domains 0.07 ± 7% +0.1 0.15 ± 31% perf-profile.self.cycles-pp.scheduler_tick 0.07 ± 17% +0.1 0.15 ± 32% perf-profile.self.cycles-pp.timerqueue_del 0.00 +0.1 0.09 ± 15% perf-profile.self.cycles-pp.tick_nohz_tick_stopped 0.05 ± 62% +0.1 0.14 ± 36% perf-profile.self.cycles-pp.__remove_hrtimer 0.07 ± 15% +0.1 0.17 ± 30% perf-profile.self.cycles-pp.sched_clock_cpu 0.08 ± 6% +0.1 0.17 ± 19% perf-profile.self.cycles-pp.clockevents_program_event 0.07 ± 11% +0.1 0.17 ± 25% perf-profile.self.cycles-pp.perf_event_task_tick 0.00 +0.1 0.10 ± 15% perf-profile.self.cycles-pp.rcu_nmi_exit 0.06 ± 6% +0.1 0.16 ± 34% perf-profile.self.cycles-pp.__wake_up_bit 0.06 ± 16% +0.1 0.16 ± 15% perf-profile.self.cycles-pp.irq_enter_rcu 0.17 ± 6% +0.1 0.28 ± 12% perf-profile.self.cycles-pp.update_rq_clock 0.08 ± 19% +0.1 0.18 ± 22% perf-profile.self.cycles-pp.get_next_timer_interrupt 0.08 ± 16% +0.1 0.18 ± 32% perf-profile.self.cycles-pp.__hrtimer_get_next_event 0.00 +0.1 0.10 ± 25% perf-profile.self.cycles-pp.__dentry_kill 0.12 ± 11% +0.1 0.23 ± 14% perf-profile.self.cycles-pp.load_balance 0.07 ± 17% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.run_posix_cpu_timers 0.06 ± 11% +0.1 0.17 ± 27% perf-profile.self.cycles-pp.menu_reflect 0.10 ± 10% +0.1 0.21 ± 19% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.10 ± 12% +0.1 0.21 ± 12% perf-profile.self.cycles-pp.irqtime_account_irq 0.04 ± 60% +0.1 0.15 ± 26% perf-profile.self.cycles-pp.truncate_inode_pages_final 0.08 ± 19% +0.1 0.19 ± 19% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt 0.08 ± 13% +0.1 0.20 ± 24% perf-profile.self.cycles-pp.iput 0.00 +0.1 0.12 ± 63% perf-profile.self.cycles-pp.rwsem_down_read_slowpath 0.09 ± 25% +0.1 0.20 ± 22% perf-profile.self.cycles-pp.tick_sched_timer 0.11 ± 13% +0.1 0.23 ± 20% perf-profile.self.cycles-pp.native_apic_msr_eoi_write 0.07 ± 21% +0.1 0.20 ± 17% perf-profile.self.cycles-pp.irqtime_account_process_tick 0.09 ± 4% +0.1 0.22 ± 13% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust 0.09 ± 8% +0.1 0.22 ± 15% perf-profile.self.cycles-pp.__x86_retpoline_rax 0.04 ±106% +0.1 0.17 ± 22% perf-profile.self.cycles-pp.btrfs_get_16 0.00 +0.1 0.13 ± 31% perf-profile.self.cycles-pp.fsnotify_grab_connector 0.10 ± 15% +0.1 0.23 ± 10% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt 0.05 ±124% +0.1 0.19 ± 24% perf-profile.self.cycles-pp.check_inode_key 0.13 ± 9% +0.1 0.27 ± 17% perf-profile.self.cycles-pp.mutex_lock 0.07 ± 20% +0.1 0.22 ± 21% perf-profile.self.cycles-pp.inode_lru_isolate 0.12 ± 22% +0.1 0.27 ± 25% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.06 ± 58% +0.1 0.21 ± 26% perf-profile.self.cycles-pp.btrfs_destroy_inode 0.12 ± 6% +0.2 0.28 ± 32% perf-profile.self.cycles-pp.update_process_times 0.07 ± 16% +0.2 0.23 ± 29% perf-profile.self.cycles-pp.evict 0.03 ±100% +0.2 0.19 ± 26% perf-profile.self.cycles-pp.__clear_extent_bit 0.12 ± 5% +0.2 0.29 ± 18% perf-profile.self.cycles-pp.native_irq_return_iret 0.09 ± 15% +0.2 0.27 ± 27% perf-profile.self.cycles-pp.__remove_inode_hash 0.14 ± 11% +0.2 0.32 ± 16% perf-profile.self.cycles-pp.list_lru_add 0.17 ± 9% +0.2 0.35 ± 27% perf-profile.self.cycles-pp.lapic_next_deadline 0.10 ± 27% +0.2 0.29 ± 16% perf-profile.self.cycles-pp.refill_obj_stock 0.23 ± 5% +0.2 0.42 ± 24% perf-profile.self.cycles-pp.update_irq_load_avg 0.11 ± 51% +0.2 0.30 ± 36% perf-profile.self.cycles-pp.check_dir_item 0.11 ± 15% +0.2 0.31 ± 29% perf-profile.self.cycles-pp.dentry_unlink_inode 0.04 ±107% +0.2 0.24 ± 50% perf-profile.self.cycles-pp.calc_global_load_tick 0.10 ± 27% +0.2 0.30 ± 25% perf-profile.self.cycles-pp.shrink_lock_dentry 0.15 ± 9% +0.2 0.36 ± 23% perf-profile.self.cycles-pp.hrtimer_interrupt 0.15 ± 12% +0.2 0.35 ± 19% perf-profile.self.cycles-pp.io_serial_in 0.18 ± 12% +0.2 0.39 ± 14% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.25 ± 4% +0.2 0.46 ± 9% perf-profile.self.cycles-pp.___might_sleep 0.23 ± 5% +0.2 0.45 ± 21% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.16 ± 18% +0.2 0.40 ± 29% perf-profile.self.cycles-pp.memcpy_toio 0.59 ± 5% +0.2 0.83 ± 10% perf-profile.self.cycles-pp.update_sd_lb_stats 0.14 ± 20% +0.2 0.39 ± 28% perf-profile.self.cycles-pp.__slab_free 0.16 ± 15% +0.3 0.42 ± 21% perf-profile.self.cycles-pp.call_rcu 0.20 ± 9% +0.3 0.46 ± 25% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.40 ± 6% +0.3 0.67 ± 7% perf-profile.self.cycles-pp.kmem_cache_alloc 0.10 ± 13% +0.3 0.36 ± 18% perf-profile.self.cycles-pp.dentry_lru_isolate 0.21 ± 3% +0.3 0.48 ± 11% perf-profile.self.cycles-pp.read_tsc 0.11 ± 35% +0.3 0.39 ± 27% perf-profile.self.cycles-pp.btrfs_evict_inode 0.19 ± 11% +0.3 0.48 ± 15% perf-profile.self.cycles-pp.tick_nohz_next_event 0.18 ± 17% +0.3 0.47 ± 19% perf-profile.self.cycles-pp.rb_erase 0.23 ± 11% +0.3 0.52 ± 28% perf-profile.self.cycles-pp.do_idle 0.19 ± 4% +0.3 0.48 ± 17% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.18 ± 54% +0.3 0.51 ± 15% perf-profile.self.cycles-pp.check_leaf 0.30 ± 7% +0.3 0.63 ± 11% perf-profile.self.cycles-pp.native_sched_clock 0.11 ± 6% +0.3 0.45 ± 29% perf-profile.self.cycles-pp.mem_cgroup_from_obj 0.18 ± 23% +0.4 0.53 ± 16% perf-profile.self.cycles-pp.rcu_cblist_dequeue 0.26 ± 8% +0.4 0.69 ± 21% perf-profile.self.cycles-pp.__btrfs_release_delayed_node 0.18 ± 17% +0.5 0.64 ± 19% perf-profile.self.cycles-pp.btrfs_drop_inode 0.43 ± 8% +0.5 0.89 ± 8% perf-profile.self.cycles-pp.__list_del_entry_valid 0.37 ± 17% +0.5 0.92 ± 18% perf-profile.self.cycles-pp.cpuidle_enter_state 0.32 ± 18% +0.6 0.88 ± 18% perf-profile.self.cycles-pp.___d_drop 0.50 ± 42% +0.6 1.14 ± 18% perf-profile.self.cycles-pp.read_extent_buffer 0.54 ± 36% +0.7 1.25 ± 24% perf-profile.self.cycles-pp.btrfs_get_32 0.35 ± 13% +0.8 1.14 ± 17% perf-profile.self.cycles-pp._raw_spin_trylock 0.00 +0.8 0.82 ± 50% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.81 ± 8% +1.0 1.80 ± 16% perf-profile.self.cycles-pp.menu_select 1.25 ± 10% +1.1 2.38 ± 13% perf-profile.self.cycles-pp._raw_spin_lock 0.65 ± 14% +1.2 1.84 ± 19% perf-profile.self.cycles-pp.kmem_cache_free 0.93 ± 20% +1.4 2.32 ± 35% perf-profile.self.cycles-pp.ktime_get 2.99 ± 10% +5.5 8.51 ± 20% perf-profile.self.cycles-pp.intel_idle 0.01 ±173% +14.0 14.04 ± 36% perf-profile.self.cycles-pp.osq_lock fxmark.hdd_btrfs_MWCL_72_bufferedio.sys_sec 1200 +--------------------------------------------------------------------+ | | 1000 |++ .+. .+.+. .+. .+.+. +.+.+. .+.+.+.+. .+. .+.| | +.+ +.+.++ +.+ + +.+.+ + +.+.+.++ +.+ | | | 800 |-+ | | | 600 |-+ | | O O O | 400 |-+ O O O O O O O O O O O OO O O O O O O O O O O O O | | O O O O O | | | 200 |-+ | | | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_72_bufferedio.idle_sec 1800 +--------------------------------------------------------------------+ | O O O O O O | 1600 |-+ O O O O O O O O O O OO O O O O O O O O O O OO O O O | 1400 |-+ | | | 1200 |-+ | 1000 |.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.| | | 800 |-+ | 600 |-+ | | | 400 |-+ | 200 |-+ | | | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_72_bufferedio.sys_util 60 +----------------------------------------------------------------------+ | | 50 |.+ | | +.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+. .+.+.+.+.| | + | 40 |-+ | | | 30 |-+ | | | 20 |-+ O O O O O OO O O O O O O O O O O O O O O O | | O O O O O O O O O O O | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_72_bufferedio.idle_util 80 +----------------------------------------------------------------------+ | O O O O O O O O O O OO O O O O O O O O O O O O O O O | 70 |-+ | 60 |-+ | | | 50 |.+.+. .+.+.+. .+.+. .+. .+.+.+ .+. .+.+.+.+.+. .+.+. | | +.+ +.+ + +.+ +.+.+ +.+.+.+ + +.| 40 |-+ | | | 30 |-+ | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_63_bufferedio.sys_sec 1000 +--------------------------------------------------------------------+ 900 |-+.+.+.+.+.++. .+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.| | + | 800 |-+ | 700 |-+ | | | 600 |-+ O O | 500 |-+ O O O O O O O O O O O O O O | 400 |-+ O O O | | O O O O OO O O O O O O O O | 300 |-+ | 200 |-+ | | | 100 |-+ | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_63_bufferedio.idle_sec 1400 +--------------------------------------------------------------------+ | O O O | 1200 |-+ O O O O O O O O O OO O O O | | | 1000 |-+ | | .+. .+. +. | 800 |.+.+.+.+.+.++ +.+.+.+.+.+ +.+.+ +.+.+.+.+.+.+.+.+.+.++.+.+.+.+.| | | 600 |-+ | | | 400 |-+ | | | 200 |-+ | | | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_63_bufferedio.sys_util 60 +----------------------------------------------------------------------+ | | 50 |.+.+.+.+.+.+.+. .+.+.+.+.+.+. .+.+.+ .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| | + + + | | | 40 |-+ | | | 30 |-+ O O O O O O O O O O O O O O | | O O | 20 |-O O O O O O O O O O O O O O O O O | | | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_63_bufferedio.idle_util 80 +----------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O | 70 |-+ O O O O O O O O O O O O O O O O | 60 |-+ | | | 50 |-+ | |.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| 40 |-+ | | | 30 |-+ | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_54_bufferedio.sys_sec 1000 +--------------------------------------------------------------------+ 900 |.+ | | +. .+.+. .++. .+.+.+.+.+.+.+.+.+.++.+.+. .+.+.+.+.+. .+. .+.+.+.| 800 |-+ + + + + + ++.+ | 700 |-+ | | | 600 |-+ | 500 |-+ O O O O O O O O O OO O O O | 400 |-+ O O | | O O O O O OO O O O O O O O O O O | 300 |-+ | 200 |-+ | | | 100 |-+ | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_54_bufferedio.idle_sec 1200 +--------------------------------------------------------------------+ | O O OO O O O O O | 1000 |-+ O O O O O O O O O O OO O O O | | O | | | 800 |-+ | | .+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+. .+. .+. .++.+.+.+.+.| 600 |.+ + + + | | | 400 |-+ | | | | | 200 |-+ | | | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_54_bufferedio.sys_util 60 +----------------------------------------------------------------------+ |.+. .+. .+. .+. .+. .+.+.+. .+ .+. .+.+.+.+.+. .+. .+.| 50 |-+ + +.+.+ +.+ + + + + +.+ + +.+.+.+.+ | | | | | 40 |-+ | | O | 30 |-+ O O O O O O O O O O O O O O O | | | 20 |-O O O O O O O O O O O O O O O O O | | | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_54_bufferedio.idle_util 80 +----------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O | 70 |-+ O | 60 |-+ O O O O O O O O O O O O O O O | | | 50 |-+ | | .+. .+. .+. .+. .+.+.+. | 40 |.+.+.+.+ +.+ +.+.+.+.+.+.+.+.+.++.+.+ +.+.+.+.+ + +.+.+.| | | 30 |-+ | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_45_bufferedio.sys_sec 800 +---------------------------------------------------------------------+ | +.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+. .+.+.+.++.+.+.+.+.+.+.+.| 700 |-+ + | 600 |-+ | | | 500 |-+ | | O O O O O | 400 |-+ O O O O O O O OO O O | | | 300 |-O O O O O O O O O O O O O O O O O | 200 |-+ | | | 100 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_45_bufferedio.idle_sec 1000 +--------------------------------------------------------------------+ 900 |-O O O O O O O O O | | O O O O O O | 800 |-+ O O O O O OO O O O | 700 |-+ | | | 600 |-+ | 500 |.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+. .++.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.| 400 |-+ + | | | 300 |-+ | 200 |-+ | | | 100 |-+ | 0 +--------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_45_bufferedio.sys_util 70 +----------------------------------------------------------------------+ | | 60 |.+ .+.+. .+. .+.+. .+. .+.+.+. .+.+. .+. .+. .+. .+. | | +.+.+ + +.+ + + ++.+ +.+.+.+ + + + +.+.| 50 |-+ | | | 40 |-+ | | O O O O O O O O | 30 |-+ O O O O O O O O | | | 20 |-O O O O O O O O O O O O O O O O O | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_45_bufferedio.idle_util 80 +----------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O | 70 |-+ | 60 |-+ O O O O O O O O O O O O O | | O O O | 50 |-+ | | | 40 |.+.+.+. .+. .+.+. .+. .+. .++.+. .+.+.+.+. .+. .+.+.+. .+.+.| | +.+ + +.+ + +.+.+ +.+ + + + | 30 |-+ | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_36_bufferedio.sys_sec 700 +---------------------------------------------------------------------+ | +.+. .+. .+. .+.++.+. .+. .+. .+.+. .+. .+.++.+.+. .+.+.+.+.| 600 |-+ + + + + +.+.+ +.+ +.+ + + | | | 500 |-+ | | | 400 |-+ O O O O | | O O O O O O O OO O O O | 300 |-+ | | O O O O O O O O O O O O | 200 |-+ O O O O O | | | 100 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_36_bufferedio.idle_sec 800 +---------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O | 700 |-+ | 600 |-+ O O O O O O O O O O | | O OO O O O | 500 |-+ | | | 400 |-+ | |.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.| 300 |-+ | 200 |-+ | | | 100 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_36_bufferedio.sys_util 70 +----------------------------------------------------------------------+ |. .+. | 60 |-+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+ +.+.| | | 50 |-+ | | | 40 |-+ | | O O O O O O O O O O O O O O O O | 30 |-+ | | O O O | 20 |-O O O O O O O O O O O O O O | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_36_bufferedio.idle_util 80 +----------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O | 70 |-+ | 60 |-+ O O | | O O O O O O O O O O O O O O | 50 |-+ | | | 40 |-+ | |.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| 30 |-+ | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_27_bufferedio.works 2e+06 +-----------------------------------------------------------------+ 1.8e+06 |.+ | | +.+.++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.| 1.6e+06 |-+ | 1.4e+06 |-+ | | O O OO O O O O OO O O O O OO | 1.2e+06 |-+ | 1e+06 |-O O OO O O O O O O O O O OO O O | 800000 |-+ | | | 600000 |-+ | 400000 |-+ | | | 200000 |-+ | 0 +-----------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_27_bufferedio.works_sec 70000 +-------------------------------------------------------------------+ | | 60000 |.+ .+. .+. | | +.+.+.++.+.+.+.+.+.+.+.++.+ +.+ +.+.++.+.+.+.+.+.+.+.++.+.+.+.| 50000 |-+ | | O O O O O O O OO O O | 40000 |-+ O O O O O | | O O O OO O O O O O O OO O O O O | 30000 |-+ | | | 20000 |-+ | | | 10000 |-+ | | | 0 +-------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_27_bufferedio.sys_sec 600 +---------------------------------------------------------------------+ | | 500 |++ .+. .+. .+. .+ .+. .+.| | +.+.+ +.+.+.+.++.+.+.+.+.+ +.+.+.+ +.+.+.+.+ + +.+.+.+.+ | | | 400 |-+ | | | 300 |-+ O O O O O O O O OO O O O O O O | | | 200 |-O O O O O O O O O O O O O O O O O | | | | | 100 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_27_bufferedio.idle_sec 600 +---------------------------------------------------------------------+ | | 500 |-O O O O O O O O O O O O O O O O O | | | | O O O O O O O O O O O O O O | 400 |-+ O O | | | 300 |-+ | |.+. .+.+.+. .+ .+. .+. .+. .+. .+. .+. +. .+. .+.+. .| 200 |-+ +.+.+ + + + +.+.+ + +.+ + +.+.+ + +.+ + | | | | | 100 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_27_bufferedio.sys_util 70 +----------------------------------------------------------------------+ |+ .+.+.+. .+. .+. .+. .+.+.+. .+ .+.+. .+. .+.+.+. .+. .+.+. .+.| 60 |-+ +.+.+ + + + + + + + + + +.+ | | | 50 |-+ | | | 40 |-+ O O O O O O O O O O O O | | O O O O | 30 |-+ | | O O O O O O O O O O O O O O O O O | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_27_bufferedio.idle_util 70 +----------------------------------------------------------------------+ | O O O | 60 |-+ | | O O O O O O O O O O O O O O | 50 |-+ O O | | | 40 |-+ | | .+. | 30 |.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+ +.+.| | | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.works 2e+06 +-----------------------------------------------------------------+ 1.8e+06 |.+ | | +.+.++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.| 1.6e+06 |-+ | 1.4e+06 |-+ | | O O | 1.2e+06 |-+ O O OO O O O OO O O O OO | 1e+06 |-O O OO O O O O O O O O O OO O O | 800000 |-+ | | | 600000 |-+ | 400000 |-+ | | | 200000 |-+ | 0 +-----------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.works_sec 70000 +-------------------------------------------------------------------+ | | 60000 |.+ | | +.+.+.++.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.++.+.+.+.| 50000 |-+ | | | 40000 |-+ O O O OO O O O O O O O OO O O | | O O O O O | 30000 |-+ O O OO O O O OO O O O | | | 20000 |-+ | | | 10000 |-+ | | | 0 +-------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.user_sec 14 +----------------------------------------------------------------------+ | | 12 |.+ .+. .+. +. | | +.+.+ +.+.+.+.+.+.+.+.+.+.+.+ + +.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| 10 |-+ | | O O O O O O O O O O O O O O O O | 8 |-+ O O O O | | O O O O O O O O O O O O O | 6 |-+ | | | 4 |-+ | | | 2 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.sys_sec 400 +---------------------------------------------------------------------+ |. | 350 |-+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.| 300 |-+ | | | 250 |-+ | | O O O O O O O O OO O O O O O O | 200 |-+ | | O O O O O O O O O O O O O O O O O | 150 |-+ | 100 |-+ | | | 50 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.idle_sec 350 +---------------------------------------------------------------------+ | | 300 |-O O O O O O O O O O O O O O O O O | | | 250 |-+ O O O O O | | O O O O O O O O O O O | 200 |-+ | | | 150 |-+ | |.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.| 100 |-+ | | | 50 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.user_util 2.5 +---------------------------------------------------------------------+ |. .+. .+. .+. .+. .+. | | +.+.+ +.+.+.+.++ + +.+.+ + +.+.+.+.+.+.+.++.+.+.+.+.+.+.+.| 2 |-+ | | O O O O O O O | | O O O O O O O O O O | 1.5 |-O O O O O O O O O O O O O O O O | | | 1 |-+ | | | | | 0.5 |-+ | | | | | 0 +---------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.sys_util 80 +----------------------------------------------------------------------+ | | 70 |.+.+.+.+.+.+. .+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| 60 |-+ + | | | 50 |-+ | | O O O O O O O O O O O O O O O O | 40 |-+ | | O O O O O O O O O O O O O O O O O | 30 |-+ | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.hdd_btrfs_MWCL_18_bufferedio.idle_util 60 +----------------------------------------------------------------------+ | O O O O | 50 |-+ | | O O O O O O O O O O O O O O O | | O | 40 |-+ | | | 30 |-+ | |.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| 20 |-+ | | | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ fxmark.time.system_time 400 +---------------------------------------------------------------------+ |. .+.| 350 |-+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+ | 300 |-+ | | | 250 |-+ O O O O O O O O OO O O O O O O | | O O O O O O O O O O O O O O O O O | 200 |-+ | | | 150 |-+ | 100 |-+ | | | 50 |-+ | | | 0 +---------------------------------------------------------------------+ fxmark.time.percent_of_cpu_this_job_got 70 +----------------------------------------------------------------------+ |.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.| 60 |-+ | | | 50 |-+ O O O O O O O O O O O O O O O O | | O O O O O O O O O O O O O O O O O | 40 |-+ | | | 30 |-+ | | | 20 |-+ | | | 10 |-+ | | | 0 +----------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Oliver Sang

6 months, 2 weeks

2
1
0 / 0

[drm/i915] 04ff178484: phoronix-test-suite.supertuxkart.1024x768.Fullscreen.Ultimate.1.GranParadisoIsland.frames_per_second -30.4% regression

by kernel test robot

Greeting, FYI, we noticed a -30.4% regression of phoronix-test-suite.supertuxkart.1024x768.Fullscreen.Ultimate.1.GranParadisoIsland.frames_per_second due to commit: commit: 04ff1784840f5f954a656c7e8795c76467e29128 ("[Intel-gfx] [PATCH] drm/i915: Enable WaProgramMgsrForCorrectSliceSpecificMmioReads for Gen9") url: https://github.com/0day-ci/linux/commits/Cooper-Chiou/drm-i915-Enable-WaP... base: git://anongit.freedesktop.org/drm-intel for-linux-next in testcase: phoronix-test-suite on test machine: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory with following parameters: need_x: true test: supertuxkart-1.5.2 option_a: Fullscreen option_b: Ultimate option_c: 1 option_d: Gran Paradiso Island [Approximately 275k triangles; advanced graphics] cpufreq_governor: performance ucode: 0xd6 test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. test-url: http://www.phoronix-test-suite.com/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/need_x/option_a/option_b/option_c/option_d/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/true/Fullscreen/Ultimate/1/Gran Paradiso Island [Approximately 275k triangles; advanced graphics]/debian-x86_64-phoronix/lkp-kbl-nuc1/supertuxkart-1.5.2/phoronix-test-suite/0xd6 commit: 400d4953f1 ("drm/i915/pll: Centralize PLL_ENABLE register lookup") 04ff178484 ("drm/i915: Enable WaProgramMgsrForCorrectSliceSpecificMmioReads for Gen9") 400d4953f1f434d5 04ff1784840f5f954a656c7e879 ---------------- --------------------------- %stddev %change %stddev \ | \ 35.32 -30.4% 24.59 phoronix-test-suite.supertuxkart.1024x768.Fullscreen.Ultimate.1.GranParadisoIsland.frames_per_second 3638 ± 15% -39.2% 2211 ± 4% phoronix-test-suite.time.involuntary_context_switches 32.00 -30.5% 22.25 phoronix-test-suite.time.percent_of_cpu_this_job_got 36 +----------------------------------------------------------------------+ |.+.+..+.+.+.+..+.+.+.+.+..+.+.+.+..+.+.+.+.+..+.+.+.+.+..+ +.+..+.+.| 34 |-+ | | | | | 32 |-+ | | | 30 |-+ | | | 28 |-+ | | | | | 26 |-+ | | O O O O O O O O O O O O O O O O O O O O O O | 24 +----------------------------------------------------------------------+ phoronix-test-suite.time.percent_of_cpu_this_job_got 32 +----------------------------------------------------------------------+ | + +. + + +.+.+. | 30 |-+ | | | | | 28 |-+ | | | 26 |-+ | | | 24 |-+ | | O O | | | 22 |-O O O O O O O O O O O O O O O O O O O | | O | 20 +----------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

7 months

3
4
0 / 0

[xfs] db962cd266: Assertion_failed

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: db962cd266c4d3230436aec2899186510797d49f ("[PATCH v14 4/4] xfs: use current->journal_info to avoid transaction reservation recursion") url: https://github.com/0day-ci/linux/commits/Yafang-Shao/xfs-avoid-transactio... base: https://git.kernel.org/cgit/fs/xfs/xfs-linux.git for-next in testcase: filebench version: filebench-x86_64-22620e6-1_20201112 with following parameters: disk: 1HDD fs: btrfs test: fivestreamwrite.f cpufreq_governor: performance ucode: 0x42e on test machine: 48 threads Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> [ 552.503501] [ 552.525993] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/pkg/linux/x86_64-rhel-8.3/gcc-9/5c8fe5... -N -P /opt/rootfs/tmp/pkg/linux/x86_64-rhel-8.3/gcc-9/5c8fe583cce542aa0b84adc939ce85293de36e5e [ 552.525995] [ 552.884581] /opt/rootfs/tmp/pkg/linux/x86_64-rhel-8.3/gcc-9/5c8fe583cce542aa0b84adc939ce85293de36e5e/modules.cgz isn't modified [ 552.884583] [ 552.905799] XFS: Assertion failed: !current->journal_info, file: fs/xfs/xfs_trans.h, line: 280 [ 552.907594] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/osimage/ucode/intel-ucode-20201117.cgz -N -P /opt/rootfs/tmp/osimage/ucode [ 552.916568] [ 552.916574] ------------[ cut here ]------------ [ 552.939361] /opt/rootfs/tmp/osimage/ucode/intel-ucode-20201117.cgz isn't modified [ 552.940036] kernel BUG at fs/xfs/xfs_message.c:110! [ 552.946338] [ 552.955784] invalid opcode: 0000 [#1] SMP PTI [ 552.971010] CPU: 46 PID: 3793 Comm: kexec-lkp Not tainted 5.10.0-rc5-00044-gdb962cd266c4 #1 [ 552.981331] Hardware name: Intel Corporation S2600WP/S2600WP, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [ 552.993907] RIP: 0010:assfail+0x23/0x28 [xfs] [ 552.999797] Code: 67 fc ff ff 0f 0b c3 0f 1f 44 00 00 41 89 c8 48 89 d1 48 89 f2 48 c7 c6 30 58 be c0 e8 82 f9 ff ff 80 3d b1 80 0a 00 00 74 02 <0f> 0b 0f 0b c3 48 8d 45 10 48 89 e2 4c 89 e6 48 89 1c 24 48 89 44 [ 553.022798] RSP: 0018:ffffc90006a139c8 EFLAGS: 00010202 [ 553.029624] RAX: 0000000000000000 RBX: ffff889c3edea700 RCX: 0000000000000000 [ 553.038646] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc0bd7bab [ 553.047600] RBP: ffffc90006a13a14 R08: 0000000000000000 R09: 0000000000000000 [ 553.056536] R10: 000000000000000a R11: f000000000000000 R12: 0000000000000000 [ 553.065546] R13: 0000000000000000 R14: ffff889c3ede91c8 R15: ffff888f44608000 [ 553.074455] FS: 00007ffff7fc9580(0000) GS:ffff889bea380000(0000) knlGS:0000000000000000 [ 553.084494] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 553.091837] CR2: 00005555555a1420 CR3: 0000001c30fbe002 CR4: 00000000001706e0 [ 553.100720] Call Trace: [ 553.104459] xfs_trans_reserve+0x225/0x320 [xfs] [ 553.110556] xfs_trans_roll+0x6e/0xe0 [xfs] [ 553.116134] xfs_defer_trans_roll+0x104/0x2a0 [xfs] [ 553.122489] ? xfs_extent_free_create_intent+0x62/0xc0 [xfs] [ 553.129780] xfs_defer_finish_noroll+0xb8/0x620 [xfs] [ 553.136299] xfs_defer_finish+0x11/0xa0 [xfs] [ 553.142017] xfs_itruncate_extents_flags+0x141/0x440 [xfs] [ 553.149053] xfs_setattr_size+0x3da/0x480 [xfs] [ 553.154939] ? setattr_prepare+0x6a/0x1e0 [ 553.160250] xfs_vn_setattr+0x70/0x120 [xfs] [ 553.165833] notify_change+0x364/0x500 [ 553.170820] ? do_truncate+0x76/0xe0 [ 553.175673] do_truncate+0x76/0xe0 [ 553.180184] path_openat+0xe6c/0x10a0 [ 553.184981] do_filp_open+0x91/0x100 [ 553.189707] ? __check_object_size+0x136/0x160 [ 553.195493] do_sys_openat2+0x20d/0x2e0 [ 553.200481] do_sys_open+0x44/0x80 [ 553.204926] do_syscall_64+0x33/0x40 [ 553.209588] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 553.215867] RIP: 0033:0x7ffff7ef11ae [ 553.220579] Code: 25 00 00 41 00 3d 00 00 41 00 74 48 48 8d 05 59 65 0d 00 8b 00 85 c0 75 69 89 f2 b8 01 01 00 00 48 89 fe bf 9c ff ff ff 0f 05 <48> 3d 00 f0 ff ff 0f 87 a6 00 00 00 48 8b 4c 24 28 64 48 33 0c 25 [ 553.242870] RSP: 002b:00007fffffffc980 EFLAGS: 00000246 ORIG_RAX: 0000000000000101 [ 553.251949] RAX: ffffffffffffffda RBX: 000055555556afcc RCX: 00007ffff7ef11ae [ 553.260586] RDX: 0000000000000241 RSI: 00005555555aaa40 RDI: 00000000ffffff9c [ 553.269217] RBP: 0000555555577bd0 R08: 00005555555a250f R09: 00005555555783b0 [ 553.277804] R10: 00000000000001b6 R11: 0000000000000246 R12: 00005555555aaa40 [ 553.286406] R13: 00000000fffffffd R14: 00005555555a1400 R15: 0000000000000010 [ 553.294926] Modules linked in: dm_mod xfs btrfs blake2b_generic xor zstd_compress raid6_pq libcrc32c sd_mod t10_pi sg intel_rapl_msr intel_rapl_common sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm mgag200 irqbypass crct10dif_pclmul drm_kms_helper crc32_pclmul crc32c_intel ghash_clmulni_intel isci syscopyarea sysfillrect sysimgblt rapl fb_sys_fops ahci libsas libahci ipmi_si scsi_transport_sas mei_me intel_cstate ipmi_devintf ioatdma drm mei intel_uncore ipmi_msghandler libata dca wmi joydev ip_tables [ 553.349820] ---[ end trace 41e34856cd03d8f3 ]--- [ 553.359002] RIP: 0010:assfail+0x23/0x28 [xfs] [ 553.364558] Code: 67 fc ff ff 0f 0b c3 0f 1f 44 00 00 41 89 c8 48 89 d1 48 89 f2 48 c7 c6 30 58 be c0 e8 82 f9 ff ff 80 3d b1 80 0a 00 00 74 02 <0f> 0b 0f 0b c3 48 8d 45 10 48 89 e2 4c 89 e6 48 89 1c 24 48 89 44 [ 553.386866] RSP: 0018:ffffc90006a139c8 EFLAGS: 00010202 [ 553.393357] RAX: 0000000000000000 RBX: ffff889c3edea700 RCX: 0000000000000000 [ 553.402093] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc0bd7bab [ 553.410746] RBP: ffffc90006a13a14 R08: 0000000000000000 R09: 0000000000000000 [ 553.419499] R10: 000000000000000a R11: f000000000000000 R12: 0000000000000000 [ 553.428122] R13: 0000000000000000 R14: ffff889c3ede91c8 R15: ffff888f44608000 [ 553.436764] FS: 00007ffff7fc9580(0000) GS:ffff889bea380000(0000) knlGS:0000000000000000 [ 553.446562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 553.453670] CR2: 00005555555a1420 CR3: 0000001c30fbe002 CR4: 00000000001706e0 [ 553.462302] Kernel panic - not syncing: Fatal exception [ 553.513856] Kernel Offset: disabled ACPI MEMORY or I/O RESET_REG. To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Thanks, Oliver Sang

8 months, 2 weeks

3
3
0 / 0

[mm/swap] aae466b005: vm-scalability.throughput -2.7% regression

by kernel test robot

Greeting, FYI, we noticed a -2.7% regression of vm-scalability.throughput due to commit: commit: aae466b0052e1888edd1d7f473d4310d64936196 ("mm/swap: implement workingset detection for anonymous LRU") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: vm-scalability on test machine: 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory with following parameters: runtime: 300 thp_enabled: never thp_defrag: always nr_task: 32 nr_ssd: 1 test: swap-w-rand-mt cpufreq_governor: performance ucode: 0x4003003 test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us. test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/ In addition to that, the commit also has significant impact on the following tests: +------------------+------------------------------------------------------------------------+ | testcase: change | vm-scalability: vm-scalability.throughput 12.8% improvement | | test machine | 96 threads Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory | | test parameters | cpufreq_governor=performance | | | nr_pmem=2 | | | nr_task=8 | | | priority=1 | | | test=swap-w-seq | | | thp_defrag=never | | | thp_enabled=never | | | ucode=0x4003003 | +------------------+------------------------------------------------------------------------+ | testcase: change | vm-scalability: vm-scalability.median -1.3% regression | | test machine | 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | nr_ssd=1 | | | nr_task=32 | | | runtime=300 | | | test=swap-w-rand-mt | | | thp_defrag=always | | | thp_enabled=always | | | ucode=0x4003003 | +------------------+------------------------------------------------------------------------+ | testcase: change | vm-scalability: vm-scalability.throughput 17.2% improvement | | test machine | 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory | | test parameters | cpufreq_governor=performance | | | nr_pmem=4 | | | nr_task=8 | | | priority=1 | | | test=swap-w-seq | | | thp_defrag=never | | | thp_enabled=never | | | ucode=0x16 | +------------------+------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode: gcc-9/performance/x86_64-rhel-8.3/1/32/debian-10.4-x86_64-20200603.cgz/300/lkp-csl-2ap1/swap-w-rand-mt/vm-scalability/always/never/0x4003003 commit: 3852f6768e ("mm/swapcache: support to handle the shadow entries") aae466b005 ("mm/swap: implement workingset detection for anonymous LRU") 3852f6768ede542e aae466b0052e1888edd1d7f473d ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 5% 1:4 perf-profile.children.cycles-pp.error_entry 0:4 2% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 3.97 +33.0% 5.28 ± 2% vm-scalability.free_time 6216 -2.4% 6065 vm-scalability.median 184.21 +57.2 241.41 ± 2% vm-scalability.stddev% 198352 -2.7% 193018 vm-scalability.throughput 368.12 +6.4% 391.63 vm-scalability.time.elapsed_time 368.12 +6.4% 391.63 vm-scalability.time.elapsed_time.max 18610 ± 29% -47.9% 9704 ± 11% vm-scalability.time.involuntary_context_switches 320.00 ± 4% -6.3% 299.75 ± 2% vm-scalability.time.percent_of_cpu_this_job_got 11.22 -4.9% 10.67 iostat.cpu.iowait 0.11 -0.0 0.09 mpstat.cpu.all.soft% 30334488 -44.9% 16726456 cpuidle.POLL.time 6991777 -46.0% 3774649 ± 2% cpuidle.POLL.usage 164847 ± 2% +387.8% 804132 slabinfo.radix_tree_node.active_objs 3155 ± 2% +372.3% 14905 slabinfo.radix_tree_node.active_slabs 176738 ± 2% +372.3% 834722 slabinfo.radix_tree_node.num_objs 3155 ± 2% +372.3% 14905 slabinfo.radix_tree_node.num_slabs 481751 ± 4% +11.1% 535142 ± 5% sched_debug.cfs_rq:/.min_vruntime.max 44029 ± 48% +720.6% 361329 ± 44% sched_debug.cfs_rq:/.spread0.max 0.03 ± 10% +17.7% 0.03 ± 12% sched_debug.cpu.nr_running.avg 0.16 ± 5% +8.0% 0.17 ± 5% sched_debug.cpu.nr_running.stddev 2921 ± 29% -39.4% 1770 ± 11% sched_debug.cpu.nr_switches.min 129531 ± 10% +33.7% 173189 ± 10% sched_debug.cpu.nr_switches.stddev 284476 -5.3% 269500 ± 2% vmstat.io.bi 829640 -4.6% 791105 vmstat.io.bo 689.50 ± 24% -52.7% 326.00 ± 17% vmstat.memory.buff 1695753 +18.6% 2012004 ± 2% vmstat.memory.cache 24761938 +21.1% 29998510 vmstat.memory.free 284470 -5.3% 269494 ± 2% vmstat.swap.si 829635 -4.6% 791100 vmstat.swap.so 147287 -4.9% 140140 vmstat.system.cs 39473212 ± 2% -65.6% 13576005 ± 8% meminfo.Active 39472833 ± 2% -65.6% 13575638 ± 8% meminfo.Active(anon) 28016 ± 11% +27.6% 35751 ± 5% meminfo.CmaFree 1.295e+08 +15.8% 1.499e+08 meminfo.Inactive 1.295e+08 +15.8% 1.499e+08 meminfo.Inactive(anon) 179771 +209.6% 556606 meminfo.KReclaimable 23750082 +22.5% 29103301 meminfo.MemAvailable 24371669 +21.2% 29537348 meminfo.MemFree 268.00 ± 4% +452.0% 1479 ± 42% meminfo.Mlocked 179771 +209.6% 556606 meminfo.SReclaimable 501211 +76.2% 883374 meminfo.Slab 2015638 ± 20% +81.6% 3659798 ± 15% proc-vmstat.compact_daemon_free_scanned 2015638 ± 20% +81.6% 3659798 ± 15% proc-vmstat.compact_free_scanned 9901379 -65.8% 3389780 ± 8% proc-vmstat.nr_active_anon 41693055 -3.5% 40233791 proc-vmstat.nr_anon_pages 591382 +22.5% 724480 proc-vmstat.nr_dirty_background_threshold 1184213 +22.5% 1450733 proc-vmstat.nr_dirty_threshold 7034 ± 12% +27.6% 8976 ± 5% proc-vmstat.nr_free_cma 6089969 +21.9% 7425242 proc-vmstat.nr_free_pages 32343769 +15.8% 37442761 proc-vmstat.nr_inactive_anon 153.50 ± 28% -63.2% 56.50 ± 26% proc-vmstat.nr_inactive_file 11447 -4.9% 10883 ± 2% proc-vmstat.nr_mapped 66.75 ± 4% +453.9% 369.75 ± 42% proc-vmstat.nr_mlock 225376 -2.8% 219090 proc-vmstat.nr_page_table_pages 135218 ± 2% -10.8% 120652 ± 8% proc-vmstat.nr_shmem 44994 +209.1% 139062 proc-vmstat.nr_slab_reclaimable 47878384 +5.7% 50604735 proc-vmstat.nr_vmscan_write 77049882 +1.4% 78117892 proc-vmstat.nr_written 9901589 -65.8% 3390472 ± 8% proc-vmstat.nr_zone_active_anon 32344898 +15.8% 37443693 proc-vmstat.nr_zone_inactive_anon 153.25 ± 28% -63.1% 56.50 ± 26% proc-vmstat.nr_zone_inactive_file 222877 ±173% +7663.4% 17302906 ± 3% proc-vmstat.pgdeactivate 3.082e+08 +1.4% 3.125e+08 proc-vmstat.pgpgout 222877 ±173% +7663.4% 17302906 ± 3% proc-vmstat.pgrefill 77049882 +1.4% 78117893 proc-vmstat.pswpout 3950 ± 8% +27.7% 5043 ± 6% proc-vmstat.swap_ra_hit 1.582e+09 -3.1% 1.532e+09 perf-stat.i.branch-instructions 148737 -4.9% 141447 perf-stat.i.context-switches 2.114e+09 -3.8% 2.033e+09 perf-stat.i.dTLB-loads 1.112e+09 -3.8% 1.07e+09 perf-stat.i.dTLB-stores 58.64 -0.9 57.71 perf-stat.i.iTLB-load-miss-rate% 8601022 ± 3% -6.8% 8018116 ± 2% perf-stat.i.iTLB-load-misses 7.824e+09 -3.0% 7.588e+09 perf-stat.i.instructions 71817 ± 2% -5.3% 68008 ± 2% perf-stat.i.major-faults 1.10 ± 2% -5.9% 1.04 ± 2% perf-stat.i.metric.K/sec 25.50 -3.4% 24.62 perf-stat.i.metric.M/sec 271982 -5.5% 257059 perf-stat.i.minor-faults 86.69 -2.5 84.16 ± 2% perf-stat.i.node-load-miss-rate% 3592897 ± 3% -7.2% 3335717 perf-stat.i.node-store-misses 343799 -5.4% 325068 perf-stat.i.page-faults 87.63 -2.2 85.44 perf-stat.overall.node-load-miss-rate% 44275 +3.2% 45673 perf-stat.overall.path-length 1.581e+09 -3.1% 1.532e+09 perf-stat.ps.branch-instructions 147972 -4.9% 140775 ± 2% perf-stat.ps.context-switches 2.112e+09 -3.8% 2.032e+09 perf-stat.ps.dTLB-loads 1.111e+09 -3.7% 1.069e+09 perf-stat.ps.dTLB-stores 8576754 ± 3% -6.7% 8000293 ± 2% perf-stat.ps.iTLB-load-misses 7.82e+09 -3.0% 7.587e+09 perf-stat.ps.instructions 71434 ± 2% -5.3% 67666 ± 2% perf-stat.ps.major-faults 275553 -5.7% 259748 perf-stat.ps.minor-faults 3597708 ± 3% -7.1% 3342209 ± 2% perf-stat.ps.node-store-misses 346987 -5.6% 327415 perf-stat.ps.page-faults 2.89e+12 +3.2% 2.982e+12 perf-stat.total.instructions 2797818 ± 13% -62.0% 1062303 ± 18% numa-vmstat.node0.nr_active_anon 7606015 ± 4% +18.5% 9015289 ± 3% numa-vmstat.node0.nr_inactive_anon 2841 ± 20% -23.7% 2167 ± 12% numa-vmstat.node0.nr_mapped 21.25 ± 17% +364.7% 98.75 ± 41% numa-vmstat.node0.nr_mlock 399.50 ± 58% +40928.8% 163910 ± 57% numa-vmstat.node0.nr_page_table_pages 23030 ± 37% -49.7% 11581 ± 35% numa-vmstat.node0.nr_shmem 10778 ± 18% +154.0% 27381 ± 28% numa-vmstat.node0.nr_slab_reclaimable 2797850 ± 13% -62.0% 1062427 ± 18% numa-vmstat.node0.nr_zone_active_anon 7606315 ± 4% +18.5% 9015536 ± 3% numa-vmstat.node0.nr_zone_inactive_anon 2434112 ± 4% -70.0% 729671 ± 7% numa-vmstat.node1.nr_active_anon 1478062 ± 6% +24.7% 1842766 ± 4% numa-vmstat.node1.nr_free_pages 8286756 +15.8% 9597629 numa-vmstat.node1.nr_inactive_anon 13.75 ± 6% +678.2% 107.00 ± 52% numa-vmstat.node1.nr_mlock 11056 ± 7% +265.0% 40351 ± 11% numa-vmstat.node1.nr_slab_reclaimable 2434168 ± 4% -70.0% 729866 ± 7% numa-vmstat.node1.nr_zone_active_anon 8287096 +15.8% 9597821 numa-vmstat.node1.nr_zone_inactive_anon 2143905 ± 13% -62.8% 797472 ± 24% numa-vmstat.node2.nr_active_anon 1494773 ± 5% +29.0% 1927632 ± 9% numa-vmstat.node2.nr_free_pages 16.50 ± 29% +400.0% 82.50 ± 44% numa-vmstat.node2.nr_mlock 11153 ± 14% +211.9% 34787 ± 26% numa-vmstat.node2.nr_slab_reclaimable 2143957 ± 13% -62.8% 797647 ± 24% numa-vmstat.node2.nr_zone_active_anon 2483365 ± 7% -67.9% 797268 ± 4% numa-vmstat.node3.nr_active_anon 7022 ± 12% +27.8% 8975 ± 5% numa-vmstat.node3.nr_free_cma 1480903 +26.7% 1876124 numa-vmstat.node3.nr_free_pages 8081690 ± 3% +17.4% 9491688 numa-vmstat.node3.nr_inactive_anon 8163 ± 8% -19.9% 6535 numa-vmstat.node3.nr_kernel_stack 11935 ± 4% +205.0% 36402 ± 4% numa-vmstat.node3.nr_slab_reclaimable 20598 ± 13% -21.9% 16083 ± 9% numa-vmstat.node3.nr_slab_unreclaimable 2483418 ± 7% -67.9% 797444 ± 4% numa-vmstat.node3.nr_zone_active_anon 8081950 ± 3% +17.4% 9491926 numa-vmstat.node3.nr_zone_inactive_anon 18061676 ± 9% +16.2% 20994129 ± 9% numa-vmstat.node3.numa_hit 17948663 ± 9% +16.0% 20828234 ± 9% numa-vmstat.node3.numa_local 11235292 ± 14% -62.1% 4253332 ± 18% numa-meminfo.node0.Active 11235045 ± 14% -62.1% 4253174 ± 18% numa-meminfo.node0.Active(anon) 30372185 ± 5% +18.7% 36043049 ± 3% numa-meminfo.node0.Inactive 30372149 ± 5% +18.7% 36043021 ± 3% numa-meminfo.node0.Inactive(anon) 43141 ± 18% +154.4% 109749 ± 28% numa-meminfo.node0.KReclaimable 43141 ± 18% +154.4% 109749 ± 28% numa-meminfo.node0.SReclaimable 92323 ± 37% -49.7% 46402 ± 35% numa-meminfo.node0.Shmem 142930 ± 14% +51.3% 216266 ± 15% numa-meminfo.node0.Slab 9771157 ± 4% -70.1% 2923440 ± 7% numa-meminfo.node1.Active 9771112 ± 4% -70.1% 2923413 ± 7% numa-meminfo.node1.Active(anon) 33103934 +15.9% 38369090 numa-meminfo.node1.Inactive 33103732 +15.9% 38369003 numa-meminfo.node1.Inactive(anon) 44315 ± 7% +264.5% 161527 ± 11% numa-meminfo.node1.KReclaimable 5921070 ± 6% +24.8% 7388272 ± 4% numa-meminfo.node1.MemFree 44315 ± 7% +264.5% 161527 ± 11% numa-meminfo.node1.SReclaimable 107817 ± 3% +121.5% 238839 ± 5% numa-meminfo.node1.Slab 8607727 ± 13% -62.9% 3193249 ± 23% numa-meminfo.node2.Active 8607678 ± 13% -62.9% 3193160 ± 23% numa-meminfo.node2.Active(anon) 44678 ± 14% +212.0% 139381 ± 26% numa-meminfo.node2.KReclaimable 5985691 ± 4% +29.1% 7729464 ± 8% numa-meminfo.node2.MemFree 44678 ± 14% +212.0% 139381 ± 26% numa-meminfo.node2.SReclaimable 120407 ± 19% +81.0% 217905 ± 20% numa-meminfo.node2.Slab 9966813 ± 7% -68.0% 3193310 ± 4% numa-meminfo.node3.Active 9966773 ± 7% -68.0% 3193215 ± 4% numa-meminfo.node3.Active(anon) 32288714 ± 3% +17.5% 37944173 numa-meminfo.node3.Inactive 32288483 ± 3% +17.5% 37944122 numa-meminfo.node3.Inactive(anon) 47843 ± 4% +204.8% 145824 ± 4% numa-meminfo.node3.KReclaimable 8154 ± 8% -19.9% 6535 numa-meminfo.node3.KernelStack 12199 ± 5% +18.9% 14501 ± 7% numa-meminfo.node3.Mapped 5928259 ± 2% +26.9% 7523247 ± 2% numa-meminfo.node3.MemFree 47843 ± 4% +204.8% 145824 ± 4% numa-meminfo.node3.SReclaimable 82430 ± 13% -21.9% 64341 ± 9% numa-meminfo.node3.SUnreclaim 130274 ± 8% +61.3% 210167 ± 3% numa-meminfo.node3.Slab 0.01 ± 13% +45.5% 0.01 ± 15% perf-sched.sch_delay.avg.ms.__sched_text_start.__sched_text_start.do_syslog.part.0 0.00 ± 34% -100.0% 0.00 perf-sched.sch_delay.avg.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.do_swap_page 0.01 ± 6% +24.0% 0.01 ± 5% perf-sched.sch_delay.avg.ms.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 0.01 ± 13% +45.5% 0.01 ± 15% perf-sched.sch_delay.max.ms.__sched_text_start.__sched_text_start.do_syslog.part.0 0.01 ± 40% -80.9% 0.00 ± 19% perf-sched.sch_delay.max.ms.__sched_text_start.__sched_text_start.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt 0.00 ± 72% -100.0% 0.00 perf-sched.sch_delay.max.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.do_swap_page 0.01 ± 20% +75.0% 0.03 ± 22% perf-sched.sch_delay.max.ms.__sched_text_start.__sched_text_start.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop 0.03 ± 25% +63.0% 0.05 ± 43% perf-sched.sch_delay.max.ms.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 0.82 ±147% -92.7% 0.06 ± 69% perf-sched.sch_delay.max.ms.__sched_text_start.__sched_text_start.smpboot_thread_fn.kthread.ret_from_fork 3.48 ± 2% -10.3% 3.12 ± 2% perf-sched.total_wait_and_delay.average.ms 3.48 ± 2% -10.3% 3.12 ± 2% perf-sched.total_wait_time.average.ms 208.52 ± 3% +8.8% 226.98 ± 2% perf-sched.wait_and_delay.avg.ms.__sched_text_start.__sched_text_start.do_task_dead.do_exit.do_group_exit 74.43 ± 56% -92.1% 5.90 ±173% perf-sched.wait_and_delay.avg.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.generic_perform_write 346.68 +164.3% 916.39 ± 35% perf-sched.wait_and_delay.avg.ms.__sched_text_start.__sched_text_start.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait 4.05 +61.0% 6.52 ± 12% perf-sched.wait_and_delay.avg.ms.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 374.36 ± 10% +98.3% 742.31 ± 2% perf-sched.wait_and_delay.avg.ms.__sched_text_start.__sched_text_start.smpboot_thread_fn.kthread.ret_from_fork 3.50 ± 42% -92.9% 0.25 ±173% perf-sched.wait_and_delay.count.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.generic_perform_write 2462 -38.5% 1514 ± 13% perf-sched.wait_and_delay.count.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 5945 ± 8% -58.0% 2498 perf-sched.wait_and_delay.count.__sched_text_start.__sched_text_start.smpboot_thread_fn.kthread.ret_from_fork 1918 ± 22% +132.6% 4463 ± 21% perf-sched.wait_and_delay.max.ms.__sched_text_start.__sched_text_start.do_task_dead.do_exit.do_group_exit 142.24 ± 49% -95.9% 5.90 ±173% perf-sched.wait_and_delay.max.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.generic_perform_write 5.03 +5481.4% 280.75 ± 35% perf-sched.wait_and_delay.max.ms.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 7708 ± 12% -83.5% 1270 ± 34% perf-sched.wait_and_delay.max.ms.__sched_text_start.__sched_text_start.smpboot_thread_fn.kthread.ret_from_fork 208.52 ± 3% +8.8% 226.97 ± 2% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.do_task_dead.do_exit.do_group_exit 0.36 ± 79% -100.0% 0.00 perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.do_swap_page 0.13 ± 31% -88.8% 0.01 ±173% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.down_read 74.43 ± 56% -92.1% 5.90 ±173% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.generic_perform_write 346.67 +164.3% 916.38 ± 35% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait 2.11 ± 17% +60.0% 3.37 ± 38% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg 4.04 +61.1% 6.51 ± 12% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 374.35 ± 10% +98.3% 742.30 ± 2% perf-sched.wait_time.avg.ms.__sched_text_start.__sched_text_start.smpboot_thread_fn.kthread.ret_from_fork 1918 ± 22% +132.6% 4463 ± 21% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.do_task_dead.do_exit.do_group_exit 31.60 ±130% -99.1% 0.28 ± 90% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt 1.33 ± 85% -100.0% 0.00 perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.do_swap_page 0.14 ± 26% -89.5% 0.01 ±173% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.down_read 142.24 ± 49% -95.9% 5.90 ±173% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.preempt_schedule_common._cond_resched.generic_perform_write 2.11 ± 17% +60.0% 3.37 ± 38% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg 5.01 +5501.3% 280.74 ± 35% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.schedule_timeout.rcu_gp_kthread.kthread 7708 ± 12% -83.5% 1270 ± 34% perf-sched.wait_time.max.ms.__sched_text_start.__sched_text_start.smpboot_thread_fn.kthread.ret_from_fork 0.76 ± 20% +0.2 0.96 ± 3% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__read_swap_cache_async.read_swap_cache_async.swapin_readahead.do_swap_page 0.88 ± 22% +0.3 1.16 ± 6% perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle 0.59 ± 59% +0.3 0.89 ± 12% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.28 ±100% +0.3 0.62 ± 5% perf-profile.calltrace.cycles-pp.mem_cgroup_uncharge_swap.mem_cgroup_charge.__read_swap_cache_async.read_swap_cache_async.swapin_readahead 1.43 ± 20% +0.4 1.83 ± 4% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 0.54 ± 59% +0.4 0.94 ± 8% perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.pagecache_get_page.lookup_swap_cache.do_swap_page 0.56 ± 60% +0.4 0.97 ± 8% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.lookup_swap_cache.do_swap_page.__handle_mm_fault 0.56 ± 60% +0.4 0.98 ± 8% perf-profile.calltrace.cycles-pp.pagecache_get_page.lookup_swap_cache.do_swap_page.__handle_mm_fault.handle_mm_fault 0.13 ±173% +0.4 0.55 ± 6% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.64 ± 60% +0.4 1.09 ± 8% perf-profile.calltrace.cycles-pp.lookup_swap_cache.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 1.56 ± 20% +0.5 2.07 ± 4% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 1.54 ± 34% +0.6 2.12 ± 11% perf-profile.calltrace.cycles-pp.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_lruvec 3.38 ±162% -3.3 0.13 ± 25% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 3.37 ±160% -3.2 0.15 ± 7% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.65 ± 21% -0.3 0.37 ± 10% perf-profile.children.cycles-pp.poll_idle 0.32 ± 4% -0.2 0.10 ± 22% perf-profile.children.cycles-pp.rcu_core 0.23 ± 17% -0.1 0.10 perf-profile.children.cycles-pp.kmem_cache_free 0.16 ± 19% -0.1 0.05 ± 9% perf-profile.children.cycles-pp.__slab_free 0.14 ± 23% -0.1 0.08 ± 29% perf-profile.children.cycles-pp.find_vma 0.15 ± 10% -0.0 0.10 ± 19% perf-profile.children.cycles-pp.xas_create_range 0.15 ± 2% +0.0 0.18 ± 6% perf-profile.children.cycles-pp.__mod_lruvec_state 0.09 ± 20% +0.0 0.12 ± 13% perf-profile.children.cycles-pp.update_cfs_group 0.05 ± 58% +0.0 0.09 ± 10% perf-profile.children.cycles-pp.io_serial_in 0.05 ± 59% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.rcu_nmi_enter 0.20 ± 7% +0.0 0.24 ± 5% perf-profile.children.cycles-pp.__count_memcg_events 0.04 ± 60% +0.0 0.08 ± 19% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.03 ±100% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.__blk_mq_alloc_request 0.03 ±102% +0.0 0.07 ± 14% perf-profile.children.cycles-pp.__rq_qos_throttle 0.08 ± 21% +0.0 0.13 ± 9% perf-profile.children.cycles-pp.blk_throtl_bio 0.01 ±173% +0.0 0.06 ± 13% perf-profile.children.cycles-pp.wbt_wait 0.04 ± 58% +0.1 0.09 ± 15% perf-profile.children.cycles-pp.account_process_tick 0.01 ±173% +0.1 0.06 ± 13% perf-profile.children.cycles-pp.timerqueue_add 0.00 +0.1 0.05 perf-profile.children.cycles-pp.blk_mq_get_tag 0.09 ± 24% +0.1 0.14 ± 12% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.08 ± 29% +0.1 0.13 ± 9% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.04 ± 58% +0.1 0.11 ± 12% perf-profile.children.cycles-pp.workingset_age_nonresident 0.04 ± 58% +0.1 0.11 ± 14% perf-profile.children.cycles-pp.xas_init_marks 0.28 ± 9% +0.1 0.35 ± 9% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.28 ± 26% +0.1 0.35 ± 5% perf-profile.children.cycles-pp.submit_bio_checks 0.10 ± 31% +0.1 0.18 ± 4% perf-profile.children.cycles-pp.__frontswap_load 0.03 ±100% +0.1 0.11 ± 17% perf-profile.children.cycles-pp.xas_clear_mark 0.31 ± 16% +0.1 0.39 ± 8% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.14 ± 21% +0.1 0.23 ± 10% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.10 ± 24% +0.1 0.19 ± 6% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.45 ± 19% +0.1 0.55 ± 6% perf-profile.children.cycles-pp.schedule_idle 0.50 ± 22% +0.1 0.62 ± 7% perf-profile.children.cycles-pp.end_swap_bio_read 0.13 ± 24% +0.2 0.28 ± 8% perf-profile.children.cycles-pp.cpumask_any_but 0.38 ± 31% +0.2 0.54 ± 13% perf-profile.children.cycles-pp.bio_alloc_bioset 0.54 ± 22% +0.2 0.71 ± 6% perf-profile.children.cycles-pp.mem_cgroup_uncharge_swap 0.00 +0.2 0.18 ± 9% perf-profile.children.cycles-pp.workingset_refault 0.43 ± 20% +0.2 0.63 ± 5% perf-profile.children.cycles-pp._find_next_bit 0.80 ± 24% +0.2 1.00 ± 7% perf-profile.children.cycles-pp.blk_mq_submit_bio 0.88 ± 22% +0.3 1.16 ± 7% perf-profile.children.cycles-pp.timekeeping_max_deferment 1.14 ± 25% +0.3 1.43 ± 6% perf-profile.children.cycles-pp.submit_bio 1.12 ± 25% +0.3 1.41 ± 6% perf-profile.children.cycles-pp.submit_bio_noacct 0.80 ± 29% +0.3 1.10 ± 9% perf-profile.children.cycles-pp.xas_load 0.73 ± 33% +0.4 1.09 ± 8% perf-profile.children.cycles-pp.lookup_swap_cache 0.67 ± 34% +0.4 1.03 ± 9% perf-profile.children.cycles-pp.find_get_entry 0.67 ± 33% +0.4 1.04 ± 8% perf-profile.children.cycles-pp.pagecache_get_page 1.44 ± 21% +0.4 1.85 ± 4% perf-profile.children.cycles-pp.tick_nohz_next_event 1.57 ± 21% +0.5 2.08 ± 4% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.00 +0.5 0.53 ± 12% perf-profile.children.cycles-pp.shrink_active_list 1.58 ± 29% +0.5 2.12 ± 11% perf-profile.children.cycles-pp.__swap_writepage 3.38 ±163% -3.3 0.13 ± 25% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.15 ± 21% -0.1 0.05 ± 9% perf-profile.self.cycles-pp.__slab_free 0.12 ± 22% -0.1 0.05 ± 64% perf-profile.self.cycles-pp.vmacache_find 0.18 ± 6% -0.0 0.14 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.07 ± 20% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.page_counter_try_charge 0.13 ± 7% +0.0 0.16 ± 7% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.09 ± 20% +0.0 0.12 ± 13% perf-profile.self.cycles-pp.update_cfs_group 0.11 ± 21% +0.0 0.14 ± 8% perf-profile.self.cycles-pp.mem_cgroup_id_put_many 0.05 ± 58% +0.0 0.09 ± 10% perf-profile.self.cycles-pp.io_serial_in 0.04 ± 59% +0.0 0.08 ± 19% perf-profile.self.cycles-pp.propagate_protected_usage 0.20 ± 5% +0.0 0.23 ± 4% perf-profile.self.cycles-pp.__count_memcg_events 0.10 ± 10% +0.0 0.14 ± 12% perf-profile.self.cycles-pp.xas_create 0.04 ± 58% +0.1 0.09 ± 15% perf-profile.self.cycles-pp.account_process_tick 0.01 ±173% +0.1 0.06 ± 13% perf-profile.self.cycles-pp.__swap_writepage 0.06 ± 66% +0.1 0.11 ± 6% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.04 ± 58% +0.1 0.10 ± 10% perf-profile.self.cycles-pp.workingset_age_nonresident 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.workingset_refault 0.01 ±173% +0.1 0.08 ± 24% perf-profile.self.cycles-pp.percpu_counter_add_batch 0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.__swap_duplicate 0.23 ± 22% +0.1 0.30 ± 9% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.07 ± 62% +0.1 0.16 ± 4% perf-profile.self.cycles-pp.__frontswap_load 0.35 ± 19% +0.1 0.45 ± 7% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.00 +0.1 0.10 ± 15% perf-profile.self.cycles-pp.xas_clear_mark 0.39 ± 20% +0.2 0.58 ± 6% perf-profile.self.cycles-pp._find_next_bit 0.58 ± 27% +0.2 0.81 ± 9% perf-profile.self.cycles-pp.xas_load 0.88 ± 22% +0.3 1.16 ± 7% perf-profile.self.cycles-pp.timekeeping_max_deferment 550.50 ± 37% -53.4% 256.50 ± 57% interrupts.CPU0.RES:Rescheduling_interrupts 471.50 ± 94% -85.9% 66.25 ± 46% interrupts.CPU1.RES:Rescheduling_interrupts 251.25 ± 34% -75.7% 61.00 ± 35% interrupts.CPU10.RES:Rescheduling_interrupts 681.25 ±101% -81.9% 123.25 ± 33% interrupts.CPU100.NMI:Non-maskable_interrupts 681.25 ±101% -81.9% 123.25 ± 33% interrupts.CPU100.PMI:Performance_monitoring_interrupts 256.25 ± 80% -60.7% 100.75 ± 25% interrupts.CPU102.NMI:Non-maskable_interrupts 256.25 ± 80% -60.7% 100.75 ± 25% interrupts.CPU102.PMI:Performance_monitoring_interrupts 240.50 ± 35% -49.3% 122.00 ± 32% interrupts.CPU104.NMI:Non-maskable_interrupts 240.50 ± 35% -49.3% 122.00 ± 32% interrupts.CPU104.PMI:Performance_monitoring_interrupts 1330 ±115% -86.1% 184.50 ± 53% interrupts.CPU108.NMI:Non-maskable_interrupts 1330 ±115% -86.1% 184.50 ± 53% interrupts.CPU108.PMI:Performance_monitoring_interrupts 375.25 ± 51% -46.4% 201.00 ± 62% interrupts.CPU11.NMI:Non-maskable_interrupts 375.25 ± 51% -46.4% 201.00 ± 62% interrupts.CPU11.PMI:Performance_monitoring_interrupts 414.25 ± 37% -69.2% 127.50 ± 30% interrupts.CPU111.NMI:Non-maskable_interrupts 414.25 ± 37% -69.2% 127.50 ± 30% interrupts.CPU111.PMI:Performance_monitoring_interrupts 2112995 ± 11% -28.8% 1504089 ± 42% interrupts.CPU114.TLB:TLB_shootdowns 31.00 ± 36% +126.6% 70.25 ± 65% interrupts.CPU118.RES:Rescheduling_interrupts 1831 ±103% -86.4% 249.00 ± 83% interrupts.CPU12.NMI:Non-maskable_interrupts 1831 ±103% -86.4% 249.00 ± 83% interrupts.CPU12.PMI:Performance_monitoring_interrupts 241.75 ± 72% -83.5% 40.00 ± 36% interrupts.CPU12.RES:Rescheduling_interrupts 106.75 ± 37% +64.9% 176.00 ± 22% interrupts.CPU125.RES:Rescheduling_interrupts 850681 ± 26% +37.7% 1171518 ± 18% interrupts.CPU126.CAL:Function_call_interrupts 99.50 ± 61% +97.2% 196.25 ± 16% interrupts.CPU126.RES:Rescheduling_interrupts 124.50 ± 38% +89.6% 236.00 ± 22% interrupts.CPU129.RES:Rescheduling_interrupts 284.00 ± 65% -84.6% 43.75 ± 42% interrupts.CPU13.RES:Rescheduling_interrupts 988716 ± 18% +35.6% 1340401 ± 2% interrupts.CPU131.CAL:Function_call_interrupts 1052717 ± 14% +50.1% 1580609 ± 20% interrupts.CPU133.CAL:Function_call_interrupts 151.50 ± 56% +94.2% 294.25 ± 21% interrupts.CPU135.RES:Rescheduling_interrupts 55.75 ± 38% +86.5% 104.00 ± 23% interrupts.CPU136.RES:Rescheduling_interrupts 41.75 ± 41% +91.0% 79.75 ± 33% interrupts.CPU137.RES:Rescheduling_interrupts 82031 ± 44% -77.9% 18146 ± 23% interrupts.CPU15.CAL:Function_call_interrupts 470.25 ± 38% -68.8% 146.50 ± 20% interrupts.CPU15.NMI:Non-maskable_interrupts 470.25 ± 38% -68.8% 146.50 ± 20% interrupts.CPU15.PMI:Performance_monitoring_interrupts 478.25 ± 91% -83.4% 79.50 ± 80% interrupts.CPU15.RES:Rescheduling_interrupts 83996 ± 12% -62.1% 31856 ±109% interrupts.CPU16.CAL:Function_call_interrupts 266121 ± 37% -77.9% 58704 ± 82% interrupts.CPU16.TLB:TLB_shootdowns 216830 ± 74% -90.0% 21706 ± 80% interrupts.CPU17.CAL:Function_call_interrupts 155845 ±104% -91.7% 12939 ±118% interrupts.CPU18.CAL:Function_call_interrupts 305444 ± 48% -81.6% 56176 ±145% interrupts.CPU18.TLB:TLB_shootdowns 580700 ± 24% +100.8% 1165795 ± 11% interrupts.CPU187.CAL:Function_call_interrupts 1143784 ± 33% +56.2% 1786340 ± 17% interrupts.CPU187.TLB:TLB_shootdowns 403282 ± 41% +83.7% 741015 ± 26% interrupts.CPU189.CAL:Function_call_interrupts 127301 ± 69% -75.3% 31438 ±152% interrupts.CPU19.CAL:Function_call_interrupts 139476 ± 41% -85.3% 20557 ± 82% interrupts.CPU20.CAL:Function_call_interrupts 241687 ± 55% -90.2% 23612 ±132% interrupts.CPU21.CAL:Function_call_interrupts 390203 ± 56% -76.1% 93439 ±128% interrupts.CPU21.TLB:TLB_shootdowns 1374 ± 3% -41.8% 800.25 ± 28% interrupts.CPU24.RES:Rescheduling_interrupts 291.25 ± 38% -69.3% 89.50 ± 57% interrupts.CPU25.RES:Rescheduling_interrupts 372.50 ± 61% -90.9% 34.00 ± 16% interrupts.CPU27.RES:Rescheduling_interrupts 382.25 ± 17% -70.5% 112.75 ± 65% interrupts.CPU29.RES:Rescheduling_interrupts 109264 ± 20% -42.8% 62530 ± 35% interrupts.CPU3.CAL:Function_call_interrupts 348.75 ± 52% -58.7% 144.00 ± 21% interrupts.CPU3.NMI:Non-maskable_interrupts 348.75 ± 52% -58.7% 144.00 ± 21% interrupts.CPU3.PMI:Performance_monitoring_interrupts 184.25 ± 67% -69.2% 56.75 ± 39% interrupts.CPU3.RES:Rescheduling_interrupts 866.75 ±101% -74.6% 220.25 ± 51% interrupts.CPU32.NMI:Non-maskable_interrupts 866.75 ±101% -74.6% 220.25 ± 51% interrupts.CPU32.PMI:Performance_monitoring_interrupts 386.25 ± 77% -81.0% 73.50 ± 62% interrupts.CPU32.RES:Rescheduling_interrupts 175.75 ± 47% -84.8% 26.75 ± 38% interrupts.CPU33.RES:Rescheduling_interrupts 86801 ± 77% -78.3% 18806 ± 56% interrupts.CPU34.CAL:Function_call_interrupts 290.25 ± 54% -77.1% 66.50 ± 74% interrupts.CPU34.RES:Rescheduling_interrupts 509.25 ± 85% -72.1% 142.00 ± 19% interrupts.CPU4.NMI:Non-maskable_interrupts 509.25 ± 85% -72.1% 142.00 ± 19% interrupts.CPU4.PMI:Performance_monitoring_interrupts 233.75 ± 67% +103.7% 476.25 ± 20% interrupts.CPU41.NMI:Non-maskable_interrupts 233.75 ± 67% +103.7% 476.25 ± 20% interrupts.CPU41.PMI:Performance_monitoring_interrupts 102481 ± 60% -86.2% 14192 ± 89% interrupts.CPU42.CAL:Function_call_interrupts 199657 ± 62% -70.0% 59900 ±120% interrupts.CPU42.TLB:TLB_shootdowns 99111 ± 36% -64.7% 34962 ±106% interrupts.CPU44.CAL:Function_call_interrupts 133788 ± 70% -76.7% 31187 ± 87% interrupts.CPU47.CAL:Function_call_interrupts 255715 ± 45% -72.7% 69684 ± 87% interrupts.CPU47.TLB:TLB_shootdowns 750.25 ± 24% -51.7% 362.25 ± 74% interrupts.CPU48.RES:Rescheduling_interrupts 111872 ± 61% -68.1% 35692 ± 13% interrupts.CPU51.CAL:Function_call_interrupts 248476 ± 54% -65.9% 84695 ± 57% interrupts.CPU51.TLB:TLB_shootdowns 130521 ± 86% -75.4% 32054 ± 81% interrupts.CPU53.CAL:Function_call_interrupts 330056 ± 64% -76.1% 78788 ±107% interrupts.CPU53.TLB:TLB_shootdowns 122572 ± 36% -73.8% 32077 ± 65% interrupts.CPU54.CAL:Function_call_interrupts 223.75 ± 73% -81.3% 41.75 ± 60% interrupts.CPU54.RES:Rescheduling_interrupts 261777 ± 29% -69.6% 79586 ±101% interrupts.CPU54.TLB:TLB_shootdowns 38695 ± 78% -73.9% 10112 ± 83% interrupts.CPU59.CAL:Function_call_interrupts 91774 ± 39% -75.9% 22107 ± 69% interrupts.CPU6.CAL:Function_call_interrupts 337.75 ± 54% -82.3% 59.75 ± 48% interrupts.CPU6.RES:Rescheduling_interrupts 38136 ± 70% -76.6% 8929 ± 95% interrupts.CPU62.CAL:Function_call_interrupts 107221 ± 74% -82.2% 19106 ±131% interrupts.CPU62.TLB:TLB_shootdowns 50363 ± 79% -85.2% 7477 ± 51% interrupts.CPU63.CAL:Function_call_interrupts 107471 ± 89% -65.0% 37647 ±100% interrupts.CPU63.TLB:TLB_shootdowns 196470 ± 27% -89.8% 20111 ±146% interrupts.CPU66.CAL:Function_call_interrupts 251626 ± 28% -86.9% 33021 ±168% interrupts.CPU66.TLB:TLB_shootdowns 244907 ± 51% -95.9% 10117 ± 95% interrupts.CPU67.CAL:Function_call_interrupts 351943 ± 41% -94.1% 20599 ± 98% interrupts.CPU67.TLB:TLB_shootdowns 111121 ± 44% -92.8% 7951 ± 95% interrupts.CPU68.CAL:Function_call_interrupts 169523 ± 45% -80.0% 33881 ±144% interrupts.CPU68.TLB:TLB_shootdowns 128876 ± 44% -97.2% 3560 ± 35% interrupts.CPU69.CAL:Function_call_interrupts 196198 ± 26% -96.1% 7648 ± 82% interrupts.CPU69.TLB:TLB_shootdowns 86918 ± 43% -78.8% 18404 ±138% interrupts.CPU70.CAL:Function_call_interrupts 137071 ± 53% -69.6% 41713 ±137% interrupts.CPU70.TLB:TLB_shootdowns 248192 ± 54% -99.1% 2141 ± 28% interrupts.CPU71.CAL:Function_call_interrupts 351778 ± 50% -99.4% 2248 ±171% interrupts.CPU71.TLB:TLB_shootdowns 72843 ± 39% -59.9% 29213 ± 73% interrupts.CPU79.CAL:Function_call_interrupts 296.25 ± 75% -95.6% 13.00 ± 39% interrupts.CPU79.RES:Rescheduling_interrupts 294.75 ± 44% -51.8% 142.00 ± 14% interrupts.CPU8.NMI:Non-maskable_interrupts 294.75 ± 44% -51.8% 142.00 ± 14% interrupts.CPU8.PMI:Performance_monitoring_interrupts 631.50 ± 60% -71.2% 181.75 ± 13% interrupts.CPU82.NMI:Non-maskable_interrupts 631.50 ± 60% -71.2% 181.75 ± 13% interrupts.CPU82.PMI:Performance_monitoring_interrupts 180.75 ± 53% -76.1% 43.25 ±118% interrupts.CPU83.RES:Rescheduling_interrupts 224.25 ± 45% -74.6% 57.00 ±126% interrupts.CPU84.RES:Rescheduling_interrupts 152.75 ± 76% -67.1% 50.25 ±110% interrupts.CPU85.RES:Rescheduling_interrupts 69834 ± 44% -89.6% 7248 ± 34% interrupts.CPU88.CAL:Function_call_interrupts 175679 ± 56% -84.4% 27337 ± 52% interrupts.CPU88.TLB:TLB_shootdowns 79758 ± 46% -67.9% 25563 ±130% interrupts.CPU89.CAL:Function_call_interrupts 172259 ± 39% -90.6% 16168 ± 96% interrupts.CPU91.CAL:Function_call_interrupts 163998 ± 41% -87.5% 20465 ±101% interrupts.CPU92.CAL:Function_call_interrupts 272932 ± 52% -79.7% 55479 ±115% interrupts.CPU92.TLB:TLB_shootdowns 171203 ± 30% -88.9% 19071 ±112% interrupts.CPU93.CAL:Function_call_interrupts 281620 ± 34% -85.6% 40571 ± 74% interrupts.CPU93.TLB:TLB_shootdowns 1737 ±123% -92.9% 123.50 ± 17% interrupts.CPU96.NMI:Non-maskable_interrupts 1737 ±123% -92.9% 123.50 ± 17% interrupts.CPU96.PMI:Performance_monitoring_interrupts 353.50 ± 48% -60.5% 139.50 ± 44% interrupts.CPU97.NMI:Non-maskable_interrupts 353.50 ± 48% -60.5% 139.50 ± 44% interrupts.CPU97.PMI:Performance_monitoring_interrupts 432.00 ± 42% -66.6% 144.25 ± 21% interrupts.CPU99.NMI:Non-maskable_interrupts 432.00 ± 42% -66.6% 144.25 ± 21% interrupts.CPU99.PMI:Performance_monitoring_interrupts 25708 ± 6% -20.9% 20326 ± 8% interrupts.RES:Rescheduling_interrupts 35428 ± 11% -32.4% 23935 ± 12% softirqs.CPU0.RCU 32512 -32.2% 22047 ± 8% softirqs.CPU1.RCU 31237 ± 2% -31.1% 21518 ± 8% softirqs.CPU10.RCU 33358 ± 2% -34.0% 22013 ± 8% softirqs.CPU100.RCU 34383 ± 5% -34.9% 22384 ± 4% softirqs.CPU101.RCU 34539 ± 3% -36.4% 21956 ± 7% softirqs.CPU102.RCU 33724 ± 6% -35.7% 21681 ± 9% softirqs.CPU103.RCU 33883 ± 2% -36.8% 21411 ± 8% softirqs.CPU104.RCU 33349 ± 3% -34.5% 21843 ± 7% softirqs.CPU105.RCU 33947 ± 3% -35.6% 21869 ± 8% softirqs.CPU106.RCU 35088 ± 2% -37.9% 21804 ± 8% softirqs.CPU107.RCU 35392 -37.6% 22077 ± 9% softirqs.CPU108.RCU 34530 -36.0% 22086 ± 9% softirqs.CPU109.RCU 31070 ± 5% -30.1% 21721 ± 7% softirqs.CPU11.RCU 35908 ± 2% -40.7% 21300 ± 8% softirqs.CPU110.RCU 35501 -38.7% 21779 ± 7% softirqs.CPU111.RCU 34344 ± 2% -42.2% 19837 ± 6% softirqs.CPU112.RCU 33845 -41.0% 19980 ± 7% softirqs.CPU113.RCU 33862 ± 3% -39.7% 20433 ± 7% softirqs.CPU114.RCU 32765 ± 3% -39.1% 19942 ± 7% softirqs.CPU115.RCU 32934 ± 2% -38.6% 20224 ± 5% softirqs.CPU116.RCU 32819 ± 3% -39.5% 19865 ± 6% softirqs.CPU117.RCU 33093 ± 3% -39.9% 19885 ± 7% softirqs.CPU118.RCU 32575 ± 4% -38.9% 19898 ± 6% softirqs.CPU119.RCU 31681 ± 7% -31.0% 21852 ± 7% softirqs.CPU12.RCU 33330 ± 6% -41.4% 19546 ± 6% softirqs.CPU120.RCU 33723 ± 5% -43.1% 19200 ± 5% softirqs.CPU121.RCU 33744 ± 6% -42.7% 19336 ± 6% softirqs.CPU122.RCU 33521 ± 8% -41.4% 19648 ± 5% softirqs.CPU123.RCU 33386 ± 5% -40.7% 19799 ± 5% softirqs.CPU124.RCU 33788 ± 4% -43.8% 18979 ± 6% softirqs.CPU125.RCU 33692 ± 6% -41.4% 19756 ± 5% softirqs.CPU126.RCU 33196 ± 7% -41.8% 19309 ± 5% softirqs.CPU127.RCU 34241 ± 7% -42.0% 19853 ± 7% softirqs.CPU128.RCU 33830 ± 6% -42.1% 19600 ± 7% softirqs.CPU129.RCU 31799 ± 5% -31.3% 21860 ± 9% softirqs.CPU13.RCU 33276 ± 4% -41.2% 19566 ± 7% softirqs.CPU130.RCU 34680 ± 5% -42.8% 19829 ± 6% softirqs.CPU131.RCU 34512 ± 4% -42.3% 19913 ± 7% softirqs.CPU132.RCU 35534 ± 2% -44.7% 19654 ± 6% softirqs.CPU133.RCU 34896 ± 3% -43.0% 19889 ± 8% softirqs.CPU134.RCU 34745 ± 5% -42.9% 19831 ± 7% softirqs.CPU135.RCU 35559 ± 7% -44.1% 19890 ± 6% softirqs.CPU136.RCU 34349 ± 6% -41.7% 20009 ± 8% softirqs.CPU137.RCU 34036 ± 5% -41.9% 19771 ± 6% softirqs.CPU138.RCU 34760 ± 2% -42.6% 19946 ± 7% softirqs.CPU139.RCU 31258 ± 2% -31.2% 21499 ± 7% softirqs.CPU14.RCU 33466 ± 4% -40.8% 19814 ± 7% softirqs.CPU140.RCU 32509 ± 5% -40.8% 19246 ± 7% softirqs.CPU141.RCU 33244 ± 3% -35.0% 21617 ± 8% softirqs.CPU142.RCU 32706 ± 5% -38.6% 20067 ± 7% softirqs.CPU143.RCU 33261 ± 4% -37.7% 20717 ± 5% softirqs.CPU144.RCU 32254 ± 2% -37.2% 20271 ± 4% softirqs.CPU145.RCU 32274 ± 4% -38.1% 19985 ± 4% softirqs.CPU146.RCU 32816 ± 4% -37.4% 20532 ± 6% softirqs.CPU147.RCU 33441 ± 8% -38.9% 20441 ± 6% softirqs.CPU148.RCU 33248 ± 6% -40.0% 19953 ± 7% softirqs.CPU149.RCU 30279 ± 9% -27.9% 21839 ± 9% softirqs.CPU15.RCU 32601 ± 6% -38.2% 20155 ± 5% softirqs.CPU150.RCU 32860 ± 4% -37.1% 20673 ± 8% softirqs.CPU151.RCU 32643 ± 6% -37.0% 20569 ± 8% softirqs.CPU152.RCU 33337 ± 8% -39.2% 20261 ± 5% softirqs.CPU153.RCU 32641 ± 7% -37.2% 20493 ± 6% softirqs.CPU154.RCU 32548 ± 5% -36.8% 20580 ± 5% softirqs.CPU155.RCU 33385 ± 4% -38.5% 20531 ± 5% softirqs.CPU156.RCU 33250 ± 8% -39.9% 19972 ± 4% softirqs.CPU157.RCU 33614 ± 5% -39.0% 20507 ± 7% softirqs.CPU158.RCU 32542 ± 7% -37.4% 20365 ± 6% softirqs.CPU159.RCU 30962 ± 4% -33.2% 20694 ± 6% softirqs.CPU16.RCU 33130 ± 2% -40.5% 19714 ± 4% softirqs.CPU160.RCU 32930 ± 4% -39.2% 20029 ± 5% softirqs.CPU161.RCU 33810 ± 5% -39.5% 20452 ± 7% softirqs.CPU162.RCU 33694 ± 4% -39.9% 20249 ± 4% softirqs.CPU163.RCU 32579 ± 3% -38.7% 19955 ± 6% softirqs.CPU164.RCU 31732 ± 3% -36.8% 20067 ± 4% softirqs.CPU165.RCU 32614 ± 3% -37.1% 20502 ± 7% softirqs.CPU166.RCU 32179 ± 3% -37.2% 20218 ± 4% softirqs.CPU167.RCU 31673 ± 4% -40.9% 18722 ± 4% softirqs.CPU168.RCU 31132 ± 6% -39.3% 18899 ± 4% softirqs.CPU169.RCU 31814 ± 4% -34.4% 20885 ± 5% softirqs.CPU17.RCU 32315 ± 6% -44.3% 17995 ± 3% softirqs.CPU170.RCU 31903 ± 6% -42.2% 18436 ± 4% softirqs.CPU171.RCU 30810 ± 6% -39.0% 18786 ± 3% softirqs.CPU172.RCU 31117 ± 6% -40.0% 18661 ± 6% softirqs.CPU173.RCU 31954 ± 7% -41.8% 18597 ± 4% softirqs.CPU174.RCU 31720 ± 5% -41.1% 18696 ± 4% softirqs.CPU175.RCU 34100 ± 10% -41.9% 19817 ± 5% softirqs.CPU176.RCU 32522 ± 6% -41.6% 19004 ± 6% softirqs.CPU177.RCU 32041 ± 7% -41.7% 18685 ± 8% softirqs.CPU178.RCU 32337 ± 7% -41.1% 19031 ± 6% softirqs.CPU179.RCU 31987 ± 8% -34.0% 21115 ± 5% softirqs.CPU18.RCU 32733 ± 3% -40.8% 19385 ± 8% softirqs.CPU180.RCU 32337 ± 5% -40.0% 19418 ± 8% softirqs.CPU181.RCU 31730 ± 5% -40.5% 18894 ± 7% softirqs.CPU182.RCU 32190 -41.7% 18778 ± 6% softirqs.CPU183.RCU 32604 ± 5% -41.5% 19066 ± 7% softirqs.CPU184.RCU 32316 -41.1% 19049 ± 6% softirqs.CPU185.RCU 31497 ± 2% -41.6% 18383 ± 5% softirqs.CPU186.RCU 31844 ± 4% -40.9% 18828 ± 7% softirqs.CPU187.RCU 31207 ± 6% -37.6% 19479 ± 7% softirqs.CPU188.RCU 31677 ± 5% -40.2% 18932 ± 7% softirqs.CPU189.RCU 31643 ± 4% -34.0% 20898 ± 5% softirqs.CPU19.RCU 31618 ± 8% -38.9% 19308 ± 5% softirqs.CPU190.RCU 30165 ± 6% -34.8% 19667 ± 5% softirqs.CPU191.RCU 30591 ± 4% -28.1% 21993 ± 5% softirqs.CPU2.RCU 45537 +10.8% 50453 ± 2% softirqs.CPU2.SCHED 31294 ± 5% -33.7% 20740 ± 5% softirqs.CPU20.RCU 32036 ± 3% -34.9% 20853 ± 5% softirqs.CPU21.RCU 31837 ± 3% -34.8% 20770 ± 6% softirqs.CPU22.RCU 31914 ± 2% -34.8% 20815 ± 6% softirqs.CPU23.RCU 32142 ± 4% -36.9% 20279 ± 6% softirqs.CPU24.RCU 30685 ± 5% -34.5% 20098 ± 6% softirqs.CPU25.RCU 30461 ± 5% -33.3% 20307 ± 5% softirqs.CPU26.RCU 29637 ± 9% -31.0% 20444 ± 6% softirqs.CPU27.RCU 30580 ± 5% -33.5% 20334 ± 5% softirqs.CPU28.RCU 30860 ± 5% -35.7% 19856 ± 9% softirqs.CPU29.RCU 30808 ± 4% -29.4% 21739 ± 9% softirqs.CPU3.RCU 30612 ± 5% -33.8% 20276 ± 5% softirqs.CPU30.RCU 30416 ± 5% -34.4% 19957 ± 6% softirqs.CPU31.RCU 32305 ± 8% -34.3% 21232 ± 7% softirqs.CPU32.RCU 32214 ± 5% -34.5% 21085 ± 6% softirqs.CPU33.RCU 31564 ± 4% -33.1% 21101 ± 7% softirqs.CPU34.RCU 32098 ± 6% -34.2% 21115 ± 7% softirqs.CPU35.RCU 31331 ± 4% -27.0% 22869 ± 13% softirqs.CPU36.RCU 31247 ± 5% -32.2% 21178 ± 7% softirqs.CPU37.RCU 32514 ± 8% -35.0% 21125 ± 6% softirqs.CPU38.RCU 31150 ± 4% -29.4% 21977 ± 8% softirqs.CPU39.RCU 30868 ± 4% -29.4% 21808 ± 7% softirqs.CPU4.RCU 31274 ± 5% -32.2% 21217 ± 6% softirqs.CPU40.RCU 31369 ± 6% -32.9% 21039 ± 7% softirqs.CPU41.RCU 31353 ± 5% -33.6% 20822 ± 6% softirqs.CPU42.RCU 32650 ± 5% -34.9% 21267 ± 7% softirqs.CPU43.RCU 31688 ± 4% -32.6% 21360 ± 5% softirqs.CPU44.RCU 31966 ± 7% -34.1% 21053 ± 7% softirqs.CPU45.RCU 31681 ± 5% -33.4% 21111 ± 7% softirqs.CPU46.RCU 31963 ± 5% -34.3% 20989 ± 7% softirqs.CPU47.RCU 32375 ± 6% -33.5% 21544 ± 6% softirqs.CPU48.RCU 31389 ± 5% -28.6% 22426 ± 9% softirqs.CPU49.RCU 31171 ± 4% -28.6% 22264 ± 7% softirqs.CPU5.RCU 32538 ± 6% -34.2% 21408 ± 4% softirqs.CPU50.RCU 31689 ± 5% -31.9% 21577 ± 7% softirqs.CPU51.RCU 31219 ± 7% -30.8% 21588 ± 6% softirqs.CPU52.RCU 31505 ± 5% -33.2% 21052 ± 6% softirqs.CPU53.RCU 31950 ± 6% -32.7% 21498 ± 5% softirqs.CPU54.RCU 31274 ± 5% -32.4% 21147 ± 5% softirqs.CPU55.RCU 31105 ± 5% -31.4% 21350 ± 7% softirqs.CPU56.RCU 31774 ± 5% -32.9% 21325 ± 4% softirqs.CPU57.RCU 30439 ± 10% -29.3% 21506 ± 6% softirqs.CPU58.RCU 31582 ± 5% -30.5% 21947 ± 5% softirqs.CPU59.RCU 31230 ± 4% -30.4% 21728 ± 7% softirqs.CPU6.RCU 31606 ± 5% -30.5% 21952 ± 4% softirqs.CPU60.RCU 31319 ± 6% -32.7% 21076 ± 5% softirqs.CPU61.RCU 31538 ± 7% -33.1% 21088 ± 6% softirqs.CPU62.RCU 31193 ± 5% -31.1% 21499 ± 7% softirqs.CPU63.RCU 32026 ± 3% -35.3% 20715 ± 5% softirqs.CPU64.RCU 32074 ± 3% -34.6% 20982 ± 5% softirqs.CPU65.RCU 33788 ± 6% -38.3% 20852 ± 5% softirqs.CPU66.RCU 32471 ± 5% -34.9% 21149 ± 5% softirqs.CPU67.RCU 32427 ± 6% -35.7% 20861 ± 6% softirqs.CPU68.RCU 32462 ± 4% -35.2% 21044 ± 6% softirqs.CPU69.RCU 31535 ± 4% -30.6% 21879 ± 7% softirqs.CPU7.RCU 43714 ± 5% +11.5% 48741 ± 2% softirqs.CPU7.SCHED 32081 ± 2% -35.0% 20854 ± 6% softirqs.CPU70.RCU 32576 ± 3% -35.4% 21031 ± 5% softirqs.CPU71.RCU 30737 ± 4% -35.1% 19939 ± 4% softirqs.CPU72.RCU 30253 ± 4% -35.3% 19568 ± 5% softirqs.CPU73.RCU 30874 ± 7% -37.0% 19449 ± 5% softirqs.CPU74.RCU 29806 ± 4% -34.3% 19591 ± 5% softirqs.CPU75.RCU 29904 ± 5% -35.0% 19451 ± 5% softirqs.CPU76.RCU 29914 ± 4% -34.7% 19541 ± 4% softirqs.CPU77.RCU 30603 ± 5% -36.8% 19352 ± 5% softirqs.CPU78.RCU 30164 ± 5% -34.1% 19885 ± 7% softirqs.CPU79.RCU 30473 ± 4% -28.6% 21745 ± 7% softirqs.CPU8.RCU 30256 ± 4% -34.1% 19941 ± 6% softirqs.CPU80.RCU 29945 ± 4% -33.3% 19961 ± 5% softirqs.CPU81.RCU 30259 ± 4% -34.0% 19972 ± 7% softirqs.CPU82.RCU 30326 ± 4% -34.0% 20016 ± 6% softirqs.CPU83.RCU 30662 ± 5% -35.0% 19939 ± 5% softirqs.CPU84.RCU 30592 ± 4% -34.8% 19953 ± 6% softirqs.CPU85.RCU 30065 ± 4% -34.5% 19702 ± 6% softirqs.CPU86.RCU 30100 ± 4% -34.2% 19805 ± 6% softirqs.CPU87.RCU 30493 ± 6% -33.3% 20336 ± 4% softirqs.CPU88.RCU 30934 ± 6% -35.7% 19883 ± 6% softirqs.CPU89.RCU 31023 ± 5% -30.4% 21580 ± 6% softirqs.CPU9.RCU 30607 ± 5% -35.8% 19653 ± 5% softirqs.CPU90.RCU 31895 ± 3% -37.3% 20002 ± 6% softirqs.CPU91.RCU 30994 ± 5% -34.7% 20242 ± 7% softirqs.CPU92.RCU 31973 ± 5% -38.0% 19833 ± 5% softirqs.CPU93.RCU 31326 ± 7% -35.8% 20111 ± 6% softirqs.CPU94.RCU 32100 ± 4% -36.3% 20461 ± 7% softirqs.CPU95.RCU 34644 ± 2% -37.9% 21527 ± 7% softirqs.CPU96.RCU 34061 ± 5% -36.2% 21721 ± 7% softirqs.CPU97.RCU 34668 ± 3% -38.2% 21433 ± 6% softirqs.CPU98.RCU 34388 ± 3% -37.3% 21564 ± 7% softirqs.CPU99.RCU 6196758 ± 4% -36.5% 3932333 ± 6% softirqs.RCU vm-scalability.median 7000 +--------------------------------------------------------------------+ |.+.+.+.+.+.++.+ +.+.+.+.+.+.+.+.++.+.+.+ +.+.+. | 6000 |-O O O O O OO : : O O O O O O OO O O : O : O O +.+.+.+O O O O O | | : : : : | 5000 |-+ : : : : | | : : : : | 4000 |-+ : : : : | | : : : : | 3000 |-+ : : : : | | : : : : | 2000 |-+ : : : : | | : : | 1000 |-+ : : | | : : | 0 +--------------------------------------------------------------------+ vm-scalability.stddev_ 4500 +--------------------------------------------------------------------+ | O | 4000 |-+ | 3500 |-+ | | | 3000 |-+ | 2500 |-+ | | | 2000 |-+ | 1500 |-+ | | | 1000 |-+ | 500 |-+ | | O O O O O OO O O.+.O O O O OO O O O O.+.O O.+.+.+.+ O O O O | 0 +--------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-csl-2sp4: 96 threads Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_pmem/nr_task/priority/rootfs/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode: gcc-9/performance/x86_64-rhel-8.3/2/8/1/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp4/swap-w-seq/vm-scalability/never/never/0x4003003 commit: 3852f6768e ("mm/swapcache: support to handle the shadow entries") aae466b005 ("mm/swap: implement workingset detection for anonymous LRU") 3852f6768ede542e aae466b0052e1888edd1d7f473d ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :3 29% 0:2 perf-profile.calltrace.cycles-pp.sync_regs.error_entry.do_access :3 34% 1:2 perf-profile.calltrace.cycles-pp.error_entry.do_access 1:3 11% 1:2 perf-profile.children.cycles-pp.error_entry 0:3 1% 0:2 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 542839 +18.8% 644645 ± 9% vm-scalability.median 4306633 +12.8% 4855863 ± 4% vm-scalability.throughput 30.01 -3.1% 29.07 vm-scalability.time.elapsed_time 30.01 -3.1% 29.07 vm-scalability.time.elapsed_time.max 36096 ± 27% -64.0% 12994 ± 41% vm-scalability.time.involuntary_context_switches 5106690 ± 5% +26.8% 6477410 ± 13% vm-scalability.time.maximum_resident_set_size 2001 ± 56% -69.5% 611.00 ± 12% vm-scalability.time.voluntary_context_switches 5476 ± 29% +311.6% 22539 ± 78% cpuidle.C1.usage 5283 ± 16% -36.1% 3375 ± 9% vmstat.system.cs 20.69 +3.5% 21.42 ± 2% boot-time.boot 1529 ± 3% +7.5% 1643 boot-time.idle 89.51 +1.3% 90.68 iostat.cpu.idle 8.65 -14.6% 7.39 ± 11% iostat.cpu.system 36029 ± 14% +68.2% 60587 ± 30% meminfo.CmaFree 697090 ± 5% +9.4% 762414 ± 2% meminfo.DirectMap4k 0.00 ± 10% +0.0 0.00 mpstat.cpu.all.iowait% 0.35 ± 5% -0.3 0.05 ± 18% mpstat.cpu.all.soft% 1.813e+08 ± 2% -41.0% 1.07e+08 ± 17% perf-node.node-loads 38.67 ± 2% -32.8% 26.00 ± 7% perf-node.node-local-load-ratio 54.67 -61.6% 21.00 ± 9% perf-node.node-local-store-ratio 2.167e+08 ± 4% -20.8% 1.717e+08 ± 9% perf-node.node-store-misses 2.671e+08 ± 2% -82.3% 47402485 ± 2% perf-node.node-stores 22519 ± 3% -20.3% 17951 ± 9% numa-meminfo.node0.Active 22324 ± 3% -20.6% 17736 ± 10% numa-meminfo.node0.Active(anon) 13921 ± 2% +15.8% 16121 ± 14% numa-meminfo.node0.Mapped 5201 ± 20% +32.3% 6881 ± 3% numa-meminfo.node1.Active 5084 ± 20% +34.0% 6811 ± 3% numa-meminfo.node1.Active(anon) 65575 ± 4% +12.4% 73725 ± 5% numa-meminfo.node1.KReclaimable 7093 ± 2% +7.4% 7615 ± 2% numa-meminfo.node1.KernelStack 17090 ± 4% -13.8% 14733 ± 5% numa-meminfo.node1.Mapped 66670 ± 5% -23.4% 51082 ± 14% numa-meminfo.node1.PageTables 65575 ± 4% +12.4% 73725 ± 5% numa-meminfo.node1.SReclaimable 3308500 ± 20% +140.2% 7945839 ± 36% numa-numastat.node0.local_node 1675907 ± 6% +140.5% 4030944 ± 4% numa-numastat.node0.numa_foreign 3318819 ± 20% +140.3% 7976782 ± 36% numa-numastat.node0.numa_hit 5171847 ± 14% -62.5% 1939771 ± 34% numa-numastat.node0.numa_miss 5182188 ± 14% -62.0% 1970716 ± 34% numa-numastat.node0.other_node 15171228 -31.1% 10449562 ± 23% numa-numastat.node1.local_node 5171847 ± 14% -62.5% 1939771 ± 34% numa-numastat.node1.numa_foreign 15191898 -31.2% 10449560 ± 23% numa-numastat.node1.numa_hit 1675907 ± 6% +140.5% 4030944 ± 4% numa-numastat.node1.numa_miss 1696577 ± 7% +137.6% 4030962 ± 4% numa-numastat.node1.other_node 1430 ± 4% +14.6% 1640 ± 2% slabinfo.Acpi-Parse.active_objs 1430 ± 4% +14.6% 1640 ± 2% slabinfo.Acpi-Parse.num_objs 1495 ± 7% +28.5% 1921 ± 9% slabinfo.dmaengine-unmap-16.active_objs 1495 ± 7% +28.5% 1921 ± 9% slabinfo.dmaengine-unmap-16.num_objs 4330 ± 9% +8.6% 4704 ± 4% slabinfo.eventpoll_pwq.active_objs 4330 ± 9% +8.6% 4704 ± 4% slabinfo.eventpoll_pwq.num_objs 893.33 +5.4% 941.50 ± 4% slabinfo.filp.active_slabs 28601 +5.4% 30133 ± 4% slabinfo.filp.num_objs 893.33 +5.4% 941.50 ± 4% slabinfo.filp.num_slabs 790.00 ± 11% +16.2% 918.00 ± 6% slabinfo.kmem_cache_node.active_objs 828.00 ± 10% +15.3% 955.00 ± 6% slabinfo.kmem_cache_node.num_objs 1983 ± 9% +16.6% 2312 ± 10% slabinfo.radix_tree_node.active_slabs 111093 ± 9% +16.6% 129533 ± 10% slabinfo.radix_tree_node.num_objs 1983 ± 9% +16.6% 2312 ± 10% slabinfo.radix_tree_node.num_slabs 4330 ± 6% -15.0% 3680 slabinfo.skbuff_head_cache.active_objs 4330 ± 6% -15.0% 3680 slabinfo.skbuff_head_cache.num_objs 5566 ± 3% -20.5% 4424 ± 9% numa-vmstat.node0.nr_active_anon 3524 ± 3% +15.2% 4061 ± 13% numa-vmstat.node0.nr_mapped 5576 ± 2% -20.7% 4424 ± 9% numa-vmstat.node0.nr_zone_active_anon 1054096 ± 10% +164.4% 2787187 ± 19% numa-vmstat.node0.numa_foreign 2769819 ± 18% +83.1% 5070160 ± 30% numa-vmstat.node0.numa_hit 2716892 ± 17% +83.2% 4977012 ± 32% numa-vmstat.node0.numa_local 3395314 ± 14% -63.4% 1241437 ± 54% numa-vmstat.node0.numa_miss 3448253 ± 12% -61.3% 1334595 ± 55% numa-vmstat.node0.numa_other 1265 ± 21% +34.8% 1706 ± 4% numa-vmstat.node1.nr_active_anon 8775 ± 13% +74.8% 15335 ± 29% numa-vmstat.node1.nr_free_cma 103.33 ± 4% -37.1% 65.00 ± 30% numa-vmstat.node1.nr_isolated_anon 7103 ± 2% +7.3% 7619 ± 2% numa-vmstat.node1.nr_kernel_stack 16671 ± 4% -23.3% 12782 ± 14% numa-vmstat.node1.nr_page_table_pages 1276 ± 21% +33.8% 1707 ± 4% numa-vmstat.node1.nr_zone_active_anon 3395812 ± 14% -63.4% 1241615 ± 54% numa-vmstat.node1.numa_foreign 1054335 ± 10% +164.4% 2787638 ± 19% numa-vmstat.node1.numa_miss 1166568 ± 4% +145.1% 2859690 ± 20% numa-vmstat.node1.numa_other 15105 ± 2% -45.0% 8309 ± 50% proc-vmstat.allocstall_movable 30459 ± 49% -71.7% 8615 ± 48% proc-vmstat.compact_isolated 6848 ± 3% -10.4% 6136 ± 6% proc-vmstat.nr_active_anon 9005 ± 14% +68.2% 15144 ± 30% proc-vmstat.nr_free_cma 132.33 ± 5% -23.7% 101.00 ± 7% proc-vmstat.nr_isolated_anon 6868 ± 3% -10.7% 6136 ± 6% proc-vmstat.nr_zone_active_anon 7563 ± 27% -64.8% 2660 ± 61% proc-vmstat.numa_hint_faults 10414558 ± 9% -19.1% 8428117 ± 2% proc-vmstat.numa_pte_updates 1031362 -20.5% 820126 proc-vmstat.pgalloc_dma32 31078215 -24.0% 23617831 proc-vmstat.pgalloc_normal 32164957 -23.9% 24479418 proc-vmstat.pgfree 4152 -23.2% 3188 ± 3% proc-vmstat.pgmajfault 17471 ± 45% -74.5% 4458 ± 49% proc-vmstat.pgmigrate_success 46356943 ± 9% -28.9% 32956826 ± 17% proc-vmstat.pgscan_anon 29201063 ± 14% -28.2% 20954738 ± 2% proc-vmstat.pgscan_direct 4248 ± 2% -21.8% 3321 proc-vmstat.pswpin 36037 +3.2% 37204 proc-vmstat.slabs_scanned 0.00 +2.8e+10% 284.55 ± 22% sched_debug.cfs_rq:/.MIN_vruntime.avg 0.00 +2.7e+12% 27316 ± 22% sched_debug.cfs_rq:/.MIN_vruntime.max 2720 ± 18% +589.5% 18759 ± 31% sched_debug.cfs_rq:/.load.avg 46202 ± 36% +3321.4% 1580776 ± 32% sched_debug.cfs_rq:/.load.max 8163 ± 17% +1865.3% 160439 ± 32% sched_debug.cfs_rq:/.load.stddev 382.50 ±121% -91.3% 33.40 ± 12% sched_debug.cfs_rq:/.load_avg.avg 17337 ±129% -94.4% 972.00 sched_debug.cfs_rq:/.load_avg.max 2438 ±128% -94.4% 136.89 ± 8% sched_debug.cfs_rq:/.load_avg.stddev 0.00 +2.8e+10% 284.55 ± 22% sched_debug.cfs_rq:/.max_vruntime.avg 0.00 +2.7e+12% 27316 ± 22% sched_debug.cfs_rq:/.max_vruntime.max 16104 ± 13% +54.7% 24908 ± 36% sched_debug.cfs_rq:/.min_vruntime.avg 9293 ± 32% +72.6% 16037 ± 32% sched_debug.cfs_rq:/.min_vruntime.min 3035 ± 5% +38.0% 4189 ± 24% sched_debug.cfs_rq:/.min_vruntime.stddev 1.00 +100.0% 2.00 sched_debug.cfs_rq:/.nr_running.max 0.32 ± 7% +15.6% 0.37 ± 2% sched_debug.cfs_rq:/.nr_running.stddev 20.87 ± 39% -75.4% 5.12 ±100% sched_debug.cfs_rq:/.removed.load_avg.avg 140.08 ± 20% -64.3% 49.95 ±100% sched_debug.cfs_rq:/.removed.load_avg.stddev 355.11 ± 4% -14.2% 304.76 sched_debug.cfs_rq:/.runnable_avg.stddev -759.95 -1050.2% 7221 ± 72% sched_debug.cfs_rq:/.spread0.avg 12531 ± 16% +76.2% 22078 ± 25% sched_debug.cfs_rq:/.spread0.max -7559 -81.2% -1421 sched_debug.cfs_rq:/.spread0.min 3045 ± 4% +38.5% 4219 ± 24% sched_debug.cfs_rq:/.spread0.stddev 355.02 ± 4% -14.1% 304.79 sched_debug.cfs_rq:/.util_avg.stddev 34.72 ± 12% -21.4% 27.28 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.avg 772814 ± 7% +5.6% 816403 ± 6% sched_debug.cpu.avg_idle.avg 1396289 ± 27% +314.0% 5781242 ± 71% sched_debug.cpu.avg_idle.max 2225 ± 32% +512.8% 13639 ± 81% sched_debug.cpu.avg_idle.min 0.12 ± 11% +14.7% 0.14 ± 7% sched_debug.cpu.nr_running.avg 1.00 +100.0% 2.00 sched_debug.cpu.nr_running.max 0.32 ± 4% +15.2% 0.37 ± 2% sched_debug.cpu.nr_running.stddev 6.76 ± 9% +11.6% 7.55 ± 5% sched_debug.cpu.nr_uninterruptible.stddev 4.47 ±122% +308.4% 18.27 ± 78% sched_debug.cpu.sched_count.avg 272.67 ±136% +313.5% 1127 ± 79% sched_debug.cpu.sched_count.max 32.56 ±133% +325.6% 138.57 ± 78% sched_debug.cpu.sched_count.stddev 2.26 ±122% +305.0% 9.15 ± 77% sched_debug.cpu.sched_goidle.avg 137.67 ±136% +310.4% 565.00 ± 79% sched_debug.cpu.sched_goidle.max 16.42 ±133% +322.8% 69.44 ± 78% sched_debug.cpu.sched_goidle.stddev 0.98 ± 57% +796.7% 8.79 ± 68% sched_debug.cpu.ttwu_count.avg 51.00 ± 76% +952.0% 536.50 ± 75% sched_debug.cpu.ttwu_count.max 6.18 ± 72% +971.6% 66.18 ± 73% sched_debug.cpu.ttwu_count.stddev 0.08 ± 55% -80.3% 0.02 ± 6% sched_debug.cpu.ttwu_local.avg 0.36 ± 47% -65.4% 0.13 ± 3% sched_debug.cpu.ttwu_local.stddev 17248 ± 18% -59.1% 7054 ± 50% softirqs.CPU0.RCU 9395 ± 25% -63.7% 3412 ± 34% softirqs.CPU1.RCU 9451 ± 17% -70.5% 2785 ± 27% softirqs.CPU11.RCU 8411 ± 33% -60.8% 3294 ± 2% softirqs.CPU13.RCU 8757 ± 18% -70.4% 2590 ± 27% softirqs.CPU14.RCU 15363 ± 11% -82.6% 2668 ± 23% softirqs.CPU24.RCU 14609 ± 20% -77.0% 3361 ± 26% softirqs.CPU25.RCU 11185 ± 21% -73.8% 2931 ± 31% softirqs.CPU26.RCU 11890 ± 31% -68.1% 3790 ± 5% softirqs.CPU27.RCU 11480 ± 29% -73.2% 3073 ± 17% softirqs.CPU28.RCU 10461 ± 33% -63.2% 3847 ± 6% softirqs.CPU29.RCU 13942 ± 32% -78.2% 3045 ± 25% softirqs.CPU30.RCU 12582 ± 3% -77.0% 2889 ± 38% softirqs.CPU31.RCU 12318 ± 24% -70.8% 3600 ± 10% softirqs.CPU32.RCU 9897 ± 10% -44.1% 5537 ± 37% softirqs.CPU33.RCU 10918 ± 9% -72.4% 3018 ± 21% softirqs.CPU34.RCU 14239 ± 33% -76.2% 3386 ± 4% softirqs.CPU35.RCU 11469 ± 23% -74.6% 2908 ± 28% softirqs.CPU36.RCU 12694 ± 50% -77.9% 2805 ± 26% softirqs.CPU37.RCU 13133 ± 19% -79.1% 2746 ± 27% softirqs.CPU38.RCU 12577 ± 7% -78.8% 2672 ± 30% softirqs.CPU39.RCU 12311 ± 14% -75.6% 3002 ± 34% softirqs.CPU40.RCU 11091 ± 3% -73.5% 2940 ± 31% softirqs.CPU41.RCU 9579 ± 25% -72.0% 2683 ± 37% softirqs.CPU42.RCU 10558 ± 14% -74.3% 2713 ± 37% softirqs.CPU43.RCU 10360 ± 37% -69.2% 3188 ± 30% softirqs.CPU44.RCU 9697 ± 20% -71.5% 2763 ± 24% softirqs.CPU45.RCU 8819 ± 39% -67.4% 2873 ± 24% softirqs.CPU46.RCU 10626 ± 29% -74.2% 2738 ± 21% softirqs.CPU47.RCU 7931 ± 24% -69.7% 2402 ± 25% softirqs.CPU48.RCU 11642 ± 23% -72.4% 3219 ± 43% softirqs.CPU72.RCU 10515 ± 28% -76.8% 2442 ± 28% softirqs.CPU73.RCU 13581 ± 60% -79.1% 2837 ± 42% softirqs.CPU75.RCU 14199 ± 53% -81.4% 2639 ± 33% softirqs.CPU76.RCU 8791 ± 31% -71.5% 2504 ± 30% softirqs.CPU77.RCU 13260 ± 32% -81.8% 2418 ± 32% softirqs.CPU78.RCU 13741 ± 24% -79.4% 2837 ± 24% softirqs.CPU79.RCU 11007 ± 25% -77.6% 2463 ± 32% softirqs.CPU80.RCU 10950 ± 33% -77.2% 2494 ± 33% softirqs.CPU81.RCU 10367 ± 30% -74.8% 2610 ± 23% softirqs.CPU82.RCU 12792 ± 18% -81.6% 2353 ± 34% softirqs.CPU83.RCU 11857 ± 32% -79.2% 2465 ± 37% softirqs.CPU85.RCU 9573 ± 38% -73.9% 2498 ± 30% softirqs.CPU86.RCU 8645 ± 18% -70.6% 2542 ± 34% softirqs.CPU87.RCU 10293 ± 27% -76.5% 2417 ± 33% softirqs.CPU88.RCU 10604 ± 29% -72.7% 2896 ± 22% softirqs.CPU89.RCU 8119 ± 24% -70.8% 2371 ± 31% softirqs.CPU90.RCU 9698 ± 25% -65.8% 3321 ± 48% softirqs.CPU95.RCU 862186 ± 10% -67.6% 279218 ± 27% softirqs.RCU 8.23 -23.0% 6.34 ± 8% perf-stat.i.MPKI 6.462e+09 -4.4% 6.175e+09 perf-stat.i.branch-instructions 0.56 +0.0 0.57 perf-stat.i.branch-miss-rate% 30675041 -2.2% 29993559 perf-stat.i.branch-misses 1.099e+08 ± 4% -23.4% 84100899 ± 9% perf-stat.i.cache-misses 1.996e+08 -27.2% 1.453e+08 ± 9% perf-stat.i.cache-references 5330 ± 18% -40.5% 3170 ± 9% perf-stat.i.context-switches 3.42e+10 -10.1% 3.074e+10 ± 6% perf-stat.i.cpu-cycles 274.89 -19.8% 220.40 perf-stat.i.cpu-migrations 496.32 ± 5% +25.8% 624.53 ± 16% perf-stat.i.cycles-between-cache-misses 6.592e+09 -7.9% 6.069e+09 ± 3% perf-stat.i.dTLB-loads 0.13 +0.0 0.16 ± 13% perf-stat.i.dTLB-store-miss-rate% 2.832e+09 ± 2% -13.9% 2.439e+09 ± 7% perf-stat.i.dTLB-stores 2194729 -4.3% 2099808 ± 2% perf-stat.i.iTLB-loads 2.588e+10 -6.8% 2.413e+10 ± 3% perf-stat.i.instructions 104.43 -24.2% 79.16 ± 16% perf-stat.i.major-faults 0.36 -10.1% 0.32 ± 6% perf-stat.i.metric.GHz 167.95 -7.8% 154.81 ± 3% perf-stat.i.metric.M/sec 810491 +2.6% 831441 perf-stat.i.minor-faults 63.14 ± 3% +6.8 69.97 ± 5% perf-stat.i.node-load-miss-rate% 9153385 ± 7% +16.6% 10675997 ± 5% perf-stat.i.node-load-misses 5449241 ± 5% -33.6% 3619910 ± 7% perf-stat.i.node-loads 48.01 +25.4 73.36 ± 10% perf-stat.i.node-store-miss-rate% 8802770 ± 11% -79.6% 1794154 ± 20% perf-stat.i.node-stores 810595 +2.6% 831521 perf-stat.i.page-faults 7.71 -22.0% 6.01 ± 6% perf-stat.overall.MPKI 0.48 +0.0 0.49 perf-stat.overall.branch-miss-rate% 55.07 ± 3% +2.8 57.89 perf-stat.overall.cache-miss-rate% 311.03 ± 2% +17.7% 365.94 ± 2% perf-stat.overall.cycles-between-cache-misses 0.15 +0.0 0.17 ± 5% perf-stat.overall.dTLB-store-miss-rate% 62.67 ± 2% +12.0 74.69 perf-stat.overall.node-load-miss-rate% 43.92 +36.5 80.41 ± 3% perf-stat.overall.node-store-miss-rate% 7132 -9.3% 6468 ± 4% perf-stat.overall.path-length 6.258e+09 -4.4% 5.979e+09 perf-stat.ps.branch-instructions 29818678 -2.7% 29004012 perf-stat.ps.branch-misses 1.065e+08 ± 4% -23.5% 81492231 ± 9% perf-stat.ps.cache-misses 1.934e+08 -27.2% 1.408e+08 ± 9% perf-stat.ps.cache-references 5145 ± 18% -40.3% 3070 ± 9% perf-stat.ps.context-switches 3.31e+10 -10.1% 2.975e+10 ± 6% perf-stat.ps.cpu-cycles 266.05 -20.0% 212.96 perf-stat.ps.cpu-migrations 6.386e+09 -8.0% 5.876e+09 ± 3% perf-stat.ps.dTLB-loads 2.743e+09 ± 2% -13.9% 2.363e+09 ± 7% perf-stat.ps.dTLB-stores 2123501 -4.4% 2029324 ± 2% perf-stat.ps.iTLB-loads 2.507e+10 -6.8% 2.336e+10 ± 3% perf-stat.ps.instructions 101.46 -24.8% 76.33 ± 16% perf-stat.ps.major-faults 784848 +2.6% 805278 perf-stat.ps.minor-faults 8879280 ± 6% +16.5% 10347043 ± 5% perf-stat.ps.node-load-misses 5280243 ± 5% -33.5% 3511677 ± 7% perf-stat.ps.node-loads 8532944 ± 11% -79.6% 1737146 ± 19% perf-stat.ps.node-stores 784950 +2.6% 805354 perf-stat.ps.page-faults 7.758e+11 -9.3% 7.036e+11 ± 4% perf-stat.total.instructions 16.00 ± 19% -9.7 6.28 ± 37% perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask 15.76 ± 19% -9.5 6.25 ± 37% perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath 15.72 ± 19% -9.5 6.24 ± 37% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages 11.57 ± 37% -9.1 2.51 ±100% perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault 10.80 ± 40% -8.5 2.32 ±100% perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page 10.79 ± 40% -8.5 2.32 ±100% perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma 11.52 ± 2% -8.4 3.10 ±100% perf-profile.calltrace.cycles-pp.ret_from_fork 11.52 ± 2% -8.4 3.10 ±100% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 12.38 ± 36% -7.5 4.88 ± 15% perf-profile.calltrace.cycles-pp.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 12.26 ± 36% -7.5 4.79 ± 17% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault 13.21 ± 15% -7.1 6.14 ± 36% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages 8.08 ± 7% -5.1 2.94 ±100% perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork 8.08 ± 7% -5.1 2.94 ±100% perf-profile.calltrace.cycles-pp.balance_pgdat.kswapd.kthread.ret_from_fork 8.07 ± 7% -5.1 2.94 ±100% perf-profile.calltrace.cycles-pp.shrink_node.balance_pgdat.kswapd.kthread.ret_from_fork 8.05 ± 8% -5.1 2.93 ±100% perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.balance_pgdat.kswapd.kthread 8.04 ± 7% -5.1 2.93 ±100% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd 7.51 ± 9% -4.7 2.77 ±100% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat 5.02 ± 5% -2.4 2.62 ± 35% perf-profile.calltrace.cycles-pp.try_to_unmap_flush_dirty.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 5.01 ± 5% -2.4 2.62 ± 35% perf-profile.calltrace.cycles-pp.arch_tlbbatch_flush.try_to_unmap_flush_dirty.shrink_page_list.shrink_inactive_list.shrink_lruvec 4.66 ± 13% -2.4 2.27 ± 64% perf-profile.calltrace.cycles-pp.pageout.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 4.91 ± 5% -2.4 2.55 ± 34% perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush_dirty.shrink_page_list.shrink_inactive_list 4.60 ± 4% -2.1 2.47 ± 33% perf-profile.calltrace.cycles-pp.smp_call_function_single.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush_dirty.shrink_page_list 3.96 ± 13% -2.1 1.86 ± 65% perf-profile.calltrace.cycles-pp.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_lruvec 3.89 ± 13% -2.1 1.81 ± 65% perf-profile.calltrace.cycles-pp.bdev_write_page.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list 3.23 ± 13% -2.0 1.24 ±100% perf-profile.calltrace.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 3.48 ± 14% -1.9 1.58 ± 65% perf-profile.calltrace.cycles-pp.pmem_rw_page.bdev_write_page.__swap_writepage.pageout.shrink_page_list 2.06 ± 35% -1.8 0.25 ±100% perf-profile.calltrace.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 1.94 ± 26% -1.4 0.57 ±100% perf-profile.calltrace.cycles-pp.pmem_do_write.pmem_rw_page.bdev_write_page.__swap_writepage.pageout 1.94 ± 26% -1.4 0.57 ±100% perf-profile.calltrace.cycles-pp.write_pmem.pmem_do_write.pmem_rw_page.bdev_write_page.__swap_writepage 1.86 ± 25% -1.3 0.55 ±100% perf-profile.calltrace.cycles-pp.__memcpy_flushcache.write_pmem.pmem_do_write.pmem_rw_page.bdev_write_page 0.96 ± 34% -0.7 0.28 ±100% perf-profile.calltrace.cycles-pp.mem_cgroup_swapout.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec 0.56 ± 8% +0.3 0.82 perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.36 ± 70% +0.4 0.73 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 1.61 ± 8% +0.4 2.06 ± 22% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.68 ± 17% +0.5 1.21 ± 37% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt 0.20 ±141% +0.6 0.82 ± 31% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack 1.29 ± 15% +1.1 2.42 ± 45% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 1.31 ± 15% +1.1 2.46 ± 45% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 1.31 ± 15% +1.2 2.47 ± 45% perf-profile.calltrace.cycles-pp.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.17 ±141% +1.3 1.47 ± 15% perf-profile.calltrace.cycles-pp.clear_shadow_from_swap_cache.swapcache_free_entries.free_swap_slot.__swap_entry_free.free_swap_and_cache 29.19 ± 21% +4.7 33.91 ± 23% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 32.27 ± 18% +7.3 39.52 ± 12% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 32.59 ± 18% +7.4 40.00 ± 11% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 34.63 ± 16% +7.9 42.53 ± 9% perf-profile.calltrace.cycles-pp.secondary_startup_64 34.42 ± 16% +8.0 42.44 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 34.42 ± 16% +8.0 42.45 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 34.42 ± 16% +8.0 42.45 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 25.02 ± 11% -15.8 9.27 ± 57% perf-profile.children.cycles-pp.shrink_node 24.75 ± 11% -15.5 9.23 ± 57% perf-profile.children.cycles-pp.shrink_lruvec 24.71 ± 11% -15.5 9.23 ± 57% perf-profile.children.cycles-pp.shrink_inactive_list 21.26 ± 7% -12.3 8.96 ± 56% perf-profile.children.cycles-pp.shrink_page_list 17.87 ± 19% -11.3 6.54 ± 39% perf-profile.children.cycles-pp.__alloc_pages_slowpath 16.97 ± 20% -10.6 6.34 ± 38% perf-profile.children.cycles-pp.try_to_free_pages 16.95 ± 20% -10.6 6.34 ± 38% perf-profile.children.cycles-pp.do_try_to_free_pages 18.60 ± 19% -9.8 8.84 ± 10% perf-profile.children.cycles-pp.__alloc_pages_nodemask 11.52 ± 2% -8.2 3.31 ± 87% perf-profile.children.cycles-pp.kthread 11.52 ± 2% -8.2 3.31 ± 87% perf-profile.children.cycles-pp.ret_from_fork 12.53 ± 36% -7.6 4.89 ± 15% perf-profile.children.cycles-pp.alloc_pages_vma 8.08 ± 7% -5.1 2.94 ±100% perf-profile.children.cycles-pp.kswapd 8.08 ± 7% -5.1 2.94 ±100% perf-profile.children.cycles-pp.balance_pgdat 5.15 ± 5% -2.5 2.63 ± 35% perf-profile.children.cycles-pp.try_to_unmap_flush_dirty 5.15 ± 5% -2.5 2.63 ± 35% perf-profile.children.cycles-pp.arch_tlbbatch_flush 5.05 ± 5% -2.5 2.56 ± 34% perf-profile.children.cycles-pp.on_each_cpu_cond_mask 4.79 ± 13% -2.5 2.29 ± 65% perf-profile.children.cycles-pp.pageout 3.64 ± 15% -2.4 1.24 ± 66% perf-profile.children.cycles-pp.rmap_walk_anon 4.78 ± 4% -2.3 2.50 ± 34% perf-profile.children.cycles-pp.smp_call_function_single 4.06 ± 14% -2.2 1.88 ± 65% perf-profile.children.cycles-pp.__swap_writepage 3.99 ± 14% -2.2 1.83 ± 65% perf-profile.children.cycles-pp.bdev_write_page 2.92 ± 10% -2.1 0.84 ± 49% perf-profile.children.cycles-pp.add_to_swap 3.56 ± 14% -2.0 1.59 ± 65% perf-profile.children.cycles-pp.pmem_rw_page 2.03 ± 14% -1.9 0.09 ± 44% perf-profile.children.cycles-pp.rcu_do_batch 2.46 ± 59% -1.9 0.53 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irq 2.08 ± 14% -1.9 0.21 ± 65% perf-profile.children.cycles-pp.add_to_swap_cache 3.33 ± 14% -1.9 1.47 ± 70% perf-profile.children.cycles-pp.__remove_mapping 2.12 ± 42% -1.8 0.29 perf-profile.children.cycles-pp.worker_thread 2.08 ± 14% -1.8 0.27 ± 77% perf-profile.children.cycles-pp.rcu_core 2.10 ± 43% -1.8 0.29 perf-profile.children.cycles-pp.process_one_work 2.43 ± 25% -1.8 0.63 ± 68% perf-profile.children.cycles-pp.page_referenced 2.42 ± 14% -1.6 0.82 ± 58% perf-profile.children.cycles-pp.__softirqentry_text_start 1.60 ± 14% -1.6 0.03 ±100% perf-profile.children.cycles-pp.xas_create_range 1.59 ± 14% -1.6 0.04 ±100% perf-profile.children.cycles-pp.xas_create 1.64 ± 13% -1.5 0.10 ± 50% perf-profile.children.cycles-pp.kmem_cache_free 1.37 ± 12% -1.3 0.04 ±100% perf-profile.children.cycles-pp.__slab_free 1.28 ± 23% -1.2 0.04 ±100% perf-profile.children.cycles-pp.run_ksoftirqd 1.31 ± 22% -1.2 0.07 ± 23% perf-profile.children.cycles-pp.smpboot_thread_fn 2.13 ± 16% -1.2 0.96 ± 65% perf-profile.children.cycles-pp.pmem_do_write 2.11 ± 16% -1.2 0.95 ± 65% perf-profile.children.cycles-pp.write_pmem 2.09 ± 16% -1.2 0.94 ± 65% perf-profile.children.cycles-pp.__memcpy_flushcache 1.22 ± 27% -0.9 0.30 ± 80% perf-profile.children.cycles-pp.page_referenced_one 1.17 ± 20% -0.8 0.33 ± 70% perf-profile.children.cycles-pp.page_vma_mapped_walk 1.53 ± 7% -0.8 0.71 ± 67% perf-profile.children.cycles-pp.try_to_unmap 1.41 ± 11% -0.8 0.62 ± 64% perf-profile.children.cycles-pp.end_page_writeback 0.87 ± 12% -0.7 0.18 ± 61% perf-profile.children.cycles-pp.__delete_from_swap_cache 0.80 ± 28% -0.7 0.14 ±100% perf-profile.children.cycles-pp.isolate_lru_pages 1.17 ± 9% -0.6 0.57 ± 66% perf-profile.children.cycles-pp.try_to_unmap_one 0.85 ± 21% -0.6 0.27 ± 47% perf-profile.children.cycles-pp.page_lock_anon_vma_read 1.49 ± 6% -0.5 0.95 ± 34% perf-profile.children.cycles-pp.asm_sysvec_call_function_single 0.59 ± 19% -0.4 0.18 ± 60% perf-profile.children.cycles-pp.down_read_trylock 0.46 ± 35% -0.4 0.06 ±100% perf-profile.children.cycles-pp.move_pages_to_lru 1.01 ± 5% -0.3 0.68 ± 31% perf-profile.children.cycles-pp.sysvec_call_function_single 0.93 ± 9% -0.3 0.60 ± 30% perf-profile.children.cycles-pp.flush_smp_call_function_queue 0.34 ± 63% -0.3 0.03 ±100% perf-profile.children.cycles-pp.__libc_fork 0.33 ± 65% -0.3 0.03 ±100% perf-profile.children.cycles-pp.__do_sys_clone 0.33 ± 65% -0.3 0.03 ±100% perf-profile.children.cycles-pp._do_fork 0.33 ± 65% -0.3 0.03 ±100% perf-profile.children.cycles-pp.copy_process 0.91 ± 5% -0.3 0.62 ± 32% perf-profile.children.cycles-pp.__sysvec_call_function_single 0.46 ± 12% -0.2 0.21 ± 67% perf-profile.children.cycles-pp.put_swap_page 0.27 ± 51% -0.2 0.04 ±100% perf-profile.children.cycles-pp.smp_call_function_many_cond 1.05 ± 10% -0.2 0.83 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.26 ± 35% -0.2 0.05 ±100% perf-profile.children.cycles-pp.__isolate_lru_page 0.60 ± 14% -0.2 0.41 ± 8% perf-profile.children.cycles-pp.xas_store 0.25 ± 61% -0.2 0.06 ± 16% perf-profile.children.cycles-pp.__x64_sys_execve 0.25 ± 61% -0.2 0.06 ± 16% perf-profile.children.cycles-pp.execve 0.25 ± 61% -0.2 0.06 ± 16% perf-profile.children.cycles-pp.do_execveat_common 0.39 ± 15% -0.2 0.21 ± 31% perf-profile.children.cycles-pp.flush_tlb_func_common 0.19 ± 42% -0.2 0.03 ±100% perf-profile.children.cycles-pp.shrink_slab 0.22 ± 7% -0.1 0.07 ±100% perf-profile.children.cycles-pp.test_clear_page_writeback 0.27 ± 26% -0.1 0.13 ± 23% perf-profile.children.cycles-pp.up_read 0.24 ± 22% -0.1 0.12 ± 39% perf-profile.children.cycles-pp.native_flush_tlb_local 0.21 ± 4% -0.1 0.08 ± 29% perf-profile.children.cycles-pp.start_kernel 0.31 ± 13% -0.1 0.20 ± 12% perf-profile.children.cycles-pp.propagate_protected_usage 0.20 ± 14% -0.1 0.09 ± 22% perf-profile.children.cycles-pp.page_mapping 0.50 ± 3% -0.1 0.41 ± 4% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.11 ± 32% -0.1 0.03 ±100% perf-profile.children.cycles-pp.unlock_page 0.13 ± 12% -0.1 0.05 ±100% perf-profile.children.cycles-pp.clear_page_dirty_for_io 0.11 ± 25% -0.1 0.04 ±100% perf-profile.children.cycles-pp.__set_page_dirty_no_writeback 0.15 ± 28% -0.1 0.07 perf-profile.children.cycles-pp._find_next_bit 0.09 ± 9% -0.1 0.03 ±100% perf-profile.children.cycles-pp.cpumask_any_but 0.07 ± 14% -0.0 0.03 ±100% perf-profile.children.cycles-pp.inc_node_page_state 0.08 ± 14% -0.0 0.06 ± 9% perf-profile.children.cycles-pp._cond_resched 0.08 ± 31% +0.0 0.11 ± 18% perf-profile.children.cycles-pp.calc_global_load_tick 0.07 ± 14% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.07 ± 14% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.07 ± 18% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__radix_tree_lookup 0.02 ±141% +0.0 0.06 ± 16% perf-profile.children.cycles-pp.do_swap 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.xas_start 0.02 ±141% +0.1 0.08 ± 37% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.27 ± 12% +0.1 0.33 ± 15% perf-profile.children.cycles-pp.scheduler_tick 0.15 ± 11% +0.1 0.24 ± 19% perf-profile.children.cycles-pp.memcpy_erms 0.15 ± 11% +0.1 0.24 ± 19% perf-profile.children.cycles-pp.drm_fb_helper_dirty_work 0.02 ±141% +0.1 0.10 ± 42% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.14 ± 17% +0.1 0.23 ± 43% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.30 ± 9% +0.1 0.41 ± 23% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.00 +0.1 0.11 ± 4% perf-profile.children.cycles-pp.xas_clear_mark 0.02 ±141% +0.1 0.15 ± 6% perf-profile.children.cycles-pp.xas_init_marks 0.51 ± 8% +0.2 0.73 ± 6% perf-profile.children.cycles-pp.tick_nohz_next_event 0.46 ± 20% +0.2 0.68 ± 22% perf-profile.children.cycles-pp.update_process_times 0.46 ± 20% +0.2 0.68 ± 22% perf-profile.children.cycles-pp.tick_sched_handle 0.56 ± 8% +0.3 0.83 perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.43 ± 17% +0.3 0.71 ± 35% perf-profile.children.cycles-pp.clockevents_program_event 0.59 ± 17% +0.3 0.93 ± 32% perf-profile.children.cycles-pp.tick_sched_timer 0.08 ± 26% +0.4 0.51 ± 21% perf-profile.children.cycles-pp.xas_load 1.62 ± 8% +0.5 2.07 ± 22% perf-profile.children.cycles-pp.menu_select 0.05 ± 70% +0.5 0.56 ± 21% perf-profile.children.cycles-pp.xas_find 0.82 ± 15% +0.5 1.35 ± 37% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.51 ± 4% +1.0 1.52 ± 16% perf-profile.children.cycles-pp.clear_shadow_from_swap_cache 29.35 ± 21% +4.6 33.95 ± 23% perf-profile.children.cycles-pp.intel_idle 32.79 ± 18% +7.3 40.07 ± 11% perf-profile.children.cycles-pp.cpuidle_enter 32.78 ± 18% +7.3 40.06 ± 11% perf-profile.children.cycles-pp.cpuidle_enter_state 34.63 ± 16% +7.9 42.53 ± 9% perf-profile.children.cycles-pp.secondary_startup_64 34.63 ± 16% +7.9 42.53 ± 9% perf-profile.children.cycles-pp.cpu_startup_entry 34.63 ± 16% +7.9 42.53 ± 9% perf-profile.children.cycles-pp.do_idle 34.42 ± 16% +8.0 42.45 ± 9% perf-profile.children.cycles-pp.start_secondary 4.20 ± 5% -2.0 2.25 ± 30% perf-profile.self.cycles-pp.smp_call_function_single 1.33 ± 12% -1.3 0.04 ±100% perf-profile.self.cycles-pp.__slab_free 1.97 ± 16% -1.1 0.90 ± 64% perf-profile.self.cycles-pp.__memcpy_flushcache 1.10 ± 12% -0.6 0.50 ± 64% perf-profile.self.cycles-pp.end_page_writeback 0.54 ± 15% -0.4 0.12 ±100% perf-profile.self.cycles-pp.page_vma_mapped_walk 0.55 ± 11% -0.4 0.14 ±100% perf-profile.self.cycles-pp.shrink_page_list 0.56 ± 20% -0.4 0.17 ± 57% perf-profile.self.cycles-pp.down_read_trylock 0.28 ± 40% -0.2 0.04 ±100% perf-profile.self.cycles-pp.move_pages_to_lru 0.32 ± 18% -0.2 0.07 ±100% perf-profile.self.cycles-pp.page_lock_anon_vma_read 0.26 ± 35% -0.2 0.05 ±100% perf-profile.self.cycles-pp.__isolate_lru_page 0.25 ± 19% -0.2 0.06 ±100% perf-profile.self.cycles-pp.rmap_walk_anon 0.38 ± 8% -0.2 0.21 ± 56% perf-profile.self.cycles-pp.try_to_unmap_one 0.29 ± 14% -0.2 0.13 ± 61% perf-profile.self.cycles-pp.add_to_swap_cache 0.21 ± 23% -0.2 0.06 ±100% perf-profile.self.cycles-pp.page_referenced_one 0.17 ± 20% -0.1 0.03 ±100% perf-profile.self.cycles-pp.xas_create 0.31 ± 13% -0.1 0.18 ± 16% perf-profile.self.cycles-pp.propagate_protected_usage 0.26 ± 28% -0.1 0.12 ± 19% perf-profile.self.cycles-pp.up_read 0.24 ± 22% -0.1 0.12 ± 39% perf-profile.self.cycles-pp.native_flush_tlb_local 0.16 ± 24% -0.1 0.04 ±100% perf-profile.self.cycles-pp.isolate_lru_pages 0.18 ± 15% -0.1 0.09 ± 17% perf-profile.self.cycles-pp.page_mapping 0.11 ± 36% -0.1 0.03 ±100% perf-profile.self.cycles-pp.unlock_page 0.13 ± 26% -0.1 0.07 ± 7% perf-profile.self.cycles-pp._find_next_bit 0.09 ± 19% -0.1 0.03 ±100% perf-profile.self.cycles-pp.pageout 0.13 ± 12% -0.0 0.09 ± 17% perf-profile.self.cycles-pp.flush_tlb_func_common 0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.test_clear_page_writeback 0.06 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.inc_node_page_state 0.16 ± 10% -0.0 0.12 ± 4% perf-profile.self.cycles-pp.get_page_from_freelist 0.06 ± 13% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__radix_tree_lookup 0.06 ± 19% +0.0 0.09 perf-profile.self.cycles-pp.tsc_verify_tsc_adjust 0.08 ± 31% +0.0 0.11 ± 18% perf-profile.self.cycles-pp.calc_global_load_tick 0.34 ± 7% +0.0 0.38 ± 6% perf-profile.self.cycles-pp.swap_range_free 0.02 ±141% +0.1 0.08 ± 37% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.00 +0.1 0.06 ± 16% perf-profile.self.cycles-pp.do_swap 0.09 ± 10% +0.1 0.15 ± 41% perf-profile.self.cycles-pp.irqtime_account_irq 0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.xas_find 0.15 ± 11% +0.1 0.24 ± 19% perf-profile.self.cycles-pp.memcpy_erms 0.12 ± 10% +0.1 0.21 ± 12% perf-profile.self.cycles-pp.xas_store 0.15 ± 9% +0.1 0.24 ± 4% perf-profile.self.cycles-pp.tick_nohz_next_event 0.11 ± 14% +0.1 0.21 ± 21% perf-profile.self.cycles-pp.clear_shadow_from_swap_cache 0.30 ± 11% +0.1 0.41 ± 23% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.00 +0.1 0.11 ± 9% perf-profile.self.cycles-pp.xas_clear_mark 0.02 ±141% +0.4 0.45 ± 21% perf-profile.self.cycles-pp.xas_load 29.34 ± 21% +4.6 33.95 ± 23% perf-profile.self.cycles-pp.intel_idle 1309 ± 31% -95.8% 55.00 ± 38% interrupts.CPU1.NMI:Non-maskable_interrupts 1309 ± 31% -95.8% 55.00 ± 38% interrupts.CPU1.PMI:Performance_monitoring_interrupts 113374 ± 41% -100.0% 55.00 ± 7% interrupts.CPU11.CAL:Function_call_interrupts 257.33 ± 58% -74.4% 66.00 ± 46% interrupts.CPU11.NMI:Non-maskable_interrupts 257.33 ± 58% -74.4% 66.00 ± 46% interrupts.CPU11.PMI:Performance_monitoring_interrupts 123300 ± 42% -100.0% 2.00 ±100% interrupts.CPU11.TLB:TLB_shootdowns 71595 ± 21% +346.8% 319882 ± 25% interrupts.CPU13.CAL:Function_call_interrupts 39.33 ±112% +80.5% 71.00 ± 66% interrupts.CPU13.RES:Rescheduling_interrupts 79142 ± 23% +327.8% 338596 ± 25% interrupts.CPU13.TLB:TLB_shootdowns 121354 ± 28% -99.9% 70.50 ± 31% interrupts.CPU14.CAL:Function_call_interrupts 282.67 ± 73% +397.1% 1405 ± 7% interrupts.CPU14.NMI:Non-maskable_interrupts 282.67 ± 73% +397.1% 1405 ± 7% interrupts.CPU14.PMI:Performance_monitoring_interrupts 133142 ± 28% -100.0% 1.00 ±100% interrupts.CPU14.TLB:TLB_shootdowns 79518 ± 47% -99.4% 497.50 ± 90% interrupts.CPU17.CAL:Function_call_interrupts 87505 ± 47% -99.5% 431.50 ±100% interrupts.CPU17.TLB:TLB_shootdowns 57594 ± 58% -99.9% 77.00 ± 49% interrupts.CPU18.CAL:Function_call_interrupts 62678 ± 58% -100.0% 1.50 ± 33% interrupts.CPU18.TLB:TLB_shootdowns 83503 ± 32% -99.9% 95.00 ± 36% interrupts.CPU19.CAL:Function_call_interrupts 387.33 ± 75% -82.3% 68.50 ± 6% interrupts.CPU19.NMI:Non-maskable_interrupts 387.33 ± 75% -82.3% 68.50 ± 6% interrupts.CPU19.PMI:Performance_monitoring_interrupts 92869 ± 29% -100.0% 2.00 ±100% interrupts.CPU19.TLB:TLB_shootdowns 76523 ± 29% -98.8% 934.00 ± 93% interrupts.CPU2.CAL:Function_call_interrupts 1128 ± 68% -89.7% 116.00 ± 65% interrupts.CPU2.NMI:Non-maskable_interrupts 1128 ± 68% -89.7% 116.00 ± 65% interrupts.CPU2.PMI:Performance_monitoring_interrupts 84432 ± 28% -99.3% 550.00 ± 99% interrupts.CPU2.TLB:TLB_shootdowns 42900 ± 35% -99.9% 50.50 ± 4% interrupts.CPU20.CAL:Function_call_interrupts 47261 ± 35% -100.0% 1.00 ±100% interrupts.CPU20.TLB:TLB_shootdowns 55343 ± 5% -99.8% 133.50 ± 64% interrupts.CPU21.CAL:Function_call_interrupts 557.33 ± 70% -83.9% 89.50 ± 19% interrupts.CPU21.NMI:Non-maskable_interrupts 557.33 ± 70% -83.9% 89.50 ± 19% interrupts.CPU21.PMI:Performance_monitoring_interrupts 60700 ± 3% -100.0% 1.50 ±100% interrupts.CPU21.TLB:TLB_shootdowns 65151 ± 29% -99.9% 65.50 ± 31% interrupts.CPU23.CAL:Function_call_interrupts 1511 ±132% -96.6% 51.50 ± 28% interrupts.CPU23.NMI:Non-maskable_interrupts 1511 ±132% -96.6% 51.50 ± 28% interrupts.CPU23.PMI:Performance_monitoring_interrupts 71450 ± 26% -100.0% 2.50 ± 20% interrupts.CPU23.TLB:TLB_shootdowns 917.33 ± 65% +289.9% 3576 ± 39% interrupts.CPU24.NMI:Non-maskable_interrupts 917.33 ± 65% +289.9% 3576 ± 39% interrupts.CPU24.PMI:Performance_monitoring_interrupts 304398 ± 14% +354.3% 1382899 ± 17% interrupts.CPU25.CAL:Function_call_interrupts 331035 ± 15% +351.5% 1494674 ± 15% interrupts.CPU25.TLB:TLB_shootdowns 198328 ± 28% +632.6% 1452903 ± 4% interrupts.CPU26.CAL:Function_call_interrupts 494.00 ± 20% +343.8% 2192 ± 35% interrupts.CPU26.NMI:Non-maskable_interrupts 494.00 ± 20% +343.8% 2192 ± 35% interrupts.CPU26.PMI:Performance_monitoring_interrupts 215319 ± 28% +623.9% 1558705 ± 4% interrupts.CPU26.TLB:TLB_shootdowns 58.33 ± 88% -86.3% 8.00 ± 12% interrupts.CPU28.RES:Rescheduling_interrupts 189955 ± 55% -99.9% 116.50 ± 47% interrupts.CPU29.CAL:Function_call_interrupts 1128 ± 49% -92.0% 90.50 ± 22% interrupts.CPU29.NMI:Non-maskable_interrupts 1128 ± 49% -92.0% 90.50 ± 22% interrupts.CPU29.PMI:Performance_monitoring_interrupts 205120 ± 55% -100.0% 1.00 ±100% interrupts.CPU29.TLB:TLB_shootdowns 127609 ± 33% -96.9% 3959 ± 98% interrupts.CPU3.CAL:Function_call_interrupts 139191 ± 32% -97.2% 3873 ±100% interrupts.CPU3.TLB:TLB_shootdowns 281773 ± 58% -99.8% 476.50 ± 87% interrupts.CPU30.CAL:Function_call_interrupts 1645 ± 12% -94.7% 88.00 ± 20% interrupts.CPU30.NMI:Non-maskable_interrupts 1645 ± 12% -94.7% 88.00 ± 20% interrupts.CPU30.PMI:Performance_monitoring_interrupts 105.00 ± 59% -91.9% 8.50 ± 52% interrupts.CPU30.RES:Rescheduling_interrupts 303723 ± 58% -99.9% 432.00 ± 99% interrupts.CPU30.TLB:TLB_shootdowns 236289 ± 46% -87.7% 29164 ± 99% interrupts.CPU32.CAL:Function_call_interrupts 918.67 ± 36% -90.1% 90.50 ± 14% interrupts.CPU32.NMI:Non-maskable_interrupts 918.67 ± 36% -90.1% 90.50 ± 14% interrupts.CPU32.PMI:Performance_monitoring_interrupts 135.00 ± 56% -97.0% 4.00 ±100% interrupts.CPU32.RES:Rescheduling_interrupts 255505 ± 46% -88.1% 30485 ± 99% interrupts.CPU32.TLB:TLB_shootdowns 260418 ± 32% -100.0% 70.00 ± 30% interrupts.CPU34.CAL:Function_call_interrupts 1693 ± 41% -92.1% 134.00 ± 48% interrupts.CPU34.NMI:Non-maskable_interrupts 1693 ± 41% -92.1% 134.00 ± 48% interrupts.CPU34.PMI:Performance_monitoring_interrupts 283853 ± 32% -100.0% 2.50 ± 20% interrupts.CPU34.TLB:TLB_shootdowns 306303 -100.0% 72.00 ± 19% interrupts.CPU35.CAL:Function_call_interrupts 1685 ± 23% -94.3% 96.50 ± 8% interrupts.CPU35.NMI:Non-maskable_interrupts 1685 ± 23% -94.3% 96.50 ± 8% interrupts.CPU35.PMI:Performance_monitoring_interrupts 377.33 ± 88% -97.5% 9.50 ± 89% interrupts.CPU35.RES:Rescheduling_interrupts 331951 ± 2% -100.0% 1.50 ± 33% interrupts.CPU35.TLB:TLB_shootdowns 2148 ± 86% -95.9% 88.50 ± 17% interrupts.CPU36.NMI:Non-maskable_interrupts 2148 ± 86% -95.9% 88.50 ± 17% interrupts.CPU36.PMI:Performance_monitoring_interrupts 1007 ± 33% -93.0% 71.00 interrupts.CPU39.NMI:Non-maskable_interrupts 1007 ± 33% -93.0% 71.00 interrupts.CPU39.PMI:Performance_monitoring_interrupts 89.67 ± 57% -98.3% 1.50 ± 33% interrupts.CPU39.RES:Rescheduling_interrupts 227185 ± 39% -100.0% 45.00 ± 6% interrupts.CPU40.CAL:Function_call_interrupts 297.33 ±105% -99.8% 0.50 ±100% interrupts.CPU40.RES:Rescheduling_interrupts 248670 ± 39% -100.0% 1.50 ±100% interrupts.CPU40.TLB:TLB_shootdowns 281008 ± 24% -100.0% 52.50 ± 2% interrupts.CPU41.CAL:Function_call_interrupts 2233 ± 34% -96.8% 70.50 ± 2% interrupts.CPU41.NMI:Non-maskable_interrupts 2233 ± 34% -96.8% 70.50 ± 2% interrupts.CPU41.PMI:Performance_monitoring_interrupts 78.00 ± 35% -98.1% 1.50 ±100% interrupts.CPU41.RES:Rescheduling_interrupts 304440 ± 24% -100.0% 4.00 ± 25% interrupts.CPU41.TLB:TLB_shootdowns 295913 ± 47% -100.0% 52.00 ± 5% interrupts.CPU42.CAL:Function_call_interrupts 2330 ± 57% -96.4% 84.50 ± 25% interrupts.CPU42.NMI:Non-maskable_interrupts 2330 ± 57% -96.4% 84.50 ± 25% interrupts.CPU42.PMI:Performance_monitoring_interrupts 321984 ± 48% -100.0% 2.00 ±100% interrupts.CPU42.TLB:TLB_shootdowns 168874 ± 32% -100.0% 75.00 ± 25% interrupts.CPU43.CAL:Function_call_interrupts 182538 ± 32% -100.0% 1.50 ±100% interrupts.CPU43.TLB:TLB_shootdowns 212342 ± 41% -99.9% 107.50 ± 49% interrupts.CPU44.CAL:Function_call_interrupts 475.00 ± 32% -80.6% 92.00 ± 26% interrupts.CPU44.NMI:Non-maskable_interrupts 475.00 ± 32% -80.6% 92.00 ± 26% interrupts.CPU44.PMI:Performance_monitoring_interrupts 73.33 ±124% -97.3% 2.00 ± 50% interrupts.CPU44.RES:Rescheduling_interrupts 229440 ± 41% -100.0% 1.50 ±100% interrupts.CPU44.TLB:TLB_shootdowns 239600 ± 62% -100.0% 52.50 ± 2% interrupts.CPU45.CAL:Function_call_interrupts 2233 ± 41% -95.4% 103.50 ± 8% interrupts.CPU45.NMI:Non-maskable_interrupts 2233 ± 41% -95.4% 103.50 ± 8% interrupts.CPU45.PMI:Performance_monitoring_interrupts 259462 ± 62% -100.0% 9.00 ±100% interrupts.CPU45.TLB:TLB_shootdowns 142832 ± 79% -100.0% 52.50 ± 2% interrupts.CPU46.CAL:Function_call_interrupts 88.33 ±104% -99.4% 0.50 ±100% interrupts.CPU46.RES:Rescheduling_interrupts 153950 ± 79% -100.0% 1.50 ±100% interrupts.CPU46.TLB:TLB_shootdowns 223934 ± 51% -100.0% 51.50 ± 4% interrupts.CPU47.CAL:Function_call_interrupts 1107 ± 6% -89.8% 112.50 ± 4% interrupts.CPU47.NMI:Non-maskable_interrupts 1107 ± 6% -89.8% 112.50 ± 4% interrupts.CPU47.PMI:Performance_monitoring_interrupts 59.67 ± 92% -98.3% 1.00 ±100% interrupts.CPU47.RES:Rescheduling_interrupts 242184 ± 51% -100.0% 1.00 ±100% interrupts.CPU47.TLB:TLB_shootdowns 1904 ± 6% -17.4% 1573 ± 8% interrupts.CPU48.NMI:Non-maskable_interrupts 1904 ± 6% -17.4% 1573 ± 8% interrupts.CPU48.PMI:Performance_monitoring_interrupts 54.33 ± 72% -96.3% 2.00 ±100% interrupts.CPU48.RES:Rescheduling_interrupts 615.67 ± 10% -91.4% 53.00 ± 35% interrupts.CPU49.NMI:Non-maskable_interrupts 615.67 ± 10% -91.4% 53.00 ± 35% interrupts.CPU49.PMI:Performance_monitoring_interrupts 801.33 ± 67% -82.0% 144.00 ± 13% interrupts.CPU50.NMI:Non-maskable_interrupts 801.33 ± 67% -82.0% 144.00 ± 13% interrupts.CPU50.PMI:Performance_monitoring_interrupts 45295 ± 20% -99.4% 271.50 ± 81% interrupts.CPU51.CAL:Function_call_interrupts 211.33 ± 77% -63.3% 77.50 ± 8% interrupts.CPU51.NMI:Non-maskable_interrupts 211.33 ± 77% -63.3% 77.50 ± 8% interrupts.CPU51.PMI:Performance_monitoring_interrupts 48928 ± 18% -99.5% 220.50 ±100% interrupts.CPU51.TLB:TLB_shootdowns 47166 ± 20% -99.9% 54.50 ± 10% interrupts.CPU52.CAL:Function_call_interrupts 50380 ± 20% -100.0% 3.50 ±100% interrupts.CPU52.TLB:TLB_shootdowns 35411 ± 35% -99.8% 61.50 ± 5% interrupts.CPU54.CAL:Function_call_interrupts 38542 ± 36% -100.0% 1.50 ±100% interrupts.CPU54.TLB:TLB_shootdowns 18108 ± 37% -97.4% 469.00 ± 67% interrupts.CPU55.CAL:Function_call_interrupts 423.00 ± 61% -72.9% 114.50 ± 14% interrupts.CPU55.NMI:Non-maskable_interrupts 423.00 ± 61% -72.9% 114.50 ± 14% interrupts.CPU55.PMI:Performance_monitoring_interrupts 19986 ± 36% -98.2% 367.50 ±100% interrupts.CPU55.TLB:TLB_shootdowns 95159 ± 59% -99.9% 69.00 ± 21% interrupts.CPU56.CAL:Function_call_interrupts 106645 ± 60% -100.0% 1.00 ±100% interrupts.CPU56.TLB:TLB_shootdowns 30072 ± 48% -99.3% 215.00 ± 73% interrupts.CPU57.CAL:Function_call_interrupts 393.33 ± 98% -83.0% 67.00 ± 44% interrupts.CPU57.NMI:Non-maskable_interrupts 393.33 ± 98% -83.0% 67.00 ± 44% interrupts.CPU57.PMI:Performance_monitoring_interrupts 32538 ± 49% -99.6% 132.00 ± 97% interrupts.CPU57.TLB:TLB_shootdowns 88184 ± 34% -84.5% 13690 ± 97% interrupts.CPU58.CAL:Function_call_interrupts 66.33 ±125% -97.7% 1.50 ± 33% interrupts.CPU58.RES:Rescheduling_interrupts 96406 ± 34% -85.7% 13817 ± 98% interrupts.CPU58.TLB:TLB_shootdowns 150.67 ± 23% -56.2% 66.00 interrupts.CPU61.NMI:Non-maskable_interrupts 150.67 ± 23% -56.2% 66.00 interrupts.CPU61.PMI:Performance_monitoring_interrupts 59359 ± 14% +626.9% 431469 ± 6% interrupts.CPU62.CAL:Function_call_interrupts 366.33 ± 70% +522.2% 2279 ± 26% interrupts.CPU62.NMI:Non-maskable_interrupts 366.33 ± 70% +522.2% 2279 ± 26% interrupts.CPU62.PMI:Performance_monitoring_interrupts 64879 ± 14% +602.7% 455931 ± 6% interrupts.CPU62.TLB:TLB_shootdowns 151.00 ± 11% -37.7% 94.00 ± 5% interrupts.CPU64.NMI:Non-maskable_interrupts 151.00 ± 11% -37.7% 94.00 ± 5% interrupts.CPU64.PMI:Performance_monitoring_interrupts 13947 ± 64% -98.9% 147.50 ± 65% interrupts.CPU66.CAL:Function_call_interrupts 15318 ± 63% -99.3% 114.00 ±100% interrupts.CPU66.TLB:TLB_shootdowns 786.33 ±112% -88.7% 89.00 ± 26% interrupts.CPU67.NMI:Non-maskable_interrupts 786.33 ±112% -88.7% 89.00 ± 26% interrupts.CPU67.PMI:Performance_monitoring_interrupts 79917 ± 80% -99.9% 52.50 ± 6% interrupts.CPU68.CAL:Function_call_interrupts 212.67 ± 62% -59.1% 87.00 ± 22% interrupts.CPU68.NMI:Non-maskable_interrupts 212.67 ± 62% -59.1% 87.00 ± 22% interrupts.CPU68.PMI:Performance_monitoring_interrupts 53982 ± 65% -99.9% 58.50 ± 2% interrupts.CPU69.CAL:Function_call_interrupts 327.33 ± 41% -83.7% 53.50 ± 32% interrupts.CPU69.NMI:Non-maskable_interrupts 327.33 ± 41% -83.7% 53.50 ± 32% interrupts.CPU69.PMI:Performance_monitoring_interrupts 58974 ± 63% -100.0% 1.50 ±100% interrupts.CPU69.TLB:TLB_shootdowns 27087 ± 30% -96.1% 1051 ± 83% interrupts.CPU7.CAL:Function_call_interrupts 433.67 ± 33% -71.6% 123.00 ± 21% interrupts.CPU7.NMI:Non-maskable_interrupts 433.67 ± 33% -71.6% 123.00 ± 21% interrupts.CPU7.PMI:Performance_monitoring_interrupts 29611 ± 30% -97.5% 750.00 ±100% interrupts.CPU7.TLB:TLB_shootdowns 30032 ± 57% -99.6% 128.00 ± 57% interrupts.CPU71.CAL:Function_call_interrupts 32874 ± 57% -99.8% 77.50 ± 96% interrupts.CPU71.TLB:TLB_shootdowns 225415 ± 25% -100.0% 67.50 ± 14% interrupts.CPU72.CAL:Function_call_interrupts 735.33 ± 34% +135.9% 1734 ± 23% interrupts.CPU72.NMI:Non-maskable_interrupts 735.33 ± 34% +135.9% 1734 ± 23% interrupts.CPU72.PMI:Performance_monitoring_interrupts 243030 ± 25% -100.0% 0.50 ±100% interrupts.CPU72.TLB:TLB_shootdowns 267730 ± 75% -99.3% 1820 ± 97% interrupts.CPU75.CAL:Function_call_interrupts 290980 ± 76% -99.4% 1770 ±100% interrupts.CPU75.TLB:TLB_shootdowns 265672 ± 44% -90.3% 25882 ± 99% interrupts.CPU76.CAL:Function_call_interrupts 971.33 ± 37% -86.8% 128.50 ± 22% interrupts.CPU76.NMI:Non-maskable_interrupts 971.33 ± 37% -86.8% 128.50 ± 22% interrupts.CPU76.PMI:Performance_monitoring_interrupts 288037 ± 44% -90.5% 27254 ±100% interrupts.CPU76.TLB:TLB_shootdowns 259900 ± 63% -100.0% 64.50 ± 13% interrupts.CPU77.CAL:Function_call_interrupts 2126 ± 52% -95.6% 92.50 ± 21% interrupts.CPU77.NMI:Non-maskable_interrupts 2126 ± 52% -95.6% 92.50 ± 21% interrupts.CPU77.PMI:Performance_monitoring_interrupts 280644 ± 63% -100.0% 1.50 ±100% interrupts.CPU77.TLB:TLB_shootdowns 233432 ± 31% -100.0% 54.00 ± 9% interrupts.CPU78.CAL:Function_call_interrupts 2428 ± 50% -97.0% 73.50 ± 53% interrupts.CPU78.NMI:Non-maskable_interrupts 2428 ± 50% -97.0% 73.50 ± 53% interrupts.CPU78.PMI:Performance_monitoring_interrupts 226.00 ±110% -98.5% 3.50 ± 14% interrupts.CPU78.RES:Rescheduling_interrupts 253071 ± 32% -100.0% 0.50 ±100% interrupts.CPU78.TLB:TLB_shootdowns 252321 ± 17% -99.9% 311.50 ± 62% interrupts.CPU79.CAL:Function_call_interrupts 1040 ± 7% -85.9% 147.00 ± 12% interrupts.CPU79.NMI:Non-maskable_interrupts 1040 ± 7% -85.9% 147.00 ± 12% interrupts.CPU79.PMI:Performance_monitoring_interrupts 211.00 ±111% -94.3% 12.00 ± 83% interrupts.CPU79.RES:Rescheduling_interrupts 274447 ± 16% -99.9% 232.50 ± 98% interrupts.CPU79.TLB:TLB_shootdowns 109041 ± 28% -94.2% 6313 ± 98% interrupts.CPU8.CAL:Function_call_interrupts 122228 ± 32% -94.6% 6592 ± 99% interrupts.CPU8.TLB:TLB_shootdowns 261240 ± 44% -100.0% 53.00 ± 7% interrupts.CPU80.CAL:Function_call_interrupts 1136 ± 39% -94.9% 57.50 ± 42% interrupts.CPU80.NMI:Non-maskable_interrupts 1136 ± 39% -94.9% 57.50 ± 42% interrupts.CPU80.PMI:Performance_monitoring_interrupts 317.67 ±125% -99.7% 1.00 ±100% interrupts.CPU80.RES:Rescheduling_interrupts 281152 ± 43% -100.0% 2.00 ±100% interrupts.CPU80.TLB:TLB_shootdowns 273.00 ±130% -96.5% 9.50 ± 78% interrupts.CPU81.RES:Rescheduling_interrupts 190306 ± 52% -99.9% 106.50 ± 48% interrupts.CPU82.CAL:Function_call_interrupts 1698 ± 92% -94.6% 91.50 ± 23% interrupts.CPU82.NMI:Non-maskable_interrupts 1698 ± 92% -94.6% 91.50 ± 23% interrupts.CPU82.PMI:Performance_monitoring_interrupts 58.67 ± 95% -81.2% 11.00 ± 9% interrupts.CPU82.RES:Rescheduling_interrupts 206202 ± 52% -100.0% 1.50 ±100% interrupts.CPU82.TLB:TLB_shootdowns 318334 ± 17% -100.0% 55.00 ± 7% interrupts.CPU83.CAL:Function_call_interrupts 1359 ± 53% -90.9% 124.00 ± 15% interrupts.CPU83.NMI:Non-maskable_interrupts 1359 ± 53% -90.9% 124.00 ± 15% interrupts.CPU83.PMI:Performance_monitoring_interrupts 151.00 ±112% -96.7% 5.00 ± 60% interrupts.CPU83.RES:Rescheduling_interrupts 344952 ± 18% -100.0% 1.50 ± 33% interrupts.CPU83.TLB:TLB_shootdowns 1052 ± 31% -91.3% 91.50 ± 23% interrupts.CPU84.NMI:Non-maskable_interrupts 1052 ± 31% -91.3% 91.50 ± 23% interrupts.CPU84.PMI:Performance_monitoring_interrupts 63.33 ± 76% -92.9% 4.50 ± 55% interrupts.CPU84.RES:Rescheduling_interrupts 259296 ± 45% -100.0% 70.00 ± 5% interrupts.CPU85.CAL:Function_call_interrupts 132.67 ± 76% -98.1% 2.50 ± 60% interrupts.CPU85.RES:Rescheduling_interrupts 281595 ± 46% -100.0% 1.00 ±100% interrupts.CPU85.TLB:TLB_shootdowns 303.33 ±105% -98.7% 4.00 ±100% interrupts.CPU86.RES:Rescheduling_interrupts 173576 ± 25% -68.9% 53961 ± 93% interrupts.CPU87.CAL:Function_call_interrupts 1120 ± 31% -94.0% 67.00 ± 49% interrupts.CPU87.NMI:Non-maskable_interrupts 1120 ± 31% -94.0% 67.00 ± 49% interrupts.CPU87.PMI:Performance_monitoring_interrupts 188725 ± 27% -69.8% 57018 ± 93% interrupts.CPU87.TLB:TLB_shootdowns 197104 ± 41% -100.0% 52.00 ± 3% interrupts.CPU88.CAL:Function_call_interrupts 60.67 ± 92% -96.7% 2.00 interrupts.CPU88.RES:Rescheduling_interrupts 214605 ± 42% -100.0% 2.00 ± 50% interrupts.CPU88.TLB:TLB_shootdowns 229259 ± 46% -100.0% 58.00 ± 12% interrupts.CPU89.CAL:Function_call_interrupts 1911 ± 39% -95.3% 90.50 ± 18% interrupts.CPU89.NMI:Non-maskable_interrupts 1911 ± 39% -95.3% 90.50 ± 18% interrupts.CPU89.PMI:Performance_monitoring_interrupts 53.67 ± 95% -99.1% 0.50 ±100% interrupts.CPU89.RES:Rescheduling_interrupts 250104 ± 46% -100.0% 1.50 ± 33% interrupts.CPU89.TLB:TLB_shootdowns 40214 ± 37% -99.1% 354.00 ± 84% interrupts.CPU9.CAL:Function_call_interrupts 387.33 ±112% -87.5% 48.50 ± 29% interrupts.CPU9.NMI:Non-maskable_interrupts 387.33 ±112% -87.5% 48.50 ± 29% interrupts.CPU9.PMI:Performance_monitoring_interrupts 114.33 ±119% -98.3% 2.00 ±100% interrupts.CPU9.RES:Rescheduling_interrupts 43311 ± 38% -99.6% 169.50 ± 98% interrupts.CPU9.TLB:TLB_shootdowns 86000 ± 41% -99.9% 54.00 interrupts.CPU90.CAL:Function_call_interrupts 1558 ± 38% -94.6% 83.50 ± 13% interrupts.CPU90.NMI:Non-maskable_interrupts 1558 ± 38% -94.6% 83.50 ± 13% interrupts.CPU90.PMI:Performance_monitoring_interrupts 91513 ± 40% -100.0% 2.00 ± 50% interrupts.CPU90.TLB:TLB_shootdowns 107289 ± 56% -99.9% 56.00 ± 10% interrupts.CPU91.CAL:Function_call_interrupts 695.00 ± 46% -79.9% 140.00 ± 30% interrupts.CPU91.NMI:Non-maskable_interrupts 695.00 ± 46% -79.9% 140.00 ± 30% interrupts.CPU91.PMI:Performance_monitoring_interrupts 116833 ± 56% -100.0% 2.00 ± 50% interrupts.CPU91.TLB:TLB_shootdowns 174141 ± 53% -100.0% 53.00 ± 5% interrupts.CPU92.CAL:Function_call_interrupts 520.33 ± 35% -82.3% 92.00 ± 10% interrupts.CPU92.NMI:Non-maskable_interrupts 520.33 ± 35% -82.3% 92.00 ± 10% interrupts.CPU92.PMI:Performance_monitoring_interrupts 189666 ± 54% -100.0% 2.50 ± 60% interrupts.CPU92.TLB:TLB_shootdowns 110083 ± 63% -98.3% 1857 ± 96% interrupts.CPU93.CAL:Function_call_interrupts 1136 ± 56% -93.5% 73.50 ± 7% interrupts.CPU93.NMI:Non-maskable_interrupts 1136 ± 56% -93.5% 73.50 ± 7% interrupts.CPU93.PMI:Performance_monitoring_interrupts 118874 ± 62% -98.5% 1797 ± 99% interrupts.CPU93.TLB:TLB_shootdowns 58617 ± 40% -96.9% 1813 ± 96% interrupts.CPU94.CAL:Function_call_interrupts 63251 ± 40% -97.2% 1756 ± 99% interrupts.CPU94.TLB:TLB_shootdowns 1872 ± 27% -95.7% 80.00 interrupts.CPU95.NMI:Non-maskable_interrupts 1872 ± 27% -95.7% 80.00 interrupts.CPU95.PMI:Performance_monitoring_interrupts 83.00 ±103% -86.1% 11.50 ± 56% interrupts.CPU95.RES:Rescheduling_interrupts 7935 ± 72% -82.2% 1414 ± 10% interrupts.RES:Rescheduling_interrupts *************************************************************************************************** lkp-csl-2ap1: 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode: gcc-9/performance/x86_64-rhel-8.3/1/32/debian-10.4-x86_64-20200603.cgz/300/lkp-csl-2ap1/swap-w-rand-mt/vm-scalability/always/always/0x4003003 commit: 3852f6768e ("mm/swapcache: support to handle the shadow entries") aae466b005 ("mm/swap: implement workingset detection for anonymous LRU") 3852f6768ede542e aae466b0052e1888edd1d7f473d ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :2 50% 1:4 dmesg.BUG:kernel_NULL_pointer_dereference,address :2 50% 1:4 dmesg.Kernel_panic-not_syncing:Fatal_exception :2 50% 1:4 dmesg.Oops:#[##] :2 50% 1:4 dmesg.RIP:kobject_del :2 50% 1:4 dmesg.RIP:native_smp_send_reschedule :2 50% 1:4 dmesg.WARNING:at_arch/x86/kernel/apic/ipi.c:#native_smp_send_reschedule 0:2 64% 1:4 perf-profile.children.cycles-pp.error_entry 0:2 16% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 1.08 ± 5% +92.8% 2.08 ± 14% vm-scalability.free_time 6536 -1.3% 6450 vm-scalability.median 320.31 +5.2% 337.04 vm-scalability.time.elapsed_time 320.31 +5.2% 337.04 vm-scalability.time.elapsed_time.max 86351 ± 12% -35.3% 55851 ± 25% vm-scalability.time.involuntary_context_switches 873.12 ± 4% -22.2% 679.71 ± 15% vm-scalability.time.system_time 3.09 -8.9% 2.81 ± 5% iostat.cpu.system 36054075 -46.3% 19366911 ± 6% cpuidle.POLL.time 8107090 -45.8% 4394214 ± 7% cpuidle.POLL.usage 0.13 -0.0 0.11 ± 10% mpstat.cpu.all.soft% 1.76 ± 4% -0.4 1.39 ± 16% mpstat.cpu.all.sys% 3989891 ± 35% +199.8% 11962962 ± 8% numa-numastat.node0.local_node 4021317 ± 34% +197.8% 11974410 ± 8% numa-numastat.node0.numa_hit 11809980 ± 38% -62.8% 4394489 ± 83% numa-numastat.node3.local_node 11835379 ± 38% -62.7% 4417959 ± 83% numa-numastat.node3.numa_hit 1044721 -14.8% 890319 ± 6% vmstat.io.bo 1117642 +37.0% 1530674 vmstat.memory.cache 11365041 +45.4% 16527872 ± 8% vmstat.memory.free 1.641e+08 -14.5% 1.403e+08 ± 5% vmstat.memory.swpd 1044714 -14.8% 890313 ± 6% vmstat.swap.so 1749 ± 5% -28.7% 1246 ± 6% perf-stat.i.cpu-migrations 0.06 +0.1 0.13 ± 15% perf-stat.i.dTLB-load-miss-rate% 1136787 +80.8% 2055617 ± 14% perf-stat.i.dTLB-load-misses 6103425 -5.0% 5795625 ± 5% perf-stat.i.iTLB-loads 0.37 -6.6% 0.35 ± 5% perf-stat.i.ipc 1.20 -6.6% 1.12 ± 3% perf-stat.i.metric.K/sec 7855002 -16.6% 6547298 ± 16% perf-stat.i.node-load-misses 0.05 ± 3% +0.1 0.10 ± 19% perf-stat.overall.dTLB-load-miss-rate% 1751 ± 5% -28.9% 1245 ± 6% perf-stat.ps.cpu-migrations 1129808 +81.1% 2046346 ± 14% perf-stat.ps.dTLB-load-misses 6074224 -5.0% 5773002 ± 5% perf-stat.ps.iTLB-loads 7853233 -16.8% 6531571 ± 16% perf-stat.ps.node-load-misses 74363186 ± 7% -44.9% 40944206 ± 5% meminfo.Active 74362739 ± 7% -44.9% 40943748 ± 5% meminfo.Active(anon) 13818 ± 8% +67.4% 23128 ± 25% meminfo.CmaFree 1.088e+08 ± 4% +25.7% 1.368e+08 meminfo.Inactive 1.088e+08 ± 4% +25.7% 1.368e+08 meminfo.Inactive(anon) 137327 +296.6% 544704 ± 5% meminfo.KReclaimable 10247553 ± 4% +51.5% 15527799 ± 9% meminfo.MemAvailable 10886951 ± 3% +46.7% 15976591 ± 9% meminfo.MemFree 137327 +296.6% 544704 ± 5% meminfo.SReclaimable 11874 +54.2% 18312 ± 14% meminfo.Shmem 452079 +89.7% 857727 ± 3% meminfo.Slab 135711 ± 6% +108.7% 283289 ± 41% meminfo.SwapCached 4123 ± 20% -51.3% 2007 ± 29% meminfo.Writeback 34270 ± 5% -9.5% 31010 ± 3% slabinfo.dmaengine-unmap-16.active_objs 824.00 ± 5% -9.4% 746.25 ± 3% slabinfo.dmaengine-unmap-16.active_slabs 34644 ± 5% -9.5% 31355 ± 3% slabinfo.dmaengine-unmap-16.num_objs 824.00 ± 5% -9.4% 746.25 ± 3% slabinfo.dmaengine-unmap-16.num_slabs 815.00 +32.9% 1082 ± 3% slabinfo.mnt_cache.active_objs 815.00 +32.9% 1082 ± 3% slabinfo.mnt_cache.num_objs 15050 ± 2% -10.3% 13502 ± 4% slabinfo.proc_inode_cache.num_objs 89702 +771.6% 781844 ± 5% slabinfo.radix_tree_node.active_objs 1619 +799.4% 14566 ± 5% slabinfo.radix_tree_node.active_slabs 90726 +799.2% 815771 ± 5% slabinfo.radix_tree_node.num_objs 1619 +799.4% 14566 ± 5% slabinfo.radix_tree_node.num_slabs 7382 ± 2% +19.8% 8844 ± 5% slabinfo.shmem_inode_cache.active_objs 7382 ± 2% +19.8% 8844 ± 5% slabinfo.shmem_inode_cache.num_objs 108.44 ± 5% -61.6% 41.65 ± 24% sched_debug.cfs_rq:/.exec_clock.min 95883 ± 3% -22.1% 74741 ± 15% sched_debug.cfs_rq:/.min_vruntime.avg 6602 ± 59% +1084.4% 78195 ± 34% sched_debug.cfs_rq:/.spread0.max 1562922 ± 16% -12.8% 1362192 ± 12% sched_debug.cpu.avg_idle.max 0.00 ± 5% -9.0% 0.00 ± 3% sched_debug.cpu.next_balance.stddev 3953 ± 34% -53.7% 1828 ± 8% sched_debug.cpu.nr_switches.min 109192 ± 6% +34.2% 146571 ± 11% sched_debug.cpu.nr_switches.stddev 15.54 ± 3% -10.5% 13.90 ± 4% sched_debug.cpu.nr_uninterruptible.stddev 2843 ± 45% -72.3% 787.31 ± 16% sched_debug.cpu.sched_count.min 109111 ± 6% +34.2% 146397 ± 11% sched_debug.cpu.sched_count.stddev 1289 ± 49% -76.3% 305.32 ± 19% sched_debug.cpu.sched_goidle.min 52858 ± 7% +36.6% 72229 ± 11% sched_debug.cpu.sched_goidle.stddev 322.33 ± 5% -19.7% 258.99 ± 14% sched_debug.cpu.ttwu_count.min 271.42 -15.5% 229.38 ± 10% sched_debug.cpu.ttwu_local.min 55848 ± 6% +31.3% 73313 ± 11% sched_debug.cpu.ttwu_local.stddev 38086 +16.9% 44526 ± 7% softirqs.CPU1.SCHED 364.50 ± 44% +2507.6% 9504 ± 93% softirqs.CPU10.NET_RX 68420 -31.7% 46741 ± 33% softirqs.CPU152.RCU 66729 ± 9% -28.6% 47676 ± 35% softirqs.CPU158.RCU 71681 ± 11% -35.7% 46123 ± 35% softirqs.CPU160.RCU 69240 ± 9% -31.6% 47350 ± 35% softirqs.CPU161.RCU 72321 ± 8% -34.1% 47673 ± 35% softirqs.CPU162.RCU 66391 ± 14% -28.5% 47457 ± 36% softirqs.CPU165.RCU 63766 ± 13% -25.6% 47441 ± 35% softirqs.CPU166.RCU 67404 ± 12% -32.1% 45782 ± 37% softirqs.CPU169.RCU 69859 ± 13% -34.5% 45756 ± 35% softirqs.CPU170.RCU 67546 ± 9% -31.2% 46484 ± 36% softirqs.CPU171.RCU 68951 ± 9% -32.4% 46621 ± 37% softirqs.CPU173.RCU 67616 ± 7% -31.7% 46173 ± 37% softirqs.CPU174.RCU 39793 +10.8% 44074 ± 2% softirqs.CPU176.SCHED 67016 ± 19% -27.9% 48329 ± 38% softirqs.CPU177.RCU 67339 ± 15% -28.7% 48008 ± 36% softirqs.CPU180.RCU 68397 ± 11% -29.7% 48092 ± 37% softirqs.CPU181.RCU 70026 ± 10% -30.9% 48411 ± 38% softirqs.CPU182.RCU 70803 ± 2% -34.3% 46509 ± 35% softirqs.CPU186.RCU 39877 +10.7% 44144 ± 2% softirqs.CPU188.SCHED 36241 ± 4% +17.8% 42697 softirqs.CPU24.SCHED 40263 -23.0% 30987 ± 11% softirqs.CPU38.SCHED 36666 ± 6% +19.6% 43839 ± 2% softirqs.CPU56.SCHED 36812 +17.3% 43176 ± 3% softirqs.CPU75.SCHED 4239 ± 12% +367.7% 19827 ± 52% softirqs.NET_RX 115809 ± 48% +2278.9% 2754993 ± 26% proc-vmstat.compact_daemon_migrate_scanned 11776 -50.7% 5808 ± 22% proc-vmstat.compact_success 18598991 ± 7% -44.9% 10248481 ± 4% proc-vmstat.nr_active_anon 45770728 -3.0% 44393376 proc-vmstat.nr_anon_pages 85912 -8.6% 78555 ± 2% proc-vmstat.nr_anon_transparent_hugepages 253989 +49.2% 378960 ± 8% proc-vmstat.nr_dirty_background_threshold 508600 +49.2% 758848 ± 8% proc-vmstat.nr_dirty_threshold 279185 +13.8% 317589 ± 9% proc-vmstat.nr_file_pages 3457 ± 6% +66.9% 5770 ± 25% proc-vmstat.nr_free_cma 2713646 +46.1% 3964193 ± 8% proc-vmstat.nr_free_pages 27207952 ± 4% +25.8% 34220425 proc-vmstat.nr_inactive_anon 90.50 ± 38% -42.3% 52.25 ± 71% proc-vmstat.nr_inactive_file 3204 ± 10% -17.1% 2656 ± 9% proc-vmstat.nr_isolated_anon 2957 +54.4% 4564 ± 15% proc-vmstat.nr_shmem 34261 +297.3% 136110 ± 4% proc-vmstat.nr_slab_reclaimable 724.50 -35.8% 465.00 ± 29% proc-vmstat.nr_writeback 18599012 ± 7% -44.9% 10248642 ± 4% proc-vmstat.nr_zone_active_anon 27208816 ± 4% +25.8% 34221203 proc-vmstat.nr_zone_inactive_anon 90.50 ± 38% -42.8% 51.75 ± 72% proc-vmstat.nr_zone_inactive_file 703.00 -35.7% 452.00 ± 30% proc-vmstat.nr_zone_write_pending 3.385e+08 -10.2% 3.038e+08 ± 7% proc-vmstat.pgpgout 83774568 -10.9% 74674345 ± 7% proc-vmstat.pgrotated 2.043e+08 ± 8% -26.8% 1.496e+08 ± 12% proc-vmstat.pgscan_direct 84560845 -10.4% 75806985 ± 7% proc-vmstat.pgsteal_anon 44538776 -22.5% 34526377 ± 3% proc-vmstat.pgsteal_direct 84619799 -10.2% 75956512 ± 7% proc-vmstat.pswpout 121047 ± 8% -26.4% 89044 ± 22% proc-vmstat.slabs_scanned 615.00 ± 6% +96.7% 1209 ± 37% proc-vmstat.swap_ra_hit 207587 -10.2% 186311 ± 3% proc-vmstat.thp_fault_alloc 19001220 ± 6% -48.3% 9815424 ± 12% numa-meminfo.node0.Active 19001053 ± 6% -48.3% 9815137 ± 12% numa-meminfo.node0.Active(anon) 26175277 ± 5% +29.9% 34004831 ± 4% numa-meminfo.node0.Inactive 26175253 ± 5% +29.9% 34004819 ± 4% numa-meminfo.node0.Inactive(anon) 43040 ± 4% +230.6% 142276 ± 17% numa-meminfo.node0.KReclaimable 9504 ± 3% -18.3% 7765 ± 5% numa-meminfo.node0.KernelStack 5901 +23.0% 7256 ± 20% numa-meminfo.node0.Mapped 2684201 ± 7% +53.8% 4128329 ± 6% numa-meminfo.node0.MemFree 206184 ± 4% -27.7% 149049 ± 14% numa-meminfo.node0.PageTables 43040 ± 4% +230.6% 142276 ± 17% numa-meminfo.node0.SReclaimable 110348 ± 2% -18.6% 89858 ± 3% numa-meminfo.node0.SUnreclaim 5091 ± 10% -64.8% 1790 ±116% numa-meminfo.node0.Shmem 153389 +51.3% 232135 ± 10% numa-meminfo.node0.Slab 18726155 ± 7% -48.6% 9622670 ± 17% numa-meminfo.node1.Active 18725898 ± 7% -48.6% 9622633 ± 17% numa-meminfo.node1.Active(anon) 27336363 ± 4% +29.3% 35337382 ± 5% numa-meminfo.node1.Inactive 27336247 ± 4% +29.3% 35337252 ± 5% numa-meminfo.node1.Inactive(anon) 30936 ± 9% +410.8% 158013 ± 23% numa-meminfo.node1.KReclaimable 30936 ± 9% +410.8% 158013 ± 23% numa-meminfo.node1.SReclaimable 102012 ± 4% +124.8% 229332 ± 16% numa-meminfo.node1.Slab 18780713 ± 8% -41.5% 10981759 ± 24% numa-meminfo.node2.Active 18780699 ± 8% -41.5% 10981704 ± 24% numa-meminfo.node2.Active(anon) 260006 +18.5% 308084 ± 11% numa-meminfo.node2.FilePages 27126472 ± 5% +23.7% 33567811 ± 6% numa-meminfo.node2.Inactive 27126417 ± 5% +23.7% 33567753 ± 6% numa-meminfo.node2.Inactive(anon) 31525 ± 5% +347.0% 140930 ± 22% numa-meminfo.node2.KReclaimable 2856577 ± 3% +43.3% 4094648 ± 9% numa-meminfo.node2.MemFree 31525 ± 5% +347.0% 140930 ± 22% numa-meminfo.node2.SReclaimable 94052 ± 2% +124.9% 211533 ± 13% numa-meminfo.node2.Slab 1071 ± 2% -48.8% 548.25 ± 65% numa-meminfo.node2.Writeback 17886451 ± 8% -41.1% 10536003 ± 19% numa-meminfo.node3.Active 17886443 ± 8% -41.1% 10535924 ± 19% numa-meminfo.node3.Active(anon) 28171067 ± 4% +20.1% 33819890 ± 6% numa-meminfo.node3.Inactive 28170898 ± 4% +20.1% 33819879 ± 6% numa-meminfo.node3.Inactive(anon) 31804 +225.7% 103572 ± 21% numa-meminfo.node3.KReclaimable 10075 ± 6% -28.9% 7162 ± 25% numa-meminfo.node3.Mapped 2651367 ± 9% +58.4% 4199157 ± 15% numa-meminfo.node3.MemFree 31804 +225.7% 103572 ± 21% numa-meminfo.node3.SReclaimable 102638 +80.1% 184817 ± 8% numa-meminfo.node3.Slab 1103 ± 2% -62.4% 415.25 ± 50% numa-meminfo.node3.Writeback 4750797 ± 6% -48.4% 2453627 ± 12% numa-vmstat.node0.nr_active_anon 675471 ± 5% +52.6% 1030659 ± 7% numa-vmstat.node0.nr_free_pages 6538855 ± 5% +30.0% 8502807 ± 4% numa-vmstat.node0.nr_inactive_anon 9503 ± 3% -18.2% 7771 ± 5% numa-vmstat.node0.nr_kernel_stack 51494 ± 4% -27.6% 37274 ± 14% numa-vmstat.node0.nr_page_table_pages 1272 ± 11% -64.8% 448.00 ±116% numa-vmstat.node0.nr_shmem 10750 ± 4% +230.9% 35572 ± 17% numa-vmstat.node0.nr_slab_reclaimable 27587 ± 2% -18.6% 22460 ± 3% numa-vmstat.node0.nr_slab_unreclaimable 1543166 ± 20% +183.1% 4368165 ± 11% numa-vmstat.node0.nr_vmscan_write 1542970 ± 20% +183.1% 4367994 ± 11% numa-vmstat.node0.nr_written 4750809 ± 6% -48.4% 2453693 ± 12% numa-vmstat.node0.nr_zone_active_anon 6538943 ± 5% +30.0% 8502999 ± 4% numa-vmstat.node0.nr_zone_inactive_anon 924215 ± 53% +177.0% 2560038 ± 48% numa-vmstat.node0.numa_foreign 2217911 ± 29% +154.8% 5650919 ± 7% numa-vmstat.node0.numa_hit 2155706 ± 31% +161.5% 5637333 ± 7% numa-vmstat.node0.numa_local 4674978 ± 7% -48.4% 2411058 ± 16% numa-vmstat.node1.nr_active_anon 63.50 ± 62% -85.8% 9.00 ±132% numa-vmstat.node1.nr_active_file 6836617 ± 4% +29.1% 8824282 ± 5% numa-vmstat.node1.nr_inactive_anon 7742 ± 9% +410.4% 39516 ± 23% numa-vmstat.node1.nr_slab_reclaimable 250.50 ± 6% -37.0% 157.75 ± 34% numa-vmstat.node1.nr_writeback 4674967 ± 7% -48.4% 2411093 ± 16% numa-vmstat.node1.nr_zone_active_anon 63.50 ± 62% -85.8% 9.00 ±132% numa-vmstat.node1.nr_zone_active_file 6836844 ± 4% +29.1% 8824484 ± 5% numa-vmstat.node1.nr_zone_inactive_anon 244.50 ± 5% -37.0% 154.00 ± 35% numa-vmstat.node1.nr_zone_write_pending 575290 ± 2% +67.1% 961547 ± 29% numa-vmstat.node1.numa_foreign 4700028 ± 8% -41.6% 2746294 ± 24% numa-vmstat.node2.nr_active_anon 65049 +18.2% 76893 ± 11% numa-vmstat.node2.nr_file_pages 718878 ± 4% +42.7% 1025683 ± 8% numa-vmstat.node2.nr_free_pages 6772066 ± 5% +23.9% 8389077 ± 6% numa-vmstat.node2.nr_inactive_anon 7859 ± 5% +348.7% 35266 ± 22% numa-vmstat.node2.nr_slab_reclaimable 234.00 ± 10% -50.6% 115.50 ± 61% numa-vmstat.node2.nr_writeback 4700031 ± 8% -41.6% 2746330 ± 24% numa-vmstat.node2.nr_zone_active_anon 6772290 ± 5% +23.9% 8389269 ± 6% numa-vmstat.node2.nr_zone_inactive_anon 226.00 ± 10% -51.0% 110.75 ± 61% numa-vmstat.node2.nr_zone_write_pending 4466820 ± 8% -41.0% 2635768 ± 19% numa-vmstat.node3.nr_active_anon 3487 ± 7% +66.9% 5820 ± 25% numa-vmstat.node3.nr_free_cma 667183 ± 11% +57.7% 1052209 ± 15% numa-vmstat.node3.nr_free_pages 7043232 ± 4% +20.0% 8450818 ± 6% numa-vmstat.node3.nr_inactive_anon 2519 ± 6% -27.7% 1821 ± 24% numa-vmstat.node3.nr_mapped 7951 +225.7% 25892 ± 21% numa-vmstat.node3.nr_slab_reclaimable 4244224 ± 37% -48.6% 2180229 ± 69% numa-vmstat.node3.nr_vmscan_write 296.00 ± 17% -62.2% 111.75 ± 59% numa-vmstat.node3.nr_writeback 4243937 ± 37% -48.6% 2180124 ± 69% numa-vmstat.node3.nr_written 4466803 ± 8% -41.0% 2635791 ± 19% numa-vmstat.node3.nr_zone_active_anon 7043545 ± 4% +20.0% 8450932 ± 6% numa-vmstat.node3.nr_zone_inactive_anon 290.50 ± 18% -62.7% 108.25 ± 60% numa-vmstat.node3.nr_zone_write_pending 4851710 ± 38% -47.5% 2546955 ± 72% numa-vmstat.node3.numa_hit 4744738 ± 39% -48.5% 2442319 ± 76% numa-vmstat.node3.numa_local 691.00 ± 47% +2554.2% 18340 ± 92% interrupts.31:PCI-MSI.524289-edge.eth0-TxRx-0 278.50 ± 50% +165.7% 740.00 ± 48% interrupts.CPU0.NMI:Non-maskable_interrupts 278.50 ± 50% +165.7% 740.00 ± 48% interrupts.CPU0.PMI:Performance_monitoring_interrupts 109.00 ± 22% +597.7% 760.50 ±107% interrupts.CPU1.NMI:Non-maskable_interrupts 109.00 ± 22% +597.7% 760.50 ±107% interrupts.CPU1.PMI:Performance_monitoring_interrupts 691.00 ± 47% +2554.2% 18340 ± 92% interrupts.CPU10.31:PCI-MSI.524289-edge.eth0-TxRx-0 143.50 ± 20% +227.0% 469.25 ± 24% interrupts.CPU10.NMI:Non-maskable_interrupts 143.50 ± 20% +227.0% 469.25 ± 24% interrupts.CPU10.PMI:Performance_monitoring_interrupts 107.00 ± 29% +70.1% 182.00 ± 25% interrupts.CPU100.NMI:Non-maskable_interrupts 107.00 ± 29% +70.1% 182.00 ± 25% interrupts.CPU100.PMI:Performance_monitoring_interrupts 76888 ± 54% +499.7% 461102 ± 57% interrupts.CPU101.CAL:Function_call_interrupts 90857 ± 55% +504.5% 549258 ± 60% interrupts.CPU101.TLB:TLB_shootdowns 202.00 ± 50% -63.0% 74.75 ± 27% interrupts.CPU102.RES:Rescheduling_interrupts 287.50 ± 48% -71.0% 83.25 ± 46% interrupts.CPU103.RES:Rescheduling_interrupts 238.00 ± 36% -51.3% 116.00 ± 52% interrupts.CPU104.RES:Rescheduling_interrupts 221.50 ± 25% -51.2% 108.00 ± 45% interrupts.CPU105.RES:Rescheduling_interrupts 151.50 ± 25% +237.8% 511.75 ± 23% interrupts.CPU106.NMI:Non-maskable_interrupts 151.50 ± 25% +237.8% 511.75 ± 23% interrupts.CPU106.PMI:Performance_monitoring_interrupts 277.50 ± 42% -58.9% 114.00 ± 44% interrupts.CPU106.RES:Rescheduling_interrupts 276.50 ± 42% -58.6% 114.50 ± 30% interrupts.CPU107.RES:Rescheduling_interrupts 275.00 ± 28% -59.2% 112.25 ± 25% interrupts.CPU108.RES:Rescheduling_interrupts 290.00 ± 22% -55.7% 128.50 ± 24% interrupts.CPU109.RES:Rescheduling_interrupts 307.50 ± 60% -74.8% 77.50 ± 13% interrupts.CPU11.RES:Rescheduling_interrupts 259.50 ± 17% -49.0% 132.25 ± 26% interrupts.CPU110.RES:Rescheduling_interrupts 282.00 ± 32% -45.4% 154.00 ± 45% interrupts.CPU111.RES:Rescheduling_interrupts 62672 ± 41% +419.3% 325467 ± 45% interrupts.CPU112.CAL:Function_call_interrupts 76545 ± 41% +394.7% 378647 ± 46% interrupts.CPU112.TLB:TLB_shootdowns 218.50 ± 27% +182.3% 616.75 ± 49% interrupts.CPU116.NMI:Non-maskable_interrupts 218.50 ± 27% +182.3% 616.75 ± 49% interrupts.CPU116.PMI:Performance_monitoring_interrupts 66666 ± 26% +459.0% 372656 ± 70% interrupts.CPU118.CAL:Function_call_interrupts 78025 ± 28% +456.6% 434295 ± 72% interrupts.CPU118.TLB:TLB_shootdowns 59429 ± 63% +297.0% 235937 ± 32% interrupts.CPU119.CAL:Function_call_interrupts 68515 ± 64% +293.8% 269805 ± 34% interrupts.CPU119.TLB:TLB_shootdowns 219.50 ± 28% -48.6% 112.75 ± 41% interrupts.CPU12.RES:Rescheduling_interrupts 101.00 +212.1% 315.25 ± 31% interrupts.CPU124.RES:Rescheduling_interrupts 110.50 ± 19% +273.5% 412.75 ± 44% interrupts.CPU125.RES:Rescheduling_interrupts 94.50 ± 8% +256.3% 336.75 ± 84% interrupts.CPU126.NMI:Non-maskable_interrupts 94.50 ± 8% +256.3% 336.75 ± 84% interrupts.CPU126.PMI:Performance_monitoring_interrupts 120.00 ± 14% +271.7% 446.00 ± 30% interrupts.CPU126.RES:Rescheduling_interrupts 131.50 ± 23% +131.2% 304.00 ± 33% interrupts.CPU127.RES:Rescheduling_interrupts 133.00 ± 42% +119.9% 292.50 ± 25% interrupts.CPU128.RES:Rescheduling_interrupts 171.50 ± 21% +62.4% 278.50 ± 24% interrupts.CPU130.RES:Rescheduling_interrupts 241.50 +86.4% 450.25 ± 50% interrupts.CPU132.RES:Rescheduling_interrupts 251.50 ± 2% +67.6% 421.50 ± 26% interrupts.CPU134.RES:Rescheduling_interrupts 135.50 ± 23% -41.9% 78.75 ± 22% interrupts.CPU14.RES:Rescheduling_interrupts 36.50 ± 6% +217.1% 115.75 ± 51% interrupts.CPU141.RES:Rescheduling_interrupts 16.50 ± 27% +1084.8% 195.50 ± 80% interrupts.CPU142.RES:Rescheduling_interrupts 152.50 ± 4% +54.6% 235.75 ± 34% interrupts.CPU144.NMI:Non-maskable_interrupts 152.50 ± 4% +54.6% 235.75 ± 34% interrupts.CPU144.PMI:Performance_monitoring_interrupts 608.50 -62.2% 230.25 ± 34% interrupts.CPU145.NMI:Non-maskable_interrupts 608.50 -62.2% 230.25 ± 34% interrupts.CPU145.PMI:Performance_monitoring_interrupts 7770 ± 15% +307.5% 31664 ±104% interrupts.CPU15.CAL:Function_call_interrupts 7746 ± 14% +451.0% 42681 ± 81% interrupts.CPU15.TLB:TLB_shootdowns 179321 +37.6% 246659 ± 14% interrupts.CPU154.CAL:Function_call_interrupts 474.50 ± 5% -26.4% 349.25 ± 24% interrupts.CPU154.RES:Rescheduling_interrupts 223397 ± 3% +27.8% 285599 ± 16% interrupts.CPU154.TLB:TLB_shootdowns 158.50 ± 6% +321.6% 668.25 ±123% interrupts.CPU165.NMI:Non-maskable_interrupts 158.50 ± 6% +321.6% 668.25 ±123% interrupts.CPU165.PMI:Performance_monitoring_interrupts 155.00 ± 3% +730.2% 1286 ± 65% interrupts.CPU167.NMI:Non-maskable_interrupts 155.00 ± 3% +730.2% 1286 ± 65% interrupts.CPU167.PMI:Performance_monitoring_interrupts 227937 ± 38% -72.5% 62775 ±112% interrupts.CPU169.CAL:Function_call_interrupts 260271 ± 38% -70.9% 75774 ±113% interrupts.CPU169.TLB:TLB_shootdowns 231108 ± 29% -75.3% 57057 ± 92% interrupts.CPU171.CAL:Function_call_interrupts 352.50 ± 46% -75.8% 85.25 ±104% interrupts.CPU171.RES:Rescheduling_interrupts 263976 ± 31% -76.1% 62985 ± 93% interrupts.CPU171.TLB:TLB_shootdowns 249893 ± 22% -69.3% 76666 ± 93% interrupts.CPU173.CAL:Function_call_interrupts 313.50 ± 25% -64.0% 112.75 ± 85% interrupts.CPU173.RES:Rescheduling_interrupts 295531 ± 25% -68.0% 94592 ± 95% interrupts.CPU173.TLB:TLB_shootdowns 368.00 ± 14% -60.9% 143.75 ± 75% interrupts.CPU174.RES:Rescheduling_interrupts 423.00 -57.3% 180.50 ± 73% interrupts.CPU175.RES:Rescheduling_interrupts 550.00 -71.7% 155.50 ± 90% interrupts.CPU176.RES:Rescheduling_interrupts 528.50 ± 5% -67.0% 174.25 ±117% interrupts.CPU178.RES:Rescheduling_interrupts 225636 ± 32% -64.7% 79543 ±105% interrupts.CPU179.CAL:Function_call_interrupts 402.00 ± 32% -49.6% 202.75 ± 34% interrupts.CPU179.NMI:Non-maskable_interrupts 402.00 ± 32% -49.6% 202.75 ± 34% interrupts.CPU179.PMI:Performance_monitoring_interrupts 501.50 ± 3% -64.1% 180.25 ± 98% interrupts.CPU179.RES:Rescheduling_interrupts 266959 ± 34% -65.1% 93250 ±101% interrupts.CPU179.TLB:TLB_shootdowns 420.50 ± 12% -54.6% 191.00 ± 60% interrupts.CPU180.RES:Rescheduling_interrupts 460.50 -59.6% 186.25 ± 85% interrupts.CPU181.RES:Rescheduling_interrupts 249398 ± 34% -50.9% 122544 ± 41% interrupts.CPU182.CAL:Function_call_interrupts 298945 ± 36% -51.9% 143906 ± 42% interrupts.CPU182.TLB:TLB_shootdowns 484.00 ± 24% -54.4% 220.50 ±101% interrupts.CPU183.RES:Rescheduling_interrupts 228.50 ± 4% -65.2% 79.50 ± 80% interrupts.CPU184.RES:Rescheduling_interrupts 237.50 -32.1% 161.25 ± 40% interrupts.CPU186.NMI:Non-maskable_interrupts 237.50 -32.1% 161.25 ± 40% interrupts.CPU186.PMI:Performance_monitoring_interrupts 119.50 ± 20% -51.9% 57.50 ± 59% interrupts.CPU187.RES:Rescheduling_interrupts 100.50 ± 11% -61.4% 38.75 ± 62% interrupts.CPU188.RES:Rescheduling_interrupts 25279 ± 55% -84.0% 4034 ±108% interrupts.CPU19.CAL:Function_call_interrupts 154.50 ± 18% +299.7% 617.50 ± 46% interrupts.CPU19.NMI:Non-maskable_interrupts 154.50 ± 18% +299.7% 617.50 ± 46% interrupts.CPU19.PMI:Performance_monitoring_interrupts 27988 ± 59% -77.4% 6335 ±162% interrupts.CPU19.TLB:TLB_shootdowns 78795 ± 17% -66.5% 26361 ±132% interrupts.CPU191.CAL:Function_call_interrupts 89793 ± 17% -69.3% 27599 ±139% interrupts.CPU191.TLB:TLB_shootdowns 136.50 ± 3% +701.1% 1093 ± 69% interrupts.CPU2.NMI:Non-maskable_interrupts 136.50 ± 3% +701.1% 1093 ± 69% interrupts.CPU2.PMI:Performance_monitoring_interrupts 264.00 -62.9% 98.00 ± 42% interrupts.CPU2.RES:Rescheduling_interrupts 190.50 ± 16% +179.0% 531.50 ± 42% interrupts.CPU20.NMI:Non-maskable_interrupts 190.50 ± 16% +179.0% 531.50 ± 42% interrupts.CPU20.PMI:Performance_monitoring_interrupts 85184 ± 18% -81.5% 15741 ±122% interrupts.CPU22.CAL:Function_call_interrupts 97815 ± 17% -78.7% 20803 ±107% interrupts.CPU22.TLB:TLB_shootdowns 36354 ± 30% -80.5% 7107 ±136% interrupts.CPU23.CAL:Function_call_interrupts 41265 ± 31% -83.2% 6931 ±168% interrupts.CPU23.TLB:TLB_shootdowns 187656 ± 14% -61.3% 72695 ± 97% interrupts.CPU24.CAL:Function_call_interrupts 105763 ± 67% -89.0% 11633 ± 79% interrupts.CPU25.CAL:Function_call_interrupts 118461 ± 60% -78.6% 25319 ±100% interrupts.CPU25.TLB:TLB_shootdowns 12080 ± 13% -56.8% 5220 ± 55% interrupts.CPU26.CAL:Function_call_interrupts 235.50 ± 28% -72.0% 66.00 ± 35% interrupts.CPU27.RES:Rescheduling_interrupts 35432 ± 7% -84.5% 5502 ±117% interrupts.CPU28.CAL:Function_call_interrupts 392.00 ± 5% -74.4% 100.50 ± 75% interrupts.CPU28.RES:Rescheduling_interrupts 46283 ± 10% -81.3% 8648 ±153% interrupts.CPU28.TLB:TLB_shootdowns 222.00 -70.4% 65.75 ± 48% interrupts.CPU3.RES:Rescheduling_interrupts 253.00 ± 3% -71.3% 72.50 ± 14% interrupts.CPU35.RES:Rescheduling_interrupts 7384 ± 74% -84.1% 1177 ± 21% interrupts.CPU39.CAL:Function_call_interrupts 12116 ± 94% -99.5% 66.50 ± 80% interrupts.CPU39.TLB:TLB_shootdowns 9942 ± 22% -71.4% 2839 ± 77% interrupts.CPU4.CAL:Function_call_interrupts 261.00 ± 6% -79.6% 53.25 ± 17% interrupts.CPU4.RES:Rescheduling_interrupts 10765 ± 26% -66.5% 3606 ±138% interrupts.CPU4.TLB:TLB_shootdowns 25523 ± 92% -89.8% 2615 ± 88% interrupts.CPU40.CAL:Function_call_interrupts 113.00 ± 32% +80.3% 203.75 ± 25% interrupts.CPU44.NMI:Non-maskable_interrupts 113.00 ± 32% +80.3% 203.75 ± 25% interrupts.CPU44.PMI:Performance_monitoring_interrupts 8.50 ± 17% +1120.6% 103.75 ±100% interrupts.CPU45.RES:Rescheduling_interrupts 541.50 ± 55% -84.2% 85.50 ± 57% interrupts.CPU49.RES:Rescheduling_interrupts 150.00 ± 49% -68.2% 47.75 ± 47% interrupts.CPU5.RES:Rescheduling_interrupts 327.00 ± 22% -83.6% 53.75 ± 17% interrupts.CPU50.RES:Rescheduling_interrupts 145.00 +118.3% 316.50 ± 72% interrupts.CPU51.NMI:Non-maskable_interrupts 145.00 +118.3% 316.50 ± 72% interrupts.CPU51.PMI:Performance_monitoring_interrupts 165.50 ± 5% -72.2% 46.00 ± 19% interrupts.CPU51.RES:Rescheduling_interrupts 108.00 ± 32% +147.7% 267.50 ± 61% interrupts.CPU52.NMI:Non-maskable_interrupts 108.00 ± 32% +147.7% 267.50 ± 61% interrupts.CPU52.PMI:Performance_monitoring_interrupts 251.00 ± 46% -59.5% 101.75 ± 73% interrupts.CPU52.RES:Rescheduling_interrupts 146.00 +165.9% 388.25 ± 46% interrupts.CPU53.NMI:Non-maskable_interrupts 146.00 +165.9% 388.25 ± 46% interrupts.CPU53.PMI:Performance_monitoring_interrupts 160.00 ± 9% +100.2% 320.25 ± 58% interrupts.CPU54.NMI:Non-maskable_interrupts 160.00 ± 9% +100.2% 320.25 ± 58% interrupts.CPU54.PMI:Performance_monitoring_interrupts 132.50 ± 4% +298.9% 528.50 ± 63% interrupts.CPU55.NMI:Non-maskable_interrupts 132.50 ± 4% +298.9% 528.50 ± 63% interrupts.CPU55.PMI:Performance_monitoring_interrupts 25836 ± 36% -94.7% 1374 ± 26% interrupts.CPU56.CAL:Function_call_interrupts 321.00 ± 33% -86.6% 43.00 ± 7% interrupts.CPU56.RES:Rescheduling_interrupts 38679 ± 28% -99.4% 243.00 ± 73% interrupts.CPU56.TLB:TLB_shootdowns 21567 ± 14% -91.2% 1907 ± 61% interrupts.CPU57.CAL:Function_call_interrupts 121.50 ± 18% +180.5% 340.75 ± 52% interrupts.CPU57.NMI:Non-maskable_interrupts 121.50 ± 18% +180.5% 340.75 ± 52% interrupts.CPU57.PMI:Performance_monitoring_interrupts 272.00 ± 35% -81.2% 51.00 ± 28% interrupts.CPU57.RES:Rescheduling_interrupts 41527 ± 15% -97.9% 862.25 ±136% interrupts.CPU57.TLB:TLB_shootdowns 248.00 ± 45% -74.6% 63.00 ± 46% interrupts.CPU58.RES:Rescheduling_interrupts 258.00 ± 25% -58.9% 106.00 ± 94% interrupts.CPU59.RES:Rescheduling_interrupts 465.00 ± 2% -91.7% 38.75 ± 39% interrupts.CPU6.RES:Rescheduling_interrupts 101.50 ± 27% -53.9% 46.75 ± 13% interrupts.CPU60.RES:Rescheduling_interrupts 186.00 ± 44% -66.7% 62.00 ± 29% interrupts.CPU61.RES:Rescheduling_interrupts 6410 ± 70% -68.3% 2030 ± 48% interrupts.CPU62.CAL:Function_call_interrupts 174.50 ± 58% -65.0% 61.00 ± 24% interrupts.CPU62.RES:Rescheduling_interrupts 6054 ± 86% -86.4% 821.00 ±146% interrupts.CPU62.TLB:TLB_shootdowns 41658 ± 55% -71.7% 11775 ±150% interrupts.CPU64.CAL:Function_call_interrupts 47312 ± 55% -75.0% 11834 ±168% interrupts.CPU64.TLB:TLB_shootdowns 18320 ± 37% -91.5% 1556 ± 15% interrupts.CPU7.CAL:Function_call_interrupts 273.50 ± 39% -83.5% 45.00 ± 58% interrupts.CPU7.RES:Rescheduling_interrupts 20101 ± 38% -97.5% 504.75 ± 36% interrupts.CPU7.TLB:TLB_shootdowns 45476 ± 7% -67.5% 14783 ±122% interrupts.CPU70.CAL:Function_call_interrupts 152.50 +43.9% 219.50 ± 22% interrupts.CPU70.NMI:Non-maskable_interrupts 152.50 +43.9% 219.50 ± 22% interrupts.CPU70.PMI:Performance_monitoring_interrupts 56380 -65.3% 19561 ±109% interrupts.CPU70.TLB:TLB_shootdowns 148.50 ± 4% +744.3% 1253 ± 53% interrupts.CPU71.NMI:Non-maskable_interrupts 148.50 ± 4% +744.3% 1253 ± 53% interrupts.CPU71.PMI:Performance_monitoring_interrupts 63152 ± 21% -87.8% 7723 ± 78% interrupts.CPU73.CAL:Function_call_interrupts 531.50 ± 51% -69.0% 164.50 ± 58% interrupts.CPU73.RES:Rescheduling_interrupts 83608 ± 24% -79.0% 17535 ±100% interrupts.CPU73.TLB:TLB_shootdowns 21856 ± 49% -83.4% 3629 ±103% interrupts.CPU74.CAL:Function_call_interrupts 311.50 ± 17% -63.6% 113.50 ± 92% interrupts.CPU74.RES:Rescheduling_interrupts 32415 ± 40% -78.9% 6828 ±163% interrupts.CPU74.TLB:TLB_shootdowns 663.00 ± 39% -83.4% 110.25 ±102% interrupts.CPU75.RES:Rescheduling_interrupts 245.50 ± 40% -73.3% 65.50 ± 90% interrupts.CPU76.RES:Rescheduling_interrupts 34156 ± 4% -75.5% 8365 ±111% interrupts.CPU76.TLB:TLB_shootdowns 193.00 ± 43% -52.6% 91.50 ± 96% interrupts.CPU77.RES:Rescheduling_interrupts 209.00 ± 28% -83.9% 33.75 ± 25% interrupts.CPU78.RES:Rescheduling_interrupts 21964 ± 25% -72.9% 5954 ±168% interrupts.CPU78.TLB:TLB_shootdowns 14935 ± 19% -90.6% 1408 ± 31% interrupts.CPU79.CAL:Function_call_interrupts 310.50 ± 3% -87.4% 39.00 ± 82% interrupts.CPU79.RES:Rescheduling_interrupts 18945 -98.6% 259.75 ±108% interrupts.CPU79.TLB:TLB_shootdowns 217.00 -67.1% 71.50 ± 80% interrupts.CPU8.RES:Rescheduling_interrupts 224.00 ± 51% -75.0% 56.00 ±107% interrupts.CPU82.RES:Rescheduling_interrupts 14294 ± 4% -75.3% 3527 ± 85% interrupts.CPU83.CAL:Function_call_interrupts 309.50 ± 23% -49.3% 157.00 ± 55% interrupts.CPU83.NMI:Non-maskable_interrupts 309.50 ± 23% -49.3% 157.00 ± 55% interrupts.CPU83.PMI:Performance_monitoring_interrupts 251.50 ± 30% -68.4% 79.50 ± 79% interrupts.CPU83.RES:Rescheduling_interrupts 20072 ± 30% -63.1% 7408 ±128% interrupts.CPU83.TLB:TLB_shootdowns 14272 ± 22% -91.2% 1260 ± 32% interrupts.CPU84.CAL:Function_call_interrupts 294.00 ± 3% -83.2% 49.25 ± 64% interrupts.CPU84.RES:Rescheduling_interrupts 23916 ± 51% -99.4% 132.75 ±166% interrupts.CPU84.TLB:TLB_shootdowns 155.00 ± 37% -52.7% 73.25 ±110% interrupts.CPU85.RES:Rescheduling_interrupts 13973 ± 9% -91.1% 1250 ± 22% interrupts.CPU86.CAL:Function_call_interrupts 265.50 ± 29% -84.2% 42.00 ± 40% interrupts.CPU86.RES:Rescheduling_interrupts 14770 ± 9% -99.6% 61.00 ±158% interrupts.CPU86.TLB:TLB_shootdowns 26510 ± 18% -57.5% 11270 ± 84% interrupts.CPU88.CAL:Function_call_interrupts 95.50 ± 24% -38.0% 59.25 ± 32% interrupts.CPU9.RES:Rescheduling_interrupts 243.00 ± 10% -39.6% 146.75 ± 28% interrupts.CPU90.NMI:Non-maskable_interrupts 243.00 ± 10% -39.6% 146.75 ± 28% interrupts.CPU90.PMI:Performance_monitoring_interrupts 81359 ± 69% -59.5% 32911 ±143% interrupts.CPU91.CAL:Function_call_interrupts 92043 ± 69% -51.6% 44544 ±140% interrupts.CPU91.TLB:TLB_shootdowns 115461 ± 55% -60.2% 45972 ±134% interrupts.CPU92.CAL:Function_call_interrupts 91135 ± 7% +316.9% 379964 ± 45% interrupts.CPU98.CAL:Function_call_interrupts 105442 ± 8% +337.6% 461433 ± 50% interrupts.CPU98.TLB:TLB_shootdowns 42028 ± 2% +77.2% 74484 ± 12% interrupts.NMI:Non-maskable_interrupts 42028 ± 2% +77.2% 74484 ± 12% interrupts.PMI:Performance_monitoring_interrupts 38859 ± 12% -30.2% 27136 ± 13% interrupts.RES:Rescheduling_interrupts 10.69 ± 12% -10.4 0.28 ±173% perf-profile.calltrace.cycles-pp.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 22.09 ± 4% -8.5 13.55 ± 15% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 65.03 -8.0 57.01 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 63.55 -7.9 55.69 ± 10% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 7.80 -7.6 0.20 ±173% perf-profile.calltrace.cycles-pp.clear_huge_page.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 7.57 -7.4 0.20 ±173% perf-profile.calltrace.cycles-pp.clear_subpage.clear_huge_page.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault 17.22 ± 4% -7.1 10.15 ± 18% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 6.31 -6.1 0.16 ±173% perf-profile.calltrace.cycles-pp.clear_page_erms.clear_subpage.clear_huge_page.do_huge_pmd_anonymous_page.__handle_mm_fault 15.23 ± 3% -5.3 9.95 ± 12% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 15.24 ± 3% -5.2 10.05 ± 12% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access 15.31 ± 3% -4.3 11.00 ± 13% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access 15.32 ± 3% -4.3 11.06 ± 13% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.do_access 9.97 ± 3% -4.2 5.81 ± 18% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 9.98 ± 3% -4.2 5.83 ± 18% perf-profile.calltrace.cycles-pp.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 9.84 ± 3% -4.1 5.73 ± 18% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 4.39 -3.4 0.96 ± 10% perf-profile.calltrace.cycles-pp.try_to_unmap_one.rmap_walk_anon.try_to_unmap.shrink_page_list.shrink_inactive_list 4.42 -3.4 1.02 ± 10% perf-profile.calltrace.cycles-pp.rmap_walk_anon.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_lruvec 4.42 -3.4 1.02 ± 10% perf-profile.calltrace.cycles-pp.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 15.46 ± 3% -2.8 12.63 ± 14% perf-profile.calltrace.cycles-pp.asm_exc_page_fault.do_access 5.47 ± 4% -2.5 2.97 ± 20% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt 4.19 ± 5% -2.0 2.18 ± 18% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack 3.91 ± 5% -1.9 2.00 ± 23% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 3.38 ± 2% -1.8 1.62 ± 21% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt 3.35 ± 2% -1.8 1.60 ± 21% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 3.20 ± 7% -1.6 1.64 ± 25% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 3.19 ± 7% -1.6 1.63 ± 25% perf-profile.calltrace.cycles-pp.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 3.17 ± 7% -1.5 1.63 ± 25% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt 2.09 ± 5% -1.3 0.75 ± 16% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 2.98 -1.2 1.81 ± 14% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt 3.02 ± 4% -0.9 2.15 ± 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 2.29 ± 3% -0.8 1.44 ± 14% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack 2.68 ± 5% -0.8 1.88 ± 7% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 1.48 ± 12% -0.5 0.97 ± 10% perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 1.52 ± 11% -0.5 1.02 ± 11% perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 1.32 ± 12% -0.4 0.88 ± 15% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu 1.52 ± 4% -0.4 1.11 ± 18% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 1.55 ± 9% -0.4 1.14 ± 7% perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle 1.37 ± 7% -0.4 0.96 ± 17% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 0.77 ± 16% -0.3 0.45 ± 58% perf-profile.calltrace.cycles-pp._raw_spin_trylock.rebalance_domains.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack 0.90 ± 11% -0.2 0.66 ± 20% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt 1.03 ± 15% -0.2 0.81 ± 17% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.6 0.63 ± 16% perf-profile.calltrace.cycles-pp.page_referenced.shrink_active_list.shrink_lruvec.shrink_node.balance_pgdat 0.00 +0.7 0.70 ± 28% perf-profile.calltrace.cycles-pp.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_lruvec 0.31 ±100% +0.7 1.03 ± 18% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.io_schedule.swap_readpage.read_swap_cache_async 0.00 +0.7 0.72 ± 17% perf-profile.calltrace.cycles-pp.mem_cgroup_uncharge_swap.mem_cgroup_charge.__read_swap_cache_async.read_swap_cache_async.swapin_readahead 0.31 ±100% +0.7 1.04 ± 18% perf-profile.calltrace.cycles-pp.schedule.io_schedule.swap_readpage.read_swap_cache_async.swapin_readahead 0.31 ±100% +0.7 1.04 ± 19% perf-profile.calltrace.cycles-pp.io_schedule.swap_readpage.read_swap_cache_async.swapin_readahead.do_swap_page 1.59 ± 8% +0.7 2.32 ± 16% perf-profile.calltrace.cycles-pp.__read_swap_cache_async.read_swap_cache_async.swapin_readahead.do_swap_page.__handle_mm_fault 0.00 +0.8 0.75 ± 19% perf-profile.calltrace.cycles-pp.submit_bio_noacct.submit_bio.swap_readpage.read_swap_cache_async.swapin_readahead 0.00 +0.8 0.76 ± 19% perf-profile.calltrace.cycles-pp.submit_bio.swap_readpage.read_swap_cache_async.swapin_readahead.do_swap_page 0.00 +0.8 0.77 ± 27% perf-profile.calltrace.cycles-pp.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair 0.00 +0.8 0.77 ± 10% perf-profile.calltrace.cycles-pp.shrink_active_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd 0.00 +0.8 0.82 ± 27% perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate 0.00 +0.9 0.91 ± 33% perf-profile.calltrace.cycles-pp.pageout.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 0.00 +0.9 0.93 ± 25% perf-profile.calltrace.cycles-pp.page_vma_mapped_walk.page_referenced_one.rmap_walk_anon.page_referenced.shrink_page_list 0.00 +1.0 1.04 ± 11% perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.pagecache_get_page.lookup_swap_cache.do_swap_page 0.00 +1.1 1.06 ± 11% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.lookup_swap_cache.do_swap_page.__handle_mm_fault 0.00 +1.1 1.06 ± 11% perf-profile.calltrace.cycles-pp.pagecache_get_page.lookup_swap_cache.do_swap_page.__handle_mm_fault.handle_mm_fault 0.00 +1.1 1.11 ± 17% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__read_swap_cache_async.read_swap_cache_async.swapin_readahead.do_swap_page 1.57 ± 9% +1.1 2.71 ± 22% perf-profile.calltrace.cycles-pp.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq 0.00 +1.1 1.15 ± 12% perf-profile.calltrace.cycles-pp.lookup_swap_cache.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 1.58 ± 9% +1.1 2.73 ± 22% perf-profile.calltrace.cycles-pp.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.asm_call_on_stack 1.61 ± 10% +1.2 2.81 ± 22% perf-profile.calltrace.cycles-pp.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.asm_call_on_stack.common_interrupt 0.00 +1.3 1.26 ± 16% perf-profile.calltrace.cycles-pp.page_referenced_one.rmap_walk_anon.page_referenced.shrink_page_list.shrink_inactive_list 1.64 ± 10% +1.3 2.92 ± 22% perf-profile.calltrace.cycles-pp.handle_irq_event.handle_edge_irq.asm_call_on_stack.common_interrupt.asm_common_interrupt 1.67 ± 10% +1.3 3.00 ± 22% perf-profile.calltrace.cycles-pp.handle_edge_irq.asm_call_on_stack.common_interrupt.asm_common_interrupt.cpuidle_enter_state 1.67 ± 10% +1.3 3.00 ± 22% perf-profile.calltrace.cycles-pp.asm_call_on_stack.common_interrupt.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +1.4 1.36 ± 25% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up 0.00 +1.4 1.38 ± 18% perf-profile.calltrace.cycles-pp.rmap_walk_anon.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec 1.76 ± 10% +1.4 3.15 ± 22% perf-profile.calltrace.cycles-pp.common_interrupt.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 1.77 ± 10% +1.4 3.18 ± 22% perf-profile.calltrace.cycles-pp.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +1.7 1.65 ± 24% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.end_swap_bio_read 0.00 +1.7 1.71 ± 24% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.end_swap_bio_read.blk_update_request.blk_mq_end_request 0.00 +1.7 1.71 ± 24% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.end_swap_bio_read.blk_update_request 0.80 ± 12% +1.7 2.52 ± 17% perf-profile.calltrace.cycles-pp.swap_readpage.read_swap_cache_async.swapin_readahead.do_swap_page.__handle_mm_fault 0.00 +1.7 1.75 ± 13% perf-profile.calltrace.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 0.25 ±100% +1.8 2.01 ± 24% perf-profile.calltrace.cycles-pp.try_to_wake_up.end_swap_bio_read.blk_update_request.blk_mq_end_request.nvme_irq 0.27 ±100% +1.9 2.12 ± 24% perf-profile.calltrace.cycles-pp.end_swap_bio_read.blk_update_request.blk_mq_end_request.nvme_irq.__handle_irq_event_percpu 0.33 ±100% +2.0 2.29 ± 23% perf-profile.calltrace.cycles-pp.blk_update_request.blk_mq_end_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu 0.00 +2.0 2.01 ± 38% perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush_dirty.shrink_page_list 0.35 ±100% +2.0 2.38 ± 23% perf-profile.calltrace.cycles-pp.blk_mq_end_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event 0.00 +2.0 2.04 ± 38% perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush_dirty.shrink_page_list.shrink_inactive_list 0.00 +2.1 2.07 ± 38% perf-profile.calltrace.cycles-pp.try_to_unmap_flush_dirty.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 0.00 +2.1 2.07 ± 38% perf-profile.calltrace.cycles-pp.arch_tlbbatch_flush.try_to_unmap_flush_dirty.shrink_page_list.shrink_inactive_list.shrink_lruvec 2.40 +2.5 4.86 ± 16% perf-profile.calltrace.cycles-pp.read_swap_cache_async.swapin_readahead.do_swap_page.__handle_mm_fault.handle_mm_fault 2.41 +2.5 4.88 ± 16% perf-profile.calltrace.cycles-pp.swapin_readahead.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 4.04 +3.0 7.02 ± 21% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat 4.11 +3.4 7.48 ± 21% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd 4.12 +4.1 8.26 ± 19% perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.balance_pgdat.kswapd.kthread 4.13 +4.2 8.32 ± 19% perf-profile.calltrace.cycles-pp.shrink_node.balance_pgdat.kswapd.kthread.ret_from_fork 4.13 +4.2 8.33 ± 19% perf-profile.calltrace.cycles-pp.balance_pgdat.kswapd.kthread.ret_from_fork 4.13 +4.2 8.34 ± 19% perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork 2.71 +4.9 7.56 ± 15% perf-profile.calltrace.cycles-pp.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 10.69 ± 12% -10.3 0.41 ±114% perf-profile.children.cycles-pp.do_huge_pmd_anonymous_page 20.17 ± 4% -7.9 12.24 ± 15% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 65.62 -7.7 57.92 ± 9% perf-profile.children.cycles-pp.cpuidle_enter 65.59 -7.7 57.89 ± 9% perf-profile.children.cycles-pp.cpuidle_enter_state 7.83 -7.5 0.32 ±106% perf-profile.children.cycles-pp.clear_huge_page 7.61 -7.3 0.32 ±106% perf-profile.children.cycles-pp.clear_subpage 17.52 ± 4% -7.1 10.39 ± 17% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 6.51 -6.0 0.55 ± 51% perf-profile.children.cycles-pp.clear_page_erms 5.58 ± 8% -5.5 0.08 ±173% perf-profile.children.cycles-pp.__alloc_pages_slowpath 15.35 ± 3% -5.3 10.01 ± 12% perf-profile.children.cycles-pp.__handle_mm_fault 15.37 ± 3% -5.3 10.10 ± 12% perf-profile.children.cycles-pp.handle_mm_fault 5.75 ± 8% -5.0 0.73 ± 29% perf-profile.children.cycles-pp.__alloc_pages_nodemask 15.44 ± 3% -4.4 11.06 ± 13% perf-profile.children.cycles-pp.do_user_addr_fault 15.45 ± 3% -4.3 11.12 ± 13% perf-profile.children.cycles-pp.exc_page_fault 10.16 ± 3% -4.2 5.99 ± 17% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 5.14 -4.1 1.00 ± 13% perf-profile.children.cycles-pp.try_to_unmap_one 10.03 ± 3% -4.1 5.90 ± 17% perf-profile.children.cycles-pp.hrtimer_interrupt 15.46 ± 2% -4.1 11.36 ± 16% perf-profile.children.cycles-pp.asm_call_on_stack 5.15 -4.1 1.06 ± 13% perf-profile.children.cycles-pp.try_to_unmap 15.60 ± 3% -3.6 12.01 ± 14% perf-profile.children.cycles-pp.asm_exc_page_fault 5.50 -2.7 2.79 ± 10% perf-profile.children.cycles-pp.rmap_walk_anon 5.60 ± 4% -2.5 3.07 ± 19% perf-profile.children.cycles-pp.__hrtimer_run_queues 2.67 -2.3 0.34 ± 9% perf-profile.children.cycles-pp.load_balance 2.53 -2.3 0.27 ± 8% perf-profile.children.cycles-pp.find_busiest_group 2.50 ± 2% -2.2 0.26 ± 8% perf-profile.children.cycles-pp.update_sd_lb_stats 2.35 -2.2 0.11 ± 4% perf-profile.children.cycles-pp.newidle_balance 2.42 -2.2 0.23 ± 9% perf-profile.children.cycles-pp.pick_next_task_fair 2.08 ± 4% -2.0 0.04 ± 59% perf-profile.children.cycles-pp.worker_thread 4.28 ± 5% -2.0 2.26 ± 16% perf-profile.children.cycles-pp.tick_sched_timer 4.00 ± 4% -1.9 2.12 ± 21% perf-profile.children.cycles-pp.irq_exit_rcu 3.46 ± 3% -1.8 1.68 ± 20% perf-profile.children.cycles-pp.tick_sched_handle 3.44 ± 3% -1.8 1.67 ± 20% perf-profile.children.cycles-pp.update_process_times 2.45 ± 5% -1.7 0.74 ± 29% perf-profile.children.cycles-pp.alloc_pages_vma 2.77 -1.7 1.08 ± 18% perf-profile.children.cycles-pp.schedule 5.62 ± 9% -1.7 3.94 ± 13% perf-profile.children.cycles-pp.ktime_get 3.26 ± 7% -1.6 1.66 ± 24% perf-profile.children.cycles-pp.__softirqentry_text_start 3.26 ± 7% -1.6 1.67 ± 24% perf-profile.children.cycles-pp.do_softirq_own_stack 3.07 -1.5 1.56 ± 15% perf-profile.children.cycles-pp.__sched_text_start 2.15 ± 4% -1.4 0.80 ± 13% perf-profile.children.cycles-pp.scheduler_tick 3.03 -1.2 1.86 ± 13% perf-profile.children.cycles-pp.clockevents_program_event 3.04 ± 4% -0.9 2.17 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 2.71 ± 5% -0.8 1.89 ± 7% perf-profile.children.cycles-pp.tick_nohz_next_event 0.83 ± 8% -0.8 0.06 ± 22% perf-profile.children.cycles-pp.__rq_qos_throttle 0.81 ± 10% -0.7 0.09 ± 5% perf-profile.children.cycles-pp.idle_cpu 0.72 ± 2% -0.7 0.04 ±110% perf-profile.children.cycles-pp.__rq_qos_done 0.72 -0.7 0.04 ±110% perf-profile.children.cycles-pp.wbt_done 0.73 -0.7 0.08 ± 51% perf-profile.children.cycles-pp.blk_mq_free_request 0.88 ± 5% -0.6 0.27 ± 67% perf-profile.children.cycles-pp.rcu_core 0.72 ± 6% -0.6 0.14 ± 14% perf-profile.children.cycles-pp.swap_duplicate 0.72 ± 6% -0.5 0.19 ± 13% perf-profile.children.cycles-pp.__swap_duplicate 1.86 -0.5 1.33 ± 13% perf-profile.children.cycles-pp._raw_spin_lock 1.54 ± 11% -0.5 1.02 ± 11% perf-profile.children.cycles-pp.tick_nohz_irq_exit 1.18 ± 4% -0.5 0.70 ± 28% perf-profile.children.cycles-pp.__swap_writepage 1.34 ± 12% -0.4 0.90 ± 14% perf-profile.children.cycles-pp.rebalance_domains 1.45 ± 6% -0.4 1.03 ± 17% perf-profile.children.cycles-pp.tick_irq_enter 1.56 ± 9% -0.4 1.15 ± 7% perf-profile.children.cycles-pp.timekeeping_max_deferment 1.62 ± 3% -0.4 1.23 ± 17% perf-profile.children.cycles-pp.irq_enter_rcu 1.23 ± 2% -0.4 0.84 ± 16% perf-profile.children.cycles-pp.blk_mq_submit_bio 0.42 ± 4% -0.3 0.10 ± 15% perf-profile.children.cycles-pp.blk_flush_plug_list 0.42 ± 4% -0.3 0.10 ± 15% perf-profile.children.cycles-pp.blk_mq_flush_plug_list 0.42 ± 6% -0.3 0.10 ± 15% perf-profile.children.cycles-pp.blk_mq_sched_insert_requests 0.90 ± 16% -0.3 0.59 ± 17% perf-profile.children.cycles-pp._raw_spin_trylock 0.66 ± 7% -0.3 0.36 ± 13% perf-profile.children.cycles-pp.lapic_next_deadline 0.73 -0.3 0.44 ± 26% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.95 -0.3 0.70 ± 18% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.92 -0.2 0.67 ± 16% perf-profile.children.cycles-pp.irqtime_account_irq 0.48 ± 16% -0.2 0.23 ± 16% perf-profile.children.cycles-pp.do_syscall_64 0.49 ± 16% -0.2 0.25 ± 20% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.92 ± 9% -0.2 0.68 ± 19% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.32 ± 4% -0.2 0.08 ± 15% perf-profile.children.cycles-pp.page_remove_rmap 0.52 ± 8% -0.2 0.29 ± 14% perf-profile.children.cycles-pp.calc_global_load_tick 0.36 -0.2 0.15 ± 61% perf-profile.children.cycles-pp.note_gp_changes 0.48 ± 5% -0.2 0.27 ± 24% perf-profile.children.cycles-pp.update_rq_clock 0.47 ± 4% -0.2 0.25 ± 49% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.23 ± 2% -0.2 0.03 ±100% perf-profile.children.cycles-pp.nvme_pci_complete_rq 0.30 ± 20% -0.2 0.10 ± 24% perf-profile.children.cycles-pp.update_ts_time_stats 0.28 ± 17% -0.2 0.09 ± 17% perf-profile.children.cycles-pp.nr_iowait_cpu 0.67 ± 6% -0.2 0.48 ± 15% perf-profile.children.cycles-pp.sched_clock_cpu 0.70 ± 2% -0.2 0.52 ± 19% perf-profile.children.cycles-pp.poll_idle 0.32 ± 10% -0.2 0.16 ± 14% perf-profile.children.cycles-pp.update_blocked_averages 0.28 ± 3% -0.2 0.11 ± 4% perf-profile.children.cycles-pp.nvme_map_data 0.22 ± 6% -0.2 0.06 perf-profile.children.cycles-pp.cpumask_next_and 0.59 ± 10% -0.2 0.43 ± 15% perf-profile.children.cycles-pp.sched_clock 0.29 -0.2 0.13 ± 25% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.34 ± 4% -0.1 0.20 ± 32% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.35 ± 8% -0.1 0.20 ± 5% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.55 ± 9% -0.1 0.41 ± 15% perf-profile.children.cycles-pp.native_sched_clock 0.34 ± 10% -0.1 0.20 ± 5% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.31 ± 12% -0.1 0.17 ± 16% perf-profile.children.cycles-pp.run_rebalance_domains 0.26 ± 9% -0.1 0.14 ± 19% perf-profile.children.cycles-pp.irq_work_run_list 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.asm_sysvec_irq_work 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.sysvec_irq_work 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.__sysvec_irq_work 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.irq_work_run 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.irq_work_single 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.printk 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.vprintk_emit 0.25 ± 12% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.console_unlock 0.23 ± 11% -0.1 0.11 ± 19% perf-profile.children.cycles-pp.uart_console_write 0.23 ± 11% -0.1 0.11 ± 19% perf-profile.children.cycles-pp.serial8250_console_putchar 0.23 ± 13% -0.1 0.12 ± 21% perf-profile.children.cycles-pp.serial8250_console_write 0.23 ± 11% -0.1 0.12 ± 19% perf-profile.children.cycles-pp.wait_for_xmitr 0.14 ± 49% -0.1 0.05 ± 62% perf-profile.children.cycles-pp.ksys_read 0.16 ± 12% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.___might_sleep 0.36 ± 4% -0.1 0.27 ± 10% perf-profile.children.cycles-pp.nvme_queue_rq 0.13 ± 46% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.vfs_read 0.15 ± 20% -0.1 0.07 ± 58% perf-profile.children.cycles-pp.io_serial_in 0.22 ± 6% -0.1 0.14 ± 16% perf-profile.children.cycles-pp.rcu_idle_exit 0.18 ± 27% -0.1 0.10 ± 31% perf-profile.children.cycles-pp.cpumask_any_but 0.22 ± 4% -0.1 0.15 ± 20% perf-profile.children.cycles-pp.arch_scale_freq_tick 0.10 -0.1 0.03 ±100% perf-profile.children.cycles-pp.select_task_rq_fair 0.15 ± 10% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit 0.20 -0.1 0.14 ± 15% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.08 -0.1 0.03 ±100% perf-profile.children.cycles-pp.do_execveat_common 0.08 -0.1 0.03 ±100% perf-profile.children.cycles-pp.execve 0.08 -0.1 0.03 ±100% perf-profile.children.cycles-pp.__x64_sys_execve 0.13 ± 7% -0.1 0.08 ± 15% perf-profile.children.cycles-pp.rcu_eqs_exit 0.15 ± 3% -0.0 0.11 ± 23% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter 0.12 -0.0 0.08 ± 16% perf-profile.children.cycles-pp.call_cpuidle 0.17 ± 15% -0.0 0.12 ± 25% perf-profile.children.cycles-pp.update_irq_load_avg 0.12 ± 13% -0.0 0.08 ± 24% perf-profile.children.cycles-pp.rcu_eqs_enter 0.08 ± 12% -0.0 0.04 ± 60% perf-profile.children.cycles-pp._cond_resched 0.11 ± 4% -0.0 0.07 ± 20% perf-profile.children.cycles-pp.account_process_tick 0.10 -0.0 0.07 ± 7% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.16 ± 18% -0.0 0.13 ± 20% perf-profile.children.cycles-pp.irqentry_enter 0.14 ± 18% -0.0 0.10 ± 28% perf-profile.children.cycles-pp.rcu_nmi_enter 0.07 -0.0 0.04 ± 58% perf-profile.children.cycles-pp.get_cpu_device 0.12 ± 4% -0.0 0.10 ± 19% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.06 +0.0 0.09 ± 24% perf-profile.children.cycles-pp.set_next_entity 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.bio_associate_blkg 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.blk_mq_get_tag 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.blk_mq_start_request 0.09 ± 17% +0.1 0.15 ± 16% perf-profile.children.cycles-pp.__mod_lruvec_state 0.10 ± 10% +0.1 0.16 ± 21% perf-profile.children.cycles-pp.xas_init_marks 0.00 +0.1 0.07 ± 39% perf-profile.children.cycles-pp.scan_swap_map_slots 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.__blk_mq_alloc_request 0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.bio_init 0.14 ± 3% +0.1 0.21 ± 24% perf-profile.children.cycles-pp.rmqueue 0.10 ± 5% +0.1 0.17 ± 15% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.00 +0.1 0.07 ± 34% perf-profile.children.cycles-pp.__isolate_lru_page 0.00 +0.1 0.07 ± 15% perf-profile.children.cycles-pp.__perf_sw_event 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.blk_throtl_bio 0.00 +0.1 0.07 ± 42% perf-profile.children.cycles-pp.map_swap_entry 0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.unlock_page 0.03 ±100% +0.1 0.11 ± 19% perf-profile.children.cycles-pp.__switch_to 0.00 +0.1 0.08 ± 23% perf-profile.children.cycles-pp.get_swap_device 0.08 ± 12% +0.1 0.16 ± 28% perf-profile.children.cycles-pp.__orc_find 0.00 +0.1 0.08 ± 41% perf-profile.children.cycles-pp.get_swap_pages 0.00 +0.1 0.08 ± 34% perf-profile.children.cycles-pp.page_mapping 0.06 +0.1 0.14 ± 26% perf-profile.children.cycles-pp.__list_del_entry_valid 0.07 ± 20% +0.1 0.16 ± 21% perf-profile.children.cycles-pp.xas_clear_mark 0.00 +0.1 0.09 ± 25% perf-profile.children.cycles-pp.pagevec_move_tail 0.00 +0.1 0.09 ± 26% perf-profile.children.cycles-pp.swap_range_free 0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.xas_find 0.03 ±100% +0.1 0.12 ± 18% perf-profile.children.cycles-pp.update_cfs_group 0.00 +0.1 0.09 ± 31% perf-profile.children.cycles-pp.free_unref_page_list 0.00 +0.1 0.10 ± 55% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.00 +0.1 0.10 ± 37% perf-profile.children.cycles-pp.blk_attempt_plug_merge 0.00 +0.1 0.10 ± 19% perf-profile.children.cycles-pp.___perf_sw_event 0.09 ± 22% +0.1 0.19 ± 13% perf-profile.children.cycles-pp.__mod_node_page_state 0.00 +0.1 0.10 ± 30% perf-profile.children.cycles-pp.kernel_text_address 0.03 ±100% +0.1 0.13 ± 28% perf-profile.children.cycles-pp.__kernel_text_address 0.00 +0.1 0.11 ± 25% perf-profile.children.cycles-pp.rmqueue_bulk 0.00 +0.1 0.11 ± 23% perf-profile.children.cycles-pp.page_lock_anon_vma_read 0.00 +0.1 0.11 ± 30% perf-profile.children.cycles-pp.rotate_reclaimable_page 0.00 +0.1 0.11 ± 15% perf-profile.children.cycles-pp.do_page_add_anon_rmap 0.15 ± 10% +0.1 0.27 ± 20% perf-profile.children.cycles-pp.dequeue_entity 0.06 ± 9% +0.1 0.18 ± 23% perf-profile.children.cycles-pp.__mod_memcg_state 0.03 ±100% +0.1 0.15 ± 28% perf-profile.children.cycles-pp.unwind_get_return_address 0.17 ± 5% +0.1 0.30 ± 20% perf-profile.children.cycles-pp.dequeue_task_fair 0.00 +0.1 0.13 ± 49% perf-profile.children.cycles-pp.page_swapcount 0.17 ± 29% +0.1 0.31 ± 11% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly 0.10 ± 5% +0.1 0.23 ± 31% perf-profile.children.cycles-pp.tlb_is_not_lazy 0.00 +0.1 0.14 ± 35% perf-profile.children.cycles-pp.cgroup_throttle_swaprate 0.12 ± 4% +0.1 0.27 ± 20% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.1 0.15 ± 56% perf-profile.children.cycles-pp.swap_writepage 0.00 +0.2 0.15 ± 15% perf-profile.children.cycles-pp.workingset_refault 0.06 ± 16% +0.2 0.22 ± 32% perf-profile.children.cycles-pp.cpumask_next 0.00 +0.2 0.16 ± 30% perf-profile.children.cycles-pp.__count_memcg_events 0.03 ±100% +0.2 0.19 ± 18% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.09 +0.2 0.25 ± 21% perf-profile.children.cycles-pp.__irqentry_text_start 0.00 +0.2 0.16 ± 35% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm 0.00 +0.2 0.16 ± 19% perf-profile.children.cycles-pp.bio_alloc_bioset 0.00 +0.2 0.17 ± 37% perf-profile.children.cycles-pp.put_swap_page 0.05 +0.2 0.22 ± 20% perf-profile.children.cycles-pp.xas_start 0.03 ±100% +0.2 0.21 ± 15% perf-profile.children.cycles-pp.swap_cgroup_record 0.00 +0.2 0.18 ± 17% perf-profile.children.cycles-pp.clear_shadow_from_swap_cache 0.31 +0.2 0.50 ± 9% perf-profile.children.cycles-pp.schedule_idle 0.05 +0.2 0.24 ± 56% perf-profile.children.cycles-pp.llist_add_batch 0.05 +0.2 0.24 ± 19% perf-profile.children.cycles-pp.submit_bio_checks 0.00 +0.2 0.20 ± 33% perf-profile.children.cycles-pp.end_swap_bio_write 0.00 +0.2 0.20 ± 33% perf-profile.children.cycles-pp.end_page_writeback 0.03 ±100% +0.2 0.22 ± 22% perf-profile.children.cycles-pp.move_pages_to_lru 0.03 ±100% +0.2 0.22 ± 16% perf-profile.children.cycles-pp.blk_mq_try_issue_directly 0.31 ± 6% +0.2 0.51 ± 27% perf-profile.children.cycles-pp.unwind_next_frame 0.00 +0.2 0.20 ± 17% perf-profile.children.cycles-pp.__frontswap_load 0.00 +0.2 0.20 ± 44% perf-profile.children.cycles-pp.get_swap_page 0.00 +0.2 0.20 ± 18% perf-profile.children.cycles-pp.mem_cgroup_id_put_many 0.00 +0.2 0.20 ± 71% perf-profile.children.cycles-pp.default_send_IPI_mask_sequence_phys 0.04 ±100% +0.2 0.24 ± 38% perf-profile.children.cycles-pp.try_charge 0.00 +0.2 0.21 ± 43% perf-profile.children.cycles-pp.mem_cgroup_swapout 0.06 ± 9% +0.2 0.27 ± 26% perf-profile.children.cycles-pp.isolate_lru_pages 0.32 ± 6% +0.2 0.53 ± 32% perf-profile.children.cycles-pp.flush_tlb_mm_range 0.11 ± 23% +0.2 0.32 ± 15% perf-profile.children.cycles-pp.finish_task_switch 0.10 ± 15% +0.2 0.31 ± 44% perf-profile.children.cycles-pp.prep_new_page 0.00 +0.2 0.22 ± 26% perf-profile.children.cycles-pp.up_read 0.00 +0.2 0.23 ± 47% perf-profile.children.cycles-pp._swap_info_get 0.03 ±100% +0.2 0.26 ± 10% perf-profile.children.cycles-pp.__swp_swapcount 0.00 +0.2 0.25 ± 17% perf-profile.children.cycles-pp.lookup_swap_cgroup_id 0.00 +0.2 0.25 ± 18% perf-profile.children.cycles-pp.sync_regs 0.24 ± 2% +0.3 0.50 ± 26% perf-profile.children.cycles-pp.pmdp_clear_flush_young 0.07 ± 14% +0.3 0.34 ± 20% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.31 ± 3% +0.3 0.59 ± 34% perf-profile.children.cycles-pp.get_page_from_freelist 0.25 ± 4% +0.3 0.53 ± 14% perf-profile.children.cycles-pp.add_to_swap_cache 0.21 ± 2% +0.3 0.49 ± 40% perf-profile.children.cycles-pp.add_to_swap 0.30 ± 4% +0.3 0.60 ± 10% perf-profile.children.cycles-pp.total_mapcount 0.50 ± 8% +0.3 0.83 ± 27% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.00 +0.3 0.34 ± 31% perf-profile.children.cycles-pp.down_read_trylock 0.00 +0.3 0.34 ± 22% perf-profile.children.cycles-pp.get_swap_bio 0.45 ± 8% +0.3 0.80 ± 27% perf-profile.children.cycles-pp.arch_stack_walk 0.04 ±100% +0.4 0.39 ± 30% perf-profile.children.cycles-pp.lru_cache_add 0.10 ± 30% +0.4 0.46 ± 21% perf-profile.children.cycles-pp.delete_from_swap_cache 0.07 ± 7% +0.4 0.43 ± 15% perf-profile.children.cycles-pp.swapcache_free_entries 0.07 ± 14% +0.4 0.45 ± 16% perf-profile.children.cycles-pp.free_swap_slot 0.08 ± 12% +0.4 0.47 ± 18% perf-profile.children.cycles-pp.page_counter_cancel 0.08 ± 6% +0.4 0.47 ± 16% perf-profile.children.cycles-pp.__swap_entry_free 0.08 ± 12% +0.4 0.48 ± 18% perf-profile.children.cycles-pp.page_counter_uncharge 0.11 ± 27% +0.4 0.53 ± 19% perf-profile.children.cycles-pp.reuse_swap_page 0.12 ± 8% +0.7 0.79 ± 16% perf-profile.children.cycles-pp.mem_cgroup_uncharge_swap 0.68 ± 2% +0.7 1.38 ± 25% perf-profile.children.cycles-pp.__account_scheduler_latency 1.02 ± 5% +0.7 1.74 ± 24% perf-profile.children.cycles-pp.ttwu_do_activate 1.60 ± 8% +0.7 2.33 ± 15% perf-profile.children.cycles-pp.__read_swap_cache_async 1.00 ± 6% +0.7 1.74 ± 24% perf-profile.children.cycles-pp.enqueue_task_fair 0.03 ±100% +0.7 0.77 ± 10% perf-profile.children.cycles-pp.shrink_active_list 0.92 ± 5% +0.8 1.69 ± 24% perf-profile.children.cycles-pp.enqueue_entity 1.21 ± 5% +0.8 2.05 ± 25% perf-profile.children.cycles-pp.try_to_wake_up 0.23 ± 2% +0.9 1.12 ± 19% perf-profile.children.cycles-pp.page_vma_mapped_walk 0.14 ± 3% +0.9 1.03 ± 66% perf-profile.children.cycles-pp.flush_smp_call_function_queue 0.12 ± 4% +0.9 1.05 ± 65% perf-profile.children.cycles-pp.__sysvec_call_function 0.15 ± 6% +1.0 1.13 ± 64% perf-profile.children.cycles-pp.sysvec_call_function 0.03 ±100% +1.1 1.12 ± 12% perf-profile.children.cycles-pp.find_get_entry 0.03 ±100% +1.1 1.13 ± 12% perf-profile.children.cycles-pp.pagecache_get_page 0.03 ±100% +1.1 1.15 ± 12% perf-profile.children.cycles-pp.lookup_swap_cache 0.10 ± 5% +1.2 1.26 ± 13% perf-profile.children.cycles-pp.xas_load 1.65 ± 8% +1.3 2.91 ± 20% perf-profile.children.cycles-pp.nvme_irq 0.33 ± 7% +1.3 1.60 ± 9% perf-profile.children.cycles-pp.page_referenced_one 1.66 ± 8% +1.3 2.94 ± 20% perf-profile.children.cycles-pp.__handle_irq_event_percpu 1.69 ± 9% +1.3 3.01 ± 20% perf-profile.children.cycles-pp.handle_irq_event_percpu 0.25 ± 8% +1.4 1.62 ± 21% perf-profile.children.cycles-pp.mem_cgroup_charge 1.71 ± 10% +1.4 3.13 ± 20% perf-profile.children.cycles-pp.handle_irq_event 1.75 ± 10% +1.5 3.21 ± 20% perf-profile.children.cycles-pp.handle_edge_irq 1.84 ± 10% +1.5 3.36 ± 20% perf-profile.children.cycles-pp.common_interrupt 1.85 ± 10% +1.6 3.40 ± 20% perf-profile.children.cycles-pp.asm_common_interrupt 0.50 ± 26% +1.6 2.09 ± 38% perf-profile.children.cycles-pp.arch_tlbbatch_flush 0.43 ± 25% +1.7 2.14 ± 24% perf-profile.children.cycles-pp.end_swap_bio_read 0.80 ± 11% +1.7 2.53 ± 17% perf-profile.children.cycles-pp.swap_readpage 0.65 ± 6% +1.7 2.38 ± 6% perf-profile.children.cycles-pp.page_referenced 0.81 ± 12% +1.8 2.58 ± 35% perf-profile.children.cycles-pp.on_each_cpu_cond_mask 0.79 ± 11% +1.8 2.56 ± 35% perf-profile.children.cycles-pp.smp_call_function_many_cond 0.17 ± 19% +1.9 2.08 ± 38% perf-profile.children.cycles-pp.try_to_unmap_flush_dirty 0.54 ± 24% +1.9 2.45 ± 21% perf-profile.children.cycles-pp.blk_update_request 0.59 ± 22% +2.0 2.56 ± 21% perf-profile.children.cycles-pp.blk_mq_end_request 2.40 +2.5 4.86 ± 16% perf-profile.children.cycles-pp.read_swap_cache_async 2.41 +2.5 4.88 ± 16% perf-profile.children.cycles-pp.swapin_readahead 4.13 +4.2 8.33 ± 19% perf-profile.children.cycles-pp.balance_pgdat 4.13 +4.2 8.34 ± 19% perf-profile.children.cycles-pp.kswapd 2.71 +4.9 7.57 ± 15% perf-profile.children.cycles-pp.do_swap_page 6.35 -5.8 0.52 ± 52% perf-profile.self.cycles-pp.clear_page_erms 3.35 -2.9 0.45 ± 8% perf-profile.self.cycles-pp.try_to_unmap_one 5.09 ± 10% -1.6 3.51 ± 12% perf-profile.self.cycles-pp.ktime_get 1.71 ± 3% -1.5 0.18 ± 14% perf-profile.self.cycles-pp.update_sd_lb_stats 1.15 -1.1 0.04 ±104% perf-profile.self.cycles-pp.clear_subpage 0.81 ± 10% -0.7 0.08 ± 10% perf-profile.self.cycles-pp.idle_cpu 1.83 -0.6 1.26 ± 13% perf-profile.self.cycles-pp._raw_spin_lock 1.55 ± 9% -0.4 1.15 ± 7% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.79 -0.3 0.45 ± 12% perf-profile.self.cycles-pp.tick_nohz_next_event 0.65 ± 7% -0.3 0.36 ± 13% perf-profile.self.cycles-pp.lapic_next_deadline 0.85 ± 12% -0.3 0.59 ± 17% perf-profile.self.cycles-pp._raw_spin_trylock 0.51 ± 9% -0.2 0.29 ± 14% perf-profile.self.cycles-pp.calc_global_load_tick 0.83 ± 10% -0.2 0.62 ± 20% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.66 -0.2 0.46 ± 20% perf-profile.self.cycles-pp.irqtime_account_irq 0.28 ± 20% -0.2 0.09 ± 17% perf-profile.self.cycles-pp.nr_iowait_cpu 0.26 ± 21% -0.2 0.07 ± 12% perf-profile.self.cycles-pp.update_rq_clock 0.33 ± 7% -0.2 0.15 ± 44% perf-profile.self.cycles-pp.__softirqentry_text_start 0.39 ± 2% -0.2 0.21 ± 50% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.64 -0.2 0.48 ± 18% perf-profile.self.cycles-pp.poll_idle 0.29 -0.2 0.13 ± 25% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.34 ± 4% -0.1 0.20 ± 32% perf-profile.self.cycles-pp.__intel_pmu_enable_all 0.53 ± 10% -0.1 0.39 ± 17% perf-profile.self.cycles-pp.native_sched_clock 0.33 ± 10% -0.1 0.20 ± 5% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust 0.21 ± 16% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.xas_store 0.19 ± 5% -0.1 0.07 ±105% perf-profile.self.cycles-pp.note_gp_changes 0.34 ± 15% -0.1 0.26 ± 17% perf-profile.self.cycles-pp._find_next_bit 0.15 ± 20% -0.1 0.07 ± 58% perf-profile.self.cycles-pp.io_serial_in 0.15 ± 10% -0.1 0.07 ± 17% perf-profile.self.cycles-pp.___might_sleep 0.22 ± 6% -0.1 0.15 ± 20% perf-profile.self.cycles-pp.arch_scale_freq_tick 0.15 ± 10% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt 0.15 ± 3% -0.1 0.08 ± 30% perf-profile.self.cycles-pp.hrtimer_interrupt 0.15 ± 10% -0.1 0.09 ± 25% perf-profile.self.cycles-pp.rebalance_domains 0.14 ± 14% -0.1 0.08 ± 17% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit 0.12 ± 21% -0.1 0.05 ± 9% perf-profile.self.cycles-pp.update_blocked_averages 0.09 -0.1 0.03 ±102% perf-profile.self.cycles-pp.load_balance 0.09 -0.0 0.04 ± 63% perf-profile.self.cycles-pp.rmqueue 0.12 -0.0 0.08 ± 16% perf-profile.self.cycles-pp.call_cpuidle 0.09 -0.0 0.05 ± 62% perf-profile.self.cycles-pp.rcu_idle_exit 0.15 -0.0 0.11 ± 20% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter 0.17 ± 15% -0.0 0.12 ± 25% perf-profile.self.cycles-pp.update_irq_load_avg 0.11 ± 4% -0.0 0.07 ± 20% perf-profile.self.cycles-pp.account_process_tick 0.12 ± 13% -0.0 0.08 ± 17% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.12 ± 4% -0.0 0.10 ± 17% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.07 ± 7% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.get_cpu_device 0.21 ± 2% -0.0 0.18 ± 5% perf-profile.self.cycles-pp.tick_sched_timer 0.06 ± 9% +0.0 0.09 ± 15% perf-profile.self.cycles-pp.xas_create 0.07 ± 7% +0.1 0.12 ± 23% perf-profile.self.cycles-pp.__delete_from_swap_cache 0.07 ± 7% +0.1 0.12 ± 17% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.07 ± 14% +0.1 0.13 ± 21% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.__blk_queue_split 0.00 +0.1 0.07 ± 34% perf-profile.self.cycles-pp.__isolate_lru_page 0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.do_page_add_anon_rmap 0.00 +0.1 0.07 ± 26% perf-profile.self.cycles-pp.get_swap_device 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.unlock_page 0.00 +0.1 0.07 ± 27% perf-profile.self.cycles-pp.isolate_lru_pages 0.00 +0.1 0.08 ± 34% perf-profile.self.cycles-pp.page_mapping 0.06 +0.1 0.14 ± 27% perf-profile.self.cycles-pp.__list_del_entry_valid 0.03 ±100% +0.1 0.10 ± 18% perf-profile.self.cycles-pp.__switch_to 0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.swap_cgroup_record 0.00 +0.1 0.08 ± 19% perf-profile.self.cycles-pp.___perf_sw_event 0.08 ± 12% +0.1 0.16 ± 28% perf-profile.self.cycles-pp.__orc_find 0.00 +0.1 0.08 ± 21% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.__swp_swapcount 0.07 ± 14% +0.1 0.16 ± 21% perf-profile.self.cycles-pp.xas_clear_mark 0.03 ±100% +0.1 0.12 ± 17% perf-profile.self.cycles-pp.update_cfs_group 0.00 +0.1 0.09 ± 46% perf-profile.self.cycles-pp.get_swap_page 0.09 ± 22% +0.1 0.18 ± 13% perf-profile.self.cycles-pp.__mod_node_page_state 0.00 +0.1 0.10 ± 33% perf-profile.self.cycles-pp.move_pages_to_lru 0.06 ± 9% +0.1 0.16 ± 21% perf-profile.self.cycles-pp.nvme_irq 0.00 +0.1 0.11 ± 32% perf-profile.self.cycles-pp.do_swap_page 0.06 ± 9% +0.1 0.17 ± 21% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +0.1 0.13 ± 49% perf-profile.self.cycles-pp.lru_cache_add 0.09 ± 11% +0.1 0.22 ± 28% perf-profile.self.cycles-pp.tlb_is_not_lazy 0.00 +0.1 0.13 ± 33% perf-profile.self.cycles-pp.cgroup_throttle_swaprate 0.03 ±100% +0.1 0.16 ± 41% perf-profile.self.cycles-pp.try_charge 0.00 +0.1 0.15 ± 40% perf-profile.self.cycles-pp.mem_cgroup_charge 0.00 +0.1 0.15 ± 30% perf-profile.self.cycles-pp.shrink_page_list 0.00 +0.2 0.15 ± 34% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm 0.12 ± 12% +0.2 0.28 ± 10% perf-profile.self.cycles-pp.__sched_text_start 0.00 +0.2 0.16 ± 30% perf-profile.self.cycles-pp.__count_memcg_events 0.03 ±100% +0.2 0.20 ± 22% perf-profile.self.cycles-pp.xas_start 0.00 +0.2 0.19 ± 16% perf-profile.self.cycles-pp.__frontswap_load 0.00 +0.2 0.19 ± 17% perf-profile.self.cycles-pp.mem_cgroup_id_put_many 0.00 +0.2 0.21 ± 28% perf-profile.self.cycles-pp.up_read 0.03 ±100% +0.2 0.23 ± 57% perf-profile.self.cycles-pp.llist_add_batch 0.10 ± 15% +0.2 0.31 ± 25% perf-profile.self.cycles-pp.__account_scheduler_latency 0.00 +0.2 0.22 ± 47% perf-profile.self.cycles-pp._swap_info_get 0.00 +0.2 0.24 ± 18% perf-profile.self.cycles-pp.lookup_swap_cgroup_id 0.00 +0.2 0.24 ± 18% perf-profile.self.cycles-pp.sync_regs 0.04 ±100% +0.3 0.29 ± 17% perf-profile.self.cycles-pp.__handle_mm_fault 0.08 ± 6% +0.3 0.33 ± 16% perf-profile.self.cycles-pp.add_to_swap_cache 0.00 +0.3 0.26 ± 22% perf-profile.self.cycles-pp.finish_task_switch 0.30 ± 3% +0.3 0.58 ± 10% perf-profile.self.cycles-pp.total_mapcount 0.03 ±100% +0.3 0.31 ± 15% perf-profile.self.cycles-pp.swap_readpage 0.00 +0.3 0.32 ± 31% perf-profile.self.cycles-pp.down_read_trylock 0.07 ± 20% +0.3 0.41 ± 19% perf-profile.self.cycles-pp.page_counter_cancel 0.14 ± 11% +0.8 0.97 ± 16% perf-profile.self.cycles-pp.page_vma_mapped_walk 0.03 ±100% +1.0 1.00 ± 13% perf-profile.self.cycles-pp.xas_load 0.58 ± 19% +1.0 1.62 ± 33% perf-profile.self.cycles-pp.smp_call_function_many_cond 0.18 ± 2% +3.6 3.79 ± 82% perf-profile.self.cycles-pp.do_access *************************************************************************************************** lkp-hsw-4ex1: 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_pmem/nr_task/priority/rootfs/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode: gcc-9/performance/x86_64-rhel-8.3/4/8/1/debian-10.4-x86_64-20200603.cgz/lkp-hsw-4ex1/swap-w-seq/vm-scalability/never/never/0x16 commit: 3852f6768e ("mm/swapcache: support to handle the shadow entries") aae466b005 ("mm/swap: implement workingset detection for anonymous LRU") 3852f6768ede542e aae466b0052e1888edd1d7f473d ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 2:4 1% 2:4 perf-profile.children.cycles-pp.error_entry 1:4 2% 2:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 23.24 ± 3% +8.6% 25.25 vm-scalability.free_time 451459 ± 2% +17.6% 531040 ± 2% vm-scalability.median 3613724 ± 2% +17.2% 4233483 ± 2% vm-scalability.throughput 147.90 ± 2% -11.1% 131.45 ± 2% vm-scalability.time.elapsed_time 147.90 ± 2% -11.1% 131.45 ± 2% vm-scalability.time.elapsed_time.max 126092 -40.2% 75396 ± 5% vm-scalability.time.involuntary_context_switches 709.75 +3.4% 733.75 vm-scalability.time.percent_of_cpu_this_job_got 858.01 ± 6% -12.7% 748.79 ± 3% vm-scalability.time.system_time 2555 ± 11% -86.5% 345.25 ± 19% vm-scalability.time.voluntary_context_switches 0.96 ± 22% +23.2% 1.18 ± 2% iostat.cpu.user 0.46 ± 2% -0.4 0.08 ± 6% mpstat.cpu.all.soft% 19058794 ± 73% -51.3% 9284205 ±108% numa-numastat.node2.numa_foreign 1166704 +28.5% 1499626 vmstat.memory.cache 2470874 ± 2% +12.5% 2779610 ± 2% vmstat.swap.so 5097 -25.6% 3792 ± 3% vmstat.system.cs 775916 ± 6% +15.8% 898759 vmstat.system.in 3.27e+09 ± 3% -9.3% 2.964e+09 ± 2% perf-node.node-load-misses 1.755e+09 ± 4% -16.1% 1.473e+09 ± 9% perf-node.node-loads 40.00 ± 4% -62.5% 15.00 perf-node.node-local-store-ratio 2.337e+09 ± 2% -39.6% 1.412e+09 ± 2% perf-node.node-store-misses 1.594e+09 ± 3% -83.9% 2.563e+08 ± 2% perf-node.node-stores 11725373 +15.5% 13547085 ± 6% meminfo.DirectMap2M 179916 +187.0% 516441 meminfo.KReclaimable 1116912 ± 5% +19.9% 1339332 ± 4% meminfo.MemAvailable 179916 +187.0% 516441 meminfo.SReclaimable 413707 +80.4% 746239 meminfo.Slab 218196 ± 2% +12.4% 245320 ± 2% meminfo.max_used_kB 11422 ± 11% +182.9% 32315 ± 25% numa-vmstat.node0.nr_slab_reclaimable 30123 +11.0% 33440 ± 4% numa-vmstat.node1.nr_page_table_pages 11318 ± 10% +187.6% 32549 ± 15% numa-vmstat.node1.nr_slab_reclaimable 14498502 +11.0% 16097678 ± 4% numa-vmstat.node1.nr_vmscan_write 14498504 +11.0% 16097680 ± 4% numa-vmstat.node1.nr_written 2099 ± 74% -67.5% 681.25 ± 58% numa-vmstat.node2.nr_active_anon 11274 ± 13% +172.3% 30698 ± 11% numa-vmstat.node2.nr_slab_reclaimable 2101 ± 74% -67.6% 681.50 ± 58% numa-vmstat.node2.nr_zone_active_anon 11491764 ± 72% -54.4% 5245129 ±107% numa-vmstat.node2.numa_foreign 10784 ± 7% +210.9% 33532 ± 6% numa-vmstat.node3.nr_slab_reclaimable 6117 ± 6% -15.4% 5175 ± 2% slabinfo.files_cache.active_objs 6124 ± 5% -15.5% 5175 ± 2% slabinfo.files_cache.num_objs 1269 ± 3% +21.3% 1539 ± 5% slabinfo.khugepaged_mm_slot.active_objs 1269 ± 3% +21.3% 1539 ± 5% slabinfo.khugepaged_mm_slot.num_objs 12779 ± 3% -15.2% 10839 ± 4% slabinfo.pde_opener.active_objs 12779 ± 3% -15.2% 10839 ± 4% slabinfo.pde_opener.num_objs 166610 ± 2% +352.8% 754410 slabinfo.radix_tree_node.active_objs 3337 ± 3% +318.4% 13961 slabinfo.radix_tree_node.active_slabs 167671 ± 2% +366.3% 781839 slabinfo.radix_tree_node.num_objs 3337 ± 3% +318.4% 13961 slabinfo.radix_tree_node.num_slabs 3109 ± 4% -10.4% 2785 slabinfo.sighand_cache.active_objs 3131 ± 4% -10.4% 2807 ± 2% slabinfo.sighand_cache.num_objs 8020 ± 4% -12.5% 7021 ± 2% slabinfo.task_delay_info.active_objs 8020 ± 4% -12.5% 7021 ± 2% slabinfo.task_delay_info.num_objs 45388 ± 11% +184.5% 129110 ± 25% numa-meminfo.node0.KReclaimable 45388 ± 11% +184.5% 129110 ± 25% numa-meminfo.node0.SReclaimable 114445 ± 14% +74.5% 199762 ± 18% numa-meminfo.node0.Slab 45359 ± 9% +187.0% 130162 ± 15% numa-meminfo.node1.KReclaimable 120458 +11.0% 133695 ± 4% numa-meminfo.node1.PageTables 45359 ± 9% +187.0% 130162 ± 15% numa-meminfo.node1.SReclaimable 109895 ± 16% +71.3% 188201 ± 13% numa-meminfo.node1.Slab 8457 ± 73% -67.5% 2751 ± 59% numa-meminfo.node2.Active 8389 ± 74% -67.5% 2726 ± 58% numa-meminfo.node2.Active(anon) 45582 ± 13% +169.3% 122741 ± 11% numa-meminfo.node2.KReclaimable 45582 ± 13% +169.3% 122741 ± 11% numa-meminfo.node2.SReclaimable 97401 ± 13% +73.7% 169199 ± 6% numa-meminfo.node2.Slab 43179 ± 6% +210.4% 134010 ± 6% numa-meminfo.node3.KReclaimable 43179 ± 6% +210.4% 134010 ± 6% numa-meminfo.node3.SReclaimable 91559 ± 9% +106.1% 188662 ± 8% numa-meminfo.node3.Slab 20729509 ± 16% -7.8e+06 12912354 ± 25% syscalls.sys_close.noise.100% 28960042 ± 11% -8.2e+06 20719899 ± 14% syscalls.sys_close.noise.2% 27766391 ± 11% -8.4e+06 19401559 ± 15% syscalls.sys_close.noise.25% 28908895 ± 11% -8.2e+06 20661833 ± 14% syscalls.sys_close.noise.5% 25426814 ± 13% -8.5e+06 16899949 ± 18% syscalls.sys_close.noise.50% 22869034 ± 14% -8e+06 14822779 ± 21% syscalls.sys_close.noise.75% 32447789 ± 25% -69.7% 9828013 ± 98% syscalls.sys_openat.max 1.654e+09 ± 39% -1.4e+09 2.337e+08 ± 39% syscalls.sys_openat.noise.100% 1.706e+09 ± 38% -1.4e+09 2.834e+08 ± 32% syscalls.sys_openat.noise.2% 1.693e+09 ± 38% -1.4e+09 2.712e+08 ± 34% syscalls.sys_openat.noise.25% 1.706e+09 ± 38% -1.4e+09 2.829e+08 ± 32% syscalls.sys_openat.noise.5% 1.678e+09 ± 38% -1.4e+09 2.548e+08 ± 36% syscalls.sys_openat.noise.50% 1.667e+09 ± 39% -1.4e+09 2.438e+08 ± 38% syscalls.sys_openat.noise.75% 1174 ± 22% +53.6% 1803 ± 5% syscalls.sys_write.med 5.911e+08 ± 64% +2e+09 2.555e+09 ± 2% syscalls.sys_write.noise.100% 6.002e+08 ± 63% +2e+09 2.56e+09 ± 2% syscalls.sys_write.noise.2% 5.985e+08 ± 64% +2e+09 2.559e+09 ± 2% syscalls.sys_write.noise.25% 6.002e+08 ± 63% +2e+09 2.56e+09 ± 2% syscalls.sys_write.noise.5% 5.953e+08 ± 64% +2e+09 2.558e+09 ± 2% syscalls.sys_write.noise.50% 5.93e+08 ± 64% +2e+09 2.557e+09 ± 2% syscalls.sys_write.noise.75% 52505 ± 2% +8.7% 57048 ± 4% proc-vmstat.allocstall_movable 1329701 ± 53% -76.6% 311376 ± 84% proc-vmstat.compact_daemon_migrate_scanned 3092 ±104% -98.4% 48.75 ± 73% proc-vmstat.compact_daemon_wake 91.25 ± 12% -83.0% 15.50 ± 39% proc-vmstat.compact_fail 1470217 ± 46% -68.7% 459729 ± 57% proc-vmstat.compact_migrate_scanned 97.50 ± 13% -81.3% 18.25 ± 32% proc-vmstat.compact_stall 3161 ± 98% -96.3% 117.50 ± 72% proc-vmstat.kswapd_low_wmark_hit_quickly 5191554 -2.4% 5065321 proc-vmstat.nr_anon_pages 5184927 -2.4% 5059469 proc-vmstat.nr_inactive_anon 187.75 ± 4% -9.1% 170.75 proc-vmstat.nr_isolated_anon 111810 +1.6% 113619 proc-vmstat.nr_page_table_pages 44657 +188.9% 129025 proc-vmstat.nr_slab_reclaimable 58446 -1.7% 57450 proc-vmstat.nr_slab_unreclaimable 5183621 -2.4% 5059220 proc-vmstat.nr_zone_inactive_anon 56750562 ± 10% -26.1% 41935745 ± 19% proc-vmstat.numa_pte_updates 1625054 ± 9% -100.0% 0.00 proc-vmstat.pgalloc_dma 8718205 ± 6% -40.3% 5207463 ± 26% proc-vmstat.pgalloc_dma32 1.346e+08 -30.0% 94227189 proc-vmstat.pgalloc_normal 1.451e+08 -31.4% 99498336 proc-vmstat.pgfree 63642 ± 3% -7.3% 59028 ± 5% proc-vmstat.slabs_scanned 456.00 ±127% +223.0% 1473 ± 21% proc-vmstat.swap_ra 345.00 ±165% +286.0% 1331 ± 20% proc-vmstat.swap_ra_hit 621120 ± 3% -12.0% 546816 ± 2% proc-vmstat.unevictable_pgs_scanned 5.92e+09 ± 3% +6.5% 6.304e+09 perf-stat.i.branch-instructions 61633368 ± 2% -24.6% 46490910 perf-stat.i.cache-misses 5041 -26.5% 3706 ± 3% perf-stat.i.context-switches 388.19 -23.9% 295.51 perf-stat.i.cpu-migrations 809.81 ± 8% +21.0% 980.06 ± 7% perf-stat.i.cycles-between-cache-misses 6.351e+09 +6.7% 6.776e+09 ± 2% perf-stat.i.dTLB-loads 0.15 ± 5% +0.0 0.18 ± 5% perf-stat.i.dTLB-store-miss-rate% 3.606e+09 ± 3% -7.4% 3.339e+09 ± 2% perf-stat.i.dTLB-stores 6823772 ± 5% +14.2% 7794812 ± 8% perf-stat.i.iTLB-load-misses 2.4e+10 ± 3% +4.7% 2.513e+10 perf-stat.i.instructions 112.11 +3.1% 115.57 perf-stat.i.metric.M/sec 666516 ± 2% +12.5% 749805 ± 2% perf-stat.i.minor-faults 61.38 ± 2% +20.6 82.01 perf-stat.i.node-store-miss-rate% 15267649 ± 4% -25.5% 11374283 ± 10% perf-stat.i.node-store-misses 10435945 ± 6% -79.8% 2104898 ± 10% perf-stat.i.node-stores 666572 ± 2% +12.5% 749872 ± 2% perf-stat.i.page-faults 659.86 ± 6% +28.5% 848.20 ± 6% perf-stat.overall.cycles-between-cache-misses 0.16 ± 3% +0.0 0.20 ± 3% perf-stat.overall.dTLB-store-miss-rate% 59.26 ± 2% +25.0 84.28 perf-stat.overall.node-store-miss-rate% 8026 -6.9% 7474 perf-stat.overall.path-length 5.902e+09 ± 3% +6.3% 6.274e+09 perf-stat.ps.branch-instructions 61374057 ± 2% -24.7% 46230779 perf-stat.ps.cache-misses 5019 -26.6% 3682 ± 3% perf-stat.ps.context-switches 386.19 -24.1% 293.29 perf-stat.ps.cpu-migrations 6.332e+09 +6.5% 6.744e+09 ± 2% perf-stat.ps.dTLB-loads 3.595e+09 ± 3% -7.6% 3.323e+09 ± 2% perf-stat.ps.dTLB-stores 6808353 ± 5% +14.1% 7769606 ± 8% perf-stat.ps.iTLB-load-misses 2.392e+10 ± 2% +4.6% 2.502e+10 perf-stat.ps.instructions 666070 ± 2% +12.2% 747635 ± 2% perf-stat.ps.minor-faults 15144045 ± 4% -25.7% 11246617 ± 10% perf-stat.ps.node-store-misses 10417852 ± 6% -79.9% 2096205 ± 10% perf-stat.ps.node-stores 666126 ± 2% +12.2% 747701 ± 2% perf-stat.ps.page-faults 3.555e+12 -6.8% 3.311e+12 perf-stat.total.instructions 12185 ± 8% +182.0% 34361 ± 8% sched_debug.cfs_rq:/.exec_clock.max 1188 ± 14% -98.8% 13.90 ± 53% sched_debug.cfs_rq:/.exec_clock.min 2713 ± 12% +171.7% 7373 ± 8% sched_debug.cfs_rq:/.exec_clock.stddev 158216 ± 20% -27.7% 114407 ± 17% sched_debug.cfs_rq:/.load.stddev 43.24 ± 15% -23.4% 33.11 ± 19% sched_debug.cfs_rq:/.load_avg.avg 1022 ± 3% -28.2% 733.92 ± 3% sched_debug.cfs_rq:/.load_avg.max 170.08 ± 8% -25.7% 126.42 ± 9% sched_debug.cfs_rq:/.load_avg.stddev 119278 ± 11% +110.4% 250918 ± 6% sched_debug.cfs_rq:/.min_vruntime.max 23859 ± 13% +115.1% 51319 ± 14% sched_debug.cfs_rq:/.min_vruntime.stddev 0.06 ± 48% -42.5% 0.04 ± 11% sched_debug.cfs_rq:/.nr_spread_over.avg 0.23 ± 26% -32.0% 0.16 ± 8% sched_debug.cfs_rq:/.nr_spread_over.stddev -50753 +175.6% -139895 sched_debug.cfs_rq:/.spread0.avg -83164 +122.8% -185253 sched_debug.cfs_rq:/.spread0.min 23868 ± 13% +115.0% 51318 ± 14% sched_debug.cfs_rq:/.spread0.stddev 140364 ± 14% +23.7% 173587 ± 4% sched_debug.cpu.avg_idle.stddev 678.88 ± 4% +20.0% 814.72 ± 5% sched_debug.cpu.clock_task.stddev 0.00 ± 26% +566.5% 0.00 ± 91% sched_debug.cpu.next_balance.stddev 3913 -17.4% 3233 ± 2% sched_debug.cpu.nr_switches.avg 14639 ± 12% +55.0% 22684 ± 19% sched_debug.cpu.nr_switches.max 1791 ± 8% -37.4% 1121 ± 7% sched_debug.cpu.nr_switches.min 2060 ± 8% +27.8% 2633 ± 6% sched_debug.cpu.nr_switches.stddev 2394 ± 2% -28.3% 1716 ± 5% sched_debug.cpu.sched_count.avg 10139 ± 24% +79.3% 18179 ± 24% sched_debug.cpu.sched_count.max 961.92 ± 11% -54.9% 434.25 sched_debug.cpu.sched_count.min 1375 ± 14% +47.3% 2025 ± 10% sched_debug.cpu.sched_count.stddev 626.15 ± 4% -19.1% 506.24 ± 5% sched_debug.cpu.sched_goidle.avg 4252 ± 25% +109.7% 8919 ± 24% sched_debug.cpu.sched_goidle.max 277.58 ± 11% -63.6% 101.00 ± 4% sched_debug.cpu.sched_goidle.min 554.97 ± 9% +71.0% 949.07 ± 11% sched_debug.cpu.sched_goidle.stddev 1105 ± 2% -30.2% 771.36 ± 4% sched_debug.cpu.ttwu_count.avg 4824 ± 23% +89.2% 9126 ± 21% sched_debug.cpu.ttwu_count.max 364.25 ± 13% -61.1% 141.83 sched_debug.cpu.ttwu_count.min 727.66 ± 8% +44.9% 1054 ± 8% sched_debug.cpu.ttwu_count.stddev 754.79 -25.7% 560.55 ± 5% sched_debug.cpu.ttwu_local.avg 1844 ± 5% +94.2% 3581 ± 25% sched_debug.cpu.ttwu_local.max 281.33 ± 10% -50.5% 139.25 sched_debug.cpu.ttwu_local.min 338.12 ± 10% +70.6% 576.68 ± 5% sched_debug.cpu.ttwu_local.stddev 4.68 ± 4% -4.0 0.73 ± 44% perf-profile.calltrace.cycles-pp.add_to_swap_cache.add_to_swap.shrink_page_list.shrink_inactive_list.shrink_lruvec 6.00 ± 4% -3.2 2.75 ± 13% perf-profile.calltrace.cycles-pp.add_to_swap.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node 1.82 ± 15% -1.5 0.28 ±100% perf-profile.calltrace.cycles-pp.prep_new_page.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page 1.74 ± 5% -1.4 0.29 ±100% perf-profile.calltrace.cycles-pp.__delete_from_swap_cache.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec 2.55 ± 11% -1.4 1.16 ± 12% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault 1.44 ± 15% -1.0 0.47 ±106% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 1.43 ± 16% -1.0 0.47 ±106% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt 1.43 ± 16% -1.0 0.47 ±106% perf-profile.calltrace.cycles-pp.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 1.55 ± 16% -0.8 0.70 ± 68% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 2.10 ± 15% -0.5 1.61 ± 12% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 2.12 ± 8% +0.4 2.52 ± 10% perf-profile.calltrace.cycles-pp.end_page_writeback.pmem_rw_page.bdev_write_page.__swap_writepage.pageout 2.13 ± 5% +0.4 2.58 ± 11% perf-profile.calltrace.cycles-pp.try_to_unmap_one.rmap_walk_anon.try_to_unmap.shrink_page_list.shrink_inactive_list 0.95 ± 26% +0.5 1.47 ± 13% perf-profile.calltrace.cycles-pp.swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_lruvec 1.28 ± 4% +0.5 1.81 ± 14% perf-profile.calltrace.cycles-pp.page_counter_uncharge.mem_cgroup_swapout.__remove_mapping.shrink_page_list.shrink_inactive_list 1.27 ± 4% +0.5 1.80 ± 14% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.mem_cgroup_swapout.__remove_mapping.shrink_page_list 0.54 ± 71% +0.9 1.41 ± 10% perf-profile.calltrace.cycles-pp.__test_set_page_writeback.bdev_write_page.__swap_writepage.pageout.shrink_page_list 2.52 ± 5% +0.9 3.44 ± 14% perf-profile.calltrace.cycles-pp.mem_cgroup_swapout.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec 5.49 ± 4% -4.8 0.69 ± 44% perf-profile.children.cycles-pp.__softirqentry_text_start 4.76 ± 4% -3.7 1.09 ± 12% perf-profile.children.cycles-pp.add_to_swap_cache 3.74 ± 5% -3.6 0.16 ± 19% perf-profile.children.cycles-pp.xas_create_range 3.74 ± 5% -3.5 0.27 ± 15% perf-profile.children.cycles-pp.xas_create 6.06 ± 4% -3.3 2.77 ± 13% perf-profile.children.cycles-pp.add_to_swap 2.32 ± 11% -1.6 0.70 ± 44% perf-profile.children.cycles-pp.do_softirq_own_stack 2.61 ± 11% -1.6 1.04 ± 35% perf-profile.children.cycles-pp.irq_exit_rcu 5.20 ± 11% -1.5 3.68 ± 11% perf-profile.children.cycles-pp.get_page_from_freelist 3.78 ± 14% -1.3 2.45 ± 12% perf-profile.children.cycles-pp.prep_new_page 3.61 ± 14% -1.3 2.32 ± 12% perf-profile.children.cycles-pp.clear_page_erms 1.21 ± 7% -1.0 0.21 ± 20% perf-profile.children.cycles-pp.xas_store 1.75 ± 5% -0.9 0.86 ± 13% perf-profile.children.cycles-pp.__delete_from_swap_cache 2.17 ± 14% -0.5 1.63 ± 12% perf-profile.children.cycles-pp.mem_cgroup_charge 0.61 ± 17% -0.5 0.15 ± 25% perf-profile.children.cycles-pp.worker_thread 0.58 ± 19% -0.4 0.13 ± 24% perf-profile.children.cycles-pp.process_one_work 0.82 ± 7% -0.3 0.56 ± 10% perf-profile.children.cycles-pp.rmqueue 0.75 ± 13% -0.2 0.52 ± 8% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.55 ± 6% -0.2 0.37 ± 11% perf-profile.children.cycles-pp.free_pcppages_bulk 0.77 ± 13% -0.2 0.59 ± 5% perf-profile.children.cycles-pp.__count_memcg_events 0.19 ± 30% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.__libc_fork 0.48 ± 13% -0.1 0.34 ± 13% perf-profile.children.cycles-pp.try_charge 0.36 ± 13% -0.1 0.23 ± 14% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.34 ± 12% -0.1 0.22 ± 13% perf-profile.children.cycles-pp.do_syscall_64 0.15 ± 22% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__do_sys_clone 0.15 ± 22% -0.1 0.03 ±100% perf-profile.children.cycles-pp._do_fork 0.21 ± 7% -0.1 0.11 ± 23% perf-profile.children.cycles-pp.drm_fb_helper_dirty_work 0.35 ± 5% -0.1 0.27 ± 13% perf-profile.children.cycles-pp.rmqueue_bulk 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.drm_atomic_helper_dirtyfb 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.memcpy_toio 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.drm_atomic_helper_commit 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.commit_tail 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.drm_atomic_helper_commit_tail 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.drm_atomic_helper_commit_planes 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.mgag200_simple_display_pipe_update 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.mgag200_handle_damage 0.15 ± 14% -0.1 0.09 ± 23% perf-profile.children.cycles-pp.drm_fb_memcpy_dstclip 0.10 ± 8% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.schedule 0.08 ± 19% +0.0 0.11 ± 12% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.14 ± 3% +0.0 0.17 ± 10% perf-profile.children.cycles-pp.default_send_IPI_single_phys 0.12 ± 3% +0.0 0.16 ± 9% perf-profile.children.cycles-pp.scan_swap_map_try_ssd_cluster 0.10 ± 11% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.inc_node_page_state 0.03 ±102% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.03 ±102% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.13 ± 11% +0.0 0.18 ± 14% perf-profile.children.cycles-pp.cpumask_any_but 0.23 ± 8% +0.1 0.29 ± 10% perf-profile.children.cycles-pp.scan_swap_map_slots 0.15 ± 12% +0.1 0.23 ± 7% perf-profile.children.cycles-pp.lock_page_memcg 0.31 ± 5% +0.1 0.39 ± 8% perf-profile.children.cycles-pp.test_clear_page_writeback 0.29 ± 6% +0.1 0.38 ± 11% perf-profile.children.cycles-pp.get_swap_pages 0.37 ± 7% +0.1 0.46 ± 16% perf-profile.children.cycles-pp.llist_reverse_order 0.39 ± 8% +0.1 0.52 ± 11% perf-profile.children.cycles-pp.tlb_is_not_lazy 0.35 ± 8% +0.1 0.48 ± 14% perf-profile.children.cycles-pp.zswap_frontswap_store 0.45 ± 2% +0.2 0.63 ± 14% perf-profile.children.cycles-pp.page_swapcount 0.49 ± 3% +0.2 0.67 ± 14% perf-profile.children.cycles-pp.try_to_free_swap 0.82 ± 4% +0.2 1.01 ± 11% perf-profile.children.cycles-pp.put_swap_page 0.55 ± 9% +0.2 0.79 ± 14% perf-profile.children.cycles-pp.__frontswap_store 0.81 ± 6% +0.3 1.07 ± 13% perf-profile.children.cycles-pp.get_swap_page 0.62 ± 7% +0.3 0.89 ± 17% perf-profile.children.cycles-pp.page_swap_info 0.58 ± 8% +0.3 0.85 ± 17% perf-profile.children.cycles-pp.swap_set_page_dirty 2.18 ± 8% +0.4 2.56 ± 10% perf-profile.children.cycles-pp.end_page_writeback 1.05 ± 3% +0.4 1.45 ± 11% perf-profile.children.cycles-pp._swap_info_get 1.04 ± 5% +0.4 1.44 ± 11% perf-profile.children.cycles-pp.__test_set_page_writeback 1.07 ± 6% +0.4 1.48 ± 13% perf-profile.children.cycles-pp.swap_writepage 2.17 ± 5% +0.4 2.61 ± 11% perf-profile.children.cycles-pp.try_to_unmap_one 2.23 ± 5% +0.5 2.71 ± 15% perf-profile.children.cycles-pp.__sysvec_call_function_single 2.52 ± 6% +0.5 3.05 ± 15% perf-profile.children.cycles-pp.sysvec_call_function_single 1.30 ± 4% +0.5 1.83 ± 14% perf-profile.children.cycles-pp.page_counter_uncharge 1.29 ± 4% +0.5 1.82 ± 14% perf-profile.children.cycles-pp.page_counter_cancel 2.56 ± 5% +0.9 3.46 ± 14% perf-profile.children.cycles-pp.mem_cgroup_swapout 3.38 ± 13% -1.2 2.17 ± 12% perf-profile.self.cycles-pp.clear_page_erms 0.77 ± 13% -0.2 0.59 ± 5% perf-profile.self.cycles-pp.__count_memcg_events 0.22 ± 8% -0.1 0.08 ± 15% perf-profile.self.cycles-pp.xas_store 0.32 ± 15% -0.1 0.18 ± 12% perf-profile.self.cycles-pp.try_charge 0.34 ± 9% -0.1 0.22 ± 9% perf-profile.self.cycles-pp.mem_cgroup_charge 0.35 ± 7% -0.1 0.24 ± 17% perf-profile.self.cycles-pp.xas_create 0.11 ± 10% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.smp_call_function_many_cond 0.18 ± 4% -0.0 0.13 ± 16% perf-profile.self.cycles-pp.rmqueue_bulk 0.13 ± 13% -0.0 0.09 ± 13% perf-profile.self.cycles-pp.rmqueue 0.12 ± 15% -0.0 0.08 ± 14% perf-profile.self.cycles-pp.page_remove_rmap 0.15 ± 15% -0.0 0.12 ± 21% perf-profile.self.cycles-pp.prep_new_page 0.09 ± 13% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.inc_node_page_state 0.05 ± 58% +0.0 0.08 ± 8% perf-profile.self.cycles-pp.scan_swap_map_slots 0.01 ±173% +0.0 0.05 ± 9% perf-profile.self.cycles-pp.dec_zone_page_state 0.01 ±173% +0.0 0.05 ± 9% perf-profile.self.cycles-pp.mutex_unlock 0.01 ±173% +0.0 0.06 ± 20% perf-profile.self.cycles-pp.irqtime_account_process_tick 0.13 ± 11% +0.1 0.19 ± 16% perf-profile.self.cycles-pp.mem_cgroup_swapout 0.08 ± 15% +0.1 0.15 ± 14% perf-profile.self.cycles-pp.arch_tlbbatch_flush 0.15 ± 11% +0.1 0.21 ± 10% perf-profile.self.cycles-pp.lock_page_memcg 0.37 ± 7% +0.1 0.46 ± 16% perf-profile.self.cycles-pp.llist_reverse_order 0.18 ± 15% +0.1 0.28 ± 13% perf-profile.self.cycles-pp.__frontswap_store 0.57 +0.1 0.67 ± 11% perf-profile.self.cycles-pp.__delete_from_swap_cache 0.60 ± 5% +0.1 0.70 ± 12% perf-profile.self.cycles-pp.add_to_swap_cache 0.33 ± 7% +0.1 0.45 ± 13% perf-profile.self.cycles-pp.zswap_frontswap_store 0.45 ± 2% +0.1 0.57 ± 14% perf-profile.self.cycles-pp.flush_tlb_func_common 0.38 ± 7% +0.1 0.52 ± 13% perf-profile.self.cycles-pp.get_swap_page 0.74 ± 3% +0.2 0.91 ± 10% perf-profile.self.cycles-pp.try_to_unmap_one 0.57 ± 9% +0.2 0.81 ± 16% perf-profile.self.cycles-pp.page_swap_info 0.72 ± 3% +0.3 1.03 ± 11% perf-profile.self.cycles-pp.__test_set_page_writeback 1.68 ± 6% +0.3 2.00 ± 9% perf-profile.self.cycles-pp.end_page_writeback 0.98 ± 3% +0.4 1.35 ± 12% perf-profile.self.cycles-pp._swap_info_get 1.22 ± 5% +0.5 1.75 ± 14% perf-profile.self.cycles-pp.page_counter_cancel 52345 ± 17% -84.0% 8384 ± 41% softirqs.CPU0.RCU 19063 ± 7% -20.7% 15125 ± 6% softirqs.CPU0.SCHED 36466 ± 32% -86.4% 4972 ± 11% softirqs.CPU1.RCU 36608 ± 40% -87.4% 4628 ± 19% softirqs.CPU10.RCU 26212 ± 19% -86.4% 3553 ± 2% softirqs.CPU100.RCU 27448 ± 17% -86.5% 3706 ± 6% softirqs.CPU101.RCU 27842 ± 29% -87.2% 3562 ± 4% softirqs.CPU102.RCU 26457 ± 29% -87.1% 3409 ± 4% softirqs.CPU103.RCU 27085 ± 19% -86.7% 3602 ± 6% softirqs.CPU104.RCU 27395 ± 20% -86.8% 3611 ± 8% softirqs.CPU105.RCU 25853 ± 23% -86.6% 3457 ± 5% softirqs.CPU106.RCU 27375 ± 24% -86.5% 3696 ± 6% softirqs.CPU107.RCU 41902 ± 27% -90.1% 4168 ± 47% softirqs.CPU108.RCU 18997 ± 7% -15.2% 16115 ± 3% softirqs.CPU108.SCHED 35065 ± 28% -91.6% 2936 ± 11% softirqs.CPU109.RCU 35638 ± 34% -85.2% 5271 ± 41% softirqs.CPU11.RCU 34068 ± 26% -91.6% 2847 ± 12% softirqs.CPU110.RCU 19277 ± 6% -18.1% 15790 ± 9% softirqs.CPU110.SCHED 34270 ± 24% -89.9% 3470 ± 31% softirqs.CPU111.RCU 34839 ± 33% -90.4% 3339 ± 3% softirqs.CPU112.RCU 38104 ± 27% -91.3% 3308 ± 5% softirqs.CPU113.RCU 32552 ± 31% -90.9% 2966 ± 8% softirqs.CPU114.RCU 33623 ± 26% -90.2% 3303 ± 7% softirqs.CPU115.RCU 35550 ± 27% -90.4% 3417 ± 8% softirqs.CPU116.RCU 33356 ± 27% -89.8% 3415 ± 5% softirqs.CPU117.RCU 33993 ± 32% -90.0% 3405 ± 12% softirqs.CPU118.RCU 36253 ± 26% -90.3% 3519 ± 3% softirqs.CPU119.RCU 34824 ± 31% -87.1% 4494 ± 9% softirqs.CPU12.RCU 32768 ± 39% -88.8% 3661 ± 11% softirqs.CPU120.RCU 36094 ± 23% -90.6% 3401 ± 3% softirqs.CPU121.RCU 34497 ± 31% -89.0% 3807 ± 12% softirqs.CPU122.RCU 36262 ± 25% -88.4% 4193 ± 32% softirqs.CPU123.RCU 34252 ± 25% -90.1% 3394 ± 5% softirqs.CPU124.RCU 36674 ± 21% -88.3% 4301 ± 25% softirqs.CPU125.RCU 27951 ± 7% -88.9% 3101 ± 10% softirqs.CPU126.RCU 18871 ± 7% -14.7% 16104 ± 3% softirqs.CPU126.SCHED 23136 ± 14% -88.8% 2600 ± 4% softirqs.CPU127.RCU 19431 ± 5% -22.5% 15053 ± 14% softirqs.CPU127.SCHED 27391 ± 5% -88.3% 3205 softirqs.CPU128.RCU 25272 ± 14% -86.9% 3319 ± 4% softirqs.CPU129.RCU 35293 ± 39% -88.5% 4050 ± 11% softirqs.CPU13.RCU 26272 ± 10% -88.4% 3041 ± 10% softirqs.CPU130.RCU 25115 ± 5% -86.9% 3291 ± 3% softirqs.CPU131.RCU 23529 ± 6% -86.9% 3071 ± 10% softirqs.CPU132.RCU 27781 ± 13% -86.5% 3755 ± 15% softirqs.CPU133.RCU 26065 ± 16% -87.4% 3289 ± 10% softirqs.CPU134.RCU 23998 ± 10% -86.3% 3277 ± 3% softirqs.CPU135.RCU 26249 ± 18% -87.3% 3328 ± 5% softirqs.CPU136.RCU 21876 ± 13% -82.2% 3887 ± 14% softirqs.CPU137.RCU 22414 ± 10% -82.1% 4001 ± 18% softirqs.CPU138.RCU 24824 ± 5% -85.5% 3595 ± 9% softirqs.CPU139.RCU 34692 ± 44% -88.7% 3921 ± 6% softirqs.CPU14.RCU 22513 ± 12% -84.8% 3418 ± 7% softirqs.CPU140.RCU 23522 ± 5% -85.0% 3517 ± 7% softirqs.CPU141.RCU 22534 ± 11% -84.6% 3469 ± 8% softirqs.CPU142.RCU 25471 ± 22% -84.8% 3869 ± 18% softirqs.CPU143.RCU 33424 ± 43% -87.6% 4133 ± 9% softirqs.CPU15.RCU 32536 ± 25% -89.7% 3340 ± 4% softirqs.CPU16.RCU 31138 ± 29% -88.7% 3526 ± 7% softirqs.CPU17.RCU 51275 ± 11% -92.3% 3956 ± 11% softirqs.CPU18.RCU 16486 ± 6% -21.1% 13010 ± 12% softirqs.CPU18.SCHED 37422 ± 27% -86.3% 5144 ± 42% softirqs.CPU19.RCU 18953 ± 6% -29.2% 13419 ± 20% softirqs.CPU19.SCHED 38774 ± 41% -88.8% 4336 ± 11% softirqs.CPU2.RCU 19636 ± 2% -19.1% 15894 ± 7% softirqs.CPU2.SCHED 37496 ± 28% -90.0% 3733 ± 8% softirqs.CPU20.RCU 19096 ± 5% -19.5% 15372 ± 19% softirqs.CPU20.SCHED 36543 ± 22% -89.9% 3688 ± 5% softirqs.CPU21.RCU 33600 ± 22% -88.2% 3950 ± 16% softirqs.CPU22.RCU 38695 ± 21% -90.1% 3830 ± 4% softirqs.CPU23.RCU 35007 ± 22% -89.8% 3559 ± 7% softirqs.CPU24.RCU 19064 ± 4% -12.9% 16604 ± 8% softirqs.CPU24.SCHED 37485 ± 21% -90.1% 3728 ± 6% softirqs.CPU25.RCU 33627 ± 28% -88.8% 3763 ± 7% softirqs.CPU26.RCU 36026 ± 24% -89.4% 3829 ± 3% softirqs.CPU27.RCU 34690 ± 29% -88.4% 4028 ± 5% softirqs.CPU28.RCU 36943 ± 24% -89.5% 3882 ± 3% softirqs.CPU29.RCU 38484 ± 41% -85.7% 5499 ± 39% softirqs.CPU3.RCU 34943 ± 26% -89.3% 3743 ± 3% softirqs.CPU30.RCU 34022 ± 31% -88.5% 3927 ± 5% softirqs.CPU31.RCU 34577 ± 26% -90.2% 3392 ± 7% softirqs.CPU32.RCU 34324 ± 39% -90.2% 3379 ± 4% softirqs.CPU33.RCU 32528 ± 21% -89.1% 3560 ± 11% softirqs.CPU34.RCU 35054 ± 38% -86.3% 4802 ± 28% softirqs.CPU35.RCU 55830 ± 22% -91.4% 4827 ± 19% softirqs.CPU36.RCU 18131 ± 5% -32.8% 12178 ± 16% softirqs.CPU36.SCHED 44535 ± 25% -91.5% 3800 ± 6% softirqs.CPU37.RCU 18780 ± 6% -17.0% 15579 ± 12% softirqs.CPU37.SCHED 46422 ± 32% -90.5% 4423 ± 17% softirqs.CPU38.RCU 18645 ± 6% -27.3% 13557 ± 20% softirqs.CPU38.SCHED 43345 ± 22% -88.7% 4918 ± 36% softirqs.CPU39.RCU 32960 ± 30% -88.1% 3917 ± 4% softirqs.CPU4.RCU 44490 ± 29% -91.7% 3685 ± 2% softirqs.CPU40.RCU 46120 ± 29% -91.8% 3798 ± 2% softirqs.CPU41.RCU 42257 ± 32% -91.6% 3551 ± 4% softirqs.CPU42.RCU 46039 ± 20% -90.9% 4188 ± 21% softirqs.CPU43.RCU 44088 ± 29% -91.8% 3604 softirqs.CPU44.RCU 41672 ± 31% -91.2% 3647 softirqs.CPU45.RCU 44499 ± 25% -91.9% 3597 ± 8% softirqs.CPU46.RCU 47826 ± 27% -92.4% 3616 softirqs.CPU47.RCU 40295 ± 41% -91.3% 3518 softirqs.CPU48.RCU 41600 ± 24% -91.6% 3497 softirqs.CPU49.RCU 36523 ± 32% -88.8% 4102 ± 6% softirqs.CPU5.RCU 43678 ± 34% -92.3% 3347 ± 4% softirqs.CPU50.RCU 44579 ± 28% -90.7% 4125 ± 15% softirqs.CPU51.RCU 43503 ± 28% -92.2% 3396 ± 3% softirqs.CPU52.RCU 44468 ± 18% -90.5% 4219 ± 33% softirqs.CPU53.RCU 49302 ± 5% -90.4% 4747 ± 22% softirqs.CPU54.RCU 16826 ± 6% -23.7% 12844 ± 10% softirqs.CPU54.SCHED 34574 ± 13% -87.8% 4220 ± 18% softirqs.CPU55.RCU 18223 ± 8% -35.1% 11830 ± 25% softirqs.CPU55.SCHED 34444 ± 10% -88.1% 4102 ± 21% softirqs.CPU56.RCU 29792 ± 13% -87.5% 3728 ± 11% softirqs.CPU57.RCU 29979 ± 15% -86.7% 3997 ± 16% softirqs.CPU58.RCU 29522 ± 13% -87.5% 3687 ± 8% softirqs.CPU59.RCU 34227 ± 39% -88.9% 3815 ± 6% softirqs.CPU6.RCU 19618 ± 4% -10.2% 17615 ± 4% softirqs.CPU6.SCHED 29331 ± 13% -88.2% 3454 ± 8% softirqs.CPU60.RCU 30844 ± 15% -88.5% 3555 ± 4% softirqs.CPU61.RCU 30676 ± 16% -87.1% 3947 ± 18% softirqs.CPU62.RCU 31209 ± 20% -89.1% 3399 ± 8% softirqs.CPU63.RCU 32203 ± 16% -89.0% 3550 ± 12% softirqs.CPU64.RCU 26618 ± 18% -86.7% 3543 ± 4% softirqs.CPU65.RCU 28476 ± 20% -86.5% 3856 ± 11% softirqs.CPU66.RCU 29713 ± 12% -87.1% 3842 ± 14% softirqs.CPU67.RCU 28361 ± 25% -87.2% 3628 ± 6% softirqs.CPU68.RCU 30363 ± 18% -87.3% 3850 ± 9% softirqs.CPU69.RCU 40268 ± 49% -90.1% 3997 ± 6% softirqs.CPU7.RCU 29067 ± 11% -83.9% 4679 ± 38% softirqs.CPU70.RCU 30143 ± 14% -87.5% 3758 ± 4% softirqs.CPU71.RCU 33102 ± 37% -90.7% 3088 ± 6% softirqs.CPU72.RCU 29408 ± 29% -88.2% 3474 ± 5% softirqs.CPU73.RCU 19427 -18.5% 15841 ± 10% softirqs.CPU73.SCHED 31208 ± 34% -89.4% 3312 softirqs.CPU74.RCU 19059 ± 2% -12.2% 16733 ± 7% softirqs.CPU74.SCHED 29231 ± 42% -88.2% 3446 ± 2% softirqs.CPU75.RCU 27628 ± 26% -86.2% 3814 ± 21% softirqs.CPU76.RCU 26377 ± 27% -87.0% 3428 ± 2% softirqs.CPU77.RCU 26349 ± 50% -86.3% 3622 ± 18% softirqs.CPU78.RCU 30531 ± 48% -88.9% 3389 ± 7% softirqs.CPU79.RCU 35512 ± 42% -88.0% 4272 ± 4% softirqs.CPU8.RCU 25522 ± 36% -86.9% 3339 ± 16% softirqs.CPU80.RCU 27427 ± 48% -86.2% 3784 ± 16% softirqs.CPU81.RCU 25383 ± 40% -82.8% 4368 ± 33% softirqs.CPU82.RCU 26528 ± 40% -84.2% 4180 ± 15% softirqs.CPU83.RCU 26637 ± 33% -85.5% 3849 ± 9% softirqs.CPU84.RCU 27814 ± 30% -86.6% 3735 ± 8% softirqs.CPU85.RCU 27615 ± 39% -82.7% 4764 ± 19% softirqs.CPU86.RCU 27935 ± 40% -85.1% 4154 ± 14% softirqs.CPU87.RCU 27323 ± 26% -84.0% 4380 ± 15% softirqs.CPU88.RCU 26788 ± 28% -85.9% 3788 ± 2% softirqs.CPU89.RCU 34530 ± 43% -88.9% 3845 ± 11% softirqs.CPU9.RCU 34234 ± 12% -90.2% 3338 softirqs.CPU90.RCU 19353 ± 3% -24.2% 14671 ± 2% softirqs.CPU90.SCHED 27937 ± 28% -85.9% 3926 ± 15% softirqs.CPU91.RCU 19542 ± 6% -15.2% 16566 ± 3% softirqs.CPU91.SCHED 28497 ± 22% -87.9% 3441 ± 14% softirqs.CPU92.RCU 28320 ± 18% -89.1% 3074 ± 4% softirqs.CPU93.RCU 26306 ± 11% -85.4% 3840 ± 27% softirqs.CPU94.RCU 19738 ± 4% -12.9% 17184 ± 9% softirqs.CPU94.SCHED 26514 ± 8% -87.0% 3439 ± 23% softirqs.CPU95.RCU 25298 ± 14% -86.9% 3318 ± 10% softirqs.CPU96.RCU 19776 ± 3% -13.9% 17031 ± 6% softirqs.CPU96.SCHED 27549 ± 12% -87.5% 3438 ± 6% softirqs.CPU97.RCU 28550 ± 25% -88.7% 3235 ± 9% softirqs.CPU98.RCU 26684 ± 19% -87.0% 3473 ± 6% softirqs.CPU99.RCU 4756845 ± 5% -88.5% 544700 softirqs.RCU 30919 ± 3% -13.8% 26641 ± 2% softirqs.TIMER 145.50 ± 2% -56.0% 64.00 ±100% interrupts.175:PCI-MSI.512000-edge.ahci[0000:00:1f.2] 112.25 ± 3% -8.7% 102.50 ± 4% interrupts.45:PCI-MSI.1572864-edge.eth0-TxRx-0 78296627 +5.0% 82208891 interrupts.CAL:Function_call_interrupts 112.25 ± 3% -8.7% 102.50 ± 4% interrupts.CPU0.45:PCI-MSI.1572864-edge.eth0-TxRx-0 1231976 ± 21% +185.1% 3511906 ± 22% interrupts.CPU0.CAL:Function_call_interrupts 1343291 ± 20% +181.1% 3775855 ± 22% interrupts.CPU0.TLB:TLB_shootdowns 608271 ± 75% -99.3% 4379 ±170% interrupts.CPU10.CAL:Function_call_interrupts 457.50 ± 61% -79.9% 91.75 ± 38% interrupts.CPU10.NMI:Non-maskable_interrupts 457.50 ± 61% -79.9% 91.75 ± 38% interrupts.CPU10.PMI:Performance_monitoring_interrupts 89.00 ± 59% -89.9% 9.00 ± 79% interrupts.CPU10.RES:Rescheduling_interrupts 657079 ± 75% -99.3% 4336 ±173% interrupts.CPU10.TLB:TLB_shootdowns 411365 ± 29% -99.7% 1267 ± 64% interrupts.CPU100.CAL:Function_call_interrupts 444274 ± 30% -99.7% 1249 ± 69% interrupts.CPU100.TLB:TLB_shootdowns 659.50 ± 68% -74.6% 167.50 ± 22% interrupts.CPU102.NMI:Non-maskable_interrupts 659.50 ± 68% -74.6% 167.50 ± 22% interrupts.CPU102.PMI:Performance_monitoring_interrupts 302129 ± 60% -99.9% 166.75 ± 59% interrupts.CPU103.CAL:Function_call_interrupts 323.75 ± 53% -56.4% 141.00 ± 34% interrupts.CPU103.NMI:Non-maskable_interrupts 323.75 ± 53% -56.4% 141.00 ± 34% interrupts.CPU103.PMI:Performance_monitoring_interrupts 327333 ± 60% -100.0% 32.50 ±166% interrupts.CPU103.TLB:TLB_shootdowns 312284 ± 48% -53.9% 144043 ± 50% interrupts.CPU104.CAL:Function_call_interrupts 338648 ± 48% -54.3% 154674 ± 50% interrupts.CPU104.TLB:TLB_shootdowns 115.50 ± 72% -81.0% 22.00 ± 19% interrupts.CPU108.RES:Rescheduling_interrupts 626496 ± 83% -90.8% 57927 ±172% interrupts.CPU11.CAL:Function_call_interrupts 78.00 ± 60% -73.1% 21.00 ± 86% interrupts.CPU11.RES:Rescheduling_interrupts 679997 ± 83% -90.5% 64580 ±173% interrupts.CPU11.TLB:TLB_shootdowns 81.25 ± 51% -80.3% 16.00 ± 11% interrupts.CPU111.RES:Rescheduling_interrupts 87.50 ± 71% -89.7% 9.00 ± 40% interrupts.CPU112.RES:Rescheduling_interrupts 645406 ± 66% -89.8% 66133 ±103% interrupts.CPU113.CAL:Function_call_interrupts 103.50 ± 48% -89.6% 10.75 ± 47% interrupts.CPU113.RES:Rescheduling_interrupts 698561 ± 66% -89.8% 71091 ±104% interrupts.CPU113.TLB:TLB_shootdowns 78.00 ± 68% -86.2% 10.75 ± 41% interrupts.CPU114.RES:Rescheduling_interrupts 1141 ± 56% -72.3% 316.50 ±106% interrupts.CPU115.NMI:Non-maskable_interrupts 1141 ± 56% -72.3% 316.50 ±106% interrupts.CPU115.PMI:Performance_monitoring_interrupts 91.00 ± 62% -90.1% 9.00 ± 26% interrupts.CPU115.RES:Rescheduling_interrupts 757124 ± 58% -60.1% 302332 ±132% interrupts.CPU116.CAL:Function_call_interrupts 98.25 ± 46% -88.0% 11.75 ± 63% interrupts.CPU116.RES:Rescheduling_interrupts 823491 ± 58% -60.9% 322256 ±132% interrupts.CPU116.TLB:TLB_shootdowns 628006 ± 76% -73.8% 164708 ±146% interrupts.CPU117.CAL:Function_call_interrupts 987.50 ± 49% -85.9% 139.25 ± 30% interrupts.CPU117.NMI:Non-maskable_interrupts 987.50 ± 49% -85.9% 139.25 ± 30% interrupts.CPU117.PMI:Performance_monitoring_interrupts 109.25 ± 69% -93.1% 7.50 ± 52% interrupts.CPU117.RES:Rescheduling_interrupts 681610 ± 76% -74.4% 174707 ±146% interrupts.CPU117.TLB:TLB_shootdowns 104.00 ± 55% -87.7% 12.75 ± 78% interrupts.CPU119.RES:Rescheduling_interrupts 471.25 ± 54% -80.9% 90.00 ± 38% interrupts.CPU12.NMI:Non-maskable_interrupts 471.25 ± 54% -80.9% 90.00 ± 38% interrupts.CPU12.PMI:Performance_monitoring_interrupts 58.25 ± 79% -76.4% 13.75 ± 88% interrupts.CPU12.RES:Rescheduling_interrupts 878.50 ± 72% -88.3% 103.00 ± 43% interrupts.CPU120.NMI:Non-maskable_interrupts 878.50 ± 72% -88.3% 103.00 ± 43% interrupts.CPU120.PMI:Performance_monitoring_interrupts 64.00 ± 77% -85.5% 9.25 ± 68% interrupts.CPU120.RES:Rescheduling_interrupts 868.50 ± 54% -84.1% 138.50 ± 45% interrupts.CPU121.NMI:Non-maskable_interrupts 868.50 ± 54% -84.1% 138.50 ± 45% interrupts.CPU121.PMI:Performance_monitoring_interrupts 597802 ± 74% -99.8% 1291 ±164% interrupts.CPU122.CAL:Function_call_interrupts 804.25 ± 83% -85.9% 113.25 ± 65% interrupts.CPU122.NMI:Non-maskable_interrupts 804.25 ± 83% -85.9% 113.25 ± 65% interrupts.CPU122.PMI:Performance_monitoring_interrupts 95.50 ± 48% -92.7% 7.00 ± 56% interrupts.CPU122.RES:Rescheduling_interrupts 649164 ± 75% -99.8% 1290 ±173% interrupts.CPU122.TLB:TLB_shootdowns 114.50 ± 54% -93.7% 7.25 ± 48% interrupts.CPU123.RES:Rescheduling_interrupts 629610 ± 63% -69.6% 191537 ±168% interrupts.CPU124.CAL:Function_call_interrupts 1011 ± 58% -86.9% 132.50 ± 45% interrupts.CPU124.NMI:Non-maskable_interrupts 1011 ± 58% -86.9% 132.50 ± 45% interrupts.CPU124.PMI:Performance_monitoring_interrupts 70.25 ± 70% -85.4% 10.25 ± 44% interrupts.CPU124.RES:Rescheduling_interrupts 683705 ± 63% -69.7% 206886 ±168% interrupts.CPU124.TLB:TLB_shootdowns 739662 ± 49% -82.9% 126387 ±117% interrupts.CPU125.CAL:Function_call_interrupts 968.50 ± 63% -84.4% 151.00 ± 27% interrupts.CPU125.NMI:Non-maskable_interrupts 968.50 ± 63% -84.4% 151.00 ± 27% interrupts.CPU125.PMI:Performance_monitoring_interrupts 66.25 ± 66% -72.8% 18.00 ± 97% interrupts.CPU125.RES:Rescheduling_interrupts 804430 ± 50% -83.3% 134653 ±118% interrupts.CPU125.TLB:TLB_shootdowns 501165 ± 14% +221.8% 1612759 ± 13% interrupts.CPU126.CAL:Function_call_interrupts 545091 ± 14% +217.3% 1729798 ± 13% interrupts.CPU126.TLB:TLB_shootdowns 303.75 ± 35% +1609.7% 5193 ± 40% interrupts.CPU127.NMI:Non-maskable_interrupts 303.75 ± 35% +1609.7% 5193 ± 40% interrupts.CPU127.PMI:Performance_monitoring_interrupts 81.00 ± 59% -78.1% 17.75 ± 68% interrupts.CPU13.RES:Rescheduling_interrupts 221283 ± 18% -61.8% 84423 ± 90% interrupts.CPU132.CAL:Function_call_interrupts 240847 ± 18% -62.5% 90210 ± 89% interrupts.CPU132.TLB:TLB_shootdowns 228853 ± 19% -64.6% 81121 ±115% interrupts.CPU135.CAL:Function_call_interrupts 514.00 ± 87% -74.7% 130.25 ± 15% interrupts.CPU135.NMI:Non-maskable_interrupts 514.00 ± 87% -74.7% 130.25 ± 15% interrupts.CPU135.PMI:Performance_monitoring_interrupts 250600 ± 19% -65.4% 86702 ±116% interrupts.CPU135.TLB:TLB_shootdowns 319279 ± 47% -92.1% 25144 ±150% interrupts.CPU136.CAL:Function_call_interrupts 343.25 ± 76% -63.6% 125.00 ± 25% interrupts.CPU136.NMI:Non-maskable_interrupts 343.25 ± 76% -63.6% 125.00 ± 25% interrupts.CPU136.PMI:Performance_monitoring_interrupts 349192 ± 47% -92.4% 26548 ±150% interrupts.CPU136.TLB:TLB_shootdowns 270185 ± 37% -78.4% 58300 ±172% interrupts.CPU139.CAL:Function_call_interrupts 378.00 ± 56% -71.6% 107.25 ± 27% interrupts.CPU139.NMI:Non-maskable_interrupts 378.00 ± 56% -71.6% 107.25 ± 27% interrupts.CPU139.PMI:Performance_monitoring_interrupts 293913 ± 37% -78.9% 62022 ±173% interrupts.CPU139.TLB:TLB_shootdowns 78.00 ± 63% -76.3% 18.50 ±111% interrupts.CPU14.RES:Rescheduling_interrupts 162067 ± 56% -81.2% 30462 ±165% interrupts.CPU140.CAL:Function_call_interrupts 175459 ± 56% -82.0% 31590 ±166% interrupts.CPU140.TLB:TLB_shootdowns 253.25 ± 32% -50.4% 125.50 ± 35% interrupts.CPU143.NMI:Non-maskable_interrupts 253.25 ± 32% -50.4% 125.50 ± 35% interrupts.CPU143.PMI:Performance_monitoring_interrupts 66.75 ± 72% -82.4% 11.75 ± 49% interrupts.CPU15.RES:Rescheduling_interrupts 508268 ± 63% -100.0% 79.25 ± 22% interrupts.CPU16.CAL:Function_call_interrupts 1082 ± 98% -93.1% 75.25 ± 11% interrupts.CPU16.NMI:Non-maskable_interrupts 1082 ± 98% -93.1% 75.25 ± 11% interrupts.CPU16.PMI:Performance_monitoring_interrupts 58.50 ± 46% -86.3% 8.00 ± 81% interrupts.CPU16.RES:Rescheduling_interrupts 549265 ± 63% -100.0% 4.00 ±133% interrupts.CPU16.TLB:TLB_shootdowns 52.25 ± 65% -66.5% 17.50 ± 57% interrupts.CPU17.RES:Rescheduling_interrupts 1258584 ± 15% +208.1% 3878023 ± 32% interrupts.CPU18.CAL:Function_call_interrupts 1369478 ± 15% +204.9% 4175783 ± 31% interrupts.CPU18.TLB:TLB_shootdowns 629511 ± 88% +241.1% 2147207 ± 76% interrupts.CPU2.CAL:Function_call_interrupts 678734 ± 89% +237.7% 2292112 ± 75% interrupts.CPU2.TLB:TLB_shootdowns 620.75 ± 72% -82.7% 107.50 ± 33% interrupts.CPU21.NMI:Non-maskable_interrupts 620.75 ± 72% -82.7% 107.50 ± 33% interrupts.CPU21.PMI:Performance_monitoring_interrupts 50.50 ± 71% -71.8% 14.25 ± 84% interrupts.CPU21.RES:Rescheduling_interrupts 63.75 ± 43% -78.8% 13.50 ± 99% interrupts.CPU22.RES:Rescheduling_interrupts 66.75 ± 50% -80.5% 13.00 ± 88% interrupts.CPU23.RES:Rescheduling_interrupts 54.25 ± 62% -77.0% 12.50 ± 17% interrupts.CPU25.RES:Rescheduling_interrupts 323.25 ± 93% -74.2% 83.25 ± 8% interrupts.CPU28.NMI:Non-maskable_interrupts 323.25 ± 93% -74.2% 83.25 ± 8% interrupts.CPU28.PMI:Performance_monitoring_interrupts 71.75 ± 37% -83.6% 11.75 ±109% interrupts.CPU29.RES:Rescheduling_interrupts 657.25 ± 54% -83.5% 108.50 ± 30% interrupts.CPU3.NMI:Non-maskable_interrupts 657.25 ± 54% -83.5% 108.50 ± 30% interrupts.CPU3.PMI:Performance_monitoring_interrupts 81.75 ± 86% -78.0% 18.00 ± 42% interrupts.CPU3.RES:Rescheduling_interrupts 846.25 ± 65% -88.7% 96.00 ± 15% interrupts.CPU30.NMI:Non-maskable_interrupts 846.25 ± 65% -88.7% 96.00 ± 15% interrupts.CPU30.PMI:Performance_monitoring_interrupts 54.50 ± 54% -85.3% 8.00 ± 49% interrupts.CPU30.RES:Rescheduling_interrupts 545049 ± 65% -98.4% 8859 ±171% interrupts.CPU31.CAL:Function_call_interrupts 612.00 ± 63% -84.8% 92.75 ± 14% interrupts.CPU31.NMI:Non-maskable_interrupts 612.00 ± 63% -84.8% 92.75 ± 14% interrupts.CPU31.PMI:Performance_monitoring_interrupts 49.75 ± 83% -78.4% 10.75 ± 54% interrupts.CPU31.RES:Rescheduling_interrupts 593689 ± 65% -98.4% 9350 ±173% interrupts.CPU31.TLB:TLB_shootdowns 67.75 ± 84% -85.6% 9.75 ± 42% interrupts.CPU33.RES:Rescheduling_interrupts 138.75 ± 65% -78.7% 29.50 ± 25% interrupts.CPU36.RES:Rescheduling_interrupts 133.75 ± 81% -84.1% 21.25 ± 49% interrupts.CPU37.RES:Rescheduling_interrupts 108.75 ± 54% -82.3% 19.25 ± 45% interrupts.CPU38.RES:Rescheduling_interrupts 112.50 ± 75% -93.8% 7.00 ± 42% interrupts.CPU40.RES:Rescheduling_interrupts 117.75 ± 69% -89.0% 13.00 ± 44% interrupts.CPU41.RES:Rescheduling_interrupts 889287 ± 63% -69.2% 273776 ±142% interrupts.CPU42.CAL:Function_call_interrupts 917.25 ± 65% -84.8% 139.25 ± 48% interrupts.CPU42.NMI:Non-maskable_interrupts 917.25 ± 65% -84.8% 139.25 ± 48% interrupts.CPU42.PMI:Performance_monitoring_interrupts 110.75 ± 72% -91.0% 10.00 ± 50% interrupts.CPU42.RES:Rescheduling_interrupts 970285 ± 63% -69.8% 292582 ±142% interrupts.CPU42.TLB:TLB_shootdowns 945929 ± 47% -54.3% 432248 ±109% interrupts.CPU43.CAL:Function_call_interrupts 1431 ± 84% -74.5% 365.50 ±134% interrupts.CPU43.NMI:Non-maskable_interrupts 1431 ± 84% -74.5% 365.50 ±134% interrupts.CPU43.PMI:Performance_monitoring_interrupts 91.25 ± 46% -93.7% 5.75 ± 44% interrupts.CPU43.RES:Rescheduling_interrupts 1030879 ± 47% -54.7% 467326 ±108% interrupts.CPU43.TLB:TLB_shootdowns 120.25 ± 47% -93.6% 7.75 ± 23% interrupts.CPU44.RES:Rescheduling_interrupts 869076 ± 61% -79.1% 182037 ±126% interrupts.CPU45.CAL:Function_call_interrupts 1007 ± 52% -88.8% 113.00 ± 61% interrupts.CPU45.NMI:Non-maskable_interrupts 1007 ± 52% -88.8% 113.00 ± 61% interrupts.CPU45.PMI:Performance_monitoring_interrupts 119.00 ± 65% -88.4% 13.75 ± 37% interrupts.CPU45.RES:Rescheduling_interrupts 945574 ± 61% -79.6% 192547 ±127% interrupts.CPU45.TLB:TLB_shootdowns 121.00 ± 36% -87.6% 15.00 ± 48% interrupts.CPU46.RES:Rescheduling_interrupts 96.50 ± 69% -85.8% 13.75 ±116% interrupts.CPU47.RES:Rescheduling_interrupts 91.25 ± 70% -91.2% 8.00 ± 31% interrupts.CPU48.RES:Rescheduling_interrupts 113.00 ± 73% -93.1% 7.75 ±108% interrupts.CPU49.RES:Rescheduling_interrupts 471.25 ± 60% -81.3% 88.25 ± 22% interrupts.CPU5.NMI:Non-maskable_interrupts 471.25 ± 60% -81.3% 88.25 ± 22% interrupts.CPU5.PMI:Performance_monitoring_interrupts 72.25 ± 54% -60.2% 28.75 ± 87% interrupts.CPU5.RES:Rescheduling_interrupts 959091 ± 62% -94.9% 48533 ±172% interrupts.CPU50.CAL:Function_call_interrupts 137.75 ± 80% -95.5% 6.25 ± 6% interrupts.CPU50.RES:Rescheduling_interrupts 1039830 ± 62% -95.0% 52192 ±173% interrupts.CPU50.TLB:TLB_shootdowns 1333 ± 57% -88.1% 158.50 ± 30% interrupts.CPU51.NMI:Non-maskable_interrupts 1333 ± 57% -88.1% 158.50 ± 30% interrupts.CPU51.PMI:Performance_monitoring_interrupts 121.25 ± 51% -89.5% 12.75 ± 45% interrupts.CPU51.RES:Rescheduling_interrupts 939728 ± 55% -87.8% 114957 ±173% interrupts.CPU52.CAL:Function_call_interrupts 103.25 ± 63% -94.2% 6.00 ± 39% interrupts.CPU52.RES:Rescheduling_interrupts 1020727 ± 55% -88.1% 121660 ±173% interrupts.CPU52.TLB:TLB_shootdowns 1039918 ± 36% -89.8% 106181 ±122% interrupts.CPU53.CAL:Function_call_interrupts 1284 ± 78% -91.1% 114.00 ± 52% interrupts.CPU53.NMI:Non-maskable_interrupts 1284 ± 78% -91.1% 114.00 ± 52% interrupts.CPU53.PMI:Performance_monitoring_interrupts 104.00 ± 68% -94.7% 5.50 ± 27% interrupts.CPU53.RES:Rescheduling_interrupts 1134197 ± 36% -90.1% 112045 ±121% interrupts.CPU53.TLB:TLB_shootdowns 1168628 ± 8% +182.2% 3297943 ± 17% interrupts.CPU54.CAL:Function_call_interrupts 963.25 ± 47% +350.1% 4336 ± 34% interrupts.CPU54.NMI:Non-maskable_interrupts 963.25 ± 47% +350.1% 4336 ± 34% interrupts.CPU54.PMI:Performance_monitoring_interrupts 80.75 ± 40% -48.3% 41.75 ± 25% interrupts.CPU54.RES:Rescheduling_interrupts 1275853 ± 8% +177.1% 3535200 ± 18% interrupts.CPU54.TLB:TLB_shootdowns 392.25 ± 34% +1015.9% 4377 ± 29% interrupts.CPU55.NMI:Non-maskable_interrupts 392.25 ± 34% +1015.9% 4377 ± 29% interrupts.CPU55.PMI:Performance_monitoring_interrupts 84.75 ± 68% -72.6% 23.25 ± 94% interrupts.CPU6.RES:Rescheduling_interrupts 707.00 ± 42% -77.1% 162.25 ± 30% interrupts.CPU61.NMI:Non-maskable_interrupts 707.00 ± 42% -77.1% 162.25 ± 30% interrupts.CPU61.PMI:Performance_monitoring_interrupts 405740 ± 55% -76.0% 97283 ±115% interrupts.CPU63.CAL:Function_call_interrupts 684.50 ± 70% -77.1% 157.00 ± 37% interrupts.CPU63.NMI:Non-maskable_interrupts 684.50 ± 70% -77.1% 157.00 ± 37% interrupts.CPU63.PMI:Performance_monitoring_interrupts 440306 ± 55% -76.6% 102844 ±115% interrupts.CPU63.TLB:TLB_shootdowns 315353 ± 24% -62.0% 119836 ±106% interrupts.CPU65.CAL:Function_call_interrupts 340082 ± 24% -62.6% 127245 ±106% interrupts.CPU65.TLB:TLB_shootdowns 356445 ± 33% -88.5% 41068 ± 70% interrupts.CPU66.CAL:Function_call_interrupts 387163 ± 33% -88.6% 44312 ± 71% interrupts.CPU66.TLB:TLB_shootdowns 390653 ± 33% -91.5% 33124 ±172% interrupts.CPU67.CAL:Function_call_interrupts 461.25 ± 50% -72.1% 128.75 ± 43% interrupts.CPU67.NMI:Non-maskable_interrupts 461.25 ± 50% -72.1% 128.75 ± 43% interrupts.CPU67.PMI:Performance_monitoring_interrupts 424248 ± 33% -91.6% 35682 ±173% interrupts.CPU67.TLB:TLB_shootdowns 362929 ± 57% -67.3% 118702 ±125% interrupts.CPU68.CAL:Function_call_interrupts 393487 ± 57% -68.0% 125761 ±125% interrupts.CPU68.TLB:TLB_shootdowns 396812 ± 29% -91.7% 32913 ±168% interrupts.CPU71.CAL:Function_call_interrupts 407.00 ± 48% -71.3% 117.00 ± 35% interrupts.CPU71.NMI:Non-maskable_interrupts 407.00 ± 48% -71.3% 117.00 ± 35% interrupts.CPU71.PMI:Performance_monitoring_interrupts 432737 ± 29% -91.1% 38455 ±169% interrupts.CPU71.TLB:TLB_shootdowns 617468 ± 68% +224.7% 2004642 ± 58% interrupts.CPU72.CAL:Function_call_interrupts 670964 ± 68% +220.4% 2149931 ± 58% interrupts.CPU72.TLB:TLB_shootdowns 62.50 ± 63% -72.0% 17.50 ± 37% interrupts.CPU75.RES:Rescheduling_interrupts 58.50 ± 67% -68.4% 18.50 ± 84% interrupts.CPU77.RES:Rescheduling_interrupts 584390 ± 73% -92.3% 45050 ±111% interrupts.CPU8.CAL:Function_call_interrupts 498.50 ± 43% -82.6% 86.50 ± 18% interrupts.CPU8.NMI:Non-maskable_interrupts 498.50 ± 43% -82.6% 86.50 ± 18% interrupts.CPU8.PMI:Performance_monitoring_interrupts 71.25 ± 62% -94.0% 4.25 ± 67% interrupts.CPU8.RES:Rescheduling_interrupts 634390 ± 73% -92.5% 47709 ±111% interrupts.CPU8.TLB:TLB_shootdowns 305172 ±104% -98.9% 3263 ±136% interrupts.CPU80.CAL:Function_call_interrupts 332295 ±104% -99.0% 3256 ±144% interrupts.CPU80.TLB:TLB_shootdowns 306939 ± 97% -100.0% 77.25 ± 23% interrupts.CPU82.CAL:Function_call_interrupts 45.50 ± 79% -80.2% 9.00 ± 53% interrupts.CPU82.RES:Rescheduling_interrupts 332644 ± 98% -100.0% 0.75 ±110% interrupts.CPU82.TLB:TLB_shootdowns 626.25 ± 82% -78.1% 137.25 ± 44% interrupts.CPU84.NMI:Non-maskable_interrupts 626.25 ± 82% -78.1% 137.25 ± 44% interrupts.CPU84.PMI:Performance_monitoring_interrupts 145.50 ± 2% -56.0% 64.00 ±100% interrupts.CPU87.175:PCI-MSI.512000-edge.ahci[0000:00:1f.2] 330258 ±115% -100.0% 114.75 ± 59% interrupts.CPU88.CAL:Function_call_interrupts 936.25 ±104% -85.1% 139.50 ± 58% interrupts.CPU88.NMI:Non-maskable_interrupts 936.25 ±104% -85.1% 139.50 ± 58% interrupts.CPU88.PMI:Performance_monitoring_interrupts 360088 ±116% -100.0% 41.50 ±164% interrupts.CPU88.TLB:TLB_shootdowns 84.75 ± 77% -69.0% 26.25 ± 97% interrupts.CPU9.RES:Rescheduling_interrupts 673363 ± 17% +226.0% 2195380 ± 32% interrupts.CPU90.CAL:Function_call_interrupts 732427 ± 17% +223.3% 2367615 ± 32% interrupts.CPU90.TLB:TLB_shootdowns 8947 ± 18% -71.3% 2570 ± 19% interrupts.RES:Rescheduling_interrupts Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Oliver Sang

8 months, 2 weeks

2
1
0 / 0

[dyndbg] e83b4a5011: leaking-addresses.proc.__dyndbg_callsites.

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: e83b4a5011dc4c54048fa264da5923d3253df8fd ("[RFC PATCH v2 02/19] dyndbg: split struct _ddebug, move display fields to new _ddebug_callsite") url: https://github.com/0day-ci/linux/commits/Jim-Cromie/dynamic-debug-diet-pl... base: https://git.kernel.org/cgit/linux/kernel/git/arnd/asm-generic.git master in testcase: leaking-addresses version: leaking-addresses-x86_64-4f19048-1_20201111 with following parameters: ucode: 0xde on test machine: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> 2020-12-30 15:54:07 ./leaking_addresses.pl --output-raw result/scan.out 2020-12-30 15:54:27 ./leaking_addresses.pl --input-raw result/scan.out --squash-by-filename Total number of results from scan (incl dmesg): 160105 dmesg output: [ 0.058423] mapped IOAPIC to ffffffffff5fb000 (fec00000) Results squashed by filename (excl dmesg). Displaying [<number of results> <filename>], <example result> [5 .altinstr_aux] 0xffffffffc0131a49 [50 .symtab] 0xffffffffc00c2000 [2 .noinstr.text] 0xffffffffc0762a40 [41 .data] 0xffffffffc009f000 [158484 kallsyms] ffffffff81000000 T startup_64 [22 .smp_locks] 0xffffffffc009d094 [1 .rodata.cst16.mask2] 0xffffffffc00de0e0 [1 key] 1000000000007 ff980000000007ff febeffdfffefffff fffffffffffffffe [49 __mcount_loc] 0xffffffffc009d03c [46 .orc_unwind_ip] 0xffffffffc009d3a0 [24 __ksymtab_strings] 0xffffffffc0118048 [7 .fixup] 0xffffffffc00d62ea [1 .rodata.cst16.mask1] 0xffffffffc00de0d0 [6 __tracepoints] 0xffffffffc02efcc0 [6 _ftrace_events] 0xffffffffc02efb80 [1 .data..cacheline_aligned] 0xffffffffc064ac80 [31 .bss] 0xffffffffc009f500 [38 .rodata.str1.8] 0xffffffffc009d170 [35 .text.unlikely] 0xffffffffc009cbaf [2 .rodata.cst16.bswap_mask] 0xffffffffc0098070 [37 .exit.text] 0xffffffffc009cc70 [14 .parainstructions] 0xffffffffc02b4d88 [50 .strtab] 0xffffffffc00c2bb8 [50 .note.Linux] 0xffffffffc009d024 [18 __dyndbg] 0xffffffffc009f0c8 [50 .text] 0xffffffffc009c000 [6 __tracepoints_strings] 0xffffffffc02eb7d0 [50 .note.gnu.build-id] 0xffffffffc009d000 [339 blacklist] 0xffffffff81c00860-0xffffffff81c00880 asm_exc_divide_error [11 __ex_table] 0xffffffffc00d1128 [1 _ftrace_eval_map] 0xffffffffc0985148 [14 __ksymtab_gpl] 0xffffffffc02b403c [9 .init.rodata] 0xffffffffc00c1000 [1 _error_injection_whitelist] 0xffffffffc098ab70 [6 .ref.data] 0xffffffffc02efba0 [10 .data..read_mostly] 0xffffffffc009f108 [42 .rodata.str1.1] 0xffffffffc009d09c [1 ___srcu_struct_ptrs] 0xffffffffc027a000 [140 printk_formats] 0xffffffff8234e927 : "CPU_ON" [1 devices] B: KEY=1000000000007 ff980000000007ff febeffdfffefffff fffffffffffffffe [1 uevent] KEY=1000000000007 ff980000000007ff febeffdfffefffff fffffffffffffffe [18 __ksymtab] 0xffffffffc011803c [6 __bpf_raw_tp_map] 0xffffffffc02efb20 [50 .gnu.linkonce.this_module] 0xffffffffc009f140 [50 modules] netconsole 20480 0 - Live 0xffffffffc00c0000 [1 .rodata.cst32.byteshift_table] 0xffffffffc00de100 [14 .altinstr_replacement] 0xffffffffc03d39ca [25 __jump_table] 0xffffffffc009e000 [7 .static_call_sites] 0xffffffffc0987088 [46 .orc_unwind] 0xffffffffc009d544 [42 .rodata] 0xffffffffc009d2c0 [6 __tracepoints_ptrs] 0xffffffffc02eb7bc [4 .init.data] 0xffffffffc0069000 [14 .altinstructions] 0xffffffffc03e5846 [10 .data.once] 0xffffffffc03e65b4 [6 .static_call.text] 0xffffffffc02e2b24 [18 __dyndbg_callsites] 0xffffffffc009f0f0 [40 .init.text] 0xffffffffc00c0000 [19 __param] 0xffffffffc009d378 [25 __bug_table] 0xffffffffc01ee070 To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Thanks, Oliver Sang

8 months, 2 weeks

1
0
0 / 0

[kasan] 97593cad00: RIP:kasan_record_aux_stack

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: 97593cad003c668e2532cb2939a24a031f8de52d ("kasan: sanitize objects when metadata doesn't fit") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: trinity version: trinity-i386-4d2343bd-1_20200320 with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +--------------------------------------------------------------------------+------------+------------+ | | 3933c17571 | 97593cad00 | +--------------------------------------------------------------------------+------------+------------+ | boot_successes | 4 | 1 | | boot_failures | 0 | 3 | | BUG:sleeping_function_called_from_invalid_context_at_arch/x86/mm/fault.c | 0 | 3 | | RIP:kasan_record_aux_stack | 0 | 3 | | BUG:kernel_NULL_pointer_dereference,address | 0 | 3 | | Oops:#[##] | 0 | 3 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 3 | +--------------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> [ 235.553325] BUG: sleeping function called from invalid context at arch/x86/mm/fault.c:1351 [ 235.554684] in_atomic(): 0, irqs_disabled(): 1, non_block: 0, pid: 7515, name: trinity-c1 [ 235.555890] 2 locks held by trinity-c1/7515: [ 235.556506] #0: ffffffff8323dd38 (&ids->rwsem){....}-{3:3}, at: semctl_down+0x6d/0x686 [ 235.557684] #1: ffff888128ccc868 (&mm->mmap_lock#2){....}-{3:3}, at: do_user_addr_fault+0x196/0x59e [ 235.559020] CPU: 1 PID: 7515 Comm: trinity-c1 Not tainted 5.10.0-g97593cad003c #2 [ 235.560317] Call Trace: [ 235.560767] dump_stack+0x7d/0xa3 [ 235.561371] ___might_sleep+0x2c4/0x2df [ 235.562063] ? do_user_addr_fault+0x196/0x59e [ 235.562834] do_user_addr_fault+0x234/0x59e [ 235.563519] exc_page_fault+0x70/0x8b [ 235.564112] asm_exc_page_fault+0x1b/0x20 [ 235.564754] RIP: 0010:kasan_record_aux_stack+0x64/0x74 [ 235.565603] Code: 48 f7 fe 8b 47 24 49 89 f0 8d 70 ff 41 0f af f0 48 01 ce 48 29 d3 48 39 f3 48 0f 46 f3 e8 6f e5 ff ff bf 00 08 00 00 48 89 c3 <8b> 40 08 89 43 0c e8 fb e2 ff ff 89 43 08 5b c3 53 48 89 f3 e8 61 [ 235.568479] RSP: 0000:ffff88811f29fce8 EFLAGS: 00010046 [ 235.569415] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff88813a800000 [ 235.570645] RDX: 0000000000000080 RSI: ffff88813a800000 RDI: 0000000000000800 [ 235.571721] RBP: 00000000001ea2c0 R08: 0000000000000000 R09: 0000000000000001 [ 235.572728] R10: ffffed1027500013 R11: ffff88813a800093 R12: ffff88813a800080 [ 235.573700] R13: 0000000000000000 R14: ffff88813a8000f8 R15: 0000000000000246 [ 235.574793] ? kasan_record_aux_stack+0x5c/0x74 [ 235.575536] ? sem_more_checks+0x6c/0x6c [ 235.576171] call_rcu+0xbe/0x96f [ 235.576668] ? lock_downgrade+0x46b/0x46b [ 235.577343] ? do_nocb_bypass_wakeup_timer+0x65/0x65 [ 235.578220] semctl_down+0x602/0x686 [ 235.579015] ? sem_lock_and_putref+0x1b/0x1b [ 235.579762] ? kvm_sched_clock_read+0x5/0xd [ 235.580517] ? paravirt_sched_clock+0x5/0x8 [ 235.581259] compat_ksys_semctl+0x1a8/0x1de [ 235.582005] ? semctl_main+0x81b/0x81b [ 235.582675] ? lock_downgrade+0x46b/0x46b [ 235.583340] ? get_vtime_delta+0x83/0x115 [ 235.583994] ? do_write_seqcount_end+0x12/0x42 [ 235.584724] do_int80_syscall_32+0x38/0x45 [ 235.585383] entry_INT80_compat+0x82/0x87 [ 235.586014] RIP: 0023:0xf7ef1a02 [ 235.586543] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 235.589764] RSP: 002b:00000000ffe6b0f8 EFLAGS: 00000292 ORIG_RAX: 000000000000018a [ 235.591049] RAX: ffffffffffffffda RBX: 0000000000000081 RCX: 0000000000000001 [ 235.592230] RDX: 0000000000000000 RSI: 0000000000004000 RDI: 00000000000000ff [ 235.593329] RBP: 000000007aeed3f6 R08: 0000000000000000 R09: 0000000000000000 [ 235.594454] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 [ 235.595609] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 [ 235.596810] BUG: kernel NULL pointer dereference, address: 0000000000000008 [ 235.598027] #PF: supervisor read access in kernel mode [ 235.598952] #PF: error_code(0x0000) - not-present page [ 235.599857] PGD 8000000118306067 P4D 8000000118306067 PUD 11ac1e067 PMD 15b2e9067 PTE 0 [ 235.601232] Oops: 0000 [#1] SMP KASAN PTI [ 235.601936] CPU: 1 PID: 7515 Comm: trinity-c1 Tainted: G W 5.10.0-g97593cad003c #2 [ 235.603475] RIP: 0010:kasan_record_aux_stack+0x64/0x74 [ 235.604329] Code: 48 f7 fe 8b 47 24 49 89 f0 8d 70 ff 41 0f af f0 48 01 ce 48 29 d3 48 39 f3 48 0f 46 f3 e8 6f e5 ff ff bf 00 08 00 00 48 89 c3 <8b> 40 08 89 43 0c e8 fb e2 ff ff 89 43 08 5b c3 53 48 89 f3 e8 61 [ 235.607111] RSP: 0000:ffff88811f29fce8 EFLAGS: 00010046 [ 235.607964] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff88813a800000 [ 235.609165] RDX: 0000000000000080 RSI: ffff88813a800000 RDI: 0000000000000800 [ 235.610409] RBP: 00000000001ea2c0 R08: 0000000000000000 R09: 0000000000000001 [ 235.611834] R10: ffffed1027500013 R11: ffff88813a800093 R12: ffff88813a800080 [ 235.613110] R13: 0000000000000000 R14: ffff88813a8000f8 R15: 0000000000000246 [ 235.614379] FS: 0000000000000000(0000) GS:ffff8881e8a00000(0063) knlGS:00000000f7eec840 [ 235.615685] CS: 0010 DS: 002b ES: 002b CR0: 0000000080050033 [ 235.616545] CR2: 0000000000000008 CR3: 00000001100b0000 CR4: 00000000000406a0 [ 235.617684] Call Trace: [ 235.618092] ? sem_more_checks+0x6c/0x6c [ 235.618706] call_rcu+0xbe/0x96f [ 235.619190] ? lock_downgrade+0x46b/0x46b [ 235.619825] ? do_nocb_bypass_wakeup_timer+0x65/0x65 [ 235.620678] semctl_down+0x602/0x686 [ 235.621319] ? sem_lock_and_putref+0x1b/0x1b [ 235.622096] ? kvm_sched_clock_read+0x5/0xd [ 235.622855] ? paravirt_sched_clock+0x5/0x8 [ 235.623616] compat_ksys_semctl+0x1a8/0x1de [ 235.624377] ? semctl_main+0x81b/0x81b [ 235.625066] ? lock_downgrade+0x46b/0x46b [ 235.625799] ? get_vtime_delta+0x83/0x115 [ 235.626468] ? do_write_seqcount_end+0x12/0x42 [ 235.627214] do_int80_syscall_32+0x38/0x45 [ 235.627854] entry_INT80_compat+0x82/0x87 [ 235.628552] RIP: 0023:0xf7ef1a02 [ 235.629128] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 235.632253] RSP: 002b:00000000ffe6b0f8 EFLAGS: 00000292 ORIG_RAX: 000000000000018a [ 235.633500] RAX: ffffffffffffffda RBX: 0000000000000081 RCX: 0000000000000001 [ 235.634649] RDX: 0000000000000000 RSI: 0000000000004000 RDI: 00000000000000ff [ 235.635722] RBP: 000000007aeed3f6 R08: 0000000000000000 R09: 0000000000000000 [ 235.636865] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 [ 235.638130] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 [ 235.639416] Modules linked in: mousedev crc32c_intel evdev psmouse autofs4 [ 235.640669] CR2: 0000000000000008 [ 235.641281] ---[ end trace 21817c93fd871d30 ]--- To reproduce: # build kernel cd linux cp config-5.10.0-g97593cad003c .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Oliver Sang

8 months, 2 weeks

3
2
0 / 0

创业、开公司必备的13套资料，帮助您企业节省很多时间成本!

by 资料宝库

8 months, 3 weeks

1
0
0 / 0

[trace] 2158a32526: BUG:using_smp_processor_id()in_preemptible

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: 2158a32526b660c34eedc2eaef2bbd623227dd84 ("[PATCH] trace: Remove get/put_cpu() from function_trace_init") url: https://github.com/0day-ci/linux/commits/Qiujun-Huang/trace-Remove-get-pu... base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git c2208046bba6842dc232a600dc5cafc2fca41078 in testcase: kernel-selftests version: kernel-selftests-x86_64-b5a583fb-1_20201015 with following parameters: group: group-01 ucode: 0xe2 test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel. test-url: https://www.kernel.org/doc/Documentation/kselftest.txt on test machine: 8 threads Intel(R) Core(TM) i7-6770HQ CPU @ 2.60GHz with 32G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> kern :err : [ 89.914811] BUG: using smp_processor_id() in preemptible [00000000] code: ftracetest/10346 kern :warn : [ 89.923315] caller is function_trace_init+0x3d/0x80 kern :warn : [ 89.928379] CPU: 6 PID: 10346 Comm: ftracetest Tainted: G I 5.10.0-rc5-00048-g2158a32526b6 #1 kern :warn : [ 89.938618] Hardware name: /NUC6i7KYB, BIOS KYSKLi70.86A.0041.2016.0817.1130 08/17/2016 kern :warn : [ 89.947067] Call Trace: kern :warn : [ 89.949611] dump_stack+0x8d/0xb5 kern :warn : [ 89.953090] check_preemption_disabled+0xc3/0xe0 kern :warn : [ 89.957991] function_trace_init+0x3d/0x80 kern :warn : [ 89.962284] tracing_set_tracer+0x138/0x220 kern :warn : [ 89.966620] tracing_set_trace_write+0x95/0xe0 kern :warn : [ 89.971222] ? ksys_write+0x68/0xe0 kern :warn : [ 89.974839] vfs_write+0xee/0x3c0 kern :warn : [ 89.978288] ksys_write+0x68/0xe0 kern :warn : [ 89.981707] do_syscall_64+0x33/0x40 kern :warn : [ 89.985450] entry_SYSCALL_64_after_hwframe+0x44/0xa9 user :notice: [ 89.988062] # Check success of execveat(5, '../execveat', 0)... [OK] kern :warn : [ 89.990669] RIP: 0033:0x7f7d1f648504 kern :warn : [ 89.990678] Code: 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b3 0f 1f 80 00 00 00 00 48 8d 05 f9 61 0d 00 8b 00 85 c0 75 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 41 54 49 89 d4 55 48 89 f5 53 kern :warn : [ 90.000988] RSP: 002b:00007fff326418a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 kern :warn : [ 90.000990] RAX: ffffffffffffffda RBX: 0000000000000009 RCX: 00007f7d1f648504 kern :warn : [ 90.000991] RDX: 0000000000000009 RSI: 0000563de1bc3920 RDI: 0000000000000001 kern :warn : [ 90.000992] RBP: 0000563de1bc3920 R08: 000000000000000a R09: 00007f7d1f6d8e80 kern :warn : [ 90.000994] R10: 000000000000000a R11: 0000000000000246 R12: 00007f7d1f71a760 kern :warn : [ 90.000995] R13: 0000000000000009 R14: 00007f7d1f715760 R15: 0000000000000009 user :notice: [ 90.068488] # Check success of execveat(7, 'execveat', 0)... [OK] user :notice: [ 90.077748] # Check success of execveat(9, 'execveat', 0)... [OK] user :notice: [ 91.944852] # Check success of execveat(-100, '/usr/src/perf_selfte...ftests/exec/execveat', 0)... [OK] user :notice: [ 91.958685] # Check success of execveat(99, '/usr/src/perf_selfte...ftests/exec/execveat', 0)... [OK] user :notice: [ 91.971263] # Check success of execveat(11, '', 4096)... [OK] user :notice: [ 91.980178] # Check success of execveat(20, '', 4096)... [OK] user :notice: [ 91.989100] # Check success of execveat(12, '', 4096)... [OK] user :notice: [ 91.998064] # Check success of execveat(17, '', 4096)... [OK] user :notice: [ 92.007057] # Check success of execveat(17, '', 4096)... [OK] user :notice: [ 92.016034] # Check success of execveat(18, '', 4096)... [OK] user :notice: [ 92.025178] # Check failure of execveat(11, '', 0) with ENOENT... [OK] user :notice: [ 92.035300] # Check failure of execveat(11, '(null)', 4096) with EFAULT... [OK] user :notice: [ 92.046380] # Check success of execveat(7, 'execveat.symlink', 0)... [OK] user :notice: [ 92.056637] # Check success of execveat(9, 'execveat.symlink', 0)... [OK] user :notice: [ 92.067857] # Check success of execveat(-100, '/usr/src/perf_selfte...xec/execveat.symlink', 0)... [OK] user :notice: [ 92.080671] # Check success of execveat(13, '', 4096)... [OK] user :notice: [ 92.090051] # Check success of execveat(13, '', 4352)... [OK] user :notice: [ 92.100312] # Check failure of execveat(7, 'execveat.symlink', 256) with ELOOP... [OK] user :notice: [ 92.112462] # Check failure of execveat(9, 'execveat.symlink', 256) with ELOOP... [OK] kern :warn : [ 93.511413] ********************************************************** kern :warn : [ 93.518345] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** kern :warn : [ 93.525104] ** ** kern :warn : [ 93.531889] ** trace_printk() being used. Allocating extra memory. ** kern :warn : [ 93.538660] ** ** kern :warn : [ 93.545394] ** This means that this is a DEBUG kernel and it is ** kern :warn : [ 93.552308] ** unsafe for production use. ** kern :warn : [ 93.559159] ** ** kern :warn : [ 93.566088] ** If you see this message and you are not debugging ** kern :warn : [ 93.572951] ** the kernel, report this immediately to your vendor! ** kern :warn : [ 93.579780] ** ** kern :warn : [ 93.586630] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** kern :warn : [ 93.593501] ********************************************************** user :notice: [ 96.683973] # Check failure of execveat(-100, '/usr/src/perf_selftests-x86_64-rhel-7.6-kselftests-2158a32526b660c34eedc2eaef2bbd623227dd84/tools/testing/selftests/exec/execveat.symlink', 256) with ELOOP... [OK] user :notice: [ 96.706608] # Check failure of execveat(7, 'pipe', 0) with EACCES... [OK] user :notice: [ 96.716823] # Check success of execveat(5, '../script', 0)... [OK] user :notice: [ 96.726318] # Check success of execveat(7, 'script', 0)... [OK] user :notice: [ 96.735349] # Check success of execveat(9, 'script', 0)... [OK] user :notice: [ 96.745231] # Check success of execveat(-100, '/usr/src/perf_selfte...elftests/exec/script', 0)... [OK] user :notice: [ 96.757894] # Check success of execveat(16, '', 4096)... [OK] user :notice: [ 96.766599] # Check success of execveat(16, '', 4352)... [OK] user :notice: [ 96.775638] # Check failure of execveat(21, '', 4096) with ENOENT... [OK] user :notice: [ 96.785800] # Check failure of execveat(10, 'script', 0) with ENOENT... [OK] user :notice: [ 96.795985] # Check success of execveat(19, '', 4096)... [OK] user :notice: [ 96.804779] # Check success of execveat(19, '', 4096)... [OK] To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Thanks, Oliver Sang

8 months, 3 weeks

1
0
0 / 0

[blokc/blk] d9ad3bf8cb: xfstests.generic.299.fail

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: d9ad3bf8cb2c5fa6738a48e303b2b0f50770700a ("[PATCH] blokc/blk-merge: remove the next_bvec label in __blk_bios_map_sg()linux-block(a)vger.kernel.org (open list:BLOCK LAYER)") url: https://github.com/0day-ci/linux/commits/sh/blokc-blk-merge-remove-the-ne... base: https://git.kernel.org/cgit/linux/kernel/git/axboe/linux-block.git for-next in testcase: xfstests version: xfstests-x86_64-d41dcbd-1_20201218 with following parameters: disk: 4HDD fs: btrfs test: generic-group-14 ucode: 0x21 test-description: xfstests is a regression test suite for xfs and other files ystems. test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git on test machine: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> 2020-12-29 18:23:58 export TEST_DIR=/fs/sda1 2020-12-29 18:23:58 export TEST_DEV=/dev/sda1 2020-12-29 18:23:58 export FSTYP=btrfs 2020-12-29 18:23:58 export SCRATCH_MNT=/fs/scratch 2020-12-29 18:23:58 mkdir /fs/scratch -p 2020-12-29 18:23:58 export SCRATCH_DEV_POOL="/dev/sda2 /dev/sda3 /dev/sda4" 2020-12-29 18:23:58 sed "s:^:generic/:" //lkp/benchmarks/xfstests/tests/generic-group-14 2020-12-29 18:23:58 ./check generic/280 generic/281 generic/282 generic/283 generic/284 generic/285 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/298 generic/299 FSTYP -- btrfs PLATFORM -- Linux/x86_64 lkp-ivb-d02 5.10.0-gd9ad3bf8cb2c #1 SMP Fri Dec 25 09:02:24 CST 2020 MKFS_OPTIONS -- /dev/sda2 MOUNT_OPTIONS -- /dev/sda2 /fs/scratch generic/280 [not run] disk quotas not supported by this filesystem type: btrfs generic/281 3s generic/282 2s generic/283 3s generic/284 2s generic/285 0s generic/286 2s generic/287 1s generic/288 [not run] FITRIM not supported on /fs/scratch generic/289 1s generic/290 1s generic/291 2s generic/292 2s generic/293 2s generic/294 1s generic/295 2s generic/296 1s generic/298 _check_btrfs_filesystem: filesystem on /dev/sda2 is inconsistent (see /lkp/benchmarks/xfstests/results//generic/298.full for details) generic/299 _check_btrfs_filesystem: filesystem on /dev/sda2 is inconsistent (see /lkp/benchmarks/xfstests/results//generic/299.full for details) Ran: generic/280 generic/281 generic/282 generic/283 generic/284 generic/285 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/298 generic/299 Not run: generic/280 generic/288 Failures: generic/298 generic/299 Failed 2 of 19 tests To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Thanks, Oliver Sang

8 months, 3 weeks

1
0
0 / 0

2021

2020

2019

2018

2017

2016

2015

2014

2013

LKP December 2020