Re: [LKP] [rcu] kernel BUG at include/linux/pagemap.h:149!
by Frederic Weisbecker
On Fri, Sep 11, 2015 at 10:19:47AM +0800, Boqun Feng wrote:
> Subject: [PATCH 01/27] rcu: Don't disable preemption for Tiny and Tree RCU
> readers
>
> Because preempt_disable() maps to barrier() for non-debug builds,
> it forces the compiler to spill and reload registers. Because Tree
> RCU and Tiny RCU now only appear in CONFIG_PREEMPT=n builds, these
> barrier() instances generate needless extra code for each instance of
> rcu_read_lock() and rcu_read_unlock(). This extra code slows down Tree
> RCU and bloats Tiny RCU.
>
> This commit therefore removes the preempt_disable() and preempt_enable()
> from the non-preemptible implementations of __rcu_read_lock() and
> __rcu_read_unlock(), respectively.
>
> For debug purposes, preempt_disable() and preempt_enable() are still
> kept if CONFIG_PREEMPT_COUNT=y, which makes the detection of sleeping
> inside atomic sections still work in non-preemptible kernels.
>
> Signed-off-by: Boqun Feng <boqun.feng(a)gmail.com>
> Signed-off-by: Paul E. McKenney <paulmck(a)linux.vnet.ibm.com>
> ---
> include/linux/rcupdate.h | 6 ++++--
> include/linux/rcutiny.h | 1 +
> kernel/rcu/tree.c | 9 +++++++++
> 3 files changed, 14 insertions(+), 2 deletions(-)
>
> diff --git a/include/linux/rcupdate.h b/include/linux/rcupdate.h
> index d63bb77..6c3cece 100644
> --- a/include/linux/rcupdate.h
> +++ b/include/linux/rcupdate.h
> @@ -297,12 +297,14 @@ void synchronize_rcu(void);
>
> static inline void __rcu_read_lock(void)
> {
> - preempt_disable();
> + if (IS_ENABLED(CONFIG_PREEMPT_COUNT))
> + preempt_disable();
preempt_disable() is a no-op when !CONFIG_PREEMPT_COUNT, right?
Or rather it's a barrier(), which is anyway implied by rcu_read_lock().
So perhaps we can get rid of the IS_ENABLED() check?
1 year, 7 months
[mm] ac5b2c1891: vm-scalability.throughput -61.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -61.3% regression of vm-scalability.throughput due to commit:
commit: ac5b2c18911ffe95c08d69273917f90212cf5659 ("mm: thp: relax __GFP_THISNODE for MADV_HUGEPAGE mappings")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: vm-scalability
on test machine: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory
with following parameters:
runtime: 300
thp_enabled: always
thp_defrag: always
nr_task: 32
nr_ssd: 1
test: swap-w-seq
ucode: 0x3d
cpufreq_governor: performance
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode:
gcc-7/performance/x86_64-rhel-7.2/1/32/debian-x86_64-2018-04-03.cgz/300/lkp-hsw-ep4/swap-w-seq/vm-scalability/always/always/0x3d
commit:
94e297c50b ("include/linux/notifier.h: SRCU: fix ctags")
ac5b2c1891 ("mm: thp: relax __GFP_THISNODE for MADV_HUGEPAGE mappings")
94e297c50b529f5d ac5b2c18911ffe95c08d692739
---------------- --------------------------
%stddev %change %stddev
\ | \
0.57 ± 35% +258.8% 2.05 ± 4% vm-scalability.free_time
146022 ± 14% -40.5% 86833 ± 2% vm-scalability.median
29.29 ± 40% -89.6% 3.06 ± 26% vm-scalability.stddev
7454656 ± 9% -61.3% 2885836 ± 3% vm-scalability.throughput
189.21 ± 10% +52.4% 288.34 ± 2% vm-scalability.time.elapsed_time
189.21 ± 10% +52.4% 288.34 ± 2% vm-scalability.time.elapsed_time.max
8768 ± 3% +11.6% 9781 ± 5% vm-scalability.time.involuntary_context_switches
20320196 ± 2% -33.4% 13531732 ± 3% vm-scalability.time.maximum_resident_set_size
425945 ± 9% +17.4% 499908 ± 4% vm-scalability.time.minor_page_faults
253.79 ± 6% +62.0% 411.07 ± 4% vm-scalability.time.system_time
322.52 +8.0% 348.18 vm-scalability.time.user_time
246150 ± 12% +50.3% 370019 ± 4% vm-scalability.time.voluntary_context_switches
7746519 ± 11% +49.0% 11538799 ± 4% cpuidle.C6.usage
192240 ± 10% +44.3% 277460 ± 8% interrupts.CAL:Function_call_interrupts
22.45 ± 85% -80.6% 4.36 ±173% sched_debug.cfs_rq:/.MIN_vruntime.avg
22.45 ± 85% -80.6% 4.36 ±173% sched_debug.cfs_rq:/.max_vruntime.avg
29.36 ± 13% +10.8% 32.52 ± 14% boot-time.boot
24.28 ± 16% +12.4% 27.30 ± 16% boot-time.dhcp
1597 ± 15% +10.2% 1760 ± 15% boot-time.idle
68.25 -9.8 58.48 ± 2% mpstat.cpu.idle%
27.12 ± 5% +10.3 37.42 ± 3% mpstat.cpu.iowait%
2.48 ± 11% -0.8 1.73 ± 2% mpstat.cpu.usr%
3422396 ± 14% +46.6% 5018492 ± 7% softirqs.RCU
1776561 ± 10% +52.4% 2707785 ± 2% softirqs.SCHED
5685772 ± 7% +54.3% 8774055 ± 3% softirqs.TIMER
7742519 ± 11% +49.0% 11534924 ± 4% turbostat.C6
29922317 ± 10% +55.0% 46366941 turbostat.IRQ
9.49 ± 64% -83.0% 1.62 ± 54% turbostat.Pkg%pc2
36878790 ± 27% -84.9% 5570259 ± 47% vmstat.memory.free
1.117e+08 ± 15% +73.5% 1.939e+08 ± 10% vmstat.memory.swpd
25.25 ± 4% +34.7% 34.00 vmstat.procs.b
513725 ± 7% +47.9% 759561 ± 12% numa-numastat.node0.local_node
35753 ±160% +264.7% 130386 ± 39% numa-numastat.node0.numa_foreign
519403 ± 6% +48.7% 772182 ± 12% numa-numastat.node0.numa_hit
35753 ±160% +264.7% 130386 ± 39% numa-numastat.node1.numa_miss
44315 ±138% +198.5% 132279 ± 40% numa-numastat.node1.other_node
32798032 ± 46% +80.6% 59228165 ± 2% numa-meminfo.node0.Active
32798009 ± 46% +80.6% 59228160 ± 2% numa-meminfo.node0.Active(anon)
33430762 ± 46% +80.8% 60429537 ± 2% numa-meminfo.node0.AnonHugePages
33572119 ± 46% +80.2% 60512777 ± 2% numa-meminfo.node0.AnonPages
1310559 ± 64% +86.4% 2442244 ± 2% numa-meminfo.node0.Inactive
1309969 ± 64% +86.4% 2442208 ± 2% numa-meminfo.node0.Inactive(anon)
30385359 ± 53% -90.7% 2821023 ± 44% numa-meminfo.node0.MemFree
35505047 ± 45% +77.6% 63055165 ± 2% numa-meminfo.node0.MemUsed
166560 ± 42% +130.2% 383345 ± 6% numa-meminfo.node0.PageTables
23702 ±105% -89.0% 2617 ± 44% numa-meminfo.node0.Shmem
1212 ± 65% +402.8% 6093 ± 57% numa-meminfo.node1.Shmem
8354144 ± 44% +77.1% 14798964 ± 2% numa-vmstat.node0.nr_active_anon
8552787 ± 44% +76.8% 15122222 ± 2% numa-vmstat.node0.nr_anon_pages
16648 ± 44% +77.1% 29492 ± 2% numa-vmstat.node0.nr_anon_transparent_hugepages
7436650 ± 53% -90.4% 712936 ± 44% numa-vmstat.node0.nr_free_pages
332106 ± 63% +83.8% 610268 ± 2% numa-vmstat.node0.nr_inactive_anon
41929 ± 41% +130.6% 96703 ± 6% numa-vmstat.node0.nr_page_table_pages
5900 ±106% -89.0% 650.75 ± 45% numa-vmstat.node0.nr_shmem
43336 ± 92% +151.2% 108840 ± 7% numa-vmstat.node0.nr_vmscan_write
43110 ± 92% +150.8% 108110 ± 7% numa-vmstat.node0.nr_written
8354142 ± 44% +77.1% 14798956 ± 2% numa-vmstat.node0.nr_zone_active_anon
332105 ± 63% +83.8% 610269 ± 2% numa-vmstat.node0.nr_zone_inactive_anon
321.50 ± 66% +384.9% 1559 ± 59% numa-vmstat.node1.nr_shmem
88815743 ± 10% +33.8% 1.188e+08 ± 2% meminfo.Active
88815702 ± 10% +33.8% 1.188e+08 ± 2% meminfo.Active(anon)
90446011 ± 11% +34.0% 1.212e+08 ± 2% meminfo.AnonHugePages
90613587 ± 11% +34.0% 1.214e+08 ± 2% meminfo.AnonPages
5.15e+08 ± 3% +22.2% 6.293e+08 ± 2% meminfo.Committed_AS
187419 ± 10% -19.6% 150730 ± 7% meminfo.DirectMap4k
3620693 ± 18% +35.3% 4897093 ± 2% meminfo.Inactive
3620054 ± 18% +35.3% 4896961 ± 2% meminfo.Inactive(anon)
36144979 ± 28% -87.0% 4715681 ± 57% meminfo.MemAvailable
36723121 ± 27% -85.9% 5179468 ± 52% meminfo.MemFree
395801 ± 2% +56.9% 620816 ± 4% meminfo.PageTables
178672 +15.1% 205668 ± 2% meminfo.SUnreclaim
249496 +12.6% 280897 meminfo.Slab
1751813 ± 2% +34.7% 2360437 ± 3% meminfo.SwapCached
6.716e+08 -12.4% 5.88e+08 ± 2% meminfo.SwapFree
3926 ± 17% +72.9% 6788 ± 13% meminfo.Writeback
1076 ± 3% +42.9% 1538 ± 4% slabinfo.biovec-max.active_objs
275.75 ± 2% +41.1% 389.00 ± 4% slabinfo.biovec-max.active_slabs
1104 ± 2% +41.0% 1557 ± 4% slabinfo.biovec-max.num_objs
275.75 ± 2% +41.1% 389.00 ± 4% slabinfo.biovec-max.num_slabs
588.25 ± 7% +17.9% 693.75 ± 7% slabinfo.file_lock_cache.active_objs
588.25 ± 7% +17.9% 693.75 ± 7% slabinfo.file_lock_cache.num_objs
13852 ± 3% +37.5% 19050 ± 3% slabinfo.kmalloc-4k.active_objs
1776 ± 3% +37.7% 2446 ± 3% slabinfo.kmalloc-4k.active_slabs
14217 ± 3% +37.7% 19577 ± 3% slabinfo.kmalloc-4k.num_objs
1776 ± 3% +37.7% 2446 ± 3% slabinfo.kmalloc-4k.num_slabs
158.25 ± 15% +54.0% 243.75 ± 18% slabinfo.nfs_read_data.active_objs
158.25 ± 15% +54.0% 243.75 ± 18% slabinfo.nfs_read_data.num_objs
17762 ± 4% +44.3% 25638 ± 4% slabinfo.pool_workqueue.active_objs
563.25 ± 3% +43.7% 809.25 ± 4% slabinfo.pool_workqueue.active_slabs
18048 ± 3% +43.5% 25906 ± 4% slabinfo.pool_workqueue.num_objs
563.25 ± 3% +43.7% 809.25 ± 4% slabinfo.pool_workqueue.num_slabs
34631 ± 3% +21.0% 41905 ± 2% slabinfo.radix_tree_node.active_objs
624.50 ± 3% +20.7% 753.75 ± 2% slabinfo.radix_tree_node.active_slabs
34998 ± 3% +20.7% 42228 ± 2% slabinfo.radix_tree_node.num_objs
624.50 ± 3% +20.7% 753.75 ± 2% slabinfo.radix_tree_node.num_slabs
9.727e+11 ± 8% +50.4% 1.463e+12 ± 12% perf-stat.branch-instructions
1.11 ± 12% +1.2 2.31 ± 8% perf-stat.branch-miss-rate%
1.078e+10 ± 13% +214.9% 3.395e+10 ± 17% perf-stat.branch-misses
3.17 ± 11% -1.5 1.65 ± 9% perf-stat.cache-miss-rate%
8.206e+08 ± 7% +49.4% 1.226e+09 ± 11% perf-stat.cache-misses
2.624e+10 ± 14% +187.0% 7.532e+10 ± 17% perf-stat.cache-references
1174249 ± 9% +52.3% 1788442 ± 3% perf-stat.context-switches
2.921e+12 ± 8% +71.1% 4.998e+12 ± 9% perf-stat.cpu-cycles
1437 ± 14% +85.1% 2661 ± 20% perf-stat.cpu-migrations
7.586e+08 ± 21% +134.7% 1.78e+09 ± 30% perf-stat.dTLB-load-misses
7.943e+11 ± 11% +84.3% 1.464e+12 ± 14% perf-stat.dTLB-loads
93963731 ± 22% +40.9% 1.324e+08 ± 10% perf-stat.dTLB-store-misses
3.394e+11 ± 6% +60.5% 5.449e+11 ± 10% perf-stat.dTLB-stores
1.531e+08 ± 22% +44.0% 2.204e+08 ± 11% perf-stat.iTLB-load-misses
1.688e+08 ± 23% +71.1% 2.888e+08 ± 12% perf-stat.iTLB-loads
3.267e+12 ± 7% +58.5% 5.177e+12 ± 13% perf-stat.instructions
3988 ± 43% +123.9% 8930 ± 22% perf-stat.major-faults
901474 ± 5% +34.2% 1209877 ± 2% perf-stat.minor-faults
31.24 ± 10% +21.7 52.91 ± 2% perf-stat.node-load-miss-rate%
1.135e+08 ± 16% +187.6% 3.264e+08 ± 13% perf-stat.node-load-misses
6.27 ± 17% +26.9 33.19 ± 4% perf-stat.node-store-miss-rate%
27354489 ± 15% +601.2% 1.918e+08 ± 13% perf-stat.node-store-misses
905482 ± 5% +34.6% 1218833 ± 2% perf-stat.page-faults
4254 ± 7% +58.5% 6741 ± 13% perf-stat.path-length
6364 ± 25% +84.1% 11715 ± 14% proc-vmstat.allocstall_movable
46439 ± 12% +100.4% 93049 ± 21% proc-vmstat.compact_migrate_scanned
22425696 ± 10% +29.0% 28932634 ± 6% proc-vmstat.nr_active_anon
22875703 ± 11% +29.2% 29560082 ± 6% proc-vmstat.nr_anon_pages
44620 ± 11% +29.2% 57643 ± 6% proc-vmstat.nr_anon_transparent_hugepages
879436 ± 28% -77.3% 199768 ± 98% proc-vmstat.nr_dirty_background_threshold
1761029 ± 28% -77.3% 400034 ± 98% proc-vmstat.nr_dirty_threshold
715724 +17.6% 841386 ± 3% proc-vmstat.nr_file_pages
8960545 ± 28% -76.4% 2111248 ± 93% proc-vmstat.nr_free_pages
904330 ± 18% +31.2% 1186458 ± 7% proc-vmstat.nr_inactive_anon
11137 ± 2% +27.1% 14154 ± 9% proc-vmstat.nr_isolated_anon
12566 +3.5% 13012 proc-vmstat.nr_kernel_stack
97491 ± 2% +52.6% 148790 ± 10% proc-vmstat.nr_page_table_pages
17674 +6.2% 18763 ± 2% proc-vmstat.nr_slab_reclaimable
44820 +13.0% 50645 ± 2% proc-vmstat.nr_slab_unreclaimable
135763 ± 9% +68.4% 228600 ± 6% proc-vmstat.nr_vmscan_write
1017 ± 10% +54.7% 1573 ± 14% proc-vmstat.nr_writeback
220023 ± 5% +73.5% 381732 ± 6% proc-vmstat.nr_written
22425696 ± 10% +29.0% 28932635 ± 6% proc-vmstat.nr_zone_active_anon
904330 ± 18% +31.2% 1186457 ± 7% proc-vmstat.nr_zone_inactive_anon
1018 ± 10% +55.3% 1581 ± 13% proc-vmstat.nr_zone_write_pending
145368 ± 48% +63.1% 237050 ± 17% proc-vmstat.numa_foreign
671.50 ± 96% +479.4% 3890 ± 71% proc-vmstat.numa_hint_faults
1122389 ± 9% +17.2% 1315380 ± 4% proc-vmstat.numa_hit
214722 ± 5% +21.6% 261076 ± 3% proc-vmstat.numa_huge_pte_updates
1108142 ± 9% +17.4% 1300857 ± 4% proc-vmstat.numa_local
145368 ± 48% +63.1% 237050 ± 17% proc-vmstat.numa_miss
159615 ± 44% +57.6% 251573 ± 16% proc-vmstat.numa_other
185.50 ± 81% +8278.6% 15542 ± 40% proc-vmstat.numa_pages_migrated
1.1e+08 ± 5% +21.6% 1.337e+08 ± 3% proc-vmstat.numa_pte_updates
688332 ±106% +177.9% 1913062 ± 3% proc-vmstat.pgalloc_dma32
72593045 ± 10% +51.1% 1.097e+08 ± 3% proc-vmstat.pgdeactivate
919059 ± 4% +35.1% 1241472 ± 2% proc-vmstat.pgfault
3716 ± 45% +120.3% 8186 ± 25% proc-vmstat.pgmajfault
7.25 ± 26% +4.2e+05% 30239 ± 25% proc-vmstat.pgmigrate_fail
5340 ±106% +264.0% 19438 ± 33% proc-vmstat.pgmigrate_success
2.837e+08 ± 10% +51.7% 4.303e+08 ± 3% proc-vmstat.pgpgout
211428 ± 6% +74.1% 368188 ± 4% proc-vmstat.pgrefill
219051 ± 5% +73.7% 380419 ± 5% proc-vmstat.pgrotated
559397 ± 8% +43.0% 800110 ± 11% proc-vmstat.pgscan_direct
32894 ± 59% +158.3% 84981 ± 23% proc-vmstat.pgscan_kswapd
207042 ± 8% +71.5% 355174 ± 5% proc-vmstat.pgsteal_direct
14745 ± 65% +104.3% 30121 ± 18% proc-vmstat.pgsteal_kswapd
70934968 ± 10% +51.7% 1.076e+08 ± 3% proc-vmstat.pswpout
5852284 ± 12% +145.8% 14382881 ± 5% proc-vmstat.slabs_scanned
13453 ± 24% +204.9% 41023 ± 8% proc-vmstat.thp_split_page_failed
138385 ± 10% +51.6% 209783 ± 3% proc-vmstat.thp_split_pmd
138385 ± 10% +51.6% 209782 ± 3% proc-vmstat.thp_swpout
4.61 ± 24% -1.2 3.37 ± 10% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle
2.90 ± 18% -0.7 2.19 ± 8% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.86 ± 32% -0.6 1.22 ± 7% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
1.60 ± 31% -0.5 1.08 ± 10% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
2.98 ± 8% -0.5 2.48 ± 10% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.46 ± 32% -0.5 0.96 ± 9% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.74 ± 27% -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
1.03 ± 52% -0.4 0.63 ± 15% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.17 ± 19% -0.3 0.87 ± 11% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.80 ± 17% +0.4 1.22 ± 7% perf-profile.calltrace.cycles-pp.nvme_queue_rq.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request
0.81 ± 16% +0.4 1.23 ± 8% perf-profile.calltrace.cycles-pp.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage
0.81 ± 16% +0.4 1.23 ± 8% perf-profile.calltrace.cycles-pp.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request.submit_bio
0.52 ± 60% +0.5 1.03 ± 6% perf-profile.calltrace.cycles-pp.dma_pool_alloc.nvme_queue_rq.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request
1.64 ± 16% +0.6 2.21 ± 15% perf-profile.calltrace.cycles-pp.find_next_bit.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done
0.51 ± 64% +0.8 1.31 ± 17% perf-profile.calltrace.cycles-pp.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_start
0.80 ± 25% +0.9 1.67 ± 19% perf-profile.calltrace.cycles-pp.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_start.blk_mq_make_request
0.82 ± 24% +0.9 1.71 ± 19% perf-profile.calltrace.cycles-pp.blk_mq_in_flight.part_round_stats.blk_account_io_start.blk_mq_make_request.generic_make_request
0.82 ± 25% +0.9 1.73 ± 19% perf-profile.calltrace.cycles-pp.part_round_stats.blk_account_io_start.blk_mq_make_request.generic_make_request.submit_bio
0.87 ± 25% +1.0 1.87 ± 14% perf-profile.calltrace.cycles-pp.blk_account_io_start.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage
2.05 ± 15% +1.4 3.48 ± 7% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.__swap_writepage.pageout.shrink_page_list
2.09 ± 15% +1.4 3.53 ± 7% perf-profile.calltrace.cycles-pp.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_node_memcg
2.05 ± 15% +1.4 3.49 ± 7% perf-profile.calltrace.cycles-pp.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage.pageout
2.06 ± 15% +1.4 3.50 ± 7% perf-profile.calltrace.cycles-pp.submit_bio.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list
2.10 ± 15% +1.4 3.54 ± 6% perf-profile.calltrace.cycles-pp.pageout.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node
3.31 ± 12% +1.5 4.83 ± 5% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node.do_try_to_free_pages
3.33 ± 12% +1.5 4.86 ± 5% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_node_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages
3.40 ± 12% +1.6 4.97 ± 6% perf-profile.calltrace.cycles-pp.shrink_node_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
3.57 ± 12% +1.6 5.19 ± 7% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
3.48 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
3.48 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page
3.49 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault
3.51 ± 12% +1.7 5.17 ± 6% perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault
3.34 ± 14% +2.2 5.57 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_check_inflight.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats
9.14 ± 17% +5.5 14.66 ± 22% perf-profile.calltrace.cycles-pp.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done
12.10 ± 17% +6.8 18.89 ± 20% perf-profile.calltrace.cycles-pp.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done.blk_mq_end_request
13.88 ± 15% +7.1 21.01 ± 20% perf-profile.calltrace.cycles-pp.handle_irq.do_IRQ.ret_from_intr.cpuidle_enter_state.do_idle
13.87 ± 15% +7.1 21.00 ± 20% perf-profile.calltrace.cycles-pp.handle_edge_irq.handle_irq.do_IRQ.ret_from_intr.cpuidle_enter_state
13.97 ± 15% +7.1 21.10 ± 20% perf-profile.calltrace.cycles-pp.ret_from_intr.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
13.94 ± 15% +7.1 21.07 ± 20% perf-profile.calltrace.cycles-pp.do_IRQ.ret_from_intr.cpuidle_enter_state.do_idle.cpu_startup_entry
12.50 ± 17% +7.2 19.65 ± 20% perf-profile.calltrace.cycles-pp.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu
12.70 ± 17% +7.2 19.86 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_end_request.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu
12.48 ± 17% +7.2 19.65 ± 20% perf-profile.calltrace.cycles-pp.part_round_stats.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request.nvme_irq
12.46 ± 17% +7.2 19.63 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_in_flight.part_round_stats.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request
14.78 ± 18% +8.1 22.83 ± 20% perf-profile.calltrace.cycles-pp.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event
14.87 ± 18% +8.1 22.95 ± 21% perf-profile.calltrace.cycles-pp.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq
14.89 ± 18% +8.1 22.98 ± 21% perf-profile.calltrace.cycles-pp.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.handle_irq.do_IRQ
14.90 ± 18% +8.1 22.99 ± 21% perf-profile.calltrace.cycles-pp.handle_irq_event.handle_edge_irq.handle_irq.do_IRQ.ret_from_intr
14.88 ± 18% +8.1 22.97 ± 21% perf-profile.calltrace.cycles-pp.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.handle_irq
4.79 ± 22% -1.3 3.52 ± 9% perf-profile.children.cycles-pp.hrtimer_interrupt
3.04 ± 16% -0.7 2.30 ± 8% perf-profile.children.cycles-pp.__hrtimer_run_queues
1.98 ± 29% -0.7 1.29 ± 7% perf-profile.children.cycles-pp.tick_sched_timer
1.70 ± 27% -0.6 1.14 ± 9% perf-profile.children.cycles-pp.tick_sched_handle
1.57 ± 29% -0.5 1.03 ± 10% perf-profile.children.cycles-pp.update_process_times
3.02 ± 8% -0.5 2.52 ± 10% perf-profile.children.cycles-pp.menu_select
1.19 ± 19% -0.3 0.89 ± 10% perf-profile.children.cycles-pp.tick_nohz_next_event
0.81 ± 25% -0.2 0.56 ± 11% perf-profile.children.cycles-pp.scheduler_tick
0.42 ± 19% -0.1 0.30 ± 14% perf-profile.children.cycles-pp._raw_spin_lock
0.27 ± 13% -0.1 0.21 ± 15% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.11 ± 35% -0.0 0.07 ± 19% perf-profile.children.cycles-pp.run_local_timers
0.10 ± 15% -0.0 0.07 ± 28% perf-profile.children.cycles-pp.cpu_load_update
0.14 ± 9% -0.0 0.11 ± 15% perf-profile.children.cycles-pp.perf_event_task_tick
0.07 ± 17% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_flush_plug_list
0.07 ± 17% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_mq_flush_plug_list
0.06 ± 26% +0.0 0.11 ± 17% perf-profile.children.cycles-pp.read
0.07 ± 17% +0.0 0.11 ± 36% perf-profile.children.cycles-pp.deferred_split_scan
0.15 ± 14% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.blk_mq_sched_dispatch_requests
0.15 ± 16% +0.1 0.21 ± 15% perf-profile.children.cycles-pp.blk_mq_dispatch_rq_list
0.15 ± 14% +0.1 0.22 ± 14% perf-profile.children.cycles-pp.__blk_mq_run_hw_queue
0.08 ± 23% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.shrink_slab
0.08 ± 23% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.do_shrink_slab
0.72 ± 19% +0.3 1.00 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.44 ± 18% +0.3 0.74 ± 14% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.86 ± 18% +0.4 1.30 ± 9% perf-profile.children.cycles-pp.blk_mq_try_issue_directly
0.88 ± 18% +0.5 1.34 ± 9% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly
0.82 ± 19% +0.5 1.30 ± 9% perf-profile.children.cycles-pp.dma_pool_alloc
1.02 ± 15% +0.5 1.55 ± 9% perf-profile.children.cycles-pp.nvme_queue_rq
1.07 ± 15% +0.7 1.76 ± 21% perf-profile.children.cycles-pp.__indirect_thunk_start
2.42 ± 16% +0.7 3.16 ± 13% perf-profile.children.cycles-pp.find_next_bit
0.95 ± 26% +1.1 2.00 ± 15% perf-profile.children.cycles-pp.blk_account_io_start
2.19 ± 17% +1.5 3.72 ± 8% perf-profile.children.cycles-pp.blk_mq_make_request
2.20 ± 17% +1.5 3.73 ± 8% perf-profile.children.cycles-pp.submit_bio
2.20 ± 17% +1.5 3.73 ± 8% perf-profile.children.cycles-pp.generic_make_request
2.21 ± 17% +1.5 3.76 ± 8% perf-profile.children.cycles-pp.__swap_writepage
2.23 ± 17% +1.5 3.77 ± 7% perf-profile.children.cycles-pp.pageout
3.60 ± 13% +1.6 5.22 ± 7% perf-profile.children.cycles-pp.__alloc_pages_nodemask
3.51 ± 15% +1.6 5.15 ± 6% perf-profile.children.cycles-pp.shrink_page_list
3.48 ± 12% +1.6 5.13 ± 6% perf-profile.children.cycles-pp.do_try_to_free_pages
3.53 ± 14% +1.6 5.17 ± 6% perf-profile.children.cycles-pp.shrink_inactive_list
3.49 ± 12% +1.6 5.13 ± 6% perf-profile.children.cycles-pp.try_to_free_pages
3.51 ± 12% +1.7 5.19 ± 6% perf-profile.children.cycles-pp.__alloc_pages_slowpath
3.61 ± 14% +1.7 5.30 ± 6% perf-profile.children.cycles-pp.shrink_node_memcg
3.69 ± 15% +1.8 5.45 ± 7% perf-profile.children.cycles-pp.shrink_node
4.10 ± 17% +2.4 6.47 ± 18% perf-profile.children.cycles-pp.blk_mq_check_inflight
10.64 ± 16% +6.8 17.39 ± 17% perf-profile.children.cycles-pp.bt_iter
13.17 ± 16% +7.4 20.59 ± 18% perf-profile.children.cycles-pp.blk_account_io_done
13.39 ± 16% +7.4 20.81 ± 19% perf-profile.children.cycles-pp.blk_mq_end_request
15.67 ± 17% +8.2 23.84 ± 20% perf-profile.children.cycles-pp.handle_irq
15.66 ± 17% +8.2 23.83 ± 20% perf-profile.children.cycles-pp.handle_edge_irq
15.57 ± 17% +8.2 23.73 ± 20% perf-profile.children.cycles-pp.nvme_irq
15.60 ± 17% +8.2 23.77 ± 20% perf-profile.children.cycles-pp.handle_irq_event
15.58 ± 17% +8.2 23.75 ± 20% perf-profile.children.cycles-pp.__handle_irq_event_percpu
15.59 ± 17% +8.2 23.77 ± 20% perf-profile.children.cycles-pp.handle_irq_event_percpu
15.75 ± 17% +8.2 23.93 ± 20% perf-profile.children.cycles-pp.ret_from_intr
15.73 ± 17% +8.2 23.91 ± 20% perf-profile.children.cycles-pp.do_IRQ
15.54 ± 17% +8.2 23.73 ± 19% perf-profile.children.cycles-pp.blk_mq_complete_request
14.07 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.part_round_stats
14.05 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.blk_mq_queue_tag_busy_iter
14.05 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.blk_mq_in_flight
0.38 ± 20% -0.1 0.28 ± 16% perf-profile.self.cycles-pp._raw_spin_lock
0.10 ± 13% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.idle_cpu
0.12 ± 14% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.10 ± 15% -0.0 0.07 ± 28% perf-profile.self.cycles-pp.cpu_load_update
0.14 ± 9% -0.0 0.11 ± 15% perf-profile.self.cycles-pp.perf_event_task_tick
0.62 ± 16% +0.3 0.89 ± 12% perf-profile.self.cycles-pp.dma_pool_alloc
0.44 ± 18% +0.3 0.74 ± 14% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.81 ± 16% +0.5 1.32 ± 25% perf-profile.self.cycles-pp.__indirect_thunk_start
2.07 ± 16% +0.6 2.69 ± 12% perf-profile.self.cycles-pp.find_next_bit
1.77 ± 16% +1.1 2.91 ± 15% perf-profile.self.cycles-pp.blk_mq_queue_tag_busy_iter
3.82 ± 16% +2.2 6.00 ± 18% perf-profile.self.cycles-pp.blk_mq_check_inflight
6.43 ± 15% +4.1 10.56 ± 16% perf-profile.self.cycles-pp.bt_iter
vm-scalability.time.system_time
600 +-+-------------------------------------------------------------------+
| |
500 +-O OO |
O O OO |
| O O O O O O |
400 +-+ O O O O |
| |
300 +-+ .+.++. .+ .+ .+ .+.+ +.+ .++.+.++ .++.+.++. |
| ++ + :.+ + + + : +.+ : +.+ + .++.+ +.+ .|
200 +-+ + + : : : : + + |
|: : : : : |
|: :: : : |
100 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.time.maximum_resident_set_size
2.5e+07 +-+---------------------------------------------------------------+
| |
| ++.++.++.+. +. +. + +.++.+ +.++.+ .+.++. .++. .++.+ .+ |
2e+07 +-+ + .+ + +.+: : : : + ++ + + +.|
| : + : : : : |
| : : : : : |
1.5e+07 O-+O OO: : : : |
|: O O O O : : : : |
1e+07 +-+ O O O O OO O : : : : |
|:O O :: :: |
|: :: :: |
5e+06 +-+ : : |
| : : |
| : : |
0 +-+---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 9 months
[page cache] eb797a8ee0: vm-scalability.throughput -16.5% regression
by kernel test robot
Greeting,
FYI, we noticed a -16.5% regression of vm-scalability.throughput due to commit:
commit: eb797a8ee0ab4cd03df556980ce7bf167cadaa50 ("page cache: Rearrange address_space")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: vm-scalability
on test machine: 80 threads Skylake with 64G memory
with following parameters:
runtime: 300s
test: small-allocs
cpufreq_governor: performance
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
In addition to that, the commit also has significant impact on the following tests:
+------------------+----------------------------------------------------------------------+
| testcase: change | unixbench: unixbench.score 20.9% improvement |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=100% |
| | runtime=300s |
| | test=shell8 |
| | ucode=0xb00002e |
+------------------+----------------------------------------------------------------------+
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.2/debian-x86_64-2018-04-03.cgz/300s/lkp-skl-2sp2/small-allocs/vm-scalability
commit:
f32f004cdd ("ida: Convert to XArray")
eb797a8ee0 ("page cache: Rearrange address_space")
f32f004cddf86d63 eb797a8ee0ab4cd03df556980c
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
3:4 -13% 3:4 perf-profile.calltrace.cycles-pp.error_entry
3:4 -12% 3:4 perf-profile.children.cycles-pp.error_entry
1:4 -6% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
235891 -16.5% 197085 vm-scalability.median
18881481 -16.5% 15769081 vm-scalability.throughput
316.19 +14.4% 361.58 vm-scalability.time.elapsed_time
316.19 +14.4% 361.58 vm-scalability.time.elapsed_time.max
22924 +15.9% 26576 vm-scalability.time.system_time
3254041 ± 9% +36.4% 4437311 ± 3% vm-scalability.time.voluntary_context_switches
277831 ± 3% +9.5% 304359 interrupts.CAL:Function_call_interrupts
102367 ± 2% +10.1% 112694 ± 2% meminfo.Shmem
6.67 ± 5% -0.9 5.76 ± 2% mpstat.cpu.usr%
0.49 -5.0% 0.46 pmeter.Average_Active_Power
38678749 -12.1% 34005251 pmeter.performance_per_watt
2621420 ± 38% +59.2% 4173292 ± 3% turbostat.C1
62964314 ± 10% +18.7% 74735975 turbostat.IRQ
20821 ± 10% +20.6% 25103 ± 2% vmstat.system.cs
192700 ± 8% +5.9% 204006 vmstat.system.in
76742 +3.7% 79550 proc-vmstat.nr_active_anon
25578 ± 2% +10.1% 28154 ± 2% proc-vmstat.nr_shmem
76742 +3.7% 79550 proc-vmstat.nr_zone_active_anon
34211075 ± 14% +28.7% 44023085 ± 3% cpuidle.C1.time
2628057 ± 37% +59.1% 4179955 ± 3% cpuidle.C1.usage
200488 ± 20% +75.5% 351836 ± 13% cpuidle.POLL.time
57706 ± 49% +93.1% 111419 ± 18% cpuidle.POLL.usage
2.08 ± 14% +20.7% 2.51 ± 4% sched_debug.cfs_rq:/.nr_spread_over.avg
50.05 ± 36% -38.0% 31.04 ± 24% sched_debug.cpu.cpu_load[1].max
0.25 ± 14% +17.4% 0.29 ± 7% sched_debug.cpu.nr_running.stddev
42905 ± 12% +26.2% 54143 ± 3% sched_debug.cpu.nr_switches.avg
19996 ± 17% +43.0% 28586 ± 7% sched_debug.cpu.nr_switches.min
43774 ± 12% +26.5% 55370 ± 3% sched_debug.cpu.sched_count.avg
20285 ± 17% +43.1% 29024 ± 8% sched_debug.cpu.sched_count.min
19949 ± 12% +28.0% 25530 ± 3% sched_debug.cpu.sched_goidle.avg
9260 ± 16% +44.9% 13422 ± 8% sched_debug.cpu.sched_goidle.min
23108 ± 12% +26.0% 29110 ± 3% sched_debug.cpu.ttwu_count.avg
25905 ± 11% +25.8% 32593 ± 2% sched_debug.cpu.ttwu_count.max
21683 ± 12% +26.0% 27323 ± 3% sched_debug.cpu.ttwu_count.min
73.74 -3.6 70.12 perf-stat.cache-miss-rate%
2.83e+10 ± 2% +5.5% 2.985e+10 perf-stat.cache-misses
3.838e+10 +10.9% 4.257e+10 perf-stat.cache-references
6787110 ± 9% +35.5% 9197959 ± 3% perf-stat.context-switches
3.17 +11.1% 3.52 perf-stat.cpi
7.609e+13 +14.5% 8.715e+13 perf-stat.cpu-cycles
21380 +11.1% 23753 perf-stat.cpu-migrations
0.08 -0.0 0.07 perf-stat.dTLB-load-miss-rate%
6.634e+12 +3.8% 6.888e+12 perf-stat.dTLB-loads
0.13 -0.0 0.12 perf-stat.dTLB-store-miss-rate%
1.135e+09 -5.6% 1.071e+09 perf-stat.dTLB-store-misses
2.184e+09 -2.3% 2.135e+09 perf-stat.iTLB-load-misses
2.404e+13 +3.1% 2.479e+13 perf-stat.instructions
11006 +5.5% 11614 perf-stat.instructions-per-iTLB-miss
0.32 -10.0% 0.28 perf-stat.ipc
2.898e+09 +15.2% 3.337e+09 ± 2% perf-stat.node-load-misses
7.235e+08 +19.1% 8.615e+08 ± 4% perf-stat.node-store-misses
4975 +5.3% 5236 perf-stat.path-length
1.10 -0.1 0.97 ± 2% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link
0.68 ± 2% -0.1 0.59 perf-profile.calltrace.cycles-pp.vma_interval_tree_insert.vma_link.mmap_region.do_mmap.vm_mmap_pgoff
0.59 ± 3% -0.0 0.55 ± 2% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.task_numa_work.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.64 ± 2% +0.4 2.00 perf-profile.calltrace.cycles-pp.page_fault
1.57 ± 2% +0.4 1.93 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
1.59 ± 2% +0.4 1.96 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
0.65 +0.5 1.19 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.00 +1.0 1.03 ± 4% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.10 -0.1 0.97 ± 2% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.68 ± 2% -0.1 0.59 perf-profile.children.cycles-pp.vma_interval_tree_insert
0.62 ± 2% -0.1 0.55 ± 2% perf-profile.children.cycles-pp.native_irq_return_iret
0.47 -0.1 0.41 perf-profile.children.cycles-pp.sync_regs
0.32 ± 4% -0.1 0.27 ± 3% perf-profile.children.cycles-pp.get_unmapped_area
0.26 ± 3% -0.1 0.21 ± 3% perf-profile.children.cycles-pp.__perf_sw_event
0.21 ± 4% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.find_vma
0.27 ± 3% -0.0 0.22 ± 3% perf-profile.children.cycles-pp.unmapped_area_topdown
0.11 ± 42% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.29 ± 2% -0.0 0.24 ± 3% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.19 ± 4% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.___perf_sw_event
0.13 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.vma_policy_mof
0.59 ± 3% -0.0 0.56 ± 2% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.16 ± 2% -0.0 0.13 perf-profile.children.cycles-pp.__rb_insert_augmented
0.19 ± 2% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.perf_event_mmap
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.vmacache_find
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__fget
0.08 -0.0 0.07 ± 6% perf-profile.children.cycles-pp.d_path
0.09 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.__vma_link_rb
0.01 ±173% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.osq_unlock
1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop
1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.task_work_run
1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.task_numa_work
1.66 ± 2% +0.4 2.01 perf-profile.children.cycles-pp.page_fault
1.59 ± 2% +0.4 1.96 perf-profile.children.cycles-pp.do_page_fault
1.58 ± 2% +0.4 1.95 perf-profile.children.cycles-pp.__do_page_fault
0.66 +0.5 1.20 ± 4% perf-profile.children.cycles-pp.handle_mm_fault
0.47 +0.6 1.04 ± 4% perf-profile.children.cycles-pp.__handle_mm_fault
1.09 -0.1 0.96 ± 2% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.67 ± 2% -0.1 0.59 ± 2% perf-profile.self.cycles-pp.vma_interval_tree_insert
0.62 ± 2% -0.1 0.55 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret
0.46 -0.1 0.40 perf-profile.self.cycles-pp.sync_regs
0.43 -0.1 0.37 ± 2% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.30 ± 5% -0.1 0.25 ± 3% perf-profile.self.cycles-pp.__do_page_fault
0.11 ± 42% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.27 ± 3% -0.0 0.22 ± 3% perf-profile.self.cycles-pp.unmapped_area_topdown
0.17 ± 3% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.___perf_sw_event
0.14 ± 8% -0.0 0.11 perf-profile.self.cycles-pp.mmap_region
0.18 ± 2% -0.0 0.15 ± 2% perf-profile.self.cycles-pp.handle_mm_fault
0.15 -0.0 0.12 ± 4% perf-profile.self.cycles-pp.__rb_insert_augmented
0.12 ± 4% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.find_vma
0.08 ± 5% -0.0 0.06 perf-profile.self.cycles-pp.vma_policy_mof
0.08 ± 8% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.vmacache_find
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__fget
0.07 ± 6% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__perf_sw_event
0.06 -0.0 0.05 perf-profile.self.cycles-pp.d_path
0.08 ± 5% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.down_write
0.11 ± 4% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.up_write
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.__vma_link_rb
0.18 ± 9% +0.1 0.28 ± 6% perf-profile.self.cycles-pp.rwsem_down_write_failed
0.01 ±173% +0.1 0.12 ± 4% perf-profile.self.cycles-pp.osq_unlock
1.05 ± 4% +0.2 1.26 ± 2% perf-profile.self.cycles-pp.task_numa_work
0.35 ± 2% +0.6 0.95 ± 5% perf-profile.self.cycles-pp.__handle_mm_fault
vm-scalability.time.system_time
30000 +-+-----------------------------------------------------------------+
| O O |
25000 O-O O O O O O O O O O O O O O O O O O O O O |
|.+..+.+..+.+..+.+.+..+.+..+.+..+.+ .+..+.+.+..+.+..+.+..+.|
| : + + |
20000 +-+ : : : |
| : :: : |
15000 +-+ : : : : |
| : : : : |
10000 +-+ : : : : |
| : : : : |
| : : : : |
5000 +-+ :: :: |
| : : |
0 +-+-----------------------------------------------------------------+
vm-scalability.time.elapsed_time
400 +-+-------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O O O O |
350 +-+ |
300 +-++.+..+.+..+.+..+.+..+.+..+.+..+.+ + +..+.+..+.+..+.+..+.+..+.|
| : : : |
250 +-+ : :: : |
| : : : : |
200 +-+ : : : : |
| : : : : |
150 +-+ : : : : |
100 +-+ : : : : |
| : : : : |
50 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.time.elapsed_time.max
400 +-+-------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O O O O |
350 +-+ |
300 +-++.+..+.+..+.+..+.+..+.+..+.+..+.+ + +..+.+..+.+..+.+..+.+..+.|
| : : : |
250 +-+ : :: : |
| : : : : |
200 +-+ : : : : |
| : : : : |
150 +-+ : : : : |
100 +-+ : : : : |
| : : : : |
50 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.throughput
2e+07 +-+---------------------------------------------------------------+
1.8e+07 +-+..+.+.+..+.+..+.+.+..+.+.+..+.+ + +..+.+..+.+.+..+.+.+..+.|
| : : : |
1.6e+07 O-O O O O O O O O O O O O O O O O O O O O O O O |
1.4e+07 +-+ : :: : |
| : : : : |
1.2e+07 +-+ : : : : |
1e+07 +-+ : : : : |
8e+06 +-+ : : : : |
| : : : : |
6e+06 +-+ : : : : |
4e+06 +-+ :: : |
| : : |
2e+06 +-+ : : |
0 +-+---------------------------------------------------------------+
vm-scalability.median
250000 +-+----------------------------------------------------------------+
|.+..+.+..+.+.+..+.+..+.+.+..+ + + +.+..+.+..+.+.+..+.+..+.|
| : : : |
200000 O-O O O O O O O O O O O O O O O O O O O O O O O |
| : :: : |
| : : : : |
150000 +-+ : : : : |
| : : : : |
100000 +-+ : : : : |
| : : : : |
| : : : : |
50000 +-+ : :: |
| : : |
| : : |
0 +-+----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-bdw-ep3b: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.2/100%/debian-x86_64-2018-04-03.cgz/300s/lkp-bdw-ep3b/shell8/unixbench/0xb00002e
commit:
f32f004cdd ("ida: Convert to XArray")
eb797a8ee0 ("page cache: Rearrange address_space")
f32f004cddf86d63 eb797a8ee0ab4cd03df556980c
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at_ip___perf_sw_event/0x
:4 25% 1:4 dmesg.WARNING:at_ip__slab_free/0x
:4 25% 1:4 dmesg.WARNING:at_ip_filename_lookup/0x
1:4 -25% :4 dmesg.WARNING:at_ip_fsnotify/0x
1:4 -25% :4 dmesg.WARNING:at_ip_perf_event_mmap_output/0x
1:4 9% 2:4 perf-profile.children.cycles-pp.error_entry
1:4 7% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
39940 +20.9% 48288 unixbench.score
641.38 +1.0% 647.51 unixbench.time.elapsed_time
641.38 +1.0% 647.51 unixbench.time.elapsed_time.max
24220392 +29.1% 31263367 ± 2% unixbench.time.involuntary_context_switches
1.836e+09 +20.8% 2.217e+09 unixbench.time.minor_page_faults
7052 +2.1% 7200 unixbench.time.percent_of_cpu_this_job_got
36337 -2.7% 35347 unixbench.time.system_time
8893 +26.8% 11279 ± 2% unixbench.time.user_time
85632909 +4.3% 89281018 unixbench.time.voluntary_context_switches
15301176 +21.7% 18622462 unixbench.workload
42884872 +19.0% 51033794 softirqs.RCU
43387938 ± 6% -12.9% 37797790 ± 2% cpuidle.C1.usage
1155156 ± 4% -24.0% 878414 ± 4% cpuidle.POLL.usage
152008 ± 9% +15.2% 175048 ± 7% meminfo.DirectMap4k
255196 +13.6% 289806 meminfo.Shmem
100.25 +26.7% 127.00 ± 2% vmstat.procs.r
337268 +3.6% 349315 vmstat.system.cs
19.30 -1.7 17.59 mpstat.cpu.idle%
0.01 ± 30% +0.0 0.02 ± 35% mpstat.cpu.iowait%
15.54 +3.6 19.11 mpstat.cpu.usr%
7.086e+08 +20.8% 8.56e+08 ± 2% numa-numastat.node0.local_node
7.086e+08 +20.8% 8.561e+08 ± 2% numa-numastat.node0.numa_hit
7.053e+08 +21.3% 8.558e+08 numa-numastat.node1.local_node
7.053e+08 +21.3% 8.558e+08 numa-numastat.node1.numa_hit
2274 +2.1% 2322 turbostat.Avg_MHz
43383925 ± 6% -12.9% 37793914 ± 2% turbostat.C1
14.41 ± 2% -17.4% 11.90 ± 7% turbostat.CPU%c1
243.24 +2.2% 248.48 turbostat.PkgWatt
14.16 +8.1% 15.30 turbostat.RAMWatt
6807 ± 4% +48.1% 10084 ± 5% slabinfo.files_cache.active_objs
6807 ± 4% +48.2% 10090 ± 5% slabinfo.files_cache.num_objs
3616 +23.8% 4475 ± 5% slabinfo.kmalloc-256.active_objs
3616 +23.8% 4475 ± 5% slabinfo.kmalloc-256.num_objs
17134 ± 4% +13.8% 19493 ± 2% slabinfo.proc_inode_cache.active_objs
17134 ± 4% +14.0% 19524 ± 2% slabinfo.proc_inode_cache.num_objs
3393 ± 6% +17.7% 3994 ± 3% slabinfo.sock_inode_cache.active_objs
3393 ± 6% +17.7% 3994 ± 3% slabinfo.sock_inode_cache.num_objs
1241 ± 8% +15.0% 1427 ± 6% slabinfo.task_group.active_objs
1241 ± 8% +15.0% 1427 ± 6% slabinfo.task_group.num_objs
713963 ± 14% -20.9% 564405 ± 4% numa-meminfo.node0.FilePages
20539 ± 9% -19.7% 16496 ± 15% numa-meminfo.node0.Mapped
1281514 ± 9% -10.6% 1145886 ± 4% numa-meminfo.node0.MemUsed
683.75 ± 11% +54.1% 1053 ± 12% numa-meminfo.node0.Mlocked
48239 ± 4% -19.8% 38686 ± 17% numa-meminfo.node0.SReclaimable
669804 ± 15% +27.8% 856173 ± 3% numa-meminfo.node1.FilePages
4719 ± 56% +227.5% 15456 ± 43% numa-meminfo.node1.Inactive
4644 ± 57% +232.0% 15419 ± 43% numa-meminfo.node1.Inactive(anon)
14609 ± 12% +47.2% 21499 ± 11% numa-meminfo.node1.Mapped
40126 ± 6% +29.6% 52000 ± 12% numa-meminfo.node1.SReclaimable
119605 ± 96% +131.3% 276593 ± 3% numa-meminfo.node1.Shmem
130207 +18.0% 153583 ± 5% numa-meminfo.node1.Slab
547652 ± 4% +5.4% 577200 ± 4% numa-meminfo.node1.Unevictable
178549 ± 14% -21.0% 141123 ± 4% numa-vmstat.node0.nr_file_pages
5179 ± 9% -20.3% 4130 ± 16% numa-vmstat.node0.nr_mapped
170.50 ± 12% +54.5% 263.50 ± 13% numa-vmstat.node0.nr_mlock
12061 ± 4% -19.8% 9670 ± 17% numa-vmstat.node0.nr_slab_reclaimable
3.542e+08 +21.5% 4.304e+08 ± 2% numa-vmstat.node0.numa_hit
3.542e+08 +21.5% 4.304e+08 ± 2% numa-vmstat.node0.numa_local
167459 ± 15% +27.9% 214111 ± 3% numa-vmstat.node1.nr_file_pages
1150 ± 57% +234.3% 3845 ± 44% numa-vmstat.node1.nr_inactive_anon
3673 ± 11% +49.4% 5488 ± 13% numa-vmstat.node1.nr_mapped
29911 ± 96% +131.3% 69188 ± 3% numa-vmstat.node1.nr_shmem
10036 ± 6% +29.5% 13000 ± 12% numa-vmstat.node1.nr_slab_reclaimable
22541 +12.7% 25401 ± 3% numa-vmstat.node1.nr_slab_unreclaimable
136898 ± 4% +5.4% 144317 ± 4% numa-vmstat.node1.nr_unevictable
1150 ± 57% +234.3% 3845 ± 44% numa-vmstat.node1.nr_zone_inactive_anon
136898 ± 4% +5.4% 144317 ± 4% numa-vmstat.node1.nr_zone_unevictable
3.525e+08 +22.0% 4.301e+08 ± 2% numa-vmstat.node1.numa_hit
3.523e+08 +22.0% 4.299e+08 ± 2% numa-vmstat.node1.numa_local
149893 +6.3% 159383 proc-vmstat.nr_active_anon
345938 +2.7% 355212 proc-vmstat.nr_file_pages
6075 +9.3% 6643 proc-vmstat.nr_inactive_anon
30490 +2.2% 31159 proc-vmstat.nr_kernel_stack
8870 +8.1% 9585 proc-vmstat.nr_mapped
9254 +2.3% 9471 proc-vmstat.nr_page_table_pages
63803 +13.6% 72460 proc-vmstat.nr_shmem
22097 +2.6% 22671 proc-vmstat.nr_slab_reclaimable
47965 +6.9% 51274 proc-vmstat.nr_slab_unreclaimable
149893 +6.3% 159383 proc-vmstat.nr_zone_active_anon
6075 +9.3% 6643 proc-vmstat.nr_zone_inactive_anon
1.414e+09 +21.1% 1.712e+09 proc-vmstat.numa_hit
1.414e+09 +21.1% 1.712e+09 proc-vmstat.numa_local
47447 +10.8% 52569 proc-vmstat.pgactivate
1.487e+09 +21.1% 1.801e+09 proc-vmstat.pgalloc_normal
1.846e+09 +20.7% 2.228e+09 proc-vmstat.pgfault
1.487e+09 +21.1% 1.801e+09 proc-vmstat.pgfree
63795 +20.6% 76962 proc-vmstat.thp_deferred_split_page
63790 +20.6% 76940 proc-vmstat.thp_fault_alloc
26894638 +20.9% 32515246 proc-vmstat.unevictable_pgs_culled
1.556e+13 +4.9% 1.632e+13 perf-stat.branch-instructions
1.54 +0.2 1.75 perf-stat.branch-miss-rate%
2.399e+11 +19.4% 2.863e+11 perf-stat.branch-misses
1.034e+11 +17.1% 1.21e+11 ± 2% perf-stat.cache-misses
9.784e+11 +18.6% 1.161e+12 perf-stat.cache-references
2.18e+08 +4.6% 2.281e+08 perf-stat.context-switches
1.60 -1.0% 1.59 perf-stat.cpi
1.281e+14 +3.2% 1.322e+14 perf-stat.cpu-cycles
46095973 +22.0% 56220581 perf-stat.cpu-migrations
0.19 +0.0 0.23 ± 2% perf-stat.dTLB-load-miss-rate%
4.148e+10 +23.3% 5.113e+10 ± 2% perf-stat.dTLB-load-misses
2.213e+13 +2.1% 2.261e+13 perf-stat.dTLB-loads
5.537e+09 +22.2% 6.767e+09 ± 2% perf-stat.dTLB-store-misses
8.001e+12 +20.3% 9.625e+12 perf-stat.dTLB-stores
2.034e+10 +20.1% 2.443e+10 perf-stat.iTLB-load-misses
1.3e+10 +17.1% 1.522e+10 perf-stat.iTLB-loads
7.991e+13 +4.3% 8.332e+13 perf-stat.instructions
3929 -13.2% 3411 perf-stat.instructions-per-iTLB-miss
1.81e+09 +20.7% 2.184e+09 perf-stat.minor-faults
91.68 -2.3 89.39 perf-stat.node-load-miss-rate%
3.395e+10 +14.5% 3.889e+10 perf-stat.node-load-misses
3.083e+09 +49.7% 4.616e+09 ± 3% perf-stat.node-loads
1.018e+10 +20.2% 1.224e+10 ± 2% perf-stat.node-store-misses
8.896e+09 +21.3% 1.079e+10 ± 2% perf-stat.node-stores
1.81e+09 +20.7% 2.184e+09 perf-stat.page-faults
5222880 -14.3% 4475405 perf-stat.path-length
1942 ± 7% +37.3% 2665 ± 18% sched_debug.cfs_rq:/.exec_clock.stddev
47.72 ± 7% +18.8% 56.67 ± 2% sched_debug.cfs_rq:/.load_avg.avg
4.95 ± 9% +44.0% 7.14 ± 7% sched_debug.cfs_rq:/.load_avg.min
265960 ± 8% +36.3% 362493 ± 15% sched_debug.cfs_rq:/.min_vruntime.stddev
0.33 ± 6% -11.5% 0.29 ± 5% sched_debug.cfs_rq:/.nr_running.stddev
2.77 ± 7% +88.4% 5.23 ± 3% sched_debug.cfs_rq:/.nr_spread_over.avg
7.18 ± 5% +79.1% 12.86 ± 15% sched_debug.cfs_rq:/.nr_spread_over.max
0.27 ± 52% +358.3% 1.25 ± 25% sched_debug.cfs_rq:/.nr_spread_over.min
1.57 ± 2% +40.9% 2.21 ± 2% sched_debug.cfs_rq:/.nr_spread_over.stddev
27.36 ± 5% +13.2% 30.98 ± 6% sched_debug.cfs_rq:/.removed.load_avg.avg
1263 ± 5% +14.1% 1442 ± 6% sched_debug.cfs_rq:/.removed.runnable_sum.avg
265962 ± 8% +36.3% 362499 ± 15% sched_debug.cfs_rq:/.spread0.stddev
8169 ± 28% +64.2% 13411 ± 21% sched_debug.cpu.avg_idle.min
298.80 ± 11% +57.4% 470.43 ± 28% sched_debug.cpu.cpu_load[0].max
7.46 ± 5% +34.4% 10.03 ± 12% sched_debug.cpu.cpu_load[1].avg
212.55 ± 15% +52.5% 324.14 ± 17% sched_debug.cpu.cpu_load[1].max
25.69 ± 9% +52.4% 39.15 ± 19% sched_debug.cpu.cpu_load[1].stddev
7.18 ± 3% +32.7% 9.53 ± 5% sched_debug.cpu.cpu_load[2].avg
151.27 ± 16% +51.9% 229.80 ± 11% sched_debug.cpu.cpu_load[2].max
19.45 ± 11% +50.2% 29.22 ± 10% sched_debug.cpu.cpu_load[2].stddev
6.92 ± 2% +29.5% 8.96 ± 4% sched_debug.cpu.cpu_load[3].avg
106.45 ± 23% +52.6% 162.50 ± 15% sched_debug.cpu.cpu_load[3].max
14.94 ± 15% +48.0% 22.10 ± 10% sched_debug.cpu.cpu_load[3].stddev
6.45 ± 2% +25.9% 8.12 ± 6% sched_debug.cpu.cpu_load[4].avg
79.82 ± 34% +56.2% 124.64 ± 25% sched_debug.cpu.cpu_load[4].max
11.70 ± 23% +47.3% 17.23 ± 17% sched_debug.cpu.cpu_load[4].stddev
422565 ± 24% +22.7% 518276 ± 15% sched_debug.cpu.load.max
0.00 ± 3% +23.4% 0.00 ± 14% sched_debug.cpu.next_balance.stddev
1.14 ± 5% +31.4% 1.50 ± 7% sched_debug.cpu.nr_running.avg
3.16 ± 2% +38.1% 4.36 ± 9% sched_debug.cpu.nr_running.max
0.71 ± 2% +33.7% 0.95 ± 7% sched_debug.cpu.nr_running.stddev
39284 ± 7% +47.6% 57979 ± 20% sched_debug.cpu.nr_switches.stddev
1658 ± 12% +73.9% 2884 ± 11% sched_debug.cpu.nr_uninterruptible.max
-1902 +212.1% -5938 sched_debug.cpu.nr_uninterruptible.min
716.66 ± 9% +107.5% 1487 ± 30% sched_debug.cpu.nr_uninterruptible.stddev
43221 ± 7% +46.5% 63340 ± 18% sched_debug.cpu.sched_count.stddev
351785 ± 3% -14.1% 302212 sched_debug.cpu.sched_goidle.min
21765 ± 7% +51.5% 32969 ± 24% sched_debug.cpu.sched_goidle.stddev
148360 +23.9% 183753 ± 2% sched_debug.cpu.ttwu_local.avg
152765 +24.4% 190065 ± 2% sched_debug.cpu.ttwu_local.max
2051 ± 10% +87.1% 3838 ± 32% sched_debug.cpu.ttwu_local.stddev
0.00 ± 25% +2.1e+05% 0.56 ± 46% sched_debug.rt_rq:/.rt_time.avg
0.02 ± 25% +2.1e+05% 49.46 ± 46% sched_debug.rt_rq:/.rt_time.max
0.00 ± 25% +2.1e+05% 5.24 ± 46% sched_debug.rt_rq:/.rt_time.stddev
20.84 ± 2% -4.4 16.42 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.unlink_file_vma
21.69 ± 2% -4.4 17.32 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables
17.27 ± 2% -3.4 13.86 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.exit_mmap
17.44 -3.4 14.05 ± 3% perf-profile.calltrace.cycles-pp.down_write.unlink_file_vma.free_pgtables.exit_mmap.mmput
36.96 -3.1 33.88 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
36.94 -3.1 33.87 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.69 -2.2 10.53 ± 2% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.71 -2.2 10.55 ± 2% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.36 -2.0 11.41 perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
8.96 ± 2% -1.9 7.03 ± 3% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma
8.63 ± 2% -1.9 6.71 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.__vma_adjust
13.61 -1.9 11.71 perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.11 -1.8 6.36 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.copy_process
8.44 -1.7 6.70 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.copy_process._do_fork.do_syscall_64
8.44 -1.7 6.70 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.copy_process._do_fork
8.50 -1.7 6.76 ± 2% perf-profile.calltrace.cycles-pp.down_write.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.70 ± 2% -1.7 7.01 ± 3% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.flush_old_exec
9.06 -1.6 7.47 ± 2% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.do_exit
9.36 ± 2% -1.6 7.77 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.flush_old_exec.load_elf_binary
9.71 -1.5 8.21 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.do_exit.do_group_exit
6.71 ± 2% -1.5 5.26 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.mprotect_fixup
6.77 ± 2% -1.4 5.32 ± 3% perf-profile.calltrace.cycles-pp.down_write.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey
9.54 -1.3 8.23 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
10.17 -1.3 8.86 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64
9.31 -1.3 8.01 ± 4% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
10.04 -1.3 8.74 ± 3% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
7.63 ± 2% -1.3 6.33 ± 2% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect
10.04 -1.3 8.75 ± 3% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
10.04 -1.3 8.75 ± 3% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
7.34 -1.3 6.05 ± 2% perf-profile.calltrace.cycles-pp.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
7.71 ± 2% -1.3 6.43 ± 2% perf-profile.calltrace.cycles-pp.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64
10.84 -1.2 9.62 perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
8.01 ± 2% -1.2 6.80 ± 2% perf-profile.calltrace.cycles-pp.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.09 ± 2% -1.2 6.90 ± 2% perf-profile.calltrace.cycles-pp.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.10 ± 2% -1.2 6.90 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.17 -1.2 9.99 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork
11.16 -1.2 9.99 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
11.15 -1.2 9.98 perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
11.80 -1.1 10.73 perf-profile.calltrace.cycles-pp.__libc_fork
4.28 -1.1 3.21 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link
4.44 ± 2% -1.0 3.47 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.unmap_region
4.45 -1.0 3.49 ± 2% perf-profile.calltrace.cycles-pp.down_write.unlink_file_vma.free_pgtables.unmap_region.do_munmap
11.18 -1.0 10.22 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler
4.48 -1.0 3.52 ± 2% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.unmap_region.do_munmap.mmap_region
11.19 -1.0 10.23 perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file
4.43 -0.9 3.48 ± 8% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.vma_link.mmap_region.do_mmap
4.43 -0.9 3.48 ± 8% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link.mmap_region
4.67 -0.9 3.73 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.do_munmap.mmap_region.do_mmap
4.45 -0.9 3.51 ± 9% perf-profile.calltrace.cycles-pp.down_write.vma_link.mmap_region.do_mmap.vm_mmap_pgoff
11.30 -0.9 10.38 perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve
4.85 -0.9 3.98 ± 2% perf-profile.calltrace.cycles-pp.unmap_region.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff
5.40 -0.8 4.57 ± 2% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
2.25 -0.5 1.78 ± 3% perf-profile.calltrace.cycles-pp.down_write.__vma_adjust.__split_vma.do_munmap.mmap_region
2.25 -0.5 1.78 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.do_munmap
2.42 -0.4 1.98 ± 2% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.do_munmap.mmap_region.do_mmap
2.43 -0.4 1.99 ± 2% perf-profile.calltrace.cycles-pp.__split_vma.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff
13.17 -0.3 12.82 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
13.17 -0.3 12.83 perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
2.69 ± 2% -0.1 2.56 perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.56 +0.2 0.72 ± 2% perf-profile.calltrace.cycles-pp._IO_default_xsputn
0.63 +0.2 0.78 ± 3% perf-profile.calltrace.cycles-pp.copy_strings.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.75 +0.2 0.92 ± 2% perf-profile.calltrace.cycles-pp.wp_page_copy.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
0.82 +0.2 1.01 ± 2% perf-profile.calltrace.cycles-pp.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.94 ± 2% +0.2 1.16 perf-profile.calltrace.cycles-pp._dl_addr
0.64 ± 2% +0.2 0.87 ± 4% perf-profile.calltrace.cycles-pp.ret_from_fork
0.63 ± 2% +0.2 0.87 ± 4% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
0.67 ± 2% +0.2 0.91 ± 4% perf-profile.calltrace.cycles-pp.page_remove_rmap.unmap_page_range.unmap_vmas.exit_mmap.mmput
0.87 +0.2 1.12 ± 2% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.88 +0.2 1.13 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
0.70 ± 2% +0.3 0.96 ± 3% perf-profile.calltrace.cycles-pp.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec
1.10 +0.3 1.37 ± 2% perf-profile.calltrace.cycles-pp.__strcoll_l
0.70 ± 2% +0.3 0.97 ± 3% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec.load_elf_binary
1.04 +0.3 1.32 ± 2% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
0.89 +0.3 1.17 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.flush_old_exec
0.95 +0.3 1.25 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.flush_old_exec.load_elf_binary
1.15 +0.3 1.46 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
4.73 +0.3 5.04 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.15 +0.3 1.46 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.setlocale
1.07 +0.3 1.39 perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
1.09 ± 2% +0.3 1.42 perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
1.11 ± 2% +0.3 1.45 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.mmap64
1.11 +0.3 1.44 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
0.26 ±100% +0.3 0.60 perf-profile.calltrace.cycles-pp.copy_page_range.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.85 +0.3 5.19 perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.39 ± 57% +0.4 0.74 ± 3% perf-profile.calltrace.cycles-pp.wait4
1.20 +0.4 1.56 perf-profile.calltrace.cycles-pp.mmap64
13.89 +0.4 14.25 perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64
13.91 +0.4 14.28 perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.78 ± 2% +0.4 2.19 perf-profile.calltrace.cycles-pp.vfprintf.__vsnprintf_chk
0.55 ± 3% +0.4 0.99 ± 3% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.elf_map.load_elf_binary
0.60 ± 4% +0.5 1.06 ± 3% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.elf_map.load_elf_binary.search_binary_handler
0.66 ± 3% +0.5 1.12 ± 2% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.elf_map.load_elf_binary.search_binary_handler.__do_execve_file
5.43 +0.5 5.91 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
5.45 +0.5 5.92 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
0.00 +0.5 0.51 perf-profile.calltrace.cycles-pp.page_fault.setlocale
0.00 +0.5 0.51 ± 3% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
5.58 +0.5 6.09 perf-profile.calltrace.cycles-pp.page_fault
0.00 +0.5 0.52 ± 4% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork
0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.37 ± 2% +0.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit
1.38 ± 2% +0.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit
0.00 +0.5 0.53 ± 3% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +0.5 0.54 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.73 ± 2% +0.5 2.26 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit
0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
2.69 +0.5 3.24 perf-profile.calltrace.cycles-pp.__vsnprintf_chk
1.80 ± 2% +0.6 2.35 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit
0.00 +0.6 0.56 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +0.6 0.56 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
2.46 +0.6 3.03 ± 2% perf-profile.calltrace.cycles-pp.setlocale
0.00 +0.6 0.58 ± 3% perf-profile.calltrace.cycles-pp.write
0.00 +0.6 0.58 ± 2% perf-profile.calltrace.cycles-pp.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.12 ±173% +0.6 0.71 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait4
0.12 ±173% +0.6 0.71 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.6 0.61 ± 3% perf-profile.calltrace.cycles-pp.read
0.00 +0.6 0.61 ± 5% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.62 ± 5% perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.6 0.63 ± 4% perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
1.63 ± 2% +0.7 2.31 ± 5% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu_free.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap
0.00 +0.7 0.74 ± 3% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.elf_map
0.12 ±173% +0.8 0.91 ± 3% perf-profile.calltrace.cycles-pp.do_munmap.vm_munmap.elf_map.load_elf_binary.search_binary_handler
2.05 ± 2% +0.8 2.84 ± 4% perf-profile.calltrace.cycles-pp.tlb_flush_mmu_free.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput
0.13 ±173% +0.8 0.92 ± 4% perf-profile.calltrace.cycles-pp.vm_munmap.elf_map.load_elf_binary.search_binary_handler.__do_execve_file
15.67 +0.8 16.48 perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
15.71 +0.8 16.53 perf-profile.calltrace.cycles-pp.execve
1.16 ± 3% +0.9 2.05 ± 3% perf-profile.calltrace.cycles-pp.elf_map.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve
42.48 -8.6 33.85 ± 3% perf-profile.children.cycles-pp.osq_lock
44.24 -8.5 35.76 ± 2% perf-profile.children.cycles-pp.rwsem_down_write_failed
44.25 -8.5 35.78 ± 2% perf-profile.children.cycles-pp.call_rwsem_down_write_failed
44.77 -8.4 36.37 ± 2% perf-profile.children.cycles-pp.down_write
22.58 -4.1 18.50 ± 2% perf-profile.children.cycles-pp.unlink_file_vma
24.10 -3.9 20.25 ± 2% perf-profile.children.cycles-pp.free_pgtables
13.81 -1.8 11.97 perf-profile.children.cycles-pp.ksys_mmap_pgoff
69.44 -1.8 67.68 perf-profile.children.cycles-pp.do_syscall_64
69.50 -1.8 67.74 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
10.31 ± 2% -1.5 8.80 ± 2% perf-profile.children.cycles-pp.__vma_adjust
13.93 -1.5 12.43 perf-profile.children.cycles-pp.mmap_region
10.40 -1.5 8.90 ± 2% perf-profile.children.cycles-pp.__split_vma
14.23 -1.4 12.80 perf-profile.children.cycles-pp.do_mmap
14.44 -1.4 13.06 perf-profile.children.cycles-pp.vm_mmap_pgoff
9.67 -1.3 8.35 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
24.58 -1.3 23.26 perf-profile.children.cycles-pp.mmput
24.55 -1.3 23.24 perf-profile.children.cycles-pp.exit_mmap
9.44 -1.3 8.12 ± 4% perf-profile.children.cycles-pp.intel_idle
10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.secondary_startup_64
10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.do_idle
10.04 -1.3 8.75 ± 3% perf-profile.children.cycles-pp.start_secondary
11.07 -1.2 9.82 perf-profile.children.cycles-pp.copy_process
8.02 ± 2% -1.2 6.80 ± 2% perf-profile.children.cycles-pp.mprotect_fixup
11.38 -1.2 10.18 perf-profile.children.cycles-pp._do_fork
8.10 ± 2% -1.2 6.90 ± 2% perf-profile.children.cycles-pp.do_mprotect_pkey
8.10 ± 2% -1.2 6.90 ± 2% perf-profile.children.cycles-pp.__x64_sys_mprotect
11.84 -1.1 10.77 perf-profile.children.cycles-pp.__libc_fork
11.51 -0.9 10.57 perf-profile.children.cycles-pp.flush_old_exec
8.20 -0.8 7.44 perf-profile.children.cycles-pp.do_munmap
5.36 -0.6 4.79 perf-profile.children.cycles-pp.unmap_region
5.70 ± 2% -0.5 5.21 perf-profile.children.cycles-pp.filemap_map_pages
5.81 -0.4 5.39 perf-profile.children.cycles-pp.vma_link
0.29 ± 3% -0.1 0.15 perf-profile.children.cycles-pp.radix_tree_next_chunk
0.39 ± 3% -0.0 0.36 perf-profile.children.cycles-pp.time
0.16 ± 4% -0.0 0.13 perf-profile.children.cycles-pp.find_busiest_group
0.30 -0.0 0.29 perf-profile.children.cycles-pp.load_balance
0.23 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.__strcasecmp
0.17 -0.0 0.15 ± 3% perf-profile.children.cycles-pp.fopen
0.05 +0.0 0.06 perf-profile.children.cycles-pp.__put_task_struct
0.05 +0.0 0.06 perf-profile.children.cycles-pp.vm_brk_flags
0.05 +0.0 0.06 perf-profile.children.cycles-pp.__perf_event__output_id_sample
0.05 +0.0 0.06 perf-profile.children.cycles-pp.security_mmap_addr
0.05 +0.0 0.06 perf-profile.children.cycles-pp.selinux_file_open
0.06 +0.0 0.07 perf-profile.children.cycles-pp.__switch_to
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__x64_sys_pipe
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.do_pipe2
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.unmap_single_vma
0.07 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.__errno_location
0.05 +0.0 0.06 ± 6% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.perf_event_task_output
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.load_elf_phdrs
0.17 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.sched_ttwu_pending
0.06 ± 6% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.cpumask_next
0.06 +0.0 0.07 ± 5% perf-profile.children.cycles-pp.kfree
0.08 ± 6% +0.0 0.09 perf-profile.children.cycles-pp.do_signal
0.08 ± 6% +0.0 0.09 perf-profile.children.cycles-pp.memcpy
0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.__pipe
0.08 +0.0 0.10 ± 5% perf-profile.children.cycles-pp.vfs_getattr
0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.security_inode_getattr
0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.avc_has_perm
0.07 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.fsnotify
0.07 +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__tsearch
0.07 ± 7% +0.0 0.08 perf-profile.children.cycles-pp.memchr
0.05 ± 8% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.file_has_perm
0.05 ± 8% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__alloc_fd
0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.free_unref_page_commit
0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.up_read
0.29 +0.0 0.30 ± 2% perf-profile.children.cycles-pp.save_stack_trace_tsk
0.13 ± 3% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.pipe_wait
0.06 +0.0 0.08 ± 6% perf-profile.children.cycles-pp.__put_anon_vma
0.06 ± 11% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.wake_up_page_bit
0.05 ± 9% +0.0 0.07 perf-profile.children.cycles-pp.dup_fd
0.19 ± 2% +0.0 0.21 perf-profile.children.cycles-pp.dequeue_entity
0.10 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.move_queued_task
0.10 ± 7% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.__list_add_valid
0.08 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.find_next_bit
0.07 ± 5% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.arch_dup_task_struct
0.11 +0.0 0.13 ± 3% perf-profile.children.cycles-pp.find_get_entry
0.07 ± 10% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.cp_new_stat
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.load_new_mm_cr3
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.set_next_entity
0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__install_special_mapping
0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp._IO_setb
0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.trailing_symlink
0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.setup_new_exec
0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.perf_event_task
0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__legitimize_mnt
0.05 ± 8% +0.0 0.07 perf-profile.children.cycles-pp.vma_gap_callbacks_rotate
0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.security_file_free
0.05 ± 8% +0.0 0.07 perf-profile.children.cycles-pp.down_write_killable
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.available_idle_cpu
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp._vm_normal_page
0.08 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.expand_downwards
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp._copy_to_user
0.06 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.__unlock_page_memcg
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.security_file_alloc
0.17 ± 2% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.osq_unlock
0.10 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.finish_fault
0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.may_open
0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.perf_output_copy
0.10 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.selinux_mmap_file
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.try_charge
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.___slab_alloc
0.08 ± 6% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__pthread_once_slow
0.07 +0.0 0.09 perf-profile.children.cycles-pp.move_page_tables
0.07 +0.0 0.09 perf-profile.children.cycles-pp.touch_atime
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.queue_work_on
0.09 ± 7% +0.0 0.11 perf-profile.children.cycles-pp.filp_close
0.08 ± 8% +0.0 0.10 perf-profile.children.cycles-pp.selinux_vm_enough_memory
0.09 ± 4% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.sync_regs
0.08 +0.0 0.10 perf-profile.children.cycles-pp.__inode_security_revalidate
0.07 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.prepend_name
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.complete_walk
0.06 +0.0 0.08 ± 8% perf-profile.children.cycles-pp.unlock_page_memcg
0.06 ± 11% +0.0 0.08 perf-profile.children.cycles-pp.cred_has_capability
0.06 +0.0 0.08 perf-profile.children.cycles-pp.security_file_open
0.06 +0.0 0.08 perf-profile.children.cycles-pp.__queue_work
0.05 ± 8% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.copyin
0.06 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_stage2
0.06 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.simple_write_begin
0.06 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.security_file_permission
0.14 ± 5% +0.0 0.16 ± 2% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.13 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__anon_vma_prepare
0.10 ± 7% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.migration_cpu_stop
0.09 ± 7% +0.0 0.11 ± 3% perf-profile.children.cycles-pp._IO_file_close
0.09 +0.0 0.11 ± 3% perf-profile.children.cycles-pp.__call_rcu
0.07 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc_trace
0.11 ± 4% +0.0 0.13 perf-profile.children.cycles-pp.do_brk_flags
0.10 ± 8% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.prepare_creds
0.09 +0.0 0.11 ± 3% perf-profile.children.cycles-pp.put_task_stack
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__slab_alloc
0.09 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__x64_sys_brk
0.08 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.map_vdso
0.11 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.get_zeroed_page
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.anon_vma_interval_tree_remove
0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__libc_sigaction
0.11 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.cpu_stopper_thread
0.10 ± 5% +0.0 0.12 ± 5% perf-profile.children.cycles-pp.prepare_binprm
0.09 +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__d_alloc
0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.simple_lookup
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.vm_area_alloc
0.04 ± 57% +0.0 0.06 ± 6% perf-profile.children.cycles-pp.alloc_pid
0.11 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.brk
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.memset_erms
0.11 ± 3% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.__get_user_8
0.09 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.evict
0.15 ± 3% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.avc_has_perm_noaudit
0.13 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.sched_move_task
0.11 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.__dentry_kill
0.10 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.unmapped_area_topdown
0.10 ± 4% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.__snprintf_chk
0.09 ± 4% +0.0 0.11 ± 7% perf-profile.children.cycles-pp.select_idle_sibling
0.08 ± 5% +0.0 0.11 ± 8% perf-profile.children.cycles-pp.lockref_get_not_dead
0.07 +0.0 0.10 ± 4% perf-profile.children.cycles-pp.d_add
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.do_huge_pmd_anonymous_page
0.11 +0.0 0.14 ± 3% perf-profile.children.cycles-pp.fput
0.11 ± 6% +0.0 0.14 ± 3% perf-profile.children.cycles-pp._exit
0.12 ± 6% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.security_vm_enough_memory_mm
0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.free_pgd_range
0.11 ± 4% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.vm_area_dup
0.10 ± 7% +0.0 0.13 perf-profile.children.cycles-pp.vma_interval_tree_augment_rotate
0.10 ± 5% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.rcu_all_qs
0.09 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.munmap
0.08 ± 6% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__mmdrop
0.07 ± 6% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.truncate_inode_pages_range
0.04 ± 57% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.grab_cache_page_write_begin
0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__lru_cache_add
0.11 ± 4% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.prepend_path
0.14 ± 3% +0.0 0.17 ± 6% perf-profile.children.cycles-pp.security_mmap_file
0.14 ± 3% +0.0 0.17 ± 7% perf-profile.children.cycles-pp.mem_cgroup_try_charge
0.12 ± 3% +0.0 0.15 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.13 +0.0 0.16 ± 2% perf-profile.children.cycles-pp.lockref_put_or_lock
0.14 ± 6% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.kernel_read
0.12 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.__put_user_4
0.09 +0.0 0.12 ± 8% perf-profile.children.cycles-pp.file_free_rcu
0.11 ± 4% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.__x64_sys_close
0.20 ± 3% +0.0 0.23 ± 2% perf-profile.children.cycles-pp.update_load_avg
0.16 +0.0 0.20 ± 5% perf-profile.children.cycles-pp.vfs_statx_fd
0.17 ± 3% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.d_path
0.15 ± 3% +0.0 0.19 ± 3% perf-profile.children.cycles-pp.stop_one_cpu
0.16 +0.0 0.20 ± 2% perf-profile.children.cycles-pp.anon_vma_clone
0.16 ± 2% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.vma_compute_subtree_gap
0.16 ± 2% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.getenv
0.15 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp._init
0.14 ± 5% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.__pud_alloc
0.12 ± 4% +0.0 0.16 ± 4% perf-profile.children.cycles-pp.__getrlimit
0.09 +0.0 0.12 ± 4% perf-profile.children.cycles-pp.wake_q_add
0.30 ± 2% +0.0 0.34 ± 3% perf-profile.children.cycles-pp.strchrnul
0.18 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.open_exec
0.14 +0.0 0.18 ± 2% perf-profile.children.cycles-pp.shift_arg_pages
0.14 ± 5% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.preempt_schedule_common
0.19 ± 4% +0.0 0.23 perf-profile.children.cycles-pp.getname_flags
0.17 ± 4% +0.0 0.21 ± 2% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.14 ± 3% +0.0 0.18 ± 5% perf-profile.children.cycles-pp.__might_fault
0.15 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.perf_event_mmap_output
0.13 ± 6% +0.0 0.17 ± 5% perf-profile.children.cycles-pp.dentry_kill
0.13 ± 5% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.13 ± 3% +0.0 0.17 ± 3% perf-profile.children.cycles-pp.do_unlinkat
0.11 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.inode_permission
0.14 ± 5% +0.0 0.18 perf-profile.children.cycles-pp.free_pcppages_bulk
0.08 +0.0 0.12 ± 11% perf-profile.children.cycles-pp.rcu_cblist_dequeue
0.23 ± 2% +0.0 0.27 ± 4% perf-profile.children.cycles-pp.ptep_clear_flush
0.18 ± 4% +0.0 0.22 perf-profile.children.cycles-pp.change_protection_range
0.16 ± 2% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.memcpy_erms
0.15 ± 3% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.pagecache_get_page
0.14 ± 3% +0.0 0.18 ± 4% perf-profile.children.cycles-pp.legitimize_path
0.39 ± 2% +0.0 0.43 ± 3% perf-profile.children.cycles-pp.malloc
0.54 +0.0 0.58 perf-profile.children.cycles-pp.ttwu_do_activate
0.25 ± 3% +0.0 0.29 perf-profile.children.cycles-pp.dequeue_task_fair
0.19 ± 2% +0.0 0.23 ± 3% perf-profile.children.cycles-pp._copy_from_user
0.18 ± 2% +0.0 0.22 ± 3% perf-profile.children.cycles-pp.vmacache_find
0.18 ± 2% +0.0 0.22 perf-profile.children.cycles-pp.open64
0.14 ± 3% +0.0 0.18 perf-profile.children.cycles-pp.lock_page_memcg
0.01 ±173% +0.0 0.05 ± 9% perf-profile.children.cycles-pp.__follow_mount_rcu
0.21 ± 6% +0.0 0.26 ± 3% perf-profile.children.cycles-pp._IO_file_xsputn
0.17 ± 3% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.signal_wake_up_state
0.14 ± 3% +0.0 0.18 ± 3% perf-profile.children.cycles-pp.count
0.13 ± 3% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.unlinkat
0.11 ± 7% +0.0 0.15 ± 9% perf-profile.children.cycles-pp.__get_vm_area_node
0.09 ± 4% +0.0 0.14 ± 13% perf-profile.children.cycles-pp.alloc_vmap_area
0.20 ± 2% +0.0 0.24 ± 3% perf-profile.children.cycles-pp.__vma_link_rb
0.17 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.schedule_tail
0.14 ± 3% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.__rb_erase_color
0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.insert_vm_struct
0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.put_prev_entity
0.19 ± 2% +0.0 0.24 ± 2% perf-profile.children.cycles-pp.copy_strings_kernel
0.19 ± 2% +0.0 0.24 ± 5% perf-profile.children.cycles-pp.setup_arg_pages
0.17 ± 4% +0.0 0.22 perf-profile.children.cycles-pp.__pmd_alloc
0.15 ± 3% +0.0 0.19 ± 5% perf-profile.children.cycles-pp.unlazy_walk
0.14 ± 5% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.__get_free_pages
0.01 ±173% +0.0 0.06 perf-profile.children.cycles-pp.__free_pages_ok
0.15 +0.0 0.20 ± 4% perf-profile.children.cycles-pp.mark_page_accessed
0.15 ± 2% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.d_alloc
0.57 +0.0 0.61 perf-profile.children.cycles-pp.enqueue_entity
0.23 +0.0 0.28 ± 4% perf-profile.children.cycles-pp.__do_sys_newfstat
0.16 ± 5% +0.0 0.21 ± 6% perf-profile.children.cycles-pp.__generic_file_write_iter
0.15 ± 7% +0.0 0.20 ± 5% perf-profile.children.cycles-pp.generic_perform_write
0.00 +0.1 0.05 perf-profile.children.cycles-pp.vma_merge
0.00 +0.1 0.05 perf-profile.children.cycles-pp.free_one_page
0.00 +0.1 0.05 perf-profile.children.cycles-pp.rcu_segcblist_enqueue
0.00 +0.1 0.05 perf-profile.children.cycles-pp.__fget_light
0.17 ± 7% +0.1 0.22 ± 5% perf-profile.children.cycles-pp.generic_file_write_iter
0.24 ± 2% +0.1 0.30 ± 3% perf-profile.children.cycles-pp.anon_vma_fork
0.19 ± 3% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay
0.19 +0.1 0.24 ± 3% perf-profile.children.cycles-pp.finish_task_switch
0.18 ± 2% +0.1 0.24 ± 3% perf-profile.children.cycles-pp.__send_signal
0.18 ± 2% +0.1 0.23 ± 2% perf-profile.children.cycles-pp.__pagevec_lru_add_fn
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__pagevec_release
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__perf_event_header__init_id
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.check_preempt_curr
0.21 ± 2% +0.1 0.27 ± 5% perf-profile.children.cycles-pp.autoremove_wake_function
0.21 ± 3% +0.1 0.27 ± 3% perf-profile.children.cycles-pp.generic_file_read_iter
0.30 ± 2% +0.1 0.36 ± 3% perf-profile.children.cycles-pp.wake_up_new_task
0.25 +0.1 0.30 perf-profile.children.cycles-pp.get_unmapped_area
0.19 ± 3% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.get_user_arg_ptr
0.17 ± 2% +0.1 0.22 ± 3% perf-profile.children.cycles-pp.pgd_alloc
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.page_add_new_anon_rmap
0.21 ± 2% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.__might_sleep
0.31 +0.1 0.36 perf-profile.children.cycles-pp.native_flush_tlb_one_user
0.26 ± 3% +0.1 0.31 ± 2% perf-profile.children.cycles-pp.do_open_execat
0.20 ± 4% +0.1 0.25 ± 7% perf-profile.children.cycles-pp.__vmalloc_node_range
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.__mod_node_page_state
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.anon_vma_interval_tree_insert
0.22 +0.1 0.28 ± 4% perf-profile.children.cycles-pp.__wake_up_common_lock
0.22 ± 3% +0.1 0.28 ± 4% perf-profile.children.cycles-pp.do_notify_parent
0.28 ± 2% +0.1 0.34 ± 5% perf-profile.children.cycles-pp.__rb_insert_augmented
0.23 ± 2% +0.1 0.29 perf-profile.children.cycles-pp.strlen
0.19 ± 2% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.copyout
0.19 ± 4% +0.1 0.25 ± 3% perf-profile.children.cycles-pp.mm_init
0.64 +0.1 0.70 perf-profile.children.cycles-pp.enqueue_task_fair
0.29 ± 2% +0.1 0.35 ± 3% perf-profile.children.cycles-pp.___perf_sw_event
0.24 ± 2% +0.1 0.30 ± 3% perf-profile.children.cycles-pp.terminate_walk
0.26 ± 3% +0.1 0.33 perf-profile.children.cycles-pp.free_unref_page_list
0.23 +0.1 0.30 ± 5% perf-profile.children.cycles-pp.__wake_up_common
0.32 +0.1 0.38 perf-profile.children.cycles-pp.__perf_sw_event
0.28 ± 2% +0.1 0.35 ± 4% perf-profile.children.cycles-pp.get_user_pages_remote
0.25 ± 2% +0.1 0.32 ± 4% perf-profile.children.cycles-pp.pipe_write
0.22 ± 3% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.copy_page_to_iter
0.23 ± 2% +0.1 0.29 ± 2% perf-profile.children.cycles-pp._IO_file_open
0.32 ± 3% +0.1 0.38 ± 2% perf-profile.children.cycles-pp._fini
0.28 +0.1 0.34 ± 4% perf-profile.children.cycles-pp.__get_user_pages
0.34 ± 2% +0.1 0.41 perf-profile.children.cycles-pp.unlock_page
0.30 ± 2% +0.1 0.36 ± 4% perf-profile.children.cycles-pp.__pte_alloc
0.32 +0.1 0.39 perf-profile.children.cycles-pp.vma_interval_tree_remove
0.29 ± 2% +0.1 0.36 ± 3% perf-profile.children.cycles-pp.pipe_read
0.23 +0.1 0.30 ± 2% perf-profile.children.cycles-pp.do_dentry_open
0.10 ± 5% +0.1 0.16 ± 10% perf-profile.children.cycles-pp.run_ksoftirqd
0.22 ± 3% +0.1 0.29 ± 3% perf-profile.children.cycles-pp.d_alloc_parallel
0.39 +0.1 0.46 ± 3% perf-profile.children.cycles-pp.__fxstat64
0.34 +0.1 0.41 perf-profile.children.cycles-pp.flush_tlb_func_common
0.27 ± 3% +0.1 0.34 ± 3% perf-profile.children.cycles-pp.__d_lookup_rcu
0.34 ± 2% +0.1 0.41 ± 2% perf-profile.children.cycles-pp._IO_padn
0.16 ± 2% +0.1 0.23 ± 3% perf-profile.children.cycles-pp.release_task
0.24 +0.1 0.31 ± 3% perf-profile.children.cycles-pp.__lookup_slow
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.do_prlimit
0.32 +0.1 0.40 ± 2% perf-profile.children.cycles-pp.selinux_inode_permission
0.39 ± 2% +0.1 0.46 ± 2% perf-profile.children.cycles-pp.find_vma
0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.__x64_sys_getrlimit
0.59 +0.1 0.67 ± 2% perf-profile.children.cycles-pp.schedule
0.28 +0.1 0.36 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid
0.35 ± 2% +0.1 0.42 ± 2% perf-profile.children.cycles-pp.security_inode_permission
0.32 ± 3% +0.1 0.40 ± 3% perf-profile.children.cycles-pp.__do_sys_newstat
0.27 ± 3% +0.1 0.35 ± 2% perf-profile.children.cycles-pp.lookup_slow
0.33 ± 2% +0.1 0.41 ± 2% perf-profile.children.cycles-pp._cond_resched
0.32 +0.1 0.40 ± 3% perf-profile.children.cycles-pp.remove_vma
0.30 ± 2% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.perf_iterate_sb
0.13 ± 5% +0.1 0.21 ± 14% perf-profile.children.cycles-pp.find_vmap_area
0.33 ± 3% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.vfs_statx
0.39 ± 2% +0.1 0.47 ± 2% perf-profile.children.cycles-pp._IO_fwrite
0.29 ± 2% +0.1 0.38 ± 3% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.18 ± 8% +0.1 0.27 ± 12% perf-profile.children.cycles-pp.__vunmap
0.43 +0.1 0.52 ± 2% perf-profile.children.cycles-pp.flush_tlb_mm_range
0.37 ± 3% +0.1 0.46 ± 4% perf-profile.children.cycles-pp.___might_sleep
0.40 ± 3% +0.1 0.49 ± 2% perf-profile.children.cycles-pp.__slab_free
0.29 +0.1 0.38 ± 2% perf-profile.children.cycles-pp.create_elf_tables
0.18 ± 7% +0.1 0.27 ± 10% perf-profile.children.cycles-pp.free_work
0.37 ± 2% +0.1 0.46 perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.18 ± 4% +0.1 0.28 ± 4% perf-profile.children.cycles-pp.wait_consider_task
0.39 ± 2% +0.1 0.48 ± 3% perf-profile.children.cycles-pp.__xstat64
0.39 +0.1 0.48 ± 2% perf-profile.children.cycles-pp.pte_alloc_one
0.29 ± 2% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.__alloc_file
0.40 ± 2% +0.1 0.49 ± 2% perf-profile.children.cycles-pp.unlink_anon_vmas
0.32 ± 2% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.alloc_empty_file
0.44 +0.1 0.54 perf-profile.children.cycles-pp.page_add_file_rmap
0.41 ± 2% +0.1 0.51 ± 2% perf-profile.children.cycles-pp.sched_exec
0.39 +0.1 0.48 perf-profile.children.cycles-pp.copy_page
0.31 ± 3% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.52 +0.1 0.62 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret
0.20 ± 6% +0.1 0.30 ± 9% perf-profile.children.cycles-pp.process_one_work
0.36 ± 2% +0.1 0.47 ± 3% perf-profile.children.cycles-pp.__fput
0.51 +0.1 0.62 ± 2% perf-profile.children.cycles-pp.copy_page_range
0.40 ± 2% +0.1 0.50 ± 3% perf-profile.children.cycles-pp.__clear_user
0.36 ± 2% +0.1 0.47 perf-profile.children.cycles-pp.__x64_sys_munmap
0.35 +0.1 0.46 perf-profile.children.cycles-pp.strnlen_user
0.23 ± 5% +0.1 0.34 ± 9% perf-profile.children.cycles-pp.worker_thread
0.48 ± 2% +0.1 0.59 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.40 ± 2% +0.1 0.51 ± 3% perf-profile.children.cycles-pp.dput
0.44 +0.1 0.55 ± 4% perf-profile.children.cycles-pp.lookup_fast
1.14 +0.1 1.25 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start
0.42 ± 2% +0.1 0.54 ± 2% perf-profile.children.cycles-pp.free_pages_and_swap_cache
1.08 ± 2% +0.1 1.20 ± 2% perf-profile.children.cycles-pp.__sched_text_start
0.51 +0.1 0.63 ± 2% perf-profile.children.cycles-pp.ksys_read
0.40 +0.1 0.52 ± 4% perf-profile.children.cycles-pp.smpboot_thread_fn
0.46 +0.1 0.58 ± 3% perf-profile.children.cycles-pp.write
0.49 +0.1 0.62 ± 3% perf-profile.children.cycles-pp.read
0.42 ± 2% +0.1 0.55 ± 3% perf-profile.children.cycles-pp.__vfs_write
0.44 +0.1 0.57 ± 2% perf-profile.children.cycles-pp.task_work_run
0.99 ± 2% +0.1 1.12 ± 4% perf-profile.children.cycles-pp.rcu_process_callbacks
0.55 ± 2% +0.1 0.67 ± 2% perf-profile.children.cycles-pp.kmem_cache_free
0.54 +0.1 0.66 ± 3% perf-profile.children.cycles-pp.__vfs_read
0.62 +0.1 0.75 ± 3% perf-profile.children.cycles-pp.select_task_rq_fair
0.46 +0.1 0.59 ± 4% perf-profile.children.cycles-pp.vfs_write
0.45 ± 2% +0.1 0.58 ± 2% perf-profile.children.cycles-pp.do_faccessat
0.47 +0.1 0.60 ± 3% perf-profile.children.cycles-pp.ksys_write
0.15 ± 6% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.queued_write_lock_slowpath
0.14 ± 8% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.queued_read_lock_slowpath
0.51 ± 3% +0.1 0.65 perf-profile.children.cycles-pp.kmem_cache_alloc
0.58 +0.1 0.72 ± 2% perf-profile.children.cycles-pp.__entry_SYSCALL_64_trampoline
0.62 +0.1 0.77 perf-profile.children.cycles-pp.vfs_read
0.63 +0.2 0.78 ± 2% perf-profile.children.cycles-pp.perf_event_mmap
0.62 +0.2 0.77 ± 2% perf-profile.children.cycles-pp.alloc_pages_vma
0.35 ± 4% +0.2 0.51 ± 4% perf-profile.children.cycles-pp.lru_add_drain
0.35 ± 3% +0.2 0.52 ± 5% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.60 ± 2% +0.2 0.78 ± 2% perf-profile.children.cycles-pp.path_lookupat
0.62 ± 2% +0.2 0.80 ± 2% perf-profile.children.cycles-pp.filename_lookup
0.43 ± 2% +0.2 0.61 ± 3% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.64 +0.2 0.83 ± 3% perf-profile.children.cycles-pp.walk_component
0.75 ± 2% +0.2 0.95 ± 2% perf-profile.children.cycles-pp._IO_default_xsputn
0.86 +0.2 1.07 ± 3% perf-profile.children.cycles-pp.clear_page_erms
0.84 +0.2 1.04 ± 3% perf-profile.children.cycles-pp.copy_strings
0.41 ± 4% +0.2 0.62 ± 5% perf-profile.children.cycles-pp.do_wait
0.43 ± 5% +0.2 0.64 ± 5% perf-profile.children.cycles-pp.__do_sys_wait4
0.42 ± 4% +0.2 0.64 ± 5% perf-profile.children.cycles-pp.kernel_wait4
0.95 ± 2% +0.2 1.16 perf-profile.children.cycles-pp._dl_addr
0.95 +0.2 1.17 ± 2% perf-profile.children.cycles-pp.wp_page_copy
0.80 +0.2 1.02 ± 2% perf-profile.children.cycles-pp.link_path_walk
0.93 +0.2 1.16 perf-profile.children.cycles-pp.vma_interval_tree_insert
0.95 +0.2 1.18 perf-profile.children.cycles-pp.alloc_set_pte
0.51 ± 3% +0.2 0.74 ± 3% perf-profile.children.cycles-pp.wait4
0.63 ± 2% +0.2 0.87 ± 4% perf-profile.children.cycles-pp.kthread
1.04 +0.2 1.27 ± 2% perf-profile.children.cycles-pp.do_wp_page
1.29 +0.2 1.54 ± 3% perf-profile.children.cycles-pp.wake_up_q
2.06 +0.3 2.33 ± 2% perf-profile.children.cycles-pp.up_write
9.02 +0.3 9.29 perf-profile.children.cycles-pp.handle_mm_fault
1.53 +0.3 1.79 ± 2% perf-profile.children.cycles-pp.rwsem_wake
0.81 +0.3 1.08 ± 3% perf-profile.children.cycles-pp.ret_from_fork
1.53 +0.3 1.81 ± 2% perf-profile.children.cycles-pp.call_rwsem_wake
1.10 +0.3 1.38 ± 2% perf-profile.children.cycles-pp.__strcoll_l
0.81 ± 2% +0.3 1.08 ± 4% perf-profile.children.cycles-pp._raw_spin_lock
0.93 +0.3 1.23 perf-profile.children.cycles-pp.rwsem_spin_on_owner
1.24 +0.3 1.54 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist
1.35 +0.3 1.69 ± 3% perf-profile.children.cycles-pp.__alloc_pages_nodemask
1.68 +0.4 2.04 ± 3% perf-profile.children.cycles-pp.try_to_wake_up
1.22 +0.4 1.58 perf-profile.children.cycles-pp.mmap64
14.16 +0.4 14.53 perf-profile.children.cycles-pp.load_elf_binary
1.05 ± 2% +0.4 1.42 ± 4% perf-profile.children.cycles-pp.page_remove_rmap
14.19 +0.4 14.56 perf-profile.children.cycles-pp.search_binary_handler
2.09 ± 2% +0.4 2.52 perf-profile.children.cycles-pp.vfprintf
9.80 +0.5 10.26 perf-profile.children.cycles-pp.__do_page_fault
9.82 +0.5 10.29 perf-profile.children.cycles-pp.do_page_fault
1.27 ± 2% +0.5 1.79 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.96 +0.5 2.49 ± 2% perf-profile.children.cycles-pp.path_openat
2.01 +0.5 2.54 perf-profile.children.cycles-pp.do_sys_open
1.98 +0.5 2.52 ± 2% perf-profile.children.cycles-pp.do_filp_open
0.86 ± 2% +0.5 1.40 ± 2% perf-profile.children.cycles-pp.vm_munmap
10.22 +0.6 10.78 perf-profile.children.cycles-pp.page_fault
2.73 +0.6 3.29 perf-profile.children.cycles-pp.__vsnprintf_chk
2.76 +0.6 3.39 ± 2% perf-profile.children.cycles-pp.setlocale
1.77 ± 2% +0.7 2.50 ± 4% perf-profile.children.cycles-pp.release_pages
1.47 +0.8 2.27 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
2.12 ± 2% +0.8 2.93 ± 4% perf-profile.children.cycles-pp.tlb_flush_mmu_free
15.71 +0.8 16.53 perf-profile.children.cycles-pp.execve
16.01 +0.8 16.84 perf-profile.children.cycles-pp.__do_execve_file
16.02 +0.8 16.86 perf-profile.children.cycles-pp.__x64_sys_execve
2.24 ± 2% +0.8 3.09 ± 4% perf-profile.children.cycles-pp.arch_tlb_finish_mmu
2.25 ± 2% +0.8 3.10 ± 4% perf-profile.children.cycles-pp.tlb_finish_mmu
2.77 +0.9 3.62 ± 3% perf-profile.children.cycles-pp.unmap_page_range
2.89 +0.9 3.77 ± 3% perf-profile.children.cycles-pp.unmap_vmas
1.18 ± 3% +0.9 2.09 ± 2% perf-profile.children.cycles-pp.elf_map
41.69 -8.5 33.23 ± 3% perf-profile.self.cycles-pp.osq_lock
9.44 -1.3 8.12 ± 4% perf-profile.self.cycles-pp.intel_idle
4.14 ± 2% -0.6 3.53 perf-profile.self.cycles-pp.filemap_map_pages
0.54 ± 2% -0.2 0.37 perf-profile.self.cycles-pp.rwsem_down_write_failed
0.28 ± 3% -0.1 0.15 ± 2% perf-profile.self.cycles-pp.radix_tree_next_chunk
0.13 ± 6% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.find_busiest_group
0.05 +0.0 0.06 perf-profile.self.cycles-pp.anon_vma_fork
0.05 +0.0 0.06 perf-profile.self.cycles-pp.__call_rcu
0.05 +0.0 0.06 perf-profile.self.cycles-pp.__unlock_page_memcg
0.06 +0.0 0.07 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.06 +0.0 0.07 perf-profile.self.cycles-pp.do_wp_page
0.06 +0.0 0.07 perf-profile.self.cycles-pp.kfree
0.06 +0.0 0.07 perf-profile.self.cycles-pp.__switch_to
0.07 ± 5% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.find_next_bit
0.07 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__tsearch
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.path_openat
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.d_alloc_parallel
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.unlock_page_memcg
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.up_read
0.06 +0.0 0.07 ± 5% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.06 ± 6% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.__perf_sw_event
0.06 ± 7% +0.0 0.07 perf-profile.self.cycles-pp.strncpy_from_user
0.09 ± 4% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.update_load_avg
0.07 +0.0 0.09 ± 5% perf-profile.self.cycles-pp.find_get_entry
0.05 +0.0 0.07 ± 7% perf-profile.self.cycles-pp.__d_alloc
0.05 ± 9% +0.0 0.07 perf-profile.self.cycles-pp.create_elf_tables
0.17 ± 3% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.osq_unlock
0.07 ± 11% +0.0 0.09 perf-profile.self.cycles-pp.__alloc_pages_nodemask
0.07 ± 5% +0.0 0.09 perf-profile.self.cycles-pp.getenv
0.07 ± 11% +0.0 0.09 perf-profile.self.cycles-pp._vm_normal_page
0.11 ± 7% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.__sched_text_start
0.09 ± 4% +0.0 0.11 ± 6% perf-profile.self.cycles-pp._cond_resched
0.09 ± 4% +0.0 0.11 perf-profile.self.cycles-pp.__list_add_valid
0.08 ± 5% +0.0 0.10 perf-profile.self.cycles-pp.perf_iterate_sb
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__vma_adjust
0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.sync_regs
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.load_new_mm_cr3
0.06 ± 6% +0.0 0.08 perf-profile.self.cycles-pp._IO_setb
0.05 +0.0 0.07 ± 6% perf-profile.self.cycles-pp.__legitimize_mnt
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__libc_fork
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.change_protection_range
0.06 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.memchr
0.08 ± 6% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.anon_vma_interval_tree_remove
0.07 ± 12% +0.0 0.09 ± 9% perf-profile.self.cycles-pp.try_charge
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.inode_permission
0.07 +0.0 0.09 perf-profile.self.cycles-pp.avc_has_perm
0.08 +0.0 0.10 ± 7% perf-profile.self.cycles-pp.free_pgd_range
0.07 ± 7% +0.0 0.09 ± 5% perf-profile.self.cycles-pp.prepend_name
0.05 ± 8% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_stage2
0.08 ± 10% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.available_idle_cpu
0.10 ± 8% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.unlink_anon_vmas
0.10 ± 7% +0.0 0.12 ± 6% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.memset_erms
0.07 ± 5% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.rcu_all_qs
0.08 ± 6% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.lockref_get_not_dead
0.06 ± 9% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.memcpy
0.08 ± 5% +0.0 0.10 perf-profile.self.cycles-pp.fput
0.12 ± 6% +0.0 0.15 ± 4% perf-profile.self.cycles-pp.do_syscall_64
0.07 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__snprintf_chk
0.04 ± 57% +0.0 0.06 ± 6% perf-profile.self.cycles-pp.vm_area_dup
0.11 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.__get_user_8
0.08 ± 5% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.file_free_rcu
0.08 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__vma_link_rb
0.13 ± 5% +0.0 0.16 ± 5% perf-profile.self.cycles-pp.copy_page_range
0.11 ± 3% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.perf_event_mmap
0.18 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.find_vma
0.14 +0.0 0.17 ± 2% perf-profile.self.cycles-pp.copy_process
0.10 ± 4% +0.0 0.13 perf-profile.self.cycles-pp.link_path_walk
0.08 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__fput
0.08 ± 8% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.free_pcppages_bulk
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.do_mmap
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.kmem_cache_alloc_trace
0.10 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.vma_interval_tree_augment_rotate
0.15 ± 2% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.vma_compute_subtree_gap
0.14 ± 3% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.avc_has_perm_noaudit
0.12 +0.0 0.15 ± 2% perf-profile.self.cycles-pp.lock_page_memcg
0.11 ± 4% +0.0 0.15 ± 2% perf-profile.self.cycles-pp._init
0.10 ± 5% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.unmapped_area_topdown
0.11 +0.0 0.14 ± 3% perf-profile.self.cycles-pp.lockref_put_or_lock
0.03 ±100% +0.0 0.06 perf-profile.self.cycles-pp.unmap_vmas
0.18 +0.0 0.21 ± 4% perf-profile.self.cycles-pp.handle_mm_fault
0.09 +0.0 0.12 ± 4% perf-profile.self.cycles-pp.wake_q_add
0.15 ± 5% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.kmem_cache_free
0.08 ± 5% +0.0 0.12 ± 5% perf-profile.self.cycles-pp.queued_write_lock_slowpath
0.18 ± 3% +0.0 0.22 ± 3% perf-profile.self.cycles-pp._IO_file_xsputn
0.17 ± 2% +0.0 0.21 ± 3% perf-profile.self.cycles-pp.strchrnul
0.16 ± 5% +0.0 0.20 ± 4% perf-profile.self.cycles-pp.memcpy_erms
0.12 ± 3% +0.0 0.16 ± 4% perf-profile.self.cycles-pp.__rb_erase_color
0.12 ± 7% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.17 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.vmacache_find
0.08 +0.0 0.12 ± 11% perf-profile.self.cycles-pp.rcu_cblist_dequeue
0.16 +0.0 0.20 perf-profile.self.cycles-pp.mmap_region
0.14 +0.0 0.18 ± 2% perf-profile.self.cycles-pp.mark_page_accessed
0.07 ± 6% +0.0 0.11 ± 11% perf-profile.self.cycles-pp.queued_read_lock_slowpath
0.21 ± 2% +0.0 0.26 ± 4% perf-profile.self.cycles-pp.get_page_from_freelist
0.17 ± 2% +0.0 0.22 perf-profile.self.cycles-pp.malloc
0.16 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.strlen
0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.down_read_trylock
0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.__errno_location
0.17 ± 2% +0.0 0.22 ± 3% perf-profile.self.cycles-pp.selinux_inode_permission
0.26 +0.0 0.30 ± 5% perf-profile.self.cycles-pp.__rb_insert_augmented
0.18 ± 2% +0.0 0.23 ± 5% perf-profile.self.cycles-pp.__might_sleep
0.00 +0.1 0.05 perf-profile.self.cycles-pp.load_elf_binary
0.00 +0.1 0.05 perf-profile.self.cycles-pp.page_fault
0.00 +0.1 0.05 perf-profile.self.cycles-pp.pagevec_lru_move_fn
0.00 +0.1 0.05 perf-profile.self.cycles-pp.flush_tlb_mm_range
0.00 +0.1 0.05 perf-profile.self.cycles-pp.__inode_security_revalidate
0.00 +0.1 0.05 perf-profile.self.cycles-pp.dup_fd
0.00 +0.1 0.05 perf-profile.self.cycles-pp.acct_collect
0.00 +0.1 0.05 perf-profile.self.cycles-pp.vma_merge
0.00 +0.1 0.05 perf-profile.self.cycles-pp.rcu_segcblist_enqueue
0.24 ± 2% +0.1 0.30 ± 2% perf-profile.self.cycles-pp.___perf_sw_event
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.mem_cgroup_throttle_swaprate
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.anon_vma_interval_tree_insert
0.44 ± 2% +0.1 0.49 ± 4% perf-profile.self.cycles-pp.down_write
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.__might_fault
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.__mod_node_page_state
0.22 +0.1 0.28 ± 3% perf-profile.self.cycles-pp.__vsnprintf_chk
0.15 ± 2% +0.1 0.21 ± 5% perf-profile.self.cycles-pp.__alloc_file
0.30 +0.1 0.36 perf-profile.self.cycles-pp.native_flush_tlb_one_user
0.18 ± 4% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.__do_page_fault
0.31 ± 2% +0.1 0.37 perf-profile.self.cycles-pp._IO_padn
0.33 ± 3% +0.1 0.40 perf-profile.self.cycles-pp.unlock_page
0.21 ± 3% +0.1 0.28 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.20 ± 2% +0.1 0.27 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.36 +0.1 0.43 ± 2% perf-profile.self.cycles-pp.page_add_file_rmap
0.31 +0.1 0.38 perf-profile.self.cycles-pp.vma_interval_tree_remove
0.27 ± 3% +0.1 0.34 ± 3% perf-profile.self.cycles-pp.__d_lookup_rcu
0.28 +0.1 0.35 ± 3% perf-profile.self.cycles-pp.__list_del_entry_valid
0.41 +0.1 0.49 ± 3% perf-profile.self.cycles-pp.select_task_rq_fair
0.34 +0.1 0.42 perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.35 ± 3% +0.1 0.43 ± 3% perf-profile.self.cycles-pp.___might_sleep
0.29 ± 3% +0.1 0.38 perf-profile.self.cycles-pp.kmem_cache_alloc
0.36 ± 3% +0.1 0.45 perf-profile.self.cycles-pp._IO_fwrite
0.44 +0.1 0.53 perf-profile.self.cycles-pp.__handle_mm_fault
0.39 ± 3% +0.1 0.48 ± 2% perf-profile.self.cycles-pp.__slab_free
0.32 ± 2% +0.1 0.41 perf-profile.self.cycles-pp.alloc_set_pte
0.38 +0.1 0.47 perf-profile.self.cycles-pp.copy_page
0.52 +0.1 0.62 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret
0.34 ± 2% +0.1 0.45 ± 2% perf-profile.self.cycles-pp.strnlen_user
0.41 ± 2% +0.1 0.52 ± 2% perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.47 ± 2% +0.1 0.59 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.51 +0.1 0.64 ± 4% perf-profile.self.cycles-pp._raw_spin_lock
0.53 +0.1 0.66 perf-profile.self.cycles-pp.__entry_SYSCALL_64_trampoline
0.65 ± 2% +0.2 0.82 perf-profile.self.cycles-pp._IO_default_xsputn
0.84 +0.2 1.05 ± 3% perf-profile.self.cycles-pp.clear_page_erms
0.91 ± 2% +0.2 1.13 perf-profile.self.cycles-pp._dl_addr
0.91 +0.2 1.14 perf-profile.self.cycles-pp.vma_interval_tree_insert
1.08 +0.3 1.35 ± 2% perf-profile.self.cycles-pp.__strcoll_l
0.91 +0.3 1.20 perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.92 ± 2% +0.3 1.26 ± 4% perf-profile.self.cycles-pp.page_remove_rmap
1.33 +0.4 1.72 ± 2% perf-profile.self.cycles-pp.unmap_page_range
1.75 ± 2% +0.4 2.18 perf-profile.self.cycles-pp.vfprintf
1.23 ± 2% +0.5 1.73 ± 5% perf-profile.self.cycles-pp.release_pages
1.47 +0.8 2.26 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 11 months
[mm] 9bc8039e71: will-it-scale.per_thread_ops -64.1% regression
by kernel test robot
Greeting,
FYI, we noticed a -64.1% regression of will-it-scale.per_thread_ops due to commit:
commit: 9bc8039e715da3b53dbac89525323a9f2f69b7b5 ("mm: brk: downgrade mmap_sem to read when shrinking")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 8 threads Ivy Bridge with 16G memory
with following parameters:
nr_task: 100%
mode: thread
test: brk1
ucode: 0x20
cpufreq_governor: performance
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.2/thread/100%/debian-x86_64-2018-04-03.cgz/lkp-ivb-d01/brk1/will-it-scale/0x20
commit:
85a06835f6 ("mm: mremap: downgrade mmap_sem to read when shrinking")
9bc8039e71 ("mm: brk: downgrade mmap_sem to read when shrinking")
85a06835f6f1ba79 9bc8039e715da3b53dbac89525
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 kmsg.a0f723>]usb_hcd_irq
:4 25% 1:4 kmsg.b6a4a7>]usb_hcd_irq
1:4 -25% :4 kmsg.cae42e>]usb_hcd_irq
:4 25% 1:4 kmsg.fb#f87>]usb_hcd_irq
:4 25% 1:4 kmsg.fd#>]usb_hcd_irq
%stddev %change %stddev
\ | \
196250 ± 8% -64.1% 70494 will-it-scale.per_thread_ops
127330 ± 19% -98.0% 2525 ± 24% will-it-scale.time.involuntary_context_switches
727.50 ± 2% -77.0% 167.25 will-it-scale.time.percent_of_cpu_this_job_got
2141 ± 2% -77.6% 479.12 will-it-scale.time.system_time
50.48 ± 7% -48.5% 25.98 will-it-scale.time.user_time
34925294 ± 18% +270.3% 1.293e+08 ± 4% will-it-scale.time.voluntary_context_switches
1570007 ± 8% -64.1% 563958 will-it-scale.workload
6435 ± 2% -6.4% 6024 proc-vmstat.nr_shmem
1298 ± 16% -44.5% 721.00 ± 18% proc-vmstat.pgactivate
2341 +16.4% 2724 slabinfo.kmalloc-96.active_objs
2341 +16.4% 2724 slabinfo.kmalloc-96.num_objs
6346 ±150% -87.8% 776.25 ± 9% softirqs.NET_RX
160107 ± 8% +151.9% 403273 softirqs.SCHED
1097999 -13.0% 955526 softirqs.TIMER
5.50 ± 9% -81.8% 1.00 vmstat.procs.r
230700 ± 19% +269.9% 853292 ± 4% vmstat.system.cs
26706 ± 3% +15.7% 30910 ± 5% vmstat.system.in
11.24 ± 23% +72.2 83.39 mpstat.cpu.idle%
0.00 ±131% +0.0 0.04 ± 99% mpstat.cpu.iowait%
86.32 ± 2% -70.8 15.54 mpstat.cpu.sys%
2.44 ± 7% -1.4 1.04 ± 8% mpstat.cpu.usr%
20610709 ± 15% +2376.0% 5.103e+08 ± 34% cpuidle.C1.time
3233399 ± 8% +241.5% 11042785 ± 25% cpuidle.C1.usage
36172040 ± 6% +931.3% 3.73e+08 ± 15% cpuidle.C1E.time
783605 ± 4% +548.7% 5083041 ± 18% cpuidle.C1E.usage
28753819 ± 39% +1054.5% 3.319e+08 ± 49% cpuidle.C3.time
283912 ± 25% +688.4% 2238225 ± 34% cpuidle.C3.usage
1.507e+08 ± 47% +292.3% 5.913e+08 ± 28% cpuidle.C6.time
339861 ± 37% +549.7% 2208222 ± 24% cpuidle.C6.usage
2709719 ± 5% +824.2% 25043444 cpuidle.POLL.time
28602864 ± 18% +173.7% 78276116 ± 10% cpuidle.POLL.usage
3338 ± 2% -71.8% 941.75 turbostat.Avg_MHz
90.40 ± 2% -65.1 25.31 turbostat.Busy%
3233316 ± 8% +241.5% 11042588 ± 25% turbostat.C1
0.83 ± 16% +20.2 21.02 ± 35% turbostat.C1%
783559 ± 4% +548.7% 5082972 ± 18% turbostat.C1E
1.46 ± 7% +13.9 15.34 ± 15% turbostat.C1E%
283898 ± 25% +688.4% 2238202 ± 34% turbostat.C3
1.17 ± 39% +12.5 13.66 ± 49% turbostat.C3%
339857 ± 37% +549.7% 2208205 ± 24% turbostat.C6
6.05 ± 46% +18.2 24.30 ± 28% turbostat.C6%
6.12 ± 18% +755.7% 52.39 ± 9% turbostat.CPU%c1
2.18 ±105% +735.9% 18.18 ± 45% turbostat.CPU%c3
1.30 ±117% +216.3% 4.12 ± 92% turbostat.CPU%c6
38.31 -37.2% 24.06 turbostat.CorWatt
8285923 ± 2% +13.9% 9436075 ± 6% turbostat.IRQ
43.17 -33.4% 28.77 turbostat.PkgWatt
8.92e+11 -67.9% 2.862e+11 ± 31% perf-stat.branch-instructions
0.55 ± 4% +1.0 1.53 ± 5% perf-stat.branch-miss-rate%
0.19 ± 22% +0.7 0.89 ± 69% perf-stat.cache-miss-rate%
2.401e+10 -57.3% 1.025e+10 ± 28% perf-stat.cache-references
71517245 ± 18% +264.5% 2.607e+08 ± 4% perf-stat.context-switches
1.85 -21.9% 1.44 ± 2% perf-stat.cpi
8.223e+12 ± 2% -76.8% 1.904e+12 ± 32% perf-stat.cpu-cycles
0.34 ± 11% +0.3 0.63 ± 9% perf-stat.dTLB-load-miss-rate%
4.563e+09 ± 10% -50.7% 2.252e+09 ± 27% perf-stat.dTLB-load-misses
1.357e+12 -73.2% 3.63e+11 ± 31% perf-stat.dTLB-loads
0.01 ± 28% +0.0 0.02 ± 10% perf-stat.dTLB-store-miss-rate%
20813820 ± 31% +109.2% 43542782 ± 25% perf-stat.dTLB-store-misses
97.04 -13.4 83.65 ± 2% perf-stat.iTLB-load-miss-rate%
5.871e+08 ± 8% -48.9% 3.001e+08 ± 35% perf-stat.iTLB-load-misses
17851698 ± 4% +235.7% 59936365 ± 41% perf-stat.iTLB-loads
4.456e+12 -70.6% 1.311e+12 ± 31% perf-stat.instructions
7651 ± 9% -41.0% 4513 ± 11% perf-stat.instructions-per-iTLB-miss
0.54 +28.2% 0.69 ± 2% perf-stat.ipc
131812 ± 2% -75.7% 31973 sched_debug.cfs_rq:/.exec_clock.avg
133451 ± 2% -67.5% 43371 ± 30% sched_debug.cfs_rq:/.exec_clock.max
130067 ± 4% -83.3% 21767 ± 30% sched_debug.cfs_rq:/.exec_clock.min
1220 ± 87% +592.8% 8456 ± 98% sched_debug.cfs_rq:/.exec_clock.stddev
229519 ± 6% +70.6% 391456 ± 4% sched_debug.cfs_rq:/.load.max
65462 ± 11% +141.1% 157808 ± 4% sched_debug.cfs_rq:/.load.stddev
82.00 ± 3% -83.5% 13.54 ± 30% sched_debug.cfs_rq:/.load_avg.min
985041 ± 4% -90.8% 90737 sched_debug.cfs_rq:/.min_vruntime.avg
1004586 ± 4% -87.2% 128180 ± 21% sched_debug.cfs_rq:/.min_vruntime.max
969836 ± 5% -93.6% 62139 ± 28% sched_debug.cfs_rq:/.min_vruntime.min
0.77 ± 5% -42.6% 0.44 ± 10% sched_debug.cfs_rq:/.nr_running.avg
0.34 ± 12% +39.5% 0.48 sched_debug.cfs_rq:/.nr_running.stddev
1.79 ± 7% -63.1% 0.66 ± 22% sched_debug.cfs_rq:/.nr_spread_over.avg
10.54 ± 20% -68.0% 3.38 ± 26% sched_debug.cfs_rq:/.nr_spread_over.max
3.52 ± 18% -68.3% 1.12 ± 25% sched_debug.cfs_rq:/.nr_spread_over.stddev
96.05 ± 6% -33.5% 63.92 ± 8% sched_debug.cfs_rq:/.runnable_load_avg.avg
237.58 ± 7% +31.3% 311.83 ± 2% sched_debug.cfs_rq:/.runnable_load_avg.max
67.84 ± 9% +55.7% 105.65 sched_debug.cfs_rq:/.runnable_load_avg.stddev
200408 ± 8% +80.6% 361912 ± 6% sched_debug.cfs_rq:/.runnable_weight.max
56555 ± 14% +160.3% 147211 ± 5% sched_debug.cfs_rq:/.runnable_weight.stddev
936.14 ± 2% -55.3% 418.09 ± 6% sched_debug.cfs_rq:/.util_avg.avg
1341 ± 11% -43.2% 762.54 ± 11% sched_debug.cfs_rq:/.util_avg.max
587.25 ± 18% -69.6% 178.75 ± 23% sched_debug.cfs_rq:/.util_avg.min
518.64 ± 11% -90.2% 50.84 ± 29% sched_debug.cfs_rq:/.util_est_enqueued.avg
1018 ± 4% -70.8% 297.75 ± 23% sched_debug.cfs_rq:/.util_est_enqueued.max
386.54 ± 6% -73.6% 102.24 ± 21% sched_debug.cfs_rq:/.util_est_enqueued.stddev
116574 ± 30% +67.2% 194964 ± 30% sched_debug.cpu.avg_idle.avg
93.29 ± 16% -35.1% 60.54 ± 8% sched_debug.cpu.cpu_load[0].avg
221.08 ± 8% +34.3% 296.96 ± 9% sched_debug.cpu.cpu_load[0].max
63.60 ± 9% +57.6% 100.26 ± 9% sched_debug.cpu.cpu_load[0].stddev
95.54 ± 13% -47.7% 49.98 ± 7% sched_debug.cpu.cpu_load[1].avg
41.00 ± 52% -97.7% 0.96 ± 68% sched_debug.cpu.cpu_load[1].min
44.57 ± 16% +38.2% 61.57 ± 8% sched_debug.cpu.cpu_load[1].stddev
98.62 ± 10% -58.2% 41.19 ± 7% sched_debug.cpu.cpu_load[2].avg
169.42 ± 8% -28.1% 121.79 ± 9% sched_debug.cpu.cpu_load[2].max
58.04 ± 35% -94.5% 3.17 ± 47% sched_debug.cpu.cpu_load[2].min
100.91 ± 8% -64.5% 35.80 ± 10% sched_debug.cpu.cpu_load[3].avg
155.21 ± 5% -39.6% 93.79 ± 13% sched_debug.cpu.cpu_load[3].max
70.42 ± 22% -93.3% 4.71 ± 36% sched_debug.cpu.cpu_load[3].min
102.59 ± 6% -68.9% 31.92 ± 17% sched_debug.cpu.cpu_load[4].avg
144.54 ± 5% -44.9% 79.71 ± 28% sched_debug.cpu.cpu_load[4].max
78.79 ± 15% -92.6% 5.83 ± 30% sched_debug.cpu.cpu_load[4].min
1044 ± 5% -33.5% 694.38 ± 4% sched_debug.cpu.curr->pid.avg
835.66 ± 4% +19.0% 994.65 sched_debug.cpu.curr->pid.stddev
228643 ± 6% +71.3% 391578 ± 4% sched_debug.cpu.load.max
64674 ± 11% +143.6% 157538 ± 4% sched_debug.cpu.load.stddev
0.00 ± 5% -48.4% 0.00 ± 46% sched_debug.cpu.next_balance.stddev
1.03 ± 16% -44.9% 0.57 ± 13% sched_debug.cpu.nr_running.avg
6206533 ± 12% +167.7% 16616895 ± 4% sched_debug.cpu.nr_switches.avg
6795551 ± 18% +222.4% 21911344 ± 19% sched_debug.cpu.nr_switches.max
5666982 ± 9% +115.3% 12201219 ± 17% sched_debug.cpu.nr_switches.min
351168 ± 73% +837.8% 3293280 ± 72% sched_debug.cpu.nr_switches.stddev
0.32 ± 21% +109.8% 0.67 ± 8% sched_debug.cpu.nr_uninterruptible.avg
6297340 ± 12% +163.9% 16617675 ± 4% sched_debug.cpu.sched_count.avg
6887997 ± 18% +218.1% 21912464 ± 19% sched_debug.cpu.sched_count.max
5753875 ± 8% +112.1% 12201952 ± 17% sched_debug.cpu.sched_count.min
352908 ± 73% +833.2% 3293323 ± 71% sched_debug.cpu.sched_count.stddev
3067826 ± 12% +170.7% 8305951 ± 4% sched_debug.cpu.sched_goidle.avg
3361061 ± 18% +225.9% 10953485 ± 19% sched_debug.cpu.sched_goidle.max
2798299 ± 9% +117.9% 6098033 ± 17% sched_debug.cpu.sched_goidle.min
175049 ± 72% +840.7% 1646720 ± 72% sched_debug.cpu.sched_goidle.stddev
3232125 ± 11% +159.6% 8389199 ± 4% sched_debug.cpu.ttwu_count.avg
3533980 ± 16% +275.2% 13260800 ± 36% sched_debug.cpu.ttwu_count.max
271212 ±109% +1140.0% 3363044 ± 83% sched_debug.cpu.ttwu_count.stddev
107111 ± 9% +30.6% 139843 ± 17% sched_debug.cpu.ttwu_local.max
85459 ± 6% -29.3% 60381 ± 44% sched_debug.cpu.ttwu_local.min
6551 ± 69% +374.8% 31104 ± 78% sched_debug.cpu.ttwu_local.stddev
82.07 -72.2 9.87 ± 5% perf-profile.calltrace.cycles-pp.down_write_killable.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
81.23 -72.0 9.20 ± 5% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
81.17 -72.0 9.18 ± 5% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk.do_syscall_64
68.76 -68.8 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk
94.12 -54.6 39.55 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
94.54 -54.4 40.16 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
94.69 -54.3 40.35 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
10.16 ± 3% -10.0 0.19 ±173% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk
0.89 ± 10% -0.2 0.67 ± 6% perf-profile.calltrace.cycles-pp.anon_vma_clone.__split_vma.__do_munmap.__x64_sys_brk.do_syscall_64
0.66 ± 6% +0.4 1.03 ± 8% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__x64_sys_brk
0.74 ± 6% +0.4 1.16 ± 8% perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64
1.42 ± 7% +0.4 1.85 ± 6% perf-profile.calltrace.cycles-pp.vma_merge.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.59 ± 11% perf-profile.calltrace.cycles-pp.__task_rq_lock.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake
0.00 +0.6 0.63 ± 13% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry
0.00 +0.7 0.66 ± 18% perf-profile.calltrace.cycles-pp.tick_nohz_idle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +0.7 0.67 ± 9% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable
0.00 +0.7 0.67 ± 11% perf-profile.calltrace.cycles-pp.unlink_anon_vmas.free_pgtables.unmap_region.__do_munmap.__x64_sys_brk
0.00 +0.7 0.67 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_idle.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable
0.00 +0.7 0.68 ± 12% perf-profile.calltrace.cycles-pp.find_next_bit.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length
0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
0.67 ± 7% +0.7 1.35 ± 9% perf-profile.calltrace.cycles-pp.perf_event_mmap.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.14 ±173% +0.7 0.87 ± 5% perf-profile.calltrace.cycles-pp.get_unmapped_area.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.77 ± 8% perf-profile.calltrace.cycles-pp.security_vm_enough_memory_mm.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.78 ± 11% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64
0.00 +0.9 0.87 ± 17% perf-profile.calltrace.cycles-pp.unwind_next_frame.__save_stack_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
0.00 +0.9 0.91 ± 8% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule
1.75 ± 10% +0.9 2.66 ± 5% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.0 0.98 ± 7% perf-profile.calltrace.cycles-pp.__switch_to
0.00 +1.0 0.98 ± 9% perf-profile.calltrace.cycles-pp.__switch_to_asm
0.00 +1.1 1.10 ± 3% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule
0.00 +1.1 1.11 ± 20% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake
0.00 +1.2 1.20 ± 6% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
0.00 +1.6 1.64 ± 7% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle
0.00 +1.9 1.86 ± 14% perf-profile.calltrace.cycles-pp.__save_stack_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
5.75 ± 4% +1.9 7.64 ± 5% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.9 1.91 ± 14% perf-profile.calltrace.cycles-pp.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate
0.00 +2.1 2.09 ± 11% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
3.38 ± 5% +2.1 5.47 ± 4% perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +2.2 2.25 ± 14% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
0.00 +2.5 2.46 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry
0.00 +2.5 2.46 ± 10% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.00 +3.1 3.06 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +3.5 3.52 ± 4% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable
0.00 +3.8 3.80 ± 8% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
0.00 +4.1 4.10 ± 3% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable
0.00 +4.7 4.66 ± 11% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +4.8 4.83 ± 11% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +5.3 5.27 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.91 ± 16% +5.5 6.44 ± 4% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_write
0.95 ± 15% +5.7 6.70 ± 4% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_write.__x64_sys_brk
1.73 ± 11% +5.8 7.53 ± 4% perf-profile.calltrace.cycles-pp.up_write.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +6.2 6.15 ± 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q
1.15 ± 17% +6.2 7.33 ± 4% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_write.__x64_sys_brk.do_syscall_64
1.15 ± 17% +6.2 7.36 ± 4% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_write.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +6.9 6.93 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_read
0.00 +6.9 6.95 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake
0.00 +7.1 7.15 ± 3% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_read.__x64_sys_brk
0.00 +7.3 7.33 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake
0.00 +7.8 7.75 ± 3% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_read.__x64_sys_brk.do_syscall_64
0.00 +7.8 7.79 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_read.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +7.9 7.90 ± 3% perf-profile.calltrace.cycles-pp.up_read.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +8.0 8.00 ± 4% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable
0.00 +8.2 8.22 ± 4% perf-profile.calltrace.cycles-pp.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk
0.83 ± 27% +25.9 26.75 ± 11% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
1.09 ± 32% +30.9 31.97 ± 10% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.62 ± 36% +44.4 46.01 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.63 ± 36% +44.5 46.18 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
1.63 ± 36% +44.6 46.21 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
1.73 ± 29% +51.1 52.86 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
82.10 -72.2 9.91 ± 6% perf-profile.children.cycles-pp.down_write_killable
81.23 -72.0 9.20 ± 5% perf-profile.children.cycles-pp.call_rwsem_down_write_failed_killable
81.20 -72.0 9.18 ± 5% perf-profile.children.cycles-pp.rwsem_down_write_failed_killable
68.78 -68.8 0.01 ±173% perf-profile.children.cycles-pp.osq_lock
94.15 -54.6 39.58 ± 2% perf-profile.children.cycles-pp.__x64_sys_brk
94.59 -54.3 40.28 ± 3% perf-profile.children.cycles-pp.do_syscall_64
94.74 -54.3 40.48 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
10.16 ± 3% -9.8 0.38 ± 61% perf-profile.children.cycles-pp.rwsem_spin_on_owner
1.25 ± 11% -0.5 0.78 ± 5% perf-profile.children.cycles-pp.find_vma
0.89 ± 10% -0.2 0.67 ± 7% perf-profile.children.cycles-pp.anon_vma_clone
0.27 ± 31% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.tlb_gather_mmu
0.07 ± 7% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.cap_mmap_addr
0.03 ±100% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.tlb_flush_mmu_free
0.00 +0.1 0.05 perf-profile.children.cycles-pp.irq_work_run_list
0.08 ± 25% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.arch_tlb_finish_mmu
0.01 ±173% +0.1 0.07 ± 12% perf-profile.children.cycles-pp.cap_capable
0.07 ± 12% +0.1 0.13 ± 23% perf-profile.children.cycles-pp.selinux_mmap_addr
0.04 ± 60% +0.1 0.10 ± 27% perf-profile.children.cycles-pp.free_pgd_range
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.strlen
0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.sched_idle_set_state
0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.__list_add_valid
0.03 ±102% +0.1 0.10 ± 14% perf-profile.children.cycles-pp.__vm_enough_memory
0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.08 ± 30% perf-profile.children.cycles-pp.rcu_note_context_switch
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.lapic_next_deadline
0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.__enqueue_entity
0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.perf_exclude_event
0.04 ± 58% +0.1 0.12 ± 31% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.in_sched_functions
0.09 ± 20% +0.1 0.18 ± 26% perf-profile.children.cycles-pp.tick_sched_handle
0.09 ± 21% +0.1 0.17 ± 26% perf-profile.children.cycles-pp.update_process_times
0.00 +0.1 0.09 ± 16% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.00 +0.1 0.09 ± 16% perf-profile.children.cycles-pp.native_irq_return_iret
0.23 ± 15% +0.1 0.32 ± 13% perf-profile.children.cycles-pp.remove_vma
0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.get_cpu_device
0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.vma_adjust_trans_huge
0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.rb_insert_color_cached
0.00 +0.1 0.09 ± 15% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.hugepage_vma_check
0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.put_prev_task_idle
0.10 ± 15% +0.1 0.19 ± 13% perf-profile.children.cycles-pp.__vma_link_rb
0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.userfaultfd_unmap_prep
0.10 ± 19% +0.1 0.20 ± 21% perf-profile.children.cycles-pp.__rb_insert_augmented
0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.clear_buddies
0.16 ± 14% +0.1 0.27 ± 22% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.03 ±100% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.khugepaged_enter_vma_merge
0.13 ± 19% +0.1 0.23 ± 13% perf-profile.children.cycles-pp.tlb_finish_mmu
0.00 +0.1 0.10 ± 28% perf-profile.children.cycles-pp.pm_qos_request
0.00 +0.1 0.10 ± 34% perf-profile.children.cycles-pp.stack_access_ok
0.00 +0.1 0.11 ± 37% perf-profile.children.cycles-pp.perf_swevent_event
0.17 ± 27% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.avc_has_perm_noaudit
0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.irq_work_needs_cpu
0.00 +0.1 0.11 ± 17% perf-profile.children.cycles-pp.reschedule_interrupt
0.00 +0.1 0.11 ± 19% perf-profile.children.cycles-pp.clockevents_program_event
0.00 +0.1 0.11 ± 42% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.10 ± 15% +0.1 0.22 ± 24% perf-profile.children.cycles-pp.tick_sched_timer
0.00 +0.1 0.12 ± 33% perf-profile.children.cycles-pp.can_stop_idle_tick
0.53 ± 4% +0.1 0.66 ± 9% perf-profile.children.cycles-pp.vma_compute_subtree_gap
0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.native_load_tls
0.00 +0.1 0.13 ± 33% perf-profile.children.cycles-pp.load_new_mm_cr3
0.07 ± 23% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.cap_vm_enough_memory
0.00 +0.1 0.14 ± 19% perf-profile.children.cycles-pp.__update_idle_core
0.00 +0.1 0.14 ± 15% perf-profile.children.cycles-pp.update_min_vruntime
0.00 +0.1 0.14 ± 26% perf-profile.children.cycles-pp.leave_mm
0.33 ± 6% +0.1 0.47 ± 14% perf-profile.children.cycles-pp.___might_sleep
0.00 +0.2 0.15 ± 24% perf-profile.children.cycles-pp.ttwu_stat
0.09 ± 20% +0.2 0.24 ± 13% perf-profile.children.cycles-pp.perf_event_mmap_output
0.14 ± 9% +0.2 0.30 ± 20% perf-profile.children.cycles-pp.strlcpy
0.01 ±173% +0.2 0.18 ± 31% perf-profile.children.cycles-pp.__softirqentry_text_start
0.00 +0.2 0.17 ± 25% perf-profile.children.cycles-pp.deactivate_task
0.00 +0.2 0.18 ± 12% perf-profile.children.cycles-pp.orc_find
0.00 +0.2 0.18 ± 14% perf-profile.children.cycles-pp.sched_ttwu_pending
0.24 ± 14% +0.2 0.42 ± 7% perf-profile.children.cycles-pp.security_mmap_addr
0.00 +0.2 0.18 ± 11% perf-profile.children.cycles-pp.rcu_eqs_exit
0.00 +0.2 0.19 ± 15% perf-profile.children.cycles-pp.rcu_eqs_enter
0.20 ± 10% +0.2 0.40 ± 14% perf-profile.children.cycles-pp.__might_sleep
0.07 ± 21% +0.2 0.27 ± 18% perf-profile.children.cycles-pp.__vma_rb_erase
0.00 +0.2 0.20 ± 22% perf-profile.children.cycles-pp.rb_next
0.00 +0.2 0.20 ± 20% perf-profile.children.cycles-pp.__list_del_entry_valid
0.00 +0.2 0.20 ± 22% perf-profile.children.cycles-pp.save_stack_address
0.22 ± 19% +0.2 0.43 ± 9% perf-profile.children.cycles-pp.cred_has_capability
0.00 +0.2 0.22 ± 25% perf-profile.children.cycles-pp.__orc_find
0.00 +0.2 0.23 ± 14% perf-profile.children.cycles-pp.kernel_text_address
0.03 ±100% +0.2 0.25 ± 24% perf-profile.children.cycles-pp.irq_exit
0.00 +0.2 0.23 ± 27% perf-profile.children.cycles-pp.__rwsem_mark_wake
0.00 +0.2 0.24 ± 22% perf-profile.children.cycles-pp.nr_iowait_cpu
0.00 +0.2 0.25 ± 12% perf-profile.children.cycles-pp.call_cpuidle
0.24 ± 13% +0.3 0.50 ± 9% perf-profile.children.cycles-pp.perf_iterate_sb
0.38 ± 13% +0.3 0.63 ± 14% perf-profile.children.cycles-pp.vm_area_dup
0.32 ± 7% +0.3 0.57 ± 9% perf-profile.children.cycles-pp.kmem_cache_alloc
0.00 +0.3 0.26 ± 8% perf-profile.children.cycles-pp.put_prev_entity
0.16 ± 12% +0.3 0.42 ± 11% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +0.3 0.27 ± 24% perf-profile.children.cycles-pp.menu_reflect
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.activate_task
0.00 +0.3 0.27 ± 23% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.account_entity_dequeue
0.00 +0.3 0.28 ± 18% perf-profile.children.cycles-pp.__kernel_text_address
0.00 +0.3 0.28 ± 8% perf-profile.children.cycles-pp.get_iowait_load
0.27 ± 13% +0.3 0.56 ± 12% perf-profile.children.cycles-pp.selinux_vm_enough_memory
0.41 ± 2% +0.3 0.70 ± 9% perf-profile.children.cycles-pp.unlink_anon_vmas
0.00 +0.3 0.31 ± 13% perf-profile.children.cycles-pp.pick_next_entity
0.00 +0.3 0.31 ± 4% perf-profile.children.cycles-pp.rb_erase_cached
0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.account_entity_enqueue
0.00 +0.3 0.33 ± 8% perf-profile.children.cycles-pp.available_idle_cpu
0.00 +0.3 0.34 ± 14% perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.3 0.34 ± 12% perf-profile.children.cycles-pp.unwind_get_return_address
0.00 +0.3 0.35 ± 20% perf-profile.children.cycles-pp.rwsem_downgrade_wake
0.45 ± 3% +0.4 0.80 ± 11% perf-profile.children.cycles-pp.free_pgtables
0.00 +0.4 0.37 ± 8% perf-profile.children.cycles-pp.__calc_delta
0.00 +0.4 0.37 ± 24% perf-profile.children.cycles-pp.call_rwsem_downgrade_wake
0.00 +0.4 0.38 ± 8% perf-profile.children.cycles-pp.select_idle_sibling
0.68 ± 6% +0.4 1.06 ± 7% perf-profile.children.cycles-pp.unmap_page_range
0.00 +0.4 0.39 ± 7% perf-profile.children.cycles-pp.put_prev_task_fair
0.22 ± 8% +0.4 0.62 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt
0.00 +0.4 0.41 ± 2% perf-profile.children.cycles-pp.rcu_idle_exit
0.50 ± 11% +0.4 0.91 ± 6% perf-profile.children.cycles-pp.get_unmapped_area
0.00 +0.4 0.42 ± 3% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.36 ± 11% +0.4 0.79 ± 9% perf-profile.children.cycles-pp.security_vm_enough_memory_mm
0.75 ± 6% +0.4 1.19 ± 8% perf-profile.children.cycles-pp.unmap_vmas
1.42 ± 7% +0.4 1.86 ± 5% perf-profile.children.cycles-pp.vma_merge
0.00 +0.5 0.46 ± 15% perf-profile.children.cycles-pp.__unwind_start
0.00 +0.5 0.46 ± 32% perf-profile.children.cycles-pp.resched_curr
0.12 ± 8% +0.5 0.62 ± 12% perf-profile.children.cycles-pp.__indirect_thunk_start
0.01 ±173% +0.5 0.53 ± 14% perf-profile.children.cycles-pp.read_tsc
0.00 +0.5 0.52 ± 23% perf-profile.children.cycles-pp.downgrade_write
0.06 ± 62% +0.5 0.58 ± 12% perf-profile.children.cycles-pp.wake_q_add
0.44 ± 26% +0.6 1.00 ± 25% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.00 +0.6 0.62 ± 13% perf-profile.children.cycles-pp.reweight_entity
0.04 ±106% +0.6 0.67 ± 6% perf-profile.children.cycles-pp.native_write_msr
0.00 +0.6 0.63 ± 13% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.00 +0.6 0.64 ± 6% perf-profile.children.cycles-pp.___perf_sw_event
0.00 +0.7 0.68 ± 7% perf-profile.children.cycles-pp.pick_next_task_idle
0.28 ± 9% +0.7 0.96 ± 10% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.04 ±100% +0.7 0.72 ± 10% perf-profile.children.cycles-pp.__task_rq_lock
0.02 ±173% +0.7 0.71 ± 9% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.00 +0.7 0.70 ± 10% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.7 0.72 ± 6% perf-profile.children.cycles-pp.__update_load_avg_se
0.68 ± 6% +0.7 1.40 ± 9% perf-profile.children.cycles-pp.perf_event_mmap
0.00 +0.7 0.74 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.29 ± 8% +0.7 1.03 ± 10% perf-profile.children.cycles-pp.apic_timer_interrupt
0.01 ±173% +0.7 0.76 ± 6% perf-profile.children.cycles-pp.finish_task_switch
0.01 ±173% +0.8 0.81 ± 4% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.03 ±100% +0.8 0.84 ± 11% perf-profile.children.cycles-pp.ktime_get
0.02 ±173% +0.8 0.83 ± 21% perf-profile.children.cycles-pp.check_preempt_curr
0.01 ±173% +0.8 0.83 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.03 ±105% +0.9 0.88 ± 2% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.02 ±173% +0.9 0.92 ± 20% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.46 ± 26% +0.9 1.36 ± 20% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.75 ± 10% +0.9 2.67 ± 5% perf-profile.children.cycles-pp.unmap_region
0.01 ±173% +0.9 0.95 ± 11% perf-profile.children.cycles-pp.find_next_bit
0.01 ±173% +1.0 0.99 ± 7% perf-profile.children.cycles-pp.update_cfs_group
0.03 ±105% +1.0 1.04 ± 8% perf-profile.children.cycles-pp.__switch_to_asm
0.04 ± 57% +1.0 1.07 ± 10% perf-profile.children.cycles-pp.update_curr
0.03 ±100% +1.2 1.24 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair
0.01 ±173% +1.2 1.23 ± 6% perf-profile.children.cycles-pp.__switch_to
0.28 ± 12% +1.3 1.55 ± 10% perf-profile.children.cycles-pp._raw_spin_lock
0.01 ±173% +1.3 1.34 ± 13% perf-profile.children.cycles-pp.native_sched_clock
0.02 ±173% +1.4 1.37 ± 12% perf-profile.children.cycles-pp.sched_clock
0.00 +1.4 1.36 ± 12% perf-profile.children.cycles-pp.unwind_next_frame
0.04 ± 63% +1.4 1.49 ± 9% perf-profile.children.cycles-pp.sched_clock_cpu
0.03 ±100% +1.5 1.48 ± 10% perf-profile.children.cycles-pp.__next_timer_interrupt
0.08 ± 38% +1.7 1.77 ± 5% perf-profile.children.cycles-pp.set_next_entity
5.79 ± 4% +1.9 7.71 ± 5% perf-profile.children.cycles-pp.__do_munmap
0.00 +2.1 2.09 ± 9% perf-profile.children.cycles-pp.__save_stack_trace
3.38 ± 5% +2.1 5.47 ± 4% perf-profile.children.cycles-pp.do_brk_flags
0.00 +2.1 2.13 ± 9% perf-profile.children.cycles-pp.save_stack_trace_tsk
0.05 ± 61% +2.2 2.22 ± 7% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.01 ±173% +2.5 2.53 ± 8% perf-profile.children.cycles-pp.__account_scheduler_latency
0.11 ± 47% +2.5 2.65 ± 2% perf-profile.children.cycles-pp.update_load_avg
0.06 ± 60% +2.6 2.66 ± 7% perf-profile.children.cycles-pp.tick_nohz_next_event
0.15 ± 42% +3.2 3.33 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair
0.09 ± 31% +3.4 3.51 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.14 ± 35% +3.5 3.62 ± 3% perf-profile.children.cycles-pp.dequeue_entity
0.16 ± 36% +4.0 4.12 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair
0.24 ± 44% +4.1 4.30 ± 5% perf-profile.children.cycles-pp.poll_idle
0.24 ± 50% +5.3 5.54 ± 4% perf-profile.children.cycles-pp.schedule_idle
2.34 ± 9% +5.6 7.90 ± 4% perf-profile.children.cycles-pp.up_write
0.19 ± 35% +5.8 5.99 ± 6% perf-profile.children.cycles-pp.menu_select
0.20 ± 33% +6.1 6.30 ± 2% perf-profile.children.cycles-pp.enqueue_entity
0.22 ± 32% +6.7 6.96 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair
0.24 ± 29% +7.1 7.35 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +7.9 7.91 ± 3% perf-profile.children.cycles-pp.up_read
0.32 ± 37% +7.9 8.23 ± 4% perf-profile.children.cycles-pp.schedule
0.91 ± 15% +12.5 13.40 ± 3% perf-profile.children.cycles-pp.try_to_wake_up
0.95 ± 15% +12.9 13.85 ± 3% perf-profile.children.cycles-pp.wake_up_q
0.55 ± 43% +13.0 13.52 ± 4% perf-profile.children.cycles-pp.__sched_text_start
1.15 ± 17% +14.0 15.11 ± 3% perf-profile.children.cycles-pp.rwsem_wake
1.15 ± 17% +14.0 15.15 ± 3% perf-profile.children.cycles-pp.call_rwsem_wake
0.88 ± 20% +29.8 30.72 ± 5% perf-profile.children.cycles-pp.intel_idle
1.16 ± 24% +35.6 36.74 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
1.63 ± 36% +44.6 46.21 ± 9% perf-profile.children.cycles-pp.start_secondary
1.74 ± 29% +51.1 52.81 ± 2% perf-profile.children.cycles-pp.do_idle
1.73 ± 29% +51.1 52.86 ± 2% perf-profile.children.cycles-pp.secondary_startup_64
1.73 ± 29% +51.1 52.86 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry
68.56 -68.5 0.01 ±173% perf-profile.self.cycles-pp.osq_lock
10.12 ± 4% -9.7 0.38 ± 61% perf-profile.self.cycles-pp.rwsem_spin_on_owner
1.41 ± 7% -0.9 0.51 ± 17% perf-profile.self.cycles-pp.rwsem_down_write_failed_killable
1.16 ± 4% -0.6 0.52 ± 12% perf-profile.self.cycles-pp.up_write
1.02 ± 14% -0.5 0.48 ± 9% perf-profile.self.cycles-pp.find_vma
1.16 ± 5% -0.2 0.94 ± 2% perf-profile.self.cycles-pp.__vma_adjust
0.38 ± 10% -0.2 0.20 ± 17% perf-profile.self.cycles-pp.anon_vma_clone
0.26 ± 31% -0.1 0.12 ± 5% perf-profile.self.cycles-pp.tlb_gather_mmu
0.06 ± 15% +0.0 0.09 ± 15% perf-profile.self.cycles-pp.cap_mmap_addr
0.06 +0.0 0.10 ± 8% perf-profile.self.cycles-pp.__split_vma
0.01 ±173% +0.0 0.06 ± 14% perf-profile.self.cycles-pp.remove_vma
0.04 ± 58% +0.1 0.09 ± 19% perf-profile.self.cycles-pp.tlb_finish_mmu
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.strlen
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.unwind_get_return_address
0.04 ± 60% +0.1 0.10 ± 27% perf-profile.self.cycles-pp.free_pgd_range
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.cap_capable
0.00 +0.1 0.06 ± 34% perf-profile.self.cycles-pp.__list_add_valid
0.04 ± 58% +0.1 0.11 ± 28% perf-profile.self.cycles-pp.lru_add_drain_cpu
0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.kernel_text_address
0.00 +0.1 0.07 ± 34% perf-profile.self.cycles-pp.put_prev_task_idle
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.hugepage_vma_check
0.00 +0.1 0.08 ± 30% perf-profile.self.cycles-pp.rcu_note_context_switch
0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.__save_stack_trace
0.00 +0.1 0.08 ± 16% perf-profile.self.cycles-pp.clear_buddies
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__enqueue_entity
0.10 ± 31% +0.1 0.17 ± 13% perf-profile.self.cycles-pp.security_mmap_addr
0.04 ± 58% +0.1 0.12 ± 32% perf-profile.self.cycles-pp.selinux_vm_enough_memory
0.00 +0.1 0.08 ± 34% perf-profile.self.cycles-pp.free_pgtables
0.09 ± 13% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.unlink_anon_vmas
0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.rb_insert_color_cached
0.00 +0.1 0.08 ± 31% perf-profile.self.cycles-pp.get_cpu_device
0.04 ± 58% +0.1 0.12 ± 22% perf-profile.self.cycles-pp.selinux_mmap_addr
0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.vma_adjust_trans_huge
0.00 +0.1 0.08 ± 15% perf-profile.self.cycles-pp.tick_check_broadcast_expired
0.05 ± 8% +0.1 0.14 ± 33% perf-profile.self.cycles-pp.userfaultfd_unmap_complete
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.__vma_link_rb
0.00 +0.1 0.09 ± 16% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.1 0.09 ± 12% perf-profile.self.cycles-pp.ttwu_do_wakeup
0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.irq_work_needs_cpu
0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.update_ts_time_stats
0.00 +0.1 0.09 ± 32% perf-profile.self.cycles-pp.tick_nohz_tick_stopped
0.00 +0.1 0.09 ± 36% perf-profile.self.cycles-pp.stack_access_ok
0.00 +0.1 0.10 ± 18% perf-profile.self.cycles-pp.userfaultfd_unmap_prep
0.00 +0.1 0.10 ± 11% perf-profile.self.cycles-pp.__unwind_start
0.00 +0.1 0.10 ± 29% perf-profile.self.cycles-pp.pm_qos_request
0.50 ± 4% +0.1 0.60 ± 12% perf-profile.self.cycles-pp.vma_compute_subtree_gap
0.15 ± 12% +0.1 0.25 ± 9% perf-profile.self.cycles-pp.perf_iterate_sb
0.03 ±100% +0.1 0.12 ± 22% perf-profile.self.cycles-pp.rwsem_wake
0.00 +0.1 0.10 ± 23% perf-profile.self.cycles-pp.ttwu_do_activate
0.09 ± 17% +0.1 0.20 ± 22% perf-profile.self.cycles-pp.__rb_insert_augmented
0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.save_stack_address
0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.hrtimer_next_event_without
0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.tick_nohz_idle_exit
0.17 ± 28% +0.1 0.27 ± 9% perf-profile.self.cycles-pp.avc_has_perm_noaudit
0.01 ±173% +0.1 0.12 ± 15% perf-profile.self.cycles-pp.cap_vm_enough_memory
0.00 +0.1 0.11 ± 31% perf-profile.self.cycles-pp.sched_clock_cpu
0.09 ± 19% +0.1 0.20 ± 21% perf-profile.self.cycles-pp.arch_get_unmapped_area_topdown
0.00 +0.1 0.12 ± 33% perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.native_load_tls
0.00 +0.1 0.12 ± 33% perf-profile.self.cycles-pp.can_stop_idle_tick
0.00 +0.1 0.12 ± 15% perf-profile.self.cycles-pp.up_read
0.00 +0.1 0.13 ± 18% perf-profile.self.cycles-pp.__update_idle_core
0.00 +0.1 0.13 ± 33% perf-profile.self.cycles-pp.load_new_mm_cr3
0.00 +0.1 0.13 ± 12% perf-profile.self.cycles-pp.update_min_vruntime
0.32 ± 7% +0.1 0.45 ± 13% perf-profile.self.cycles-pp.___might_sleep
0.03 ±100% +0.1 0.16 ± 13% perf-profile.self.cycles-pp.cred_has_capability
0.11 ± 21% +0.1 0.24 ± 14% perf-profile.self.cycles-pp.get_unmapped_area
0.00 +0.1 0.14 ± 19% perf-profile.self.cycles-pp.put_prev_task_fair
0.00 +0.1 0.14 ± 30% perf-profile.self.cycles-pp.deactivate_task
0.00 +0.1 0.14 ± 46% perf-profile.self.cycles-pp.downgrade_write
0.09 ± 20% +0.1 0.23 ± 16% perf-profile.self.cycles-pp.perf_event_mmap_output
0.00 +0.1 0.15 ± 19% perf-profile.self.cycles-pp.pick_next_task_idle
0.00 +0.1 0.15 ± 13% perf-profile.self.cycles-pp.schedule_idle
0.00 +0.2 0.15 ± 24% perf-profile.self.cycles-pp.ttwu_stat
0.00 +0.2 0.15 ± 24% perf-profile.self.cycles-pp.cpu_startup_entry
0.01 ±173% +0.2 0.17 ± 28% perf-profile.self.cycles-pp.strlcpy
0.00 +0.2 0.16 ± 18% perf-profile.self.cycles-pp.schedule
0.18 ± 8% +0.2 0.34 ± 13% perf-profile.self.cycles-pp.__might_sleep
0.00 +0.2 0.16 ± 26% perf-profile.self.cycles-pp.rb_next
0.24 ± 6% +0.2 0.41 ± 11% perf-profile.self.cycles-pp.kmem_cache_alloc
0.18 ± 27% +0.2 0.35 ± 8% perf-profile.self.cycles-pp.vma_merge
0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.sched_ttwu_pending
0.00 +0.2 0.18 ± 22% perf-profile.self.cycles-pp.rcu_eqs_enter
0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.orc_find
0.00 +0.2 0.18 ± 18% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.rcu_eqs_exit
0.00 +0.2 0.19 ± 18% perf-profile.self.cycles-pp.__list_del_entry_valid
0.01 ±173% +0.2 0.21 ± 20% perf-profile.self.cycles-pp.__vma_rb_erase
0.00 +0.2 0.21 ± 27% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.00 +0.2 0.22 ± 13% perf-profile.self.cycles-pp.rcu_idle_exit
0.00 +0.2 0.22 ± 25% perf-profile.self.cycles-pp.__orc_find
0.00 +0.2 0.22 ± 21% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.2 0.22 ± 28% perf-profile.self.cycles-pp.menu_reflect
0.00 +0.2 0.23 ± 27% perf-profile.self.cycles-pp.__rwsem_mark_wake
0.00 +0.2 0.23 ± 21% perf-profile.self.cycles-pp.nr_iowait_cpu
0.00 +0.2 0.24 ± 13% perf-profile.self.cycles-pp.account_entity_dequeue
0.00 +0.2 0.24 ± 3% perf-profile.self.cycles-pp.tick_nohz_next_event
0.00 +0.2 0.24 ± 10% perf-profile.self.cycles-pp.call_cpuidle
0.25 ± 5% +0.2 0.49 ± 9% perf-profile.self.cycles-pp.perf_event_mmap
0.00 +0.2 0.25 ± 5% perf-profile.self.cycles-pp.rb_erase_cached
0.00 +0.2 0.25 ± 16% perf-profile.self.cycles-pp.pick_next_entity
0.38 ± 9% +0.2 0.63 ± 7% perf-profile.self.cycles-pp.__x64_sys_brk
0.00 +0.2 0.25 ± 7% perf-profile.self.cycles-pp.put_prev_entity
0.00 +0.3 0.27 ± 14% perf-profile.self.cycles-pp.activate_task
0.00 +0.3 0.28 ± 8% perf-profile.self.cycles-pp.get_iowait_load
0.24 ± 7% +0.3 0.52 ± 13% perf-profile.self.cycles-pp.__do_munmap
0.00 +0.3 0.28 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state
0.00 +0.3 0.29 ± 14% perf-profile.self.cycles-pp.account_entity_enqueue
0.00 +0.3 0.29 ± 7% perf-profile.self.cycles-pp.ktime_get
0.00 +0.3 0.33 ± 12% perf-profile.self.cycles-pp.check_preempt_curr
0.00 +0.3 0.33 ± 7% perf-profile.self.cycles-pp.available_idle_cpu
0.00 +0.3 0.33 ± 8% perf-profile.self.cycles-pp.__account_scheduler_latency
0.00 +0.3 0.35 ± 4% perf-profile.self.cycles-pp.__calc_delta
0.37 ± 5% +0.4 0.73 ± 6% perf-profile.self.cycles-pp.unmap_page_range
0.01 ±173% +0.4 0.45 ± 3% perf-profile.self.cycles-pp.wake_up_q
0.00 +0.4 0.44 ± 15% perf-profile.self.cycles-pp.dequeue_task_fair
0.12 ± 13% +0.4 0.56 ± 12% perf-profile.self.cycles-pp.__indirect_thunk_start
0.00 +0.5 0.46 ± 32% perf-profile.self.cycles-pp.resched_curr
0.00 +0.5 0.48 ± 10% perf-profile.self.cycles-pp.___perf_sw_event
0.01 ±173% +0.5 0.51 ± 14% perf-profile.self.cycles-pp.read_tsc
0.06 ± 62% +0.5 0.58 ± 12% perf-profile.self.cycles-pp.wake_q_add
0.44 ± 26% +0.6 0.99 ± 24% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.02 ±173% +0.6 0.58 ± 13% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.01 ±173% +0.6 0.59 ± 17% perf-profile.self.cycles-pp.update_curr
0.00 +0.6 0.59 ± 17% perf-profile.self.cycles-pp.dequeue_entity
0.04 ±106% +0.6 0.66 ± 6% perf-profile.self.cycles-pp.native_write_msr
0.00 +0.6 0.62 ± 13% perf-profile.self.cycles-pp.reweight_entity
0.00 +0.6 0.65 ± 13% perf-profile.self.cycles-pp.__next_timer_interrupt
0.23 ± 11% +0.7 0.89 ± 13% perf-profile.self.cycles-pp._raw_spin_lock
0.00 +0.7 0.66 ± 10% perf-profile.self.cycles-pp.enqueue_task_fair
0.01 ±173% +0.7 0.69 ± 4% perf-profile.self.cycles-pp.finish_task_switch
0.00 +0.7 0.69 ± 8% perf-profile.self.cycles-pp.__update_load_avg_se
0.02 ±173% +0.8 0.80 ± 2% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.01 ±173% +0.8 0.80 ± 5% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.8 0.78 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair
0.00 +0.8 0.80 ± 11% perf-profile.self.cycles-pp.unwind_next_frame
0.00 +0.8 0.83 ± 9% perf-profile.self.cycles-pp.find_next_bit
0.07 ± 17% +0.9 0.97 ± 9% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.01 ±173% +0.9 0.96 ± 7% perf-profile.self.cycles-pp.update_cfs_group
0.03 ±105% +1.0 0.98 ± 8% perf-profile.self.cycles-pp.set_next_entity
0.02 ±173% +1.0 1.01 ± 7% perf-profile.self.cycles-pp.pick_next_task_fair
0.03 ±105% +1.0 1.04 ± 8% perf-profile.self.cycles-pp.__switch_to_asm
0.04 ±103% +1.1 1.10 ± 9% perf-profile.self.cycles-pp.update_load_avg
0.01 ±173% +1.2 1.18 ± 7% perf-profile.self.cycles-pp.do_idle
0.01 ±173% +1.2 1.18 ± 5% perf-profile.self.cycles-pp.__switch_to
0.04 ±107% +1.2 1.28 ± 7% perf-profile.self.cycles-pp.enqueue_entity
0.01 ±173% +1.3 1.31 ± 14% perf-profile.self.cycles-pp.native_sched_clock
0.07 ± 28% +1.5 1.60 ± 6% perf-profile.self.cycles-pp.try_to_wake_up
0.08 ± 33% +1.7 1.81 ± 9% perf-profile.self.cycles-pp.menu_select
0.10 ± 43% +2.2 2.32 ± 9% perf-profile.self.cycles-pp.__sched_text_start
0.22 ± 44% +3.8 4.05 ± 6% perf-profile.self.cycles-pp.poll_idle
0.88 ± 20% +29.7 30.58 ± 5% perf-profile.self.cycles-pp.intel_idle
will-it-scale.per_thread_ops
220000 +-+----------------------------------------------------------------+
|. + + + +. + + +. :+ + .+. + + |
200000 +-+ +. + + .+ : + +. + + +. .+. + + .+ + + + |
180000 +-+ + + + .+. : + + +. .+ + + + +|
| + + + + |
160000 +-+ |
| |
140000 +-+ |
| |
120000 +-+ |
100000 +-O |
| |
80000 O-+ O O O O |
| O O O O O O O O O O O O O O O O O O O |
60000 +-+----------------------------------------------------------------+
will-it-scale.workload
1.8e+06 +-+---------------------------------------------------------------+
| .+ + .+ .+ + .+. .+. |
1.6e+06 +-+ + + + .+ +.+ + .+.+ + .+. + :.+ + + + |
| +.+ + + +. + +.+ +.+ +. .+ + + + +|
1.4e+06 +-+ + + + + |
| |
1.2e+06 +-+ |
| |
1e+06 +-+ |
| |
800000 +-O |
O O O |
600000 +-+ O O O O OO O O O O O O O O O O O O O |
| O O |
400000 +-+---------------------------------------------------------------+
will-it-scale.time.user_time
60 +-+--------------------------------------------------------------------+
| |
55 +-+.+ .+ .+ + .+.. .+. |
50 +-+ + .+.. .+ +.+ + .+..+ + .+. : + .+ + + + |
| +.+ + + .+. + +.+ +.+ +. : + + + +|
45 +-+ + + +.+ + |
| |
40 +-+ |
| |
35 +-+ |
30 +-O |
O O O O O O O O |
25 +-+ O O O O O O O O O O O O |
| O O O O |
20 +-+--------------------------------------------------------------------+
will-it-scale.time.system_time
2400 +-+------------------------------------------------------------------+
2200 +-+.+.+.+.+. .+.+.+.+.+.+..+.+.+.+.+.+. .+. |
| +.+.+.+.+ +.+ +.+.+.+.+.+.+.+.|
2000 +-+ |
1800 +-+ |
| |
1600 +-+ |
1400 +-+ |
1200 +-+ |
| |
1000 +-+ |
800 +-+ |
| |
600 O-O O O O O O O O O O O O O O O O O O O O O O |
400 +-+---------------------------O----O---------------------------------+
will-it-scale.time.percent_of_cpu_this_job_got
800 +-+-------------------------------------------------------------------+
|.+.+.+.+.+.+.+. .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+..+.+.+.+. .+.+.+.|
700 +-+ +. + |
| |
600 +-+ |
| |
500 +-+ |
| |
400 +-+ |
| |
300 +-+ |
| |
200 O-O O O O O O |
| O O O O O O O O O O O O O O O O O O |
100 +-+-------------------------------------------------------------------+
will-it-scale.time.voluntary_context_switches
1.6e+08 +-+---------------------------------------------------------------+
| O O O O O |
1.4e+08 +-O O O O O O O |
1.2e+08 O-+ O O OO O O O O |
| O O O O |
1e+08 +-+ |
| |
8e+07 +-+ |
| |
6e+07 +-+ |
4e+07 +-+ + .|
| .+. + :.+. .+.+.+.++.+.+.+.+.+.+.+ |
2e+07 +-+. .+.+.+ + + +.+. .+.+.+.+. .+.+.+ |
| + + + |
0 +-+---------------------------------------------------------------+
will-it-scale.time.involuntary_context_switches
200000 +-+----------------------------------------------------------------+
180000 +-+ + .+ : + + .+ + + .+ |
| + : : + + : |
160000 +-+ : : : + + |
140000 +-+ + + +.: +.+. + + .+ + + |
| + + : : + +.+ +.+.+ : + + |
120000 +-+ + : : : + :|
100000 +-+ + + :|
80000 +-+ |
| |
60000 +-+ |
40000 +-+ |
| |
20000 +-+ |
0 O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-OO-O-O-O-O-O-O-------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 12 months
Test monitoring on custom github repo
by Thomas Garnier
Hi,
I am working on KASLR (PIE for x86_64). I previously used Kees (CCed)
branches for lkp bot testing but someone told be I could ask you to add a
custom github path to monitor all branches on it.
I pushed my changes to: https://github.com/thgarnie/linux (kasrl_pie_v2
right now)
Can you add it? Anything I need to do?
Thanks,
--
Thomas
2 years
[lkp-robot] [brd] 316ba5736c: aim7.jobs-per-min -11.2% regression
by kernel test robot
Greeting,
FYI, we noticed a -11.2% regression of aim7.jobs-per-min due to commit:
commit: 316ba5736c9caa5dbcd84085989862d2df57431d ("brd: Mark as non-rotational")
https://git.kernel.org/cgit/linux/kernel/git/axboe/linux-block.git for-4.18/block
in testcase: aim7
on test machine: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory
with following parameters:
disk: 1BRD_48G
fs: btrfs
test: disk_rw
load: 1500
cpufreq_governor: performance
test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/
Details are as below:
-------------------------------------------------------------------------------------------------->
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase:
gcc-7/performance/1BRD_48G/btrfs/x86_64-rhel-7.2/1500/debian-x86_64-2016-08-31.cgz/lkp-ivb-ep01/disk_rw/aim7
commit:
522a777566 ("block: consolidate struct request timestamp fields")
316ba5736c ("brd: Mark as non-rotational")
522a777566f56696 316ba5736c9caa5dbcd8408598
---------------- --------------------------
%stddev %change %stddev
\ | \
28321 -11.2% 25147 aim7.jobs-per-min
318.19 +12.6% 358.23 aim7.time.elapsed_time
318.19 +12.6% 358.23 aim7.time.elapsed_time.max
1437526 ± 2% +14.6% 1646849 ± 2% aim7.time.involuntary_context_switches
11986 +14.2% 13691 aim7.time.system_time
73.06 ± 2% -3.6% 70.43 aim7.time.user_time
2449470 ± 2% -25.0% 1837521 ± 4% aim7.time.voluntary_context_switches
20.25 ± 58% +1681.5% 360.75 ±109% numa-meminfo.node1.Mlocked
456062 -16.3% 381859 softirqs.SCHED
9015 ± 7% -21.3% 7098 ± 22% meminfo.CmaFree
47.50 ± 58% +1355.8% 691.50 ± 92% meminfo.Mlocked
5.24 ± 3% -1.2 3.99 ± 2% mpstat.cpu.idle%
0.61 ± 2% -0.1 0.52 ± 2% mpstat.cpu.usr%
16627 +12.8% 18762 ± 4% slabinfo.Acpi-State.active_objs
16627 +12.9% 18775 ± 4% slabinfo.Acpi-State.num_objs
57.00 ± 2% +17.5% 67.00 vmstat.procs.r
20936 -24.8% 15752 ± 2% vmstat.system.cs
45474 -1.7% 44681 vmstat.system.in
6.50 ± 59% +1157.7% 81.75 ± 75% numa-vmstat.node0.nr_mlock
242870 ± 3% +13.2% 274913 ± 7% numa-vmstat.node0.nr_written
2278 ± 7% -22.6% 1763 ± 21% numa-vmstat.node1.nr_free_cma
4.75 ± 58% +1789.5% 89.75 ±109% numa-vmstat.node1.nr_mlock
88018135 ± 3% -48.9% 44980457 ± 7% cpuidle.C1.time
1398288 ± 3% -51.1% 683493 ± 9% cpuidle.C1.usage
3499814 ± 2% -38.5% 2153158 ± 5% cpuidle.C1E.time
52722 ± 4% -45.6% 28692 ± 6% cpuidle.C1E.usage
9865857 ± 3% -40.1% 5905155 ± 5% cpuidle.C3.time
69656 ± 2% -42.6% 39990 ± 5% cpuidle.C3.usage
590856 ± 2% -12.3% 517910 cpuidle.C6.usage
46160 ± 7% -53.7% 21372 ± 11% cpuidle.POLL.time
1716 ± 7% -46.6% 916.25 ± 14% cpuidle.POLL.usage
197656 +4.1% 205732 proc-vmstat.nr_active_file
191867 +4.1% 199647 proc-vmstat.nr_dirty
509282 +1.6% 517318 proc-vmstat.nr_file_pages
2282 ± 8% -24.4% 1725 ± 22% proc-vmstat.nr_free_cma
357.50 +10.6% 395.25 ± 2% proc-vmstat.nr_inactive_file
11.50 ± 58% +1397.8% 172.25 ± 93% proc-vmstat.nr_mlock
970355 ± 4% +14.6% 1111549 ± 8% proc-vmstat.nr_written
197984 +4.1% 206034 proc-vmstat.nr_zone_active_file
357.50 +10.6% 395.25 ± 2% proc-vmstat.nr_zone_inactive_file
192282 +4.1% 200126 proc-vmstat.nr_zone_write_pending
7901465 ± 3% -14.0% 6795016 ± 16% proc-vmstat.pgalloc_movable
886101 +10.2% 976329 proc-vmstat.pgfault
2.169e+12 +15.2% 2.497e+12 perf-stat.branch-instructions
0.41 -0.1 0.35 perf-stat.branch-miss-rate%
31.19 ± 2% +1.6 32.82 perf-stat.cache-miss-rate%
9.116e+09 +8.3% 9.869e+09 perf-stat.cache-misses
2.924e+10 +2.9% 3.008e+10 ± 2% perf-stat.cache-references
6712739 ± 2% -15.4% 5678643 ± 2% perf-stat.context-switches
4.02 +2.7% 4.13 perf-stat.cpi
3.761e+13 +17.3% 4.413e+13 perf-stat.cpu-cycles
606958 -13.7% 523758 ± 2% perf-stat.cpu-migrations
2.476e+12 +13.4% 2.809e+12 perf-stat.dTLB-loads
0.18 ± 2% -0.0 0.16 ± 9% perf-stat.dTLB-store-miss-rate%
1.079e+09 ± 2% -9.6% 9.755e+08 ± 9% perf-stat.dTLB-store-misses
5.933e+11 +1.6% 6.029e+11 perf-stat.dTLB-stores
9.349e+12 +14.2% 1.068e+13 perf-stat.instructions
11247 ± 11% +19.8% 13477 ± 9% perf-stat.instructions-per-iTLB-miss
0.25 -2.6% 0.24 perf-stat.ipc
865561 +10.3% 954350 perf-stat.minor-faults
2.901e+09 ± 3% +9.8% 3.186e+09 ± 3% perf-stat.node-load-misses
3.682e+09 ± 3% +11.0% 4.088e+09 ± 3% perf-stat.node-loads
3.778e+09 +4.8% 3.959e+09 ± 2% perf-stat.node-store-misses
5.079e+09 +6.4% 5.402e+09 perf-stat.node-stores
865565 +10.3% 954352 perf-stat.page-faults
51.75 ± 5% -12.5% 45.30 ± 10% sched_debug.cfs_rq:/.load_avg.avg
316.35 ± 3% +17.2% 370.81 ± 8% sched_debug.cfs_rq:/.util_est_enqueued.stddev
15294 ± 30% +234.9% 51219 ± 76% sched_debug.cpu.avg_idle.min
299443 ± 3% -7.3% 277566 ± 5% sched_debug.cpu.avg_idle.stddev
1182 ± 19% -26.3% 872.02 ± 13% sched_debug.cpu.nr_load_updates.stddev
1.22 ± 8% +21.7% 1.48 ± 6% sched_debug.cpu.nr_running.avg
2.75 ± 10% +26.2% 3.47 ± 6% sched_debug.cpu.nr_running.max
0.58 ± 7% +24.2% 0.73 ± 6% sched_debug.cpu.nr_running.stddev
77148 -20.0% 61702 ± 7% sched_debug.cpu.nr_switches.avg
70024 -24.8% 52647 ± 8% sched_debug.cpu.nr_switches.min
6662 ± 6% +61.9% 10789 ± 24% sched_debug.cpu.nr_switches.stddev
80.45 ± 18% -19.1% 65.05 ± 6% sched_debug.cpu.nr_uninterruptible.stddev
76819 -19.3% 62008 ± 8% sched_debug.cpu.sched_count.avg
70616 -23.5% 53996 ± 8% sched_debug.cpu.sched_count.min
5494 ± 9% +85.3% 10179 ± 26% sched_debug.cpu.sched_count.stddev
16936 -52.9% 7975 ± 9% sched_debug.cpu.sched_goidle.avg
19281 -49.9% 9666 ± 7% sched_debug.cpu.sched_goidle.max
15417 -54.8% 6962 ± 10% sched_debug.cpu.sched_goidle.min
875.00 ± 6% -35.0% 569.09 ± 13% sched_debug.cpu.sched_goidle.stddev
40332 -23.5% 30851 ± 7% sched_debug.cpu.ttwu_count.avg
35074 -26.3% 25833 ± 6% sched_debug.cpu.ttwu_count.min
3239 ± 8% +67.4% 5422 ± 28% sched_debug.cpu.ttwu_count.stddev
5232 +27.4% 6665 ± 13% sched_debug.cpu.ttwu_local.avg
15877 ± 12% +77.5% 28184 ± 27% sched_debug.cpu.ttwu_local.max
2530 ± 10% +95.9% 4956 ± 27% sched_debug.cpu.ttwu_local.stddev
2.52 ± 7% -0.6 1.95 ± 3% perf-profile.calltrace.cycles-pp.btrfs_dirty_pages.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write
1.48 ± 12% -0.5 1.01 ± 4% perf-profile.calltrace.cycles-pp.btrfs_get_extent.btrfs_dirty_pages.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write
1.18 ± 16% -0.4 0.76 ± 7% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_get_extent.btrfs_dirty_pages.__btrfs_buffered_write
1.18 ± 16% -0.4 0.76 ± 7% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.btrfs_get_extent.btrfs_dirty_pages.__btrfs_buffered_write.btrfs_file_write_iter
0.90 ± 17% -0.3 0.56 ± 4% perf-profile.calltrace.cycles-pp.__dentry_kill.dentry_kill.dput.__fput.task_work_run
0.90 ± 17% -0.3 0.56 ± 4% perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dentry_kill.dput.__fput
0.90 ± 17% -0.3 0.56 ± 4% perf-profile.calltrace.cycles-pp.dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop
0.90 ± 18% -0.3 0.56 ± 4% perf-profile.calltrace.cycles-pp.btrfs_evict_inode.evict.__dentry_kill.dentry_kill.dput
0.90 ± 17% -0.3 0.57 ± 5% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.90 ± 17% -0.3 0.57 ± 5% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.90 ± 17% -0.3 0.57 ± 5% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.90 ± 17% -0.3 0.57 ± 5% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
1.69 -0.1 1.54 ± 2% perf-profile.calltrace.cycles-pp.lock_and_cleanup_extent_if_need.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write
0.87 ± 4% -0.1 0.76 ± 2% perf-profile.calltrace.cycles-pp.__clear_extent_bit.clear_extent_bit.lock_and_cleanup_extent_if_need.__btrfs_buffered_write.btrfs_file_write_iter
0.87 ± 4% -0.1 0.76 ± 2% perf-profile.calltrace.cycles-pp.clear_extent_bit.lock_and_cleanup_extent_if_need.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write
0.71 ± 6% -0.1 0.61 ± 2% perf-profile.calltrace.cycles-pp.clear_state_bit.__clear_extent_bit.clear_extent_bit.lock_and_cleanup_extent_if_need.__btrfs_buffered_write
0.69 ± 6% -0.1 0.60 ± 2% perf-profile.calltrace.cycles-pp.btrfs_clear_bit_hook.clear_state_bit.__clear_extent_bit.clear_extent_bit.lock_and_cleanup_extent_if_need
96.77 +0.6 97.33 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.56 ± 3% perf-profile.calltrace.cycles-pp.can_overcommit.reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.__btrfs_buffered_write.btrfs_file_write_iter
96.72 +0.6 97.29 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
43.13 +0.8 43.91 perf-profile.calltrace.cycles-pp.btrfs_inode_rsv_release.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write
42.37 +0.8 43.16 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.block_rsv_release_bytes.btrfs_inode_rsv_release.__btrfs_buffered_write
43.11 +0.8 43.89 perf-profile.calltrace.cycles-pp.block_rsv_release_bytes.btrfs_inode_rsv_release.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write
42.96 +0.8 43.77 perf-profile.calltrace.cycles-pp._raw_spin_lock.block_rsv_release_bytes.btrfs_inode_rsv_release.__btrfs_buffered_write.btrfs_file_write_iter
95.28 +0.9 96.23 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
95.22 +1.0 96.18 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
94.88 +1.0 95.85 perf-profile.calltrace.cycles-pp.__vfs_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
94.83 +1.0 95.80 perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.__vfs_write.vfs_write.ksys_write.do_syscall_64
94.51 +1.0 95.50 perf-profile.calltrace.cycles-pp.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write.ksys_write
42.44 +1.1 43.52 perf-profile.calltrace.cycles-pp._raw_spin_lock.reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.__btrfs_buffered_write.btrfs_file_write_iter
42.09 +1.1 43.18 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.__btrfs_buffered_write
44.07 +1.2 45.29 perf-profile.calltrace.cycles-pp.btrfs_delalloc_reserve_metadata.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write
43.42 +1.3 44.69 perf-profile.calltrace.cycles-pp.reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.__btrfs_buffered_write.btrfs_file_write_iter.__vfs_write
2.06 ± 18% -0.9 1.21 ± 6% perf-profile.children.cycles-pp.btrfs_search_slot
2.54 ± 7% -0.6 1.96 ± 3% perf-profile.children.cycles-pp.btrfs_dirty_pages
1.05 ± 24% -0.5 0.52 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.50 ± 12% -0.5 1.03 ± 4% perf-profile.children.cycles-pp.btrfs_get_extent
1.22 ± 15% -0.4 0.79 ± 8% perf-profile.children.cycles-pp.btrfs_lookup_file_extent
0.81 ± 5% -0.4 0.41 ± 6% perf-profile.children.cycles-pp.btrfs_calc_reclaim_metadata_size
0.74 ± 24% -0.4 0.35 ± 9% perf-profile.children.cycles-pp.btrfs_lock_root_node
0.74 ± 24% -0.4 0.35 ± 9% perf-profile.children.cycles-pp.btrfs_tree_lock
0.90 ± 17% -0.3 0.56 ± 4% perf-profile.children.cycles-pp.__dentry_kill
0.90 ± 17% -0.3 0.56 ± 4% perf-profile.children.cycles-pp.evict
0.90 ± 17% -0.3 0.56 ± 4% perf-profile.children.cycles-pp.dentry_kill
0.90 ± 18% -0.3 0.56 ± 4% perf-profile.children.cycles-pp.btrfs_evict_inode
0.91 ± 18% -0.3 0.57 ± 4% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.52 ± 20% -0.3 0.18 ± 14% perf-profile.children.cycles-pp.do_idle
0.90 ± 17% -0.3 0.57 ± 5% perf-profile.children.cycles-pp.task_work_run
0.90 ± 17% -0.3 0.57 ± 5% perf-profile.children.cycles-pp.__fput
0.90 ± 18% -0.3 0.57 ± 4% perf-profile.children.cycles-pp.dput
0.51 ± 20% -0.3 0.18 ± 14% perf-profile.children.cycles-pp.secondary_startup_64
0.51 ± 20% -0.3 0.18 ± 14% perf-profile.children.cycles-pp.cpu_startup_entry
0.50 ± 21% -0.3 0.17 ± 16% perf-profile.children.cycles-pp.start_secondary
0.47 ± 20% -0.3 0.16 ± 13% perf-profile.children.cycles-pp.cpuidle_enter_state
0.47 ± 19% -0.3 0.16 ± 13% perf-profile.children.cycles-pp.intel_idle
0.61 ± 20% -0.3 0.36 ± 11% perf-profile.children.cycles-pp.btrfs_tree_read_lock
0.47 ± 26% -0.3 0.21 ± 10% perf-profile.children.cycles-pp.prepare_to_wait_event
0.64 ± 18% -0.2 0.39 ± 9% perf-profile.children.cycles-pp.btrfs_read_lock_root_node
0.40 ± 22% -0.2 0.21 ± 5% perf-profile.children.cycles-pp.btrfs_clear_path_blocking
0.38 ± 23% -0.2 0.19 ± 13% perf-profile.children.cycles-pp.finish_wait
1.51 ± 3% -0.2 1.35 ± 2% perf-profile.children.cycles-pp.__clear_extent_bit
1.71 -0.1 1.56 ± 2% perf-profile.children.cycles-pp.lock_and_cleanup_extent_if_need
0.29 ± 25% -0.1 0.15 ± 10% perf-profile.children.cycles-pp.btrfs_orphan_del
0.27 ± 27% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.btrfs_del_orphan_item
0.33 ± 18% -0.1 0.19 ± 9% perf-profile.children.cycles-pp.queued_read_lock_slowpath
0.33 ± 19% -0.1 0.20 ± 4% perf-profile.children.cycles-pp.__wake_up_common_lock
0.45 ± 15% -0.1 0.34 ± 2% perf-profile.children.cycles-pp.btrfs_alloc_data_chunk_ondemand
0.47 ± 16% -0.1 0.36 ± 4% perf-profile.children.cycles-pp.btrfs_check_data_free_space
0.91 ± 4% -0.1 0.81 ± 3% perf-profile.children.cycles-pp.clear_extent_bit
1.07 ± 5% -0.1 0.97 perf-profile.children.cycles-pp.__set_extent_bit
0.77 ± 6% -0.1 0.69 ± 3% perf-profile.children.cycles-pp.btrfs_clear_bit_hook
0.17 ± 20% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.queued_write_lock_slowpath
0.16 ± 22% -0.1 0.08 ± 24% perf-profile.children.cycles-pp.btrfs_lookup_inode
0.21 ± 17% -0.1 0.14 ± 19% perf-profile.children.cycles-pp.__btrfs_update_delayed_inode
0.26 ± 12% -0.1 0.18 ± 13% perf-profile.children.cycles-pp.btrfs_async_run_delayed_root
0.52 ± 5% -0.1 0.45 perf-profile.children.cycles-pp.set_extent_bit
0.45 ± 5% -0.1 0.40 ± 3% perf-profile.children.cycles-pp.alloc_extent_state
0.11 ± 17% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.btrfs_clear_lock_blocking_rw
0.28 ± 9% -0.0 0.23 ± 3% perf-profile.children.cycles-pp.btrfs_drop_pages
0.07 -0.0 0.03 ±100% perf-profile.children.cycles-pp.btrfs_set_lock_blocking_rw
0.39 ± 3% -0.0 0.34 ± 3% perf-profile.children.cycles-pp.get_alloc_profile
0.33 ± 7% -0.0 0.29 perf-profile.children.cycles-pp.btrfs_set_extent_delalloc
0.38 ± 2% -0.0 0.35 ± 4% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.49 ± 3% -0.0 0.46 ± 3% perf-profile.children.cycles-pp.pagecache_get_page
0.18 ± 4% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.truncate_inode_pages_range
0.08 ± 5% -0.0 0.05 ± 9% perf-profile.children.cycles-pp.btrfs_set_path_blocking
0.08 ± 6% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.truncate_cleanup_page
0.80 ± 4% +0.2 0.95 ± 2% perf-profile.children.cycles-pp.can_overcommit
96.84 +0.5 97.37 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
96.80 +0.5 97.35 perf-profile.children.cycles-pp.do_syscall_64
43.34 +0.8 44.17 perf-profile.children.cycles-pp.btrfs_inode_rsv_release
43.49 +0.8 44.32 perf-profile.children.cycles-pp.block_rsv_release_bytes
95.32 +0.9 96.26 perf-profile.children.cycles-pp.ksys_write
95.26 +0.9 96.20 perf-profile.children.cycles-pp.vfs_write
94.91 +1.0 95.88 perf-profile.children.cycles-pp.__vfs_write
94.84 +1.0 95.81 perf-profile.children.cycles-pp.btrfs_file_write_iter
94.55 +1.0 95.55 perf-profile.children.cycles-pp.__btrfs_buffered_write
86.68 +1.0 87.70 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
44.08 +1.2 45.31 perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata
43.49 +1.3 44.77 perf-profile.children.cycles-pp.reserve_metadata_bytes
87.59 +1.8 89.38 perf-profile.children.cycles-pp._raw_spin_lock
0.47 ± 19% -0.3 0.16 ± 13% perf-profile.self.cycles-pp.intel_idle
0.33 ± 6% -0.1 0.18 ± 6% perf-profile.self.cycles-pp.get_alloc_profile
0.27 ± 8% -0.0 0.22 ± 4% perf-profile.self.cycles-pp.btrfs_drop_pages
0.07 -0.0 0.03 ±100% perf-profile.self.cycles-pp.btrfs_set_lock_blocking_rw
0.14 ± 5% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.clear_page_dirty_for_io
0.09 ± 5% -0.0 0.07 ± 10% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.17 ± 4% +0.1 0.23 ± 3% perf-profile.self.cycles-pp.reserve_metadata_bytes
0.31 ± 7% +0.1 0.45 ± 2% perf-profile.self.cycles-pp.can_overcommit
86.35 +1.0 87.39 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
aim7.jobs-per-min
29000 +-+-----------------------------------------------------------------+
28500 +-+ +.. + +..+.. +.. |
|..+ +.+..+.. : .. + .+.+..+..+.+.. .+..+.. + + + |
28000 +-+ + .. : + +. + + + |
27500 +-+ + + |
| |
27000 +-+ |
26500 +-+ |
26000 +-+ |
| |
25500 +-+ O O O O O |
25000 +-+ O O O O O O O O O
| O O O O O O O O |
24500 O-+O O O O |
24000 +-+-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Xiaolong
2 years, 1 month
530a2dac5b ("atomic_trylock conversions"): watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/u4:2:47]
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
git://git.infradead.org/users/willy/linux-dax.git xarray-conv
commit 530a2dac5ba3d2d6c77af6dc82ef83e9a8050512
Author: Matthew Wilcox <willy(a)infradead.org>
AuthorDate: Sat Oct 27 08:14:07 2018 -0400
Commit: Matthew Wilcox <willy(a)infradead.org>
CommitDate: Fri Nov 30 12:45:26 2018 -0500
atomic_trylock conversions
5b50b41729 nfs: Convert cb_ident_idr to XArray
530a2dac5b atomic_trylock conversions
e999b2b05c scsi: Convert same_target_siblings to XArray
+------------------------------------------------+------------+------------+------------+
| | 5b50b41729 | 530a2dac5b | e999b2b05c |
+------------------------------------------------+------------+------------+------------+
| boot_successes | 65 | 0 | 0 |
| boot_failures | 0 | 34 | 21 |
| BUG:soft_lockup-CPU##stuck_for#s | 0 | 34 | 21 |
| EIP:osq_lock | 0 | 34 | 21 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 0 | 34 | 21 |
+------------------------------------------------+------------+------------+------------+
[ 1.068813] spin_lock-torture: Creating lock_torture_stats task
[ 1.069597] spin_lock-torture: lock_torture_writer task started
[ 1.070700] spin_lock-torture: lock_torture_stats task started
[ 1.623681] _warn_unseeded_randomness: 1 callbacks suppressed
[ 1.623693] random: get_random_u32 called from get_random_order+0x65/0x90 with crng_init=0
[ 28.503079] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/u4:2:47]
[ 28.503079] irq event stamp: 28084
[ 28.503079] hardirqs last enabled at (28083): [<79000ff6>] trace_hardirqs_on_thunk+0xc/0x10
[ 28.503079] hardirqs last disabled at (28084): [<79001006>] trace_hardirqs_off_thunk+0xc/0x10
[ 28.503079] softirqs last enabled at (28082): [<79a97006>] __do_softirq+0x3c6/0x445
[ 28.503079] softirqs last disabled at (28075): [<7901d2b8>] do_softirq_own_stack+0x28/0x40
[ 28.503079] CPU: 1 PID: 47 Comm: kworker/u4:2 Not tainted 4.20.0-rc4-00242-g530a2da #1078
[ 28.503079] Workqueue: test-ww_mutex stress_inorder_work
[ 28.503079] EIP: osq_lock+0xaa/0x120
[ 28.503079] Code: 3b 11 74 0c 8b 42 08 85 c0 74 1d eb a9 8d 76 00 89 d0 f0 0f b1 31 39 c2 75 ea 8d b6 00 00 00 00 eb 0d 8d b6 00 00 00 00 f3 90 <8b> 4a 04 eb d1 64 8b 35 24 a1 0e 7a 46 85 c9 74 08 8b 41 0c 89 45
[ 28.503079] EAX: 00000000 EBX: 96952654 ECX: 975f88c0 EDX: 9775a8c0
[ 28.503079] ESI: 00000000 EDI: 96952654 EBP: 9568de14 ESP: 9568de04
[ 28.503079] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00200246
[ 28.503079] CR0: 80050033 CR2: ffffffff CR3: 0224a000 CR4: 001406d0
[ 28.503079] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 28.503079] DR6: fffe0ff0 DR7: 00000400
[ 28.503079] Call Trace:
[ 28.503079] __ww_mutex_lock+0x20b/0xe90
[ 28.503079] ? __ww_mutex_lock+0x118/0xe90
[ 28.503079] ? stress_inorder_work+0x1bc/0x2f0
[ 28.503079] ? __might_sleep+0x77/0xa0
[ 28.503079] ww_mutex_lock+0x3a/0xa0
[ 28.503079] ? stress_inorder_work+0x112/0x2f0
[ 28.503079] stress_inorder_work+0x112/0x2f0
[ 28.503079] ? process_one_work+0x2c5/0x570
[ 28.503079] process_one_work+0x2c5/0x570
[ 28.503079] ? process_one_work+0x1a0/0x570
[ 28.503079] ? worker_thread+0x37/0x450
[ 28.503079] worker_thread+0x2a9/0x450
[ 28.503079] kthread+0xfd/0x110
[ 28.503079] ? process_one_work+0x570/0x570
[ 28.503079] ? __kthread_bind_mask+0x60/0x60
[ 28.503079] ret_from_fork+0x19/0x24
[ 28.503079] Kernel panic - not syncing: softlockup: hung tasks
[ 28.503079] CPU: 1 PID: 47 Comm: kworker/u4:2 Tainted: G L 4.20.0-rc4-00242-g530a2da #1078
[ 28.503079] Workqueue: test-ww_mutex stress_inorder_work
[ 28.503079] Call Trace:
[ 28.503079] dump_stack+0x60/0x96
[ 28.503079] panic+0xa3/0x1d8
[ 28.503079] watchdog_timer_fn+0x225/0x270
[ 28.503079] __hrtimer_run_queues+0x2e7/0x500
[ 28.503079] ? softlockup_fn+0x40/0x40
[ 28.503079] hrtimer_interrupt+0x10a/0x290
[ 28.503079] smp_apic_timer_interrupt+0x153/0x2a0
[ 28.503079] ? trace_hardirqs_off_thunk+0xc/0x10
[ 28.503079] apic_timer_interrupt+0xe8/0xf0
[ 28.503079] EIP: osq_lock+0xaa/0x120
[ 28.503079] Code: 3b 11 74 0c 8b 42 08 85 c0 74 1d eb a9 8d 76 00 89 d0 f0 0f b1 31 39 c2 75 ea 8d b6 00 00 00 00 eb 0d 8d b6 00 00 00 00 f3 90 <8b> 4a 04 eb d1 64 8b 35 24 a1 0e 7a 46 85 c9 74 08 8b 41 0c 89 45
[ 28.503079] EAX: 00000000 EBX: 96952654 ECX: 975f88c0 EDX: 9775a8c0
[ 28.503079] ESI: 00000000 EDI: 96952654 EBP: 9568de14 ESP: 9568de04
[ 28.503079] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00200246
[ 28.503079] __ww_mutex_lock+0x20b/0xe90
[ 28.503079] ? __ww_mutex_lock+0x118/0xe90
[ 28.503079] ? stress_inorder_work+0x1bc/0x2f0
[ 28.503079] ? __might_sleep+0x77/0xa0
[ 28.503079] ww_mutex_lock+0x3a/0xa0
[ 28.503079] ? stress_inorder_work+0x112/0x2f0
[ 28.503079] stress_inorder_work+0x112/0x2f0
[ 28.503079] ? process_one_work+0x2c5/0x570
[ 28.503079] process_one_work+0x2c5/0x570
[ 28.503079] ? process_one_work+0x1a0/0x570
[ 28.503079] ? worker_thread+0x37/0x450
[ 28.503079] worker_thread+0x2a9/0x450
[ 28.503079] kthread+0xfd/0x110
[ 28.503079] ? process_one_work+0x570/0x570
[ 28.503079] ? __kthread_bind_mask+0x60/0x60
[ 28.503079] ret_from_fork+0x19/0x24
[ 28.503079] Kernel Offset: disabled
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start e999b2b05c4509823c2154abf926b7f72969df91 94f371cb73944b410a269d570d6946c042f2ddd0 --
git bisect good 308f079ebe859e59f7d16d205673b7c8a6d02c59 # 05:07 G 16 0 4 4 radix tree: Remove preload API
git bisect good ff24e1e4ace20a91359fbd0a0bf309a5a5c0d422 # 05:17 G 16 0 0 0 pinctrl: Convert pin_group_tree to XArray
git bisect good 6c71ed0cd588678e10d47443db787cef768e9dc6 # 05:31 G 15 0 1 1 st: Convert to XArray
git bisect good c16f163da63b94be35fa6b3757546522ddae4796 # 05:40 G 15 0 1 1 firewire: Convert resource_idr to XArray
git bisect bad adb2113b7e418b5f0b4b239327c79b69221d098d # 05:49 B 8 7 8 24 fls: Change parameter to unsigned int
git bisect good 5b50b41729260404716d66e049f9ceacf24dc3a2 # 06:06 G 15 0 0 0 nfs: Convert cb_ident_idr to XArray
git bisect bad 530a2dac5ba3d2d6c77af6dc82ef83e9a8050512 # 06:18 B 1 2 1 1 atomic_trylock conversions
# first bad commit: [530a2dac5ba3d2d6c77af6dc82ef83e9a8050512] atomic_trylock conversions
git bisect good 5b50b41729260404716d66e049f9ceacf24dc3a2 # 06:23 G 47 0 0 0 nfs: Convert cb_ident_idr to XArray
# extra tests on HEAD of dax/xarray-conv
git bisect bad e999b2b05c4509823c2154abf926b7f72969df91 # 06:23 B 0 9 36 10 scsi: Convert same_target_siblings to XArray
# extra tests on tree/branch dax/xarray-conv
git bisect bad e999b2b05c4509823c2154abf926b7f72969df91 # 06:24 B 0 9 36 10 scsi: Convert same_target_siblings to XArray
# extra tests with first bad commit reverted
git bisect good ce135013d596cf882c6593671836f6d99e459312 # 06:45 G 16 0 0 0 Revert "atomic_trylock conversions"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
2 years, 1 month
[NFS] 227a5ea5cc: BUG:KASAN:null-ptr-deref_in_s
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 227a5ea5ccad1d2fed224de487b5062902e768af ("NFS: Add fs_context support.")
https://git.kernel.org/cgit/linux/kernel/git/viro/vfs.git Q18
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu IvyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------+------------+------------+
| | b51dcaefdc | 227a5ea5cc |
+------------------------------------------------+------------+------------+
| boot_successes | 4 | 0 |
| boot_failures | 2 | 4 |
| IP-Config:Auto-configuration_of_network_failed | 2 | |
| BUG:KASAN:null-ptr-deref_in_s | 0 | 4 |
| BUG:unable_to_handle_kernel | 0 | 4 |
| Oops:#[##] | 0 | 4 |
| RIP:security_sb_set_mnt_opts | 0 | 4 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 4 |
+------------------------------------------------+------------+------------+
[ 66.318452] BUG: KASAN: null-ptr-deref in security_sb_set_mnt_opts+0x2a/0xeb
[ 66.319619] Read of size 4 at addr 0000000000000010 by task mount.nfs/476
[ 66.320733]
[ 66.321096] CPU: 0 PID: 476 Comm: mount.nfs Not tainted 4.20.0-rc1-00059-g227a5ea #1
[ 66.322433] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 66.323855] Call Trace:
[ 66.324388] dump_stack+0x2f/0x3e
[ 66.325027] kasan_report+0x311/0x393
[ 66.325699] __asan_load4+0x2d/0xe2
[ 66.326355] security_sb_set_mnt_opts+0x2a/0xeb
[ 66.327158] nfs_set_sb_security+0xdc/0x197
[ 66.327916] ? nfs_reconfigure+0x549/0x549
[ 66.328649] nfs_get_tree_common+0x738/0x7c1
[ 66.329440] nfs_try_get_tree+0x45e/0x4ae
[ 66.330179] ? nfs_get_tree_common+0x7c1/0x7c1
[ 66.330977] ? nfs_fs_context_validate+0x598/0x7d6
[ 66.331811] ? generic_parse_monolithic+0x17c/0x1b6
[ 66.332675] ? ___might_sleep+0xa0/0x2ab
[ 66.333403] ? kasan_check_read+0x1b/0x23
[ 66.344026] ? preempt_count_add+0x114/0x127
[ 66.344852] ? preempt_count_sub+0x1f/0x15f
[ 66.345605] ? find_nfs_version+0x139/0x143
[ 66.346367] nfs_get_tree+0x258/0x2a8
[ 66.347060] ? vfs_get_tree+0x133/0x3a4
[ 66.347791] vfs_get_tree+0x139/0x3a4
[ 66.348470] do_mount+0x10b8/0x1220
[ 66.349143] ? copy_mount_string+0x4d/0x4d
[ 66.349889] ? kmem_cache_alloc_trace+0x239/0x24f
[ 66.350723] ? copy_mount_options+0x42/0x2d3
[ 66.351484] ? copy_mount_options+0x2c4/0x2d3
[ 66.352241] ksys_mount+0xce/0x11e
[ 66.352890] __x64_sys_mount+0x72/0x83
[ 66.353612] do_syscall_64+0xa8/0x1eb
[ 66.354283] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 66.355182] RIP: 0033:0x7f9a1e19a24a
[ 66.355867] Code: 48 8b 0d 51 fc 2a 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 1e fc 2a 00 f7 d8 64 89 01 48
[ 66.358838] RSP: 002b:00007fffdd4e9928 EFLAGS: 00000206 ORIG_RAX: 00000000000000a5
[ 66.360112] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f9a1e19a24a
[ 66.361321] RDX: 00005582b0a54f70 RSI: 00005582b0a54f50 RDI: 00005582b0a53210
[ 66.362507] RBP: 00007fffdd4e9b20 R08: 00005582b0a60320 R09: 0000000000000060
[ 66.363654] R10: 0000000000000000 R11: 0000000000000206 R12: 00007f9a1eade410
[ 66.364845] R13: 00007fffdd4e9b20 R14: 00007fffdd4e9a20 R15: 00005582b0a60300
[ 66.366043] ==================================================================
[ 66.367300] Disabling lock debugging due to kernel taint
[ 66.512352] BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
[ 66.513807] PGD 0 P4D 0
[ 66.514322] Oops: 0000 [#1] PREEMPT KASAN PTI
[ 66.515181] CPU: 0 PID: 476 Comm: mount.nfs Tainted: G B 4.20.0-rc1-00059-g227a5ea #1
[ 66.516770] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 66.518260] RIP: 0010:security_sb_set_mnt_opts+0x2a/0xeb
[ 66.519206] Code: 0f 1f 44 00 00 41 57 41 56 49 89 cf 41 55 41 54 49 89 f4 55 53 49 89 fd 49 89 d6 e8 6e b4 4e ff 49 8d 7c 24 10 e8 c4 bc 67 ff <41> 8b 6c 24 10 85 ed 75 0e e8 56 b4 4e ff 48 ff 05 7e a5 ca 05 eb
[ 66.522264] RSP: 0000:ffff88005318fa98 EFLAGS: 00010202
[ 66.523204] RAX: 0000000000000000 RBX: 1ffff1000a631f5a RCX: ffffffff811943ee
[ 66.524369] RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffffffff8757b800
[ 66.525587] RBP: ffff880051c82ee8 R08: fffffbfff094d03d R09: fffffbfff070c539
[ 66.526786] R10: fffffbfff0d3ba43 R11: fffffbfff094d03c R12: 0000000000000000
[ 66.527975] R13: ffff880051c82ee8 R14: 0000000000000000 R15: ffff88005318faf0
[ 66.529209] FS: 00007f9a1eade480(0000) GS:ffffffff848f2000(0000) knlGS:0000000000000000
[ 66.530619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 66.531620] CR2: 0000000000000010 CR3: 00000000533b2000 CR4: 00000000001406b0
[ 66.532814] Call Trace:
[ 66.533353] nfs_set_sb_security+0xdc/0x197
[ 66.534105] ? nfs_reconfigure+0x549/0x549
[ 66.534852] nfs_get_tree_common+0x738/0x7c1
[ 66.535657] nfs_try_get_tree+0x45e/0x4ae
[ 66.536397] ? nfs_get_tree_common+0x7c1/0x7c1
[ 66.537170] ? nfs_fs_context_validate+0x598/0x7d6
[ 66.538008] ? generic_parse_monolithic+0x17c/0x1b6
[ 66.538868] ? ___might_sleep+0xa0/0x2ab
[ 66.539578] ? kasan_check_read+0x1b/0x23
[ 66.540381] ? preempt_count_add+0x114/0x127
[ 66.541144] ? preempt_count_sub+0x1f/0x15f
[ 66.541907] ? find_nfs_version+0x139/0x143
[ 66.542687] nfs_get_tree+0x258/0x2a8
[ 66.543363] ? vfs_get_tree+0x133/0x3a4
[ 66.544065] vfs_get_tree+0x139/0x3a4
[ 66.544753] do_mount+0x10b8/0x1220
[ 66.545414] ? copy_mount_string+0x4d/0x4d
[ 66.546180] ? kmem_cache_alloc_trace+0x239/0x24f
[ 66.547037] ? copy_mount_options+0x42/0x2d3
[ 66.547834] ? copy_mount_options+0x2c4/0x2d3
[ 66.548625] ksys_mount+0xce/0x11e
[ 66.549314] __x64_sys_mount+0x72/0x83
[ 66.550033] do_syscall_64+0xa8/0x1eb
[ 66.550745] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 66.551641] RIP: 0033:0x7f9a1e19a24a
[ 66.552309] Code: 48 8b 0d 51 fc 2a 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 1e fc 2a 00 f7 d8 64 89 01 48
[ 66.555317] RSP: 002b:00007fffdd4e9928 EFLAGS: 00000206 ORIG_RAX: 00000000000000a5
[ 66.556645] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f9a1e19a24a
[ 66.557874] RDX: 00005582b0a54f70 RSI: 00005582b0a54f50 RDI: 00005582b0a53210
[ 66.559065] RBP: 00007fffdd4e9b20 R08: 00005582b0a60320 R09: 0000000000000060
[ 66.560223] R10: 0000000000000000 R11: 0000000000000206 R12: 00007f9a1eade410
[ 66.561382] R13: 00007fffdd4e9b20 R14: 00007fffdd4e9a20 R15: 00005582b0a60300
[ 66.562573] CR2: 0000000000000010
[ 66.696349] ---[ end trace b3babf6df207a75b ]---
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
2 years, 1 month
[locking/lockdep] fe7e1ef5c1: WARNING:at_kernel/locking/lockdep.c:#register_lock_class
by kernel test robot
FYI, we noticed the following commit (built with gcc-4.9):
commit: fe7e1ef5c1044f3ef122b877b078a47e74360dea ("locking/lockdep: Complain if a lock object has no name")
https://github.com/bvanassche/linux for-next
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 512M
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------+------------+------------+
| | 5a5c736d38 | fe7e1ef5c1 |
+----------------------------------------------------------+------------+------------+
| boot_successes | 4 | 0 |
| boot_failures | 0 | 10 |
| WARNING:at_kernel/locking/lockdep.c:#register_lock_class | 0 | 10 |
| EIP:register_lock_class | 0 | 10 |
| EIP:_raw_spin_unlock_irqrestore | 0 | 10 |
+----------------------------------------------------------+------------+------------+
[ 3.352301] WARNING: CPU: 0 PID: 0 at kernel/locking/lockdep.c:749 register_lock_class+0x290/0x540
[ 3.372139] Modules linked in:
[ 3.377973] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.20.0-rc4-00113-gfe7e1ef #1
[ 3.392870] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 3.409495] EIP: register_lock_class+0x290/0x540
[ 3.418406] Code: 68 78 18 9c c1 e8 bb 2c 01 00 68 a0 18 9c c1 e8 b1 2c 01 00 e8 bb cc 66 00 8b 06 83 c4 0c e9 28 fe ff ff 8d b4 26 00 00 00 00 <0f> 0b e9 8f fd ff ff e8 d4 82 22 00 85 c0 74 20 8b 0d 1c 81 b8 c1
[ 3.453446] EAX: 00000000 EBX: c1a8ac80 ECX: 00000000 EDX: 00000000
[ 3.465266] ESI: dd2d4dfc EDI: 00000000 EBP: dcc39e3c ESP: dcc39e0c
[ 3.477580] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00210046
[ 3.489899] CR0: 80050033 CR2: ffffffff CR3: 01da6000 CR4: 00000690
[ 3.501403] Call Trace:
[ 3.505909] <IRQ>
[ 3.510025] __lock_acquire+0x5a/0x1580
[ 3.517802] ? mark_lock+0x44b/0x5e0
[ 3.524898] ? __lock_acquire+0xd6b/0x1580
[ 3.532707] ? pvclock_clocksource_read+0xae/0x1c0
[ 3.542397] lock_acquire+0x82/0x170
[ 3.549520] ? scheduler_tick+0x46/0x130
[ 3.557632] update_rq_clock+0xbe/0x230
[ 3.565400] ? scheduler_tick+0x46/0x130
[ 3.576551] ? prandom_u32+0x1b/0x30
[ 3.584813] scheduler_tick+0x46/0x130
[ 3.591975] update_process_times+0x36/0x40
[ 3.599822] tick_periodic+0x35/0xc0
[ 3.606977] tick_handle_periodic+0x1d/0x70
[ 3.615298] timer_interrupt+0xd/0x20
[ 3.623461] __handle_irq_event_percpu+0x75/0x410
[ 3.632593] handle_irq_event_percpu+0x26/0x60
[ 3.640826] handle_irq_event+0x29/0x50
[ 3.647859] ? irq_set_chained_handler_and_data+0x70/0x70
[ 3.657327] handle_level_irq+0x7a/0x110
[ 3.664393] handle_irq+0x121/0x160
[ 3.671878] </IRQ>
[ 3.676245] do_IRQ+0x48/0x110
[ 3.682343] common_interrupt+0xec/0x100
[ 3.690738] EIP: _raw_spin_unlock_irqrestore+0x2c/0x50
[ 3.701138] Code: e5 56 53 89 c6 89 d3 8d 40 10 8b 4d 04 ba 01 00 00 00 e8 97 cb 96 ff 89 f0 e8 10 1d 97 ff f6 c7 02 74 1b e8 e6 14 9e ff 53 9d <64> ff 0d d0 57 c5 c1 5b 5e 5d c3 89 f6 8d bc 27 00 00 00 00 53 9d
[ 3.739514] EAX: c1a8ac80 EBX: 00200246 ECX: 0001056c EDX: 00000001
[ 3.751830] ESI: dcc20464 EDI: c1a9b440 EBP: c1a83f18 ESP: c1a83f10
[ 3.764572] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00200246
[ 3.779245] ? tracing_release+0x11b/0x190
[ 3.787741] ? kmsg_dump_get_buffer+0x48/0x3a0
[ 3.796330] __setup_irq+0x42b/0x6f0
[ 3.803196] setup_irq+0x70/0xd0
[ 3.809035] hpet_time_init+0x1d/0x2e
[ 3.815808] x86_late_time_init+0x9/0x16
[ 3.823388] start_kernel+0x414/0x491
[ 3.830092] i386_start_kernel+0x8f/0x93
[ 3.837451] startup_32_smp+0x15f/0x170
[ 3.845072] irq event stamp: 3500
[ 3.853797] hardirqs last enabled at (3497): [<c1767e8a>] _raw_spin_unlock_irqrestore+0x2a/0x50
[ 3.868808] hardirqs last disabled at (3498): [<c100167d>] trace_hardirqs_off_thunk+0xc/0x1f
[ 3.886173] softirqs last enabled at (3500): [<c108001c>] _local_bh_enable+0x4c/0x70
[ 3.900372] softirqs last disabled at (3499): [<c1080d00>] irq_enter+0x50/0x70
[ 3.915483] ---[ end trace 11ad95b04038b91f ]---
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
2 years, 1 month
[locking/lockdep] 62f18467c4: WARNING:at_kernel/locking/lockdep.c:#register_lock_class
by kernel test robot
FYI, we noticed the following commit (built with gcc-4.9):
commit: 62f18467c40065cae25a8e52c41de0d9771cfd24 ("locking/lockdep: Complain if a lock object has no name")
https://github.com/bvanassche/linux for-next
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 512M
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------+------------+------------+
| | 85c300bf33 | 62f18467c4 |
+----------------------------------------------------------+------------+------------+
| boot_successes | 22 | 0 |
| boot_failures | 0 | 10 |
| WARNING:at_kernel/locking/lockdep.c:#register_lock_class | 0 | 10 |
| EIP:register_lock_class | 0 | 10 |
| EIP:_raw_spin_unlock_irqrestore | 0 | 10 |
+----------------------------------------------------------+------------+------------+
[ 0.308396] WARNING: CPU: 0 PID: 0 at kernel/locking/lockdep.c:746 register_lock_class+0x290/0x540
[ 0.309861] Modules linked in:
[ 0.310284] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.20.0-rc4-00049-g62f1846 #1
[ 0.311315] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 0.312423] EIP: register_lock_class+0x290/0x540
[ 0.313066] Code: 68 34 18 9c c1 e8 bb 2c 01 00 68 5c 18 9c c1 e8 b1 2c 01 00 e8 2b cc 66 00 8b 06 83 c4 0c e9 28 fe ff ff 8d b4 26 00 00 00 00 <0f> 0b e9 8f fd ff ff e8 d4 82 22 00 85 c0 74 20 8b 0d dc 80 b8 c1
[ 0.315508] EAX: 00000000 EBX: c1a8ac80 ECX: 00000000 EDX: 00000000
[ 0.316338] ESI: dbaf4dfc EDI: 00000000 EBP: db439e3c ESP: db439e0c
[ 0.317171] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00210046
[ 0.318067] CR0: 80050033 CR2: ffffffff CR3: 01da6000 CR4: 00040690
[ 0.318901] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 0.319697] DR6: fffe0ff0 DR7: 00000400
[ 0.320211] Call Trace:
[ 0.320527] <IRQ>
[ 0.320823] __lock_acquire+0x5a/0x1580
[ 0.321312] ? mark_lock+0x44b/0x5e0
[ 0.321804] ? __lock_acquire+0xd6b/0x1580
[ 0.322327] ? pvclock_clocksource_read+0xae/0x1c0
[ 0.322949] lock_acquire+0x82/0x170
[ 0.323430] ? scheduler_tick+0x46/0x130
[ 0.323968] update_rq_clock+0xbe/0x230
[ 0.324475] ? scheduler_tick+0x46/0x130
[ 0.325043] ? prandom_u32+0x1b/0x30
[ 0.325518] scheduler_tick+0x46/0x130
[ 0.326038] update_process_times+0x36/0x40
[ 0.326585] tick_periodic+0x35/0xc0
[ 0.327092] tick_handle_periodic+0x1d/0x70
[ 0.327635] timer_interrupt+0xd/0x20
[ 0.328154] __handle_irq_event_percpu+0x75/0x410
[ 0.328786] handle_irq_event_percpu+0x26/0x60
[ 0.329367] handle_irq_event+0x29/0x50
[ 0.329910] ? irq_set_chained_handler_and_data+0x70/0x70
[ 0.330643] handle_level_irq+0x7a/0x110
[ 0.331219] handle_irq+0x121/0x160
[ 0.331674] </IRQ>
[ 0.332005] do_IRQ+0x48/0x110
[ 0.332425] common_interrupt+0xec/0x100
[ 0.332970] EIP: _raw_spin_unlock_irqrestore+0x2c/0x50
[ 0.333626] Code: e5 56 53 89 c6 89 d3 8d 40 10 8b 4d 04 ba 01 00 00 00 e8 27 cc 96 ff 89 f0 e8 a0 1d 97 ff f6 c7 02 74 1b e8 76 15 9e ff 53 9d <64> ff 0d d0 57 c5 c1 5b 5e 5d c3 89 f6 8d bc 27 00 00 00 00 53 9d
[ 0.336275] EAX: c1a8ac80 EBX: 00200246 ECX: 0001056c EDX: 00000001
[ 0.337164] ESI: db420264 EDI: c1a9b440 EBP: c1a83f18 ESP: c1a83f10
[ 0.337986] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00200246
[ 0.338901] ? tracing_release+0x11b/0x190
[ 0.339439] ? kmsg_dump_get_buffer+0x48/0x3a0
[ 0.340007] __setup_irq+0x42b/0x6f0
[ 0.340479] setup_irq+0x70/0xd0
[ 0.340930] hpet_time_init+0x1d/0x2e
[ 0.341429] x86_late_time_init+0x9/0x16
[ 0.341972] start_kernel+0x414/0x491
[ 0.342454] i386_start_kernel+0x8f/0x93
[ 0.343003] startup_32_smp+0x15f/0x170
[ 0.343507] irq event stamp: 3500
[ 0.343974] hardirqs last enabled at (3497): [<c1767dfa>] _raw_spin_unlock_irqrestore+0x2a/0x50
[ 0.345124] hardirqs last disabled at (3498): [<c100167d>] trace_hardirqs_off_thunk+0xc/0x1f
[ 0.346225] softirqs last enabled at (3500): [<c108001c>] _local_bh_enable+0x4c/0x70
[ 0.347295] softirqs last disabled at (3499): [<c1080d00>] irq_enter+0x50/0x70
[ 0.348297] ---[ end trace 04c6066979bd8a05 ]---
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
2 years, 1 month