[KVM] BUG: unable to handle kernel NULL pointer dereference at 00000000000002b0
by Fengguang Wu
Hi Paolo,
We noticed the below kernel BUG on
git://git.kernel.org/pub/scm/virt/kvm/kvm.git queue
commit 93c4adc7afedf9b0ec190066d45b6d67db5270da ("KVM: x86: handle missing MPX in nested virtualization")
[ 17.665744] Freeing initrd memory: 213444K (ffff880072f82000 - ffff88007fff3000)
[ 17.674933] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 17.682659] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8800b73c7000-ffff8800bb3c6fff]
[ 17.695661] BUG: unable to handle kernel NULL pointer dereference at 00000000000002b0
[ 17.705465] IP: [<ffffffff81015a9f>] kvm_arch_init+0x12a/0x1ea
[ 17.712577] PGD 0
[ 17.715390] Oops: 0000 [#1] SMP
[ 17.719654] Modules linked in:
[ 17.723641] CPU: 10 PID: 1 Comm: swapper/0 Not tainted 3.14.0-rc7-03020-ga929a7d #1
[ 17.733067] Hardware name: Intel Corporation LH Pass/S4600LH...., BIOS SE5C600.86B.99.02.1047.032320122259 03/23/2012
[ 17.745821] task: ffff880429cb0000 ti: ffff880429ca4000 task.ti: ffff880429ca4000
[ 17.755039] RIP: 0010:[<ffffffff81015a9f>] [<ffffffff81015a9f>] kvm_arch_init+0x12a/0x1ea
[ 17.765228] RSP: 0000:ffff880429ca5e00 EFLAGS: 00010246
[ 17.771644] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
[ 17.780096] RDX: 0000000000000000 RSI: ffff880429ca5e04 RDI: 0000000000000d90
[ 17.788549] RBP: ffff880429ca5e30 R08: ffff88082fc55d00 R09: ffff88042f803e00
[ 17.796993] R10: 0000000000000004 R11: 0000000000000003 R12: 000000000000000c
[ 17.805449] R13: 0000000000000017 R14: ffffffff82018b10 R15: 0000000000000018
[ 17.813907] FS: 0000000000000000(0000) GS:ffff88082fc40000(0000) knlGS:0000000000000000
[ 17.823808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 17.830693] CR2: 00000000000002b0 CR3: 000000000200f000 CR4: 00000000000407e0
[ 17.839159] Stack:
[ 17.841873] 0000000000000000 0000000000000040 0000000000000000 0000000000003f40
[ 17.851328] 0000000000000000 0000000000000000 ffff880429ca5e68 ffffffff810039dc
[ 17.860790] 00000000000164d8 0000000000000006 0000000000000000 000000000000023c
[ 17.870256] Call Trace:
[ 17.873468] [<ffffffff810039dc>] kvm_init+0x1f/0x24a
[ 17.879599] [<ffffffff82154fa4>] vmx_init+0x1df/0x3f6
[ 17.885825] [<ffffffff82154dc5>] ? vmx_check_processor_compat+0x61/0x61
[ 17.893782] [<ffffffff810002d2>] do_one_initcall+0xa4/0x13a
[ 17.900604] [<ffffffff810f9aa9>] ? parse_args+0x25f/0x33d
[ 17.907225] [<ffffffff8214ff94>] kernel_init_freeable+0x1a9/0x22e
[ 17.914615] [<ffffffff8214f78f>] ? do_early_param+0x88/0x88
[ 17.921433] [<ffffffff819af0d5>] ? rest_init+0x89/0x89
[ 17.927731] [<ffffffff819af0e3>] kernel_init+0xe/0xdf
Full dmesg is attached, and more details can be provided on your request.
Thanks,
Fengguang
8 years, 3 months
[sched/balance] 8015a6290b4: BUG:unable_to_handle_kernel_NULL_pointer_dereference
by Jet Chen
Hi Alex,
We noticed dmesg errors on
https://github.com/alexshi/power-scheduling.git single-balance
commit 8015a6290b477045904257f1e509a5fb5890894a ("sched/balance: single balance prototype")
373e9ec30ad1efe 8015a6290b477045904257f1e
--------------- -------------------------
0 +Inf% 0 ~412% TOTAL dmesg.BUG:unable_to_handle_kernel_NULL_pointer_dereference
0 +Inf% 0 ~20% TOTAL dmesg.Kernel_panic-not_syncing:Fatal_exception
0 +Inf% 0 ~29% TOTAL dmesg.BUG:unable_to_handle_kernel_paging_request
0 +Inf% 0 ~20% TOTAL dmesg.Oops:SMP
Legend:
~XX% - stddev percent
[+-]XX% - change percent
Thanks,
Jet
8 years, 3 months
[aio] e52ddd946a: xfstests generic/211 fail
by Fengguang Wu
Hi Benjamin,
We noticed xfstests fail and the first bad commit is
commit e52ddd946ab1def55c8282c8b3d0e80403abae12
Author: Benjamin LaHaise <bcrl(a)kvack.org>
AuthorDate: Fri Mar 21 14:26:43 2014 -0400
aio: ensure access to ctx->ring_pages is correctly serialised
# good: [dcb99fd9b08cfe1afe426af4d8d3cbc429190f15] Linux 3.14-rc7
git bisect good dcb99fd9b08cfe1afe426af4d8d3cbc429190f15
# bad: [61fabf948117a9f91e679323b49e6a0cf56d25a6] 0day head guard for 'devel-hourly-2014032214'
git bisect bad 61fabf948117a9f91e679323b49e6a0cf56d25a6
# good: [56ba91913d9f2c108be0e33eeb4a473863d91600] Merge 'regulator/topic/bcm590xx' into devel-hourly-2014032214
git bisect good 56ba91913d9f2c108be0e33eeb4a473863d91600
# good: [a3b8ced9d666d7e4da8e4867d58767e8e5e0a7c9] Merge 'kees/nak_fw-relative' into devel-hourly-2014032214
git bisect good a3b8ced9d666d7e4da8e4867d58767e8e5e0a7c9
# bad: [7a74b3c608ebb48fd99791f570c24387104dd425] Merge 'kees/nak_recv-leak' into devel-hourly-2014032214
git bisect bad 7a74b3c608ebb48fd99791f570c24387104dd425
# good: [4b518d474c67c909d82f4ed6242dee38a681daf8] Merge 'ath6kl/ath-next-test' into devel-hourly-2014032214
git bisect good 4b518d474c67c909d82f4ed6242dee38a681daf8
# good: [37e32762b783f435265c1a8a86dd074c81ad87f2] Merge 'spi/for-next' into devel-hourly-2014032214
git bisect good 37e32762b783f435265c1a8a86dd074c81ad87f2
# bad: [655a90c342c5878de4a3fef60b1a7a0cd18bc08c] Merge 'aio-next/master' into devel-hourly-2014032214
git bisect bad 655a90c342c5878de4a3fef60b1a7a0cd18bc08c
# good: [v3.14-rc6] Linux 3.14-rc6
git bisect good v3.14-rc6
# bad: [e52ddd946ab1def55c8282c8b3d0e80403abae12] aio: ensure access to ctx->ring_pages is correctly serialised
git bisect bad e52ddd946ab1def55c8282c8b3d0e80403abae12
# good: [v3.14-rc6] Linux 3.14-rc6
git bisect good v3.14-rc6
# bad: [e52ddd946ab1def55c8282c8b3d0e80403abae12] aio: ensure access to ctx->ring_pages is correctly serialised
git bisect bad e52ddd946ab1def55c8282c8b3d0e80403abae12
# good: [e6a4b6f5eaa8478b7a0b9a17e40c51463631db1a] Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
git bisect good e6a4b6f5eaa8478b7a0b9a17e40c51463631db1a
# good: [8712a00514e50aafa7c9bf5cd3955fa60758e53b] Merge branch 'akpm' (patches from Andrew Morton)
git bisect good 8712a00514e50aafa7c9bf5cd3955fa60758e53b
# first bad commit: [e52ddd946ab1def55c8282c8b3d0e80403abae12] aio: ensure access to ctx->ring_pages is correctly serialised
Thanks,
Fengguang
8 years, 3 months
[rcuwalk] e2a728c2785: -29.4% aim7.2000.jobs-per-min, +71% turbostat.Pkg_W
by Fengguang Wu
Hi Al,
We noticed the below changes on
git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs.git untested-mnt_hash
commit e2a728c2785d6aab45d1a6d2c61e986d385c30bf ("rcuwalk: recheck mount_lock after mountpoint crossing attempts")
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
395126 ~ 1% -34.2% 259849 ~ 2% grantley/micro/aim7/disk_src
190311 ~ 1% -37.9% 118138 ~ 2% grantley/micro/aim7/shell_rtns_1
383828 ~ 0% -2.4% 374511 ~ 0% grantley/micro/aim7/string_rtns
157829 ~ 0% -72.6% 43187 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
1127096 ~ 1% -29.4% 795687 ~ 1% TOTAL aim7.2000.jobs-per-min
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2980 ~ 0% -46.7% 1587 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
2980 ~ 0% -46.7% 1587 ~ 2% TOTAL netperf.Throughput_tps
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
12683 ~23% -87.3% 1614 ~46% lkp-wsx01/micro/aim7/shell_rtns_1
12683 ~23% -87.3% 1614 ~46% TOTAL numa-vmstat.node3.nr_kernel_stack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
22502 ~31% -95.6% 999 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
22502 ~31% -95.6% 999 ~ 1% TOTAL slabinfo.kmalloc-192.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2167 ~22% -83.1% 365 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
2167 ~22% -83.1% 365 ~ 0% TOTAL slabinfo.signal_cache.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
13718 ~27% -88.2% 1621 ~46% lkp-wsx01/micro/aim7/shell_rtns_1
13718 ~27% -88.2% 1621 ~46% TOTAL numa-vmstat.node2.nr_kernel_stack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14796 ~21% -90.1% 1464 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
14796 ~21% -90.1% 1464 ~ 1% TOTAL slabinfo.dentry.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14796 ~21% -90.1% 1464 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
14796 ~21% -90.1% 1464 ~ 1% TOTAL slabinfo.dentry.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
621458 ~21% -90.1% 61513 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
621458 ~21% -90.1% 61513 ~ 1% TOTAL slabinfo.dentry.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2.641e+08 ~ 4% -99.0% 2722154 ~26% grantley/micro/aim7/disk_src
51149646 ~10% -94.5% 2826487 ~25% grantley/micro/aim7/shell_rtns_1
3.153e+08 ~ 5% -98.2% 5548642 ~26% TOTAL cpuidle.C1-HSW.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
329548 ~13% -99.7% 1143 ~13% grantley/micro/aim7/disk_src
225362 ~15% -98.8% 2708 ~33% grantley/micro/aim7/shell_rtns_1
554911 ~14% -99.3% 3851 ~27% TOTAL cpuidle.C1-HSW.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
105147 ~21% -87.0% 13701 ~44% lkp-wsx01/micro/aim7/shell_rtns_1
105147 ~21% -87.0% 13701 ~44% TOTAL numa-meminfo.node0.KernelStack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
611075 ~21% -89.9% 61509 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
611075 ~21% -89.9% 61509 ~ 1% TOTAL slabinfo.dentry.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
747 ~ 5% +1722.9% 13617 ~ 9% lkp-wsx01/micro/aim7/shell_rtns_1
747 ~ 5% +1722.9% 13617 ~ 9% TOTAL interrupts.IWI
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
78043 ~ 3% -80.3% 15409 ~ 8% grantley/micro/aim7/disk_src
183980 ~16% -94.3% 10524 ~ 8% grantley/micro/aim7/shell_rtns_1
262024 ~12% -90.1% 25934 ~ 8% TOTAL cpuidle.C6-HSW.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2167 ~22% -83.1% 365 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
2167 ~22% -83.1% 365 ~ 0% TOTAL slabinfo.signal_cache.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
60879 ~ 6% -99.5% 291 ~18% grantley/micro/aim7/shell_rtns_1
60879 ~ 6% -99.5% 291 ~18% TOTAL interrupts.TLB
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
13175 ~21% -87.0% 1712 ~44% lkp-wsx01/micro/aim7/shell_rtns_1
13175 ~21% -87.0% 1712 ~44% TOTAL numa-vmstat.node0.nr_kernel_stack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1.471e+08 ~ 2% -99.3% 1006392 ~37% grantley/micro/aim7/shell_rtns_1
1.471e+08 ~ 2% -99.3% 1006392 ~37% TOTAL cpuidle.C1E-HSW.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
22502 ~31% -95.6% 999 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
22502 ~31% -95.6% 999 ~ 1% TOTAL slabinfo.kmalloc-192.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6789 ~ 7% -89.7% 699 ~27% lkp-wsx01/micro/aim7/shell_rtns_1
6789 ~ 7% -89.7% 699 ~27% TOTAL cpuidle.C1E-NHM.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
29.35 ~ 2% -92.4% 2.24 ~13% grantley/micro/aim7/disk_src
15.12 ~ 5% -98.3% 0.26 ~10% grantley/micro/aim7/shell_rtns_1
0.50 ~10% -90.5% 0.05 ~ 8% lkp-wsx01/micro/aim7/shell_rtns_1
44.97 ~ 3% -94.3% 2.55 ~12% TOTAL turbostat.%c1
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
0.00 +Inf% 11.52 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
0.00 +Inf% 11.52 ~ 1% TOTAL perf-profile.cpu-cycles._raw_spin_lock.__d_lookup.lookup_fast.do_last.path_openat
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
4 ~35% -100.0% 0 ~ 0% grantley/micro/aim7/disk_src
23 ~ 9% -100.0% 0 ~ 0% grantley/micro/aim7/shell_rtns_1
27 ~13% -100.0% 0 ~ 0% TOTAL cpuidle.POLL.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
102041 ~23% -87.3% 12959 ~46% lkp-wsx01/micro/aim7/shell_rtns_1
102041 ~23% -87.3% 12959 ~46% TOTAL numa-meminfo.node3.KernelStack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
0.00 +Inf% 11.26 ~ 3% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
0.00 +Inf% 11.26 ~ 3% TOTAL perf-profile.cpu-cycles._raw_spin_lock.lockref_put_or_lock.dput.__fput.____fput
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
110293 ~27% -88.2% 13026 ~46% lkp-wsx01/micro/aim7/shell_rtns_1
110293 ~27% -88.2% 13026 ~46% TOTAL numa-meminfo.node2.KernelStack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
89 ~49% -100.0% 0 ~ 0% grantley/micro/aim7/disk_src
663 ~18% -100.0% 0 ~ 0% grantley/micro/aim7/shell_rtns_1
752 ~22% -100.0% 0 ~ 0% TOTAL cpuidle.POLL.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
0.00 +Inf% 11.07 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
0.00 +Inf% 11.07 ~ 2% TOTAL perf-profile.cpu-cycles._raw_spin_lock.lockref_get.path_get.do_dentry_open.finish_open
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1384473 ~29% -95.3% 65064 ~40% lkp-wsx01/micro/aim7/shell_rtns_1
1384473 ~29% -95.3% 65064 ~40% TOTAL cpuidle.C1-NHM.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
4501 ~20% -87.2% 576 ~36% lkp-wsx01/micro/aim7/shell_rtns_1
4501 ~20% -87.2% 576 ~36% TOTAL cpuidle.C1-NHM.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2471092 ~11% -97.5% 62093 ~17% lkp-wsx01/micro/aim7/shell_rtns_1
2471092 ~11% -97.5% 62093 ~17% TOTAL cpuidle.C1E-NHM.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
0.00 +Inf% 11.14 ~ 3% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
0.00 +Inf% 11.14 ~ 3% TOTAL perf-profile.cpu-cycles._raw_spin_lock.lockref_put_or_lock.dput.path_put.terminate_walk
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
0.23 ~26% -73.3% 0.06 ~34% lkp-wsx01/micro/aim7/shell_rtns_1
0.23 ~26% -73.3% 0.06 ~34% TOTAL turbostat.%c3
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1363 ~15% -75.0% 340 ~25% grantley/micro/aim7/disk_src
481021 ~ 7% -99.6% 1963 ~28% grantley/micro/aim7/shell_rtns_1
482385 ~ 7% -99.5% 2304 ~27% TOTAL cpuidle.C1E-HSW.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6977 ~11% -75.9% 1681 ~ 6% grantley/micro/aim7/disk_src
592870 ~ 5% -99.4% 3369 ~ 7% grantley/micro/aim7/shell_rtns_1
599848 ~ 5% -99.2% 5050 ~ 7% TOTAL cpuidle.C3-HSW.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
17 ~ 7% +534.5% 110 ~ 4% grantley/micro/aim7/disk_src
44 ~ 2% +409.5% 225 ~ 4% grantley/micro/aim7/shell_rtns_1
209 ~ 4% +207.4% 642 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
270 ~ 4% +261.4% 978 ~ 6% TOTAL vmstat.procs.r
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2.456e+08 ~12% -97.3% 6594906 ~45% grantley/micro/aim7/shell_rtns_1
2.456e+08 ~12% -97.3% 6594906 ~45% TOTAL cpuidle.C3-HSW.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
49244 ~28% -72.9% 13365 ~28% lkp-wsx01/micro/aim7/shell_rtns_1
49244 ~28% -72.9% 13365 ~28% TOTAL numa-vmstat.node2.nr_slab_unreclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
196740 ~28% -72.8% 53475 ~28% lkp-wsx01/micro/aim7/shell_rtns_1
196740 ~28% -72.8% 53475 ~28% TOTAL numa-meminfo.node2.SUnreclaim
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14776 ~45% +84.6% 27283 ~26% grantley/micro/aim7/shell_rtns_1
108458 ~20% -85.1% 16153 ~45% lkp-wsx01/micro/aim7/shell_rtns_1
123234 ~23% -64.8% 43437 ~33% TOTAL numa-meminfo.node1.KernelStack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1837 ~44% +84.7% 3393 ~26% grantley/micro/aim7/shell_rtns_1
13576 ~21% -85.2% 2005 ~45% lkp-wsx01/micro/aim7/shell_rtns_1
15413 ~24% -65.0% 5399 ~33% TOTAL numa-vmstat.node1.nr_kernel_stack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
237898 ~26% -71.8% 66988 ~22% lkp-wsx01/micro/aim7/shell_rtns_1
237898 ~26% -71.8% 66988 ~22% TOTAL numa-meminfo.node2.Slab
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
187410 ~20% -71.6% 53204 ~27% lkp-wsx01/micro/aim7/shell_rtns_1
187410 ~20% -71.6% 53204 ~27% TOTAL numa-meminfo.node0.SUnreclaim
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
182221 ~22% -73.1% 49066 ~26% lkp-wsx01/micro/aim7/shell_rtns_1
182221 ~22% -73.1% 49066 ~26% TOTAL numa-meminfo.node3.SUnreclaim
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
47071 ~21% -71.8% 13297 ~27% lkp-wsx01/micro/aim7/shell_rtns_1
47071 ~21% -71.8% 13297 ~27% TOTAL numa-vmstat.node0.nr_slab_unreclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
45606 ~23% -73.1% 12282 ~26% lkp-wsx01/micro/aim7/shell_rtns_1
45606 ~23% -73.1% 12282 ~26% TOTAL numa-vmstat.node3.nr_slab_unreclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
12.07 ~ 0% -72.4% 3.33 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
12.07 ~ 0% -72.4% 3.33 ~ 0% TOTAL turbostat.%pc3
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
221908 ~21% -72.2% 61632 ~18% lkp-wsx01/micro/aim7/shell_rtns_1
221908 ~21% -72.2% 61632 ~18% TOTAL numa-meminfo.node3.Slab
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
48292 ~42% +146.4% 119010 ~20% grantley/micro/aim7/shell_rtns_1
48292 ~42% +146.4% 119010 ~20% TOTAL numa-meminfo.node1.PageTables
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
12086 ~43% +145.2% 29636 ~20% grantley/micro/aim7/shell_rtns_1
12086 ~43% +145.2% 29636 ~20% TOTAL numa-vmstat.node1.nr_page_table_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
68877 ~ 7% +326.1% 293515 ~ 2% grantley/micro/aim7/shell_rtns_1
55620 ~ 7% +181.2% 156385 ~ 8% lkp-wsx01/micro/aim7/shell_rtns_1
124498 ~ 7% +261.4% 449901 ~ 4% TOTAL numa-meminfo.node1.AnonPages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
17237 ~ 8% +324.2% 73111 ~ 1% grantley/micro/aim7/shell_rtns_1
13979 ~ 6% +178.0% 38857 ~ 8% lkp-wsx01/micro/aim7/shell_rtns_1
31217 ~ 7% +258.7% 111968 ~ 4% TOTAL numa-vmstat.node1.nr_anon_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2113 ~22% -74.4% 541 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
2113 ~22% -74.4% 541 ~ 1% TOTAL slabinfo.kmalloc-512.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2113 ~22% -74.4% 541 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
2113 ~22% -74.4% 541 ~ 1% TOTAL slabinfo.kmalloc-512.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
67631 ~22% -74.3% 17348 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
67631 ~22% -74.3% 17348 ~ 1% TOTAL slabinfo.kmalloc-512.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
11810487 ~ 0% -45.3% 6462482 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
104283 ~11% +1972.4% 2161157 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
11914771 ~ 0% -27.6% 8623639 ~ 1% TOTAL softirqs.RCU
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
37047 ~ 2% +297.1% 147122 ~ 1% grantley/micro/aim7/shell_rtns_1
58696 ~ 2% +168.3% 157481 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
95744 ~ 2% +218.1% 304603 ~ 2% TOTAL proc-vmstat.nr_anon_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
148067 ~ 2% +296.6% 587309 ~ 1% grantley/micro/aim7/shell_rtns_1
235601 ~ 3% +167.1% 629209 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
383669 ~ 3% +217.1% 1216518 ~ 2% TOTAL meminfo.AnonPages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
79144 ~ 5% +271.8% 294233 ~ 2% grantley/micro/aim7/shell_rtns_1
53935 ~ 5% +185.7% 154092 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
133079 ~ 5% +236.9% 448326 ~ 4% TOTAL numa-meminfo.node0.AnonPages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
226257 ~19% -70.2% 67410 ~21% lkp-wsx01/micro/aim7/shell_rtns_1
226257 ~19% -70.2% 67410 ~21% TOTAL numa-meminfo.node0.Slab
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
261563 ~11% -76.5% 61519 ~ 2% grantley/micro/aim7/disk_src
885837 ~ 7% -64.4% 315615 ~ 1% grantley/micro/aim7/shell_rtns_1
820916 ~ 0% -63.8% 297218 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
1968316 ~ 5% -65.7% 674354 ~ 2% TOTAL interrupts.RES
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
19813 ~ 5% +269.8% 73278 ~ 2% grantley/micro/aim7/shell_rtns_1
13492 ~ 5% +183.7% 38281 ~ 8% lkp-wsx01/micro/aim7/shell_rtns_1
33305 ~ 5% +235.0% 111559 ~ 4% TOTAL numa-vmstat.node0.nr_anon_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
59995 ~19% -71.5% 17106 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
59995 ~19% -71.5% 17106 ~ 1% TOTAL slabinfo.kmalloc-512.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
4976 ~ 1% +31.5% 6543 ~ 1% grantley/micro/aim7/shell_rtns_1
54140 ~22% -86.8% 7124 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
59117 ~20% -76.9% 13667 ~ 1% TOTAL proc-vmstat.nr_kernel_stack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
39796 ~ 1% +31.4% 52278 ~ 1% grantley/micro/aim7/shell_rtns_1
421773 ~21% -86.5% 56891 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
461569 ~19% -76.3% 109169 ~ 0% TOTAL meminfo.KernelStack
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
5546 ~ 0% +27.8% 7087 ~ 1% grantley/micro/aim7/shell_rtns_1
56799 ~20% -86.3% 7771 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
62346 ~19% -76.2% 14858 ~ 1% TOTAL slabinfo.task_struct.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
421 ~ 0% +28.6% 542 ~ 2% grantley/micro/aim7/shell_rtns_1
4445 ~23% -86.6% 597 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
4867 ~21% -76.6% 1140 ~ 1% TOTAL slabinfo.task_struct.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
421 ~ 0% +28.6% 542 ~ 2% grantley/micro/aim7/shell_rtns_1
4445 ~23% -86.6% 597 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
4867 ~21% -76.6% 1140 ~ 1% TOTAL slabinfo.task_struct.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
5913 ~ 0% +28.6% 7602 ~ 2% grantley/micro/aim7/shell_rtns_1
62245 ~23% -86.5% 8377 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
68159 ~21% -76.6% 15979 ~ 1% TOTAL slabinfo.task_struct.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
39568 ~16% -69.6% 12020 ~ 8% lkp-wsx01/micro/aim7/shell_rtns_1
39568 ~16% -69.6% 12020 ~ 8% TOTAL numa-meminfo.node1.SReclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
8738 ~ 4% +23.6% 10799 ~ 8% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
29194 ~ 7% -93.8% 1816 ~ 9% lkp-wsx01/micro/aim7/shell_rtns_1
37932 ~ 6% -66.7% 12615 ~ 9% TOTAL cpuidle.C3-NHM.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
9912 ~17% -69.7% 3006 ~ 8% lkp-wsx01/micro/aim7/shell_rtns_1
9912 ~17% -69.7% 3006 ~ 8% TOTAL numa-vmstat.node1.nr_slab_reclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
7566 ~ 0% +14.9% 8690 ~ 0% grantley/micro/aim7/shell_rtns_1
65043 ~22% -83.1% 10981 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
72609 ~20% -72.9% 19671 ~ 0% TOTAL slabinfo.signal_cache.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
7387 ~ 0% +12.6% 8317 ~ 1% grantley/micro/aim7/shell_rtns_1
57956 ~20% -81.5% 10709 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
65343 ~18% -70.9% 19027 ~ 0% TOTAL slabinfo.signal_cache.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
29054 ~ 1% +12.8% 32759 ~ 1% grantley/micro/aim7/shell_rtns_1
945145 ~31% -95.6% 41976 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
974200 ~30% -92.3% 74735 ~ 1% TOTAL slabinfo.kmalloc-192.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
28807 ~ 1% +12.5% 32395 ~ 1% grantley/micro/aim7/shell_rtns_1
767784 ~25% -94.6% 41733 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
796591 ~24% -90.7% 74128 ~ 1% TOTAL slabinfo.kmalloc-192.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
81548 ~ 7% +262.4% 295506 ~ 2% grantley/micro/aim7/shell_rtns_1
62798 ~ 5% +158.3% 162214 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
144346 ~ 6% +217.1% 457721 ~ 4% TOTAL numa-meminfo.node1.Active(anon)
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
167493 ~ 2% +197.0% 497489 ~ 3% grantley/micro/aim7/disk_src
618837 ~ 0% +107.6% 1284825 ~ 3% grantley/micro/aim7/shell_rtns_1
1315045 ~ 0% +307.5% 5358867 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
2101375 ~ 0% +239.8% 7141181 ~ 1% TOTAL interrupts.LOC
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
20438 ~ 7% +260.2% 73615 ~ 2% grantley/micro/aim7/shell_rtns_1
15775 ~ 5% +155.3% 40280 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
36214 ~ 6% +214.5% 113896 ~ 3% TOTAL numa-vmstat.node1.nr_active_anon
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6 ~12% -67.7% 2 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
6 ~12% -67.7% 2 ~ 0% TOTAL vmstat.procs.b
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
39686 ~17% -68.3% 12565 ~10% lkp-wsx01/micro/aim7/shell_rtns_1
39686 ~17% -68.3% 12565 ~10% TOTAL numa-meminfo.node3.SReclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
43467 ~ 2% +240.7% 148081 ~ 1% grantley/micro/aim7/shell_rtns_1
65784 ~ 2% +149.9% 164370 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
109251 ~ 2% +186.0% 312452 ~ 1% TOTAL proc-vmstat.nr_active_anon
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
173786 ~ 2% +240.2% 591203 ~ 1% grantley/micro/aim7/shell_rtns_1
264074 ~ 3% +148.6% 656365 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
437861 ~ 3% +184.9% 1247568 ~ 1% TOTAL meminfo.Active(anon)
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
9907 ~17% -68.3% 3142 ~10% lkp-wsx01/micro/aim7/shell_rtns_1
9907 ~17% -68.3% 3142 ~10% TOTAL numa-vmstat.node3.nr_slab_reclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
92198 ~ 5% +221.2% 296102 ~ 2% grantley/micro/aim7/shell_rtns_1
61041 ~ 5% +162.3% 160107 ~ 6% lkp-wsx01/micro/aim7/shell_rtns_1
153239 ~ 5% +197.7% 456209 ~ 4% TOTAL numa-meminfo.node0.Active(anon)
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
23075 ~ 4% +219.5% 73730 ~ 2% grantley/micro/aim7/shell_rtns_1
15290 ~ 4% +160.4% 39823 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
38366 ~ 4% +196.0% 113553 ~ 4% TOTAL numa-vmstat.node0.nr_active_anon
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
16972 ~19% +46.5% 24858 ~17% grantley/micro/aim7/shell_rtns_1
48753 ~22% -70.2% 14535 ~29% lkp-wsx01/micro/aim7/shell_rtns_1
65726 ~21% -40.1% 39393 ~21% TOTAL numa-vmstat.node1.nr_slab_unreclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
67859 ~19% +46.7% 99577 ~17% grantley/micro/aim7/shell_rtns_1
194381 ~20% -70.1% 58177 ~29% lkp-wsx01/micro/aim7/shell_rtns_1
262240 ~20% -39.8% 157755 ~21% TOTAL numa-meminfo.node1.SUnreclaim
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
40297 ~16% -67.5% 13103 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
40297 ~16% -67.5% 13103 ~ 0% TOTAL proc-vmstat.nr_slab_reclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
41157 ~18% -67.2% 13512 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
41157 ~18% -67.2% 13512 ~ 3% TOTAL numa-meminfo.node2.SReclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
158286 ~16% -66.9% 52413 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
158286 ~16% -66.9% 52413 ~ 0% TOTAL meminfo.SReclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
10262 ~18% -67.1% 3379 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
10262 ~18% -67.1% 3379 ~ 3% TOTAL numa-vmstat.node2.nr_slab_reclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
58257 ~ 9% +153.6% 147736 ~ 4% lkp-wsx01/micro/aim7/shell_rtns_1
58257 ~ 9% +153.6% 147736 ~ 4% TOTAL numa-meminfo.node3.AnonPages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14539 ~10% +152.1% 36647 ~ 5% lkp-wsx01/micro/aim7/shell_rtns_1
14539 ~10% +152.1% 36647 ~ 5% TOTAL numa-vmstat.node3.nr_anon_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
344 ~ 1% +51.2% 520 ~ 1% grantley/micro/aim7/shell_rtns_1
1694 ~ 0% -34.2% 1114 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
25043 ~24% -96.2% 947 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
27082 ~23% -90.5% 2582 ~ 1% TOTAL slabinfo.kmalloc-256.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
344 ~ 1% +51.2% 520 ~ 1% grantley/micro/aim7/shell_rtns_1
1694 ~ 0% -34.2% 1114 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
25043 ~24% -96.2% 947 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
27082 ~23% -90.5% 2582 ~ 1% TOTAL slabinfo.kmalloc-256.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
25230572 ~13% -60.3% 10024021 ~28% lkp-wsx01/micro/aim7/shell_rtns_1
25230572 ~13% -60.3% 10024021 ~28% TOTAL cpuidle.C3-NHM.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1947 ~20% -65.8% 666 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
1947 ~20% -65.8% 666 ~ 2% TOTAL slabinfo.task_delay_info.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1947 ~20% -65.8% 666 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
1947 ~20% -65.8% 666 ~ 2% TOTAL slabinfo.task_delay_info.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
38847 ~16% -63.4% 14205 ~11% lkp-wsx01/micro/aim7/shell_rtns_1
38847 ~16% -63.4% 14205 ~11% TOTAL numa-meminfo.node0.SReclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
91396 ~14% +33.6% 122065 ~14% grantley/micro/aim7/shell_rtns_1
233950 ~19% -70.0% 70199 ~23% lkp-wsx01/micro/aim7/shell_rtns_1
325346 ~18% -40.9% 192264 ~17% TOTAL numa-meminfo.node1.Slab
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
9737 ~16% -63.5% 3552 ~11% lkp-wsx01/micro/aim7/shell_rtns_1
9737 ~16% -63.5% 3552 ~11% TOTAL numa-vmstat.node0.nr_slab_reclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
155695 ~ 7% +112.3% 330467 ~ 2% grantley/micro/aim7/disk_src
376752 ~ 3% +91.2% 720465 ~ 3% grantley/micro/aim7/shell_rtns_1
770510 ~ 0% +263.9% 2803548 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
1302957 ~ 2% +195.8% 3854480 ~ 1% TOTAL softirqs.TIMER
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2222 ~20% -63.8% 803 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
2222 ~20% -63.8% 803 ~ 2% TOTAL slabinfo.kmalloc-128.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2222 ~20% -63.8% 803 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
2222 ~20% -63.8% 803 ~ 2% TOTAL slabinfo.kmalloc-128.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
64952 ~ 8% +136.5% 153601 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
64952 ~ 8% +136.5% 153601 ~ 3% TOTAL numa-meminfo.node3.Active(anon)
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
16208 ~10% +135.4% 38150 ~ 4% lkp-wsx01/micro/aim7/shell_rtns_1
16208 ~10% +135.4% 38150 ~ 4% TOTAL numa-vmstat.node3.nr_active_anon
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
63205 ~ 7% +159.4% 163952 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
63205 ~ 7% +159.4% 163952 ~ 7% TOTAL numa-meminfo.node2.AnonPages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
15772 ~ 7% +158.6% 40789 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
15772 ~ 7% +158.6% 40789 ~ 7% TOTAL numa-vmstat.node2.nr_anon_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
70170 ~ 7% +142.4% 170060 ~ 6% lkp-wsx01/micro/aim7/shell_rtns_1
70170 ~ 7% +142.4% 170060 ~ 6% TOTAL numa-meminfo.node2.Active(anon)
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
17497 ~ 7% +141.5% 42251 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
17497 ~ 7% +141.5% 42251 ~ 7% TOTAL numa-vmstat.node2.nr_active_anon
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
106 ~ 1% +132.1% 247 ~ 1% grantley/micro/aim7/shell_rtns_1
106 ~ 1% +132.1% 247 ~ 1% TOTAL slabinfo.kmalloc-2048.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
106 ~ 1% +132.1% 247 ~ 1% grantley/micro/aim7/shell_rtns_1
106 ~ 1% +132.1% 247 ~ 1% TOTAL slabinfo.kmalloc-2048.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
22067 ~ 1% +51.1% 33353 ~ 1% grantley/micro/aim7/shell_rtns_1
19012 ~ 3% +17.8% 22391 ~ 2% grantley/micro/aim7/string_rtns
54244 ~ 0% -34.2% 35682 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
801391 ~24% -96.2% 30328 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
896715 ~22% -86.4% 121755 ~ 1% TOTAL slabinfo.kmalloc-256.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
21569 ~ 1% +45.1% 31294 ~ 0% grantley/micro/aim7/shell_rtns_1
18498 ~ 4% +18.6% 21944 ~ 2% grantley/micro/aim7/string_rtns
51514 ~ 0% -33.2% 34432 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
768564 ~23% -96.4% 27463 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
860146 ~21% -86.6% 115134 ~ 1% TOTAL slabinfo.kmalloc-256.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
37.03 ~ 2% -39.6% 22.37 ~ 2% grantley/micro/aim7/disk_src
16.41 ~ 2% -32.5% 11.08 ~13% grantley/micro/aim7/shell_rtns_1
13.89 ~ 0% -72.3% 3.84 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
67.33 ~ 1% -44.6% 37.28 ~ 5% TOTAL turbostat.%c6
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
297496 ~ 1% +140.4% 715256 ~ 1% grantley/micro/aim7/shell_rtns_1
387686 ~ 2% +101.3% 780606 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
685183 ~ 2% +118.3% 1495862 ~ 1% TOTAL meminfo.Active
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
38432 ~ 0% +25.0% 48053 ~ 1% grantley/micro/aim7/shell_rtns_1
192752 ~22% -71.9% 54240 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
231185 ~18% -55.8% 102293 ~ 0% TOTAL proc-vmstat.nr_slab_unreclaimable
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
153710 ~ 0% +25.0% 192073 ~ 1% grantley/micro/aim7/shell_rtns_1
758954 ~21% -71.4% 216825 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
912664 ~17% -55.2% 408898 ~ 0% TOTAL meminfo.SUnreclaim
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
156138 ~ 7% +133.3% 364305 ~ 4% grantley/micro/aim7/shell_rtns_1
92594 ~ 7% +110.9% 195235 ~ 6% lkp-wsx01/micro/aim7/shell_rtns_1
248732 ~ 7% +125.0% 559540 ~ 5% TOTAL numa-meminfo.node0.Active
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
201870 ~ 0% +19.1% 240499 ~ 1% grantley/micro/aim7/shell_rtns_1
917241 ~20% -70.6% 269238 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
1119112 ~16% -54.5% 509738 ~ 0% TOTAL meminfo.Slab
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
99503 ~10% +104.9% 203904 ~ 6% lkp-wsx01/micro/aim7/shell_rtns_1
99503 ~10% +104.9% 203904 ~ 6% TOTAL numa-meminfo.node2.Active
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
0.98 ~ 2% -49.2% 0.50 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
0.98 ~ 2% -49.2% 0.50 ~ 1% TOTAL perf-profile.cpu-cycles.__netif_receive_skb_core.__netif_receive_skb.process_backlog.net_rx_action.__do_softirq
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
19601 ~ 8% -49.0% 9998 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
19601 ~ 8% -49.0% 9998 ~ 1% TOTAL slabinfo.proc_inode_cache.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
141315 ~ 8% +148.6% 351337 ~ 5% grantley/micro/aim7/shell_rtns_1
54643 ~ 2% +15.0% 62849 ~ 9% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
93629 ~ 6% +100.9% 188139 ~ 5% lkp-wsx01/micro/aim7/shell_rtns_1
289588 ~ 6% +108.0% 602326 ~ 6% TOTAL numa-meminfo.node1.Active
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
383 ~ 8% -49.0% 195 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
383 ~ 8% -49.0% 195 ~ 1% TOTAL slabinfo.proc_inode_cache.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
383 ~ 8% -49.0% 195 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
383 ~ 8% -49.0% 195 ~ 1% TOTAL slabinfo.proc_inode_cache.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
23349636 ~ 0% -46.8% 12414509 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
23349636 ~ 0% -46.8% 12414509 ~ 2% TOTAL numa-numastat.node0.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
23341368 ~ 0% -46.8% 12407894 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
23341368 ~ 0% -46.8% 12407894 ~ 2% TOTAL numa-numastat.node0.local_node
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
19297 ~ 7% -48.3% 9968 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
19297 ~ 7% -48.3% 9968 ~ 1% TOTAL slabinfo.proc_inode_cache.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
15533 ~ 2% +16.3% 18062 ~ 2% grantley/micro/aim7/shell_rtns_1
70112 ~20% -65.7% 24021 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
85646 ~17% -50.9% 42084 ~ 2% TOTAL slabinfo.task_delay_info.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2.288e+08 ~ 0% -46.7% 1.219e+08 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
2.288e+08 ~ 0% -46.7% 1.219e+08 ~ 2% TOTAL softirqs.NET_RX
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
46960527 ~ 0% -46.7% 25048760 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
46960527 ~ 0% -46.7% 25048760 ~ 2% TOTAL proc-vmstat.numa_local
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
46972931 ~ 0% -46.6% 25060337 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
46972931 ~ 0% -46.6% 25060337 ~ 2% TOTAL proc-vmstat.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
18061 ~ 2% +24.8% 22546 ~ 0% grantley/micro/aim7/shell_rtns_1
71113 ~20% -63.8% 25727 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
89174 ~16% -45.9% 48273 ~ 1% TOTAL slabinfo.kmalloc-128.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
12107352 ~ 0% -45.9% 6544676 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
12107352 ~ 0% -45.9% 6544676 ~ 2% TOTAL numa-vmstat.node0.numa_local
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
11933610 ~ 1% -47.4% 6272905 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
11933610 ~ 1% -47.4% 6272905 ~ 2% TOTAL numa-numastat.node3.local_node
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
11933610 ~ 1% -47.4% 6275386 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
11933610 ~ 1% -47.4% 6275386 ~ 2% TOTAL numa-numastat.node3.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
12186795 ~ 0% -45.6% 6623695 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
12186795 ~ 0% -45.6% 6623695 ~ 2% TOTAL numa-vmstat.node0.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
96797 ~ 9% +88.9% 182812 ~ 4% lkp-wsx01/micro/aim7/shell_rtns_1
96797 ~ 9% +88.9% 182812 ~ 4% TOTAL numa-meminfo.node3.Active
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
109 ~18% +101.8% 220 ~ 7% lkp-wsx01/micro/aim7/shell_rtns_1
109 ~18% +101.8% 220 ~ 7% TOTAL proc-vmstat.nr_written
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6193291 ~ 1% -46.3% 3325216 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
6193291 ~ 1% -46.3% 3325216 ~ 2% TOTAL numa-vmstat.node3.numa_local
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
11692936 ~ 0% -45.6% 6363752 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
11692936 ~ 0% -45.6% 6363752 ~ 2% TOTAL numa-numastat.node1.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
11688802 ~ 0% -45.6% 6361271 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
11688802 ~ 0% -45.6% 6361271 ~ 2% TOTAL numa-numastat.node1.local_node
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
18059 ~ 2% +24.8% 22543 ~ 0% grantley/micro/aim7/shell_rtns_1
65016 ~17% -60.6% 25621 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
83076 ~14% -42.0% 48164 ~ 1% TOTAL slabinfo.kmalloc-128.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
15521 ~ 2% +16.3% 18047 ~ 2% grantley/micro/aim7/shell_rtns_1
64124 ~17% -62.6% 23975 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
79646 ~14% -47.2% 42023 ~ 2% TOTAL slabinfo.task_delay_info.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1.48 ~ 1% +67.1% 2.47 ~ 0% grantley/micro/aim7/disk_src
1.26 ~ 0% +97.9% 2.49 ~ 0% grantley/micro/aim7/shell_rtns_1
2.74 ~ 0% +81.3% 4.96 ~ 0% TOTAL turbostat.GHz
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6305179 ~ 1% -45.5% 3437625 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
6305179 ~ 1% -45.5% 3437625 ~ 2% TOTAL numa-vmstat.node3.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6159931 ~ 0% -44.2% 3438297 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
6159931 ~ 0% -44.2% 3438297 ~ 2% TOTAL numa-vmstat.node1.numa_local
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
70.05 ~ 2% +22.7% 85.95 ~ 1% grantley/micro/aim7/disk_src
101.86 ~ 2% +39.8% 142.38 ~ 3% grantley/micro/aim7/shell_rtns_1
114.60 ~ 1% +176.7% 317.06 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
286.50 ~ 1% +90.4% 545.39 ~ 1% TOTAL uptime.boot
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
6195618 ~ 0% -43.9% 3473661 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
6195618 ~ 0% -43.9% 3473661 ~ 2% TOTAL numa-vmstat.node1.numa_hit
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1712 ~ 1% +131.6% 3965 ~ 1% grantley/micro/aim7/shell_rtns_1
3936 ~ 5% +28.8% 5072 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
5649 ~ 3% +60.0% 9038 ~ 0% TOTAL slabinfo.kmalloc-2048.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1712 ~ 1% +126.1% 3871 ~ 1% grantley/micro/aim7/shell_rtns_1
3863 ~ 4% +27.6% 4927 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
5575 ~ 3% +57.8% 8798 ~ 0% TOTAL slabinfo.kmalloc-2048.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
141 ~ 2% +70.4% 241 ~10% lkp-wsx01/micro/aim7/shell_rtns_1
141 ~ 2% +70.4% 241 ~10% TOTAL proc-vmstat.nr_dirtied
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
39027 ~ 3% -25.8% 28971 ~ 8% grantley/micro/aim7/disk_src
747148 ~ 0% -49.1% 380461 ~ 3% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
786176 ~ 0% -47.9% 409432 ~ 3% TOTAL proc-vmstat.pgalloc_dma32
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
29324 ~ 7% +101.1% 58978 ~33% lkp-wsx01/micro/aim7/shell_rtns_1
29324 ~ 7% +101.1% 58978 ~33% TOTAL numa-meminfo.node3.PageTables
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
128910 ~ 3% +77.2% 228459 ~ 4% grantley/micro/aim7/shell_rtns_1
167288 ~ 3% +50.7% 252075 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
296199 ~ 3% +62.2% 480534 ~ 3% TOTAL meminfo.PageTables
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
32256 ~ 3% +77.2% 57162 ~ 4% grantley/micro/aim7/shell_rtns_1
41618 ~ 3% +51.7% 63117 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
73874 ~ 3% +62.8% 120279 ~ 3% TOTAL proc-vmstat.nr_page_table_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
792183 ~ 6% -25.4% 590643 ~ 3% grantley/micro/aim7/disk_src
47655459 ~ 0% -47.1% 25213633 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
48447643 ~ 0% -46.7% 25804277 ~ 2% TOTAL proc-vmstat.pgfree
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
750656 ~ 6% -25.6% 558315 ~ 2% grantley/micro/aim7/disk_src
46948168 ~ 0% -47.0% 24871573 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
47698824 ~ 0% -46.7% 25429888 ~ 2% TOTAL proc-vmstat.pgalloc_normal
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
7321 ~ 8% +100.4% 14674 ~33% lkp-wsx01/micro/aim7/shell_rtns_1
7321 ~ 8% +100.4% 14674 ~33% TOTAL numa-vmstat.node3.nr_page_table_pages
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
106318 ~ 0% +61.5% 171693 ~ 1% grantley/micro/aim7/shell_rtns_1
121177 ~ 0% +56.6% 189713 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
227495 ~ 0% +58.9% 361407 ~ 1% TOTAL slabinfo.vm_area_struct.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2415 ~ 0% +61.5% 3901 ~ 1% grantley/micro/aim7/shell_rtns_1
2753 ~ 0% +56.6% 4311 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
5169 ~ 0% +58.9% 8213 ~ 1% TOTAL slabinfo.vm_area_struct.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2415 ~ 0% +61.5% 3901 ~ 1% grantley/micro/aim7/shell_rtns_1
2753 ~ 0% +56.6% 4311 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
5169 ~ 0% +58.9% 8213 ~ 1% TOTAL slabinfo.vm_area_struct.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
103648 ~ 0% +57.3% 163005 ~ 1% grantley/micro/aim7/shell_rtns_1
116417 ~ 0% +53.1% 178269 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
220065 ~ 0% +55.1% 341274 ~ 1% TOTAL slabinfo.vm_area_struct.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
134901 ~ 9% -32.7% 90833 ~10% grantley/micro/aim7/shell_rtns_1
129125 ~12% +35.8% 175345 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
264026 ~10% +0.8% 266179 ~ 4% TOTAL softirqs.SCHED
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1045365 ~ 3% +9.8% 1147876 ~ 1% grantley/micro/aim7/disk_src
47284865 ~ 0% -45.1% 25940066 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
48330231 ~ 0% -44.0% 27087942 ~ 1% TOTAL proc-vmstat.pgfault
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
9.72 ~11% -35.5% 6.27 ~ 6% grantley/micro/aim7/disk_src
4.37 ~12% -32.5% 2.95 ~14% grantley/micro/aim7/shell_rtns_1
14.09 ~11% -34.5% 9.22 ~ 8% TOTAL turbostat.%pc2
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
8.932e+08 ~ 3% -27.8% 6.451e+08 ~ 2% grantley/micro/aim7/disk_src
8.932e+08 ~ 3% -27.8% 6.451e+08 ~ 2% TOTAL cpuidle.C6-HSW.time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
967729 ~ 6% +37.0% 1326099 ~ 5% grantley/micro/aim7/shell_rtns_1
961879 ~ 8% -13.4% 832924 ~ 9% lkp-wsx01/micro/aim7/shell_rtns_1
1929609 ~ 7% +11.9% 2159024 ~ 7% TOTAL numa-meminfo.node1.MemUsed
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
68903 ~ 0% +37.7% 94913 ~ 1% grantley/micro/aim7/shell_rtns_1
85573 ~ 0% +24.9% 106849 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
154477 ~ 0% +30.6% 201762 ~ 1% TOTAL slabinfo.anon_vma.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1076 ~ 0% +37.8% 1482 ~ 1% grantley/micro/aim7/shell_rtns_1
1336 ~ 0% +24.9% 1669 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
2412 ~ 0% +30.6% 3151 ~ 1% TOTAL slabinfo.anon_vma.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1076 ~ 0% +37.8% 1482 ~ 1% grantley/micro/aim7/shell_rtns_1
1336 ~ 0% +24.9% 1669 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
2412 ~ 0% +30.6% 3151 ~ 1% TOTAL slabinfo.anon_vma.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
67802 ~ 0% +35.4% 91804 ~ 1% grantley/micro/aim7/shell_rtns_1
84473 ~ 0% +24.1% 104836 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
152275 ~ 0% +29.1% 196641 ~ 1% TOTAL slabinfo.anon_vma.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
376 ~ 0% +27.7% 480 ~ 2% grantley/micro/aim7/shell_rtns_1
376 ~ 0% +27.7% 480 ~ 2% TOTAL slabinfo.sighand_cache.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
376 ~ 0% +27.7% 480 ~ 2% grantley/micro/aim7/shell_rtns_1
376 ~ 0% +27.7% 480 ~ 2% TOTAL slabinfo.sighand_cache.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
5645 ~ 0% +27.7% 7208 ~ 2% grantley/micro/aim7/shell_rtns_1
6652 ~ 0% +22.4% 8144 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
12298 ~ 0% +24.8% 15353 ~ 1% TOTAL slabinfo.sighand_cache.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
5467 ~ 0% +24.0% 6779 ~ 1% grantley/micro/aim7/shell_rtns_1
6439 ~ 0% +22.9% 7916 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
11906 ~ 0% +23.4% 14696 ~ 0% TOTAL slabinfo.sighand_cache.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1268 ~ 0% +25.8% 1596 ~ 1% grantley/micro/aim7/shell_rtns_1
1702 ~ 0% +19.6% 2036 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
2971 ~ 0% +22.2% 3632 ~ 1% TOTAL slabinfo.kmalloc-4096.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
177148 ~ 0% +24.0% 219595 ~ 1% grantley/micro/aim7/shell_rtns_1
91649 ~ 0% -15.8% 77156 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
268798 ~ 0% +10.4% 296751 ~ 1% TOTAL slabinfo.kmalloc-64.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1234 ~ 0% +23.0% 1518 ~ 1% grantley/micro/aim7/shell_rtns_1
1619 ~ 0% +20.2% 1945 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
2853 ~ 0% +21.4% 3464 ~ 1% TOTAL slabinfo.kmalloc-4096.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
13333 ~ 2% +12.7% 15030 ~ 3% grantley/micro/aim7/shell_rtns_1
16521 ~ 3% +29.3% 21358 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
29855 ~ 2% +21.9% 36388 ~ 3% TOTAL slabinfo.files_cache.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
13225 ~ 2% +12.9% 14927 ~ 3% grantley/micro/aim7/shell_rtns_1
16377 ~ 3% +28.6% 21062 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
29602 ~ 3% +21.6% 35990 ~ 3% TOTAL slabinfo.files_cache.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
3259 ~ 2% -15.9% 2742 ~ 1% grantley/micro/aim7/disk_src
3231 ~ 2% -14.9% 2750 ~ 4% grantley/micro/aim7/shell_rtns_1
6491 ~ 2% -15.4% 5492 ~ 3% TOTAL uptime.idle
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2873 ~ 0% +26.5% 3635 ~ 1% grantley/micro/aim7/shell_rtns_1
1437 ~ 0% -15.5% 1214 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
4215 ~ 8% -13.2% 3658 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
8526 ~ 4% -0.2% 8508 ~ 1% TOTAL slabinfo.kmalloc-64.num_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2873 ~ 0% +26.5% 3635 ~ 1% grantley/micro/aim7/shell_rtns_1
1437 ~ 0% -15.5% 1214 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
4215 ~ 8% -13.2% 3658 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
8526 ~ 4% -0.2% 8508 ~ 1% TOTAL slabinfo.kmalloc-64.active_slabs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
183945 ~ 0% +26.5% 232676 ~ 1% grantley/micro/aim7/shell_rtns_1
92013 ~ 0% -15.5% 77762 ~ 1% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
269789 ~ 8% -13.2% 234207 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
545748 ~ 4% -0.2% 544645 ~ 1% TOTAL slabinfo.kmalloc-64.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1018345 ~ 5% +23.8% 1261207 ~ 5% grantley/micro/aim7/shell_rtns_1
1018345 ~ 5% +23.8% 1261207 ~ 5% TOTAL numa-meminfo.node0.MemUsed
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
3220038 ~ 0% +12.8% 3632740 ~ 1% grantley/micro/aim7/shell_rtns_1
3297201 ~ 0% +19.3% 3932415 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
6517239 ~ 0% +16.1% 7565155 ~ 1% TOTAL meminfo.Committed_AS
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
48 ~ 1% +14.6% 55 ~ 1% grantley/micro/aim7/disk_src
49 ~ 1% +18.1% 58 ~ 1% grantley/micro/aim7/shell_rtns_1
97 ~ 1% +16.4% 113 ~ 1% TOTAL turbostat.CTMP
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
52 ~ 0% +14.6% 59 ~ 0% grantley/micro/aim7/disk_src
55 ~ 0% +14.4% 63 ~ 1% grantley/micro/aim7/shell_rtns_1
107 ~ 0% +14.5% 123 ~ 1% TOTAL turbostat.PTMP
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2434 ~ 5% +11.7% 2720 ~ 6% grantley/micro/aim7/shell_rtns_1
2434 ~ 5% +11.7% 2720 ~ 6% TOTAL slabinfo.shmem_inode_cache.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
2434 ~ 5% +11.7% 2720 ~ 6% grantley/micro/aim7/shell_rtns_1
2434 ~ 5% +11.7% 2720 ~ 6% TOTAL slabinfo.shmem_inode_cache.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1.77 ~ 4% -13.7% 1.53 ~ 3% grantley/micro/aim7/shell_rtns_1
1.77 ~ 4% -13.7% 1.53 ~ 3% TOTAL perf-profile.cpu-cycles.find_busiest_group.load_balance.idle_balance.__schedule.schedule
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14312 ~ 1% +14.4% 16371 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
14312 ~ 1% +14.4% 16371 ~ 1% TOTAL slabinfo.mm_struct.active_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14544 ~ 1% +14.2% 16612 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
14544 ~ 1% +14.2% 16612 ~ 1% TOTAL slabinfo.mm_struct.num_objs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
3396 ~ 4% -10.4% 3044 ~ 5% grantley/micro/aim7/shell_rtns_1
3396 ~ 4% -10.4% 3044 ~ 5% TOTAL proc-vmstat.nr_alloc_batch
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
22328 ~ 4% -11.1% 19845 ~ 2% lkp-wsx01/micro/aim7/shell_rtns_1
22328 ~ 4% -11.1% 19845 ~ 2% TOTAL cpuidle.C6-NHM.usage
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
529.92 ~ 4% +268.2% 1951.04 ~ 3% grantley/micro/aim7/disk_src
1003.41 ~ 0% +279.2% 3805.01 ~ 0% grantley/micro/aim7/shell_rtns_1
19.77 ~ 6% +182.6% 55.87 ~17% grantley/micro/aim7/string_rtns
3497.24 ~ 0% +461.8% 19645.76 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
5050.34 ~ 0% +404.1% 25457.68 ~ 1% TOTAL time.system_time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
11497 ~11% +1707.3% 207797 ~ 3% grantley/micro/aim7/disk_src
942233 ~ 3% +4.7% 986308 ~ 0% grantley/micro/aim7/shell_rtns_1
1131925 ~ 0% +270.9% 4197966 ~ 4% lkp-wsx01/micro/aim7/shell_rtns_1
2085656 ~ 2% +158.5% 5392071 ~ 3% TOTAL time.involuntary_context_switches
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
32036 ~12% -72.8% 8706 ~ 2% grantley/micro/aim7/disk_src
99971 ~ 3% -70.5% 29537 ~ 3% grantley/micro/aim7/shell_rtns_1
1440638 ~ 0% -46.5% 770986 ~ 2% lkp-nex05/micro/netperf/120s-200%-TCP_CRR
47859 ~ 0% -48.0% 24882 ~ 3% lkp-wsx01/micro/aim7/shell_rtns_1
1620504 ~ 0% -48.5% 834112 ~ 2% TOTAL vmstat.system.cs
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
487467 ~12% -81.6% 89693 ~ 2% grantley/micro/aim7/disk_src
2644894 ~ 3% -41.1% 1558409 ~ 0% grantley/micro/aim7/shell_rtns_1
2110723 ~ 0% -17.9% 1731995 ~ 1% lkp-wsx01/micro/aim7/shell_rtns_1
5243086 ~ 3% -35.5% 3380098 ~ 1% TOTAL time.voluntary_context_switches
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
30.65 ~ 1% +51.7% 46.48 ~ 2% grantley/micro/aim7/disk_src
63.36 ~ 2% +62.5% 102.94 ~ 4% grantley/micro/aim7/shell_rtns_1
31.54 ~ 0% +2.5% 32.32 ~ 0% grantley/micro/aim7/string_rtns
76.30 ~ 0% +264.6% 278.15 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
201.85 ~ 1% +127.8% 459.89 ~ 1% TOTAL time.elapsed_time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
1824 ~ 3% +132.3% 4239 ~ 0% grantley/micro/aim7/disk_src
2423 ~ 1% +64.9% 3995 ~ 3% grantley/micro/aim7/shell_rtns_1
5433 ~ 0% +34.7% 7318 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
9681 ~ 1% +60.6% 15552 ~ 1% TOTAL time.percent_of_cpu_this_job_got
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
75.03 ~ 0% +75.4% 131.59 ~ 1% grantley/micro/aim7/disk_src
92.96 ~ 0% +67.5% 155.70 ~ 1% grantley/micro/aim7/shell_rtns_1
167.99 ~ 0% +71.0% 287.29 ~ 1% TOTAL turbostat.Pkg_W
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
32.68 ~ 3% +129.8% 75.08 ~ 0% grantley/micro/aim7/disk_src
68.19 ~ 0% +29.8% 88.50 ~ 1% grantley/micro/aim7/shell_rtns_1
85.38 ~ 0% +12.5% 96.05 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
186.25 ~ 0% +39.4% 259.63 ~ 0% TOTAL turbostat.%c0
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
29.50 ~ 0% -31.5% 20.20 ~ 1% grantley/micro/aim7/disk_src
531.64 ~ 0% -43.2% 302.22 ~ 1% grantley/micro/aim7/shell_rtns_1
648.67 ~ 0% +9.8% 712.26 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
1209.81 ~ 0% -14.5% 1034.68 ~ 0% TOTAL time.user_time
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
14538 ~ 7% -15.6% 12271 ~ 0% grantley/micro/aim7/disk_src
24511 ~ 5% -36.3% 15617 ~ 2% grantley/micro/aim7/shell_rtns_1
27643 ~ 0% -26.4% 20346 ~ 0% lkp-wsx01/micro/aim7/shell_rtns_1
66693 ~ 4% -27.7% 48234 ~ 0% TOTAL vmstat.system.in
887843961c4b468 e2a728c2785d6aab45d1a6d2c
--------------- -------------------------
3.86 ~ 7% +55.3% 5.99 ~ 3% grantley/micro/aim7/disk_src
7.45 ~ 5% +18.6% 8.83 ~ 4% grantley/micro/aim7/shell_rtns_1
11.31 ~ 6% +31.1% 14.82 ~ 4% TOTAL turbostat.RAM_W
Legend:
~XX% - stddev percent
[+-]XX% - change percent
time.system_time
20000 O+----O---O-----O--O--O---O--------O--O--O---O--O--O--O--O---O--O--O
| O O O O |
18000 ++ |
16000 ++ |
| |
14000 ++ |
12000 ++ |
| |
10000 ++ |
8000 ++ |
| |
6000 ++ |
4000 ++ |
*..*..*...*..*..*..*..*...*..*..*..*..*..*...*..*..* |
2000 ++-----------------------------------------------------------------+
time.percent_of_cpu_this_job_got
7500 ++------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O
| O |
7000 ++ |
| |
| |
6500 ++ |
| |
6000 ++ |
| |
| |
5500 ++ .*.. .* |
*..*..*...*..*.. *...*..*..*..*...*. *..*...*. |
| .. |
5000 ++--------------*---------------------------------------------------+
time.elapsed_time
300 ++-------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O
| O O O |
250 ++ |
| |
| |
200 ++ |
| |
150 ++ |
| |
| |
100 ++ |
| .*... .*..*..*... .*... .*.. |
*. *. *..*. *. *..*...*..*..*...* |
50 ++-------------------------------------------------------------------+
time.involuntary_context_switches
5e+06 ++---------------------------------------------------------------+
| |
4.5e+06 O+ O O O O O |
4e+06 ++ O O O O O O O O O O O O O
| O O O |
3.5e+06 ++ |
| |
3e+06 ++ |
| |
2.5e+06 ++ |
2e+06 ++ |
| |
1.5e+06 ++ |
| .*.. .*..*.. |
1e+06 *+-*--*--*--*--*---*--*-----*--------*--*--*--*---*--------------+
aim7.2000.jobs-per-min
160000 *+----*--*------*--*--*-----*------*--*--*--*--*--*---------------+
| *. *. *. *. |
140000 ++ |
| |
| |
120000 ++ |
| |
100000 ++ |
| |
80000 ++ |
| |
| |
60000 ++ |
| O O O |
40000 O+----O--O---O--O--O--O--O---------O--O--O--O--O--O--O---O--O--O--O
turbostat.%c0
98 ++--------------------------------------------------------------------+
| O O |
96 O+ O O O O O O O O O O O O O O O O O O O
94 ++ |
| |
92 ++ |
90 ++ |
| |
88 ++ |
86 ++ |
*..*...*..*..* *..*...*..*..*...*..*..*...*..*..* |
84 ++ + : |
82 ++ + : |
| + : |
80 ++---------------*----------------------------------------------------+
vmstat.system.cs
55000 ++-----------------------------------------------------------------+
| .*.. |
50000 ++ .*. |
*..*..*...*..*.. .*..*...*..*. *..*...*..*..* |
45000 ++ *. |
| |
40000 ++ |
| |
35000 ++ |
| |
30000 ++ |
| O |
25000 O+ O O O O O O O O O O O O O O O O O O O
| O |
20000 ++-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Thanks,
Fengguang
8 years, 3 months
[sched] 373e9ec30ad: -9.8% qperf.tcp_bw.bw.MB_sec
by Fengguang Wu
Alex,
FYI, we noticed the below changes on
https://github.com/alexshi/power-scheduling.git single-balance
commit 373e9ec30ad1efee2c4ba6b58fc317626e6482d0 ("sched: only do load balance on tick_do_timer_cpu")
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
0.10 ~ 3% +2134.7% 2.32 ~ 3% lkp-st02/micro/ebizzy/200%-100-10
0.10 ~ 3% +2134.7% 2.32 ~ 3% TOTAL ebizzy.throughput.per_thread.stddev_percent
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2432 ~50% -56.3% 1064 ~ 0% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
2432 ~50% -56.3% 1064 ~ 0% TOTAL fileio.request_latency_max_ms
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1541 ~ 0% +90.4% 2936 ~ 0% lkp-st02/micro/ebizzy/200%-100-10
1541 ~ 0% +90.4% 2936 ~ 0% TOTAL ebizzy.throughput.per_thread.max
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
135 ~ 4% +76.4% 238 ~33% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
135 ~ 4% +76.4% 238 ~33% TOTAL fileio.requests_per_sec
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1443 ~ 0% -31.2% 993 ~ 1% lkp-st02/micro/ebizzy/200%-100-10
1443 ~ 0% -31.2% 993 ~ 1% TOTAL ebizzy.throughput.per_thread.min
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
273 ~ 0% -11.2% 242 ~ 1% lkp-a06/micro/qperf/600s
273 ~ 0% -11.2% 242 ~ 1% TOTAL qperf.udp_bw.send_bw.MB_sec
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
268 ~ 0% -9.8% 242 ~ 0% lkp-a06/micro/qperf/600s
268 ~ 0% -9.8% 242 ~ 0% TOTAL qperf.tcp_bw.bw.MB_sec
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
266 ~ 0% -9.8% 240 ~ 1% lkp-a06/micro/qperf/600s
266 ~ 0% -9.8% 240 ~ 1% TOTAL qperf.udp_bw.recv_bw.MB_sec
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
18752 ~ 4% -19.1% 15167 ~11% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
48281 ~ 2% -81.3% 9035 ~ 1% lkp-a06/micro/qperf/600s
139171 ~ 8% -96.6% 4794 ~ 8% lkp-nex05/micro/will-it-scale/sched_yield
35512 ~ 1% -82.0% 6404 ~ 2% lkp-st02/micro/ebizzy/200%-100-10
241717 ~ 5% -85.4% 35402 ~ 6% TOTAL softirqs.SCHED
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1359067 ~ 4% -30.7% 942510 ~ 2% lkp-a06/micro/qperf/600s
63196 ~ 0% -84.2% 9974 ~ 1% lkp-nex05/micro/will-it-scale/sched_yield
1422264 ~ 3% -33.0% 952484 ~ 2% TOTAL interrupts.RES
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1013906 ~ 4% +76.3% 1787578 ~33% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
1013906 ~ 4% +76.3% 1787578 ~33% TOTAL proc-vmstat.pgpgin
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
71377 ~ 3% +74.3% 124397 ~32% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
71377 ~ 3% +74.3% 124397 ~32% TOTAL proc-vmstat.pgactivate
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2.076e+08 ~ 2% -33.4% 1.383e+08 ~ 9% lkp-a06/micro/qperf/600s
2.076e+08 ~ 2% -33.4% 1.383e+08 ~ 9% TOTAL cpuidle.C1.time
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
69494 ~ 3% +69.9% 118079 ~31% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
69494 ~ 3% +69.9% 118079 ~31% TOTAL interrupts.43:PCI-MSI-edge.virtio1-requests
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
10201776 ~14% -30.1% 7133067 ~10% lkp-a06/micro/qperf/600s
10201776 ~14% -30.1% 7133067 ~10% TOTAL cpuidle.C3.time
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
128295 ~ 0% -27.7% 92701 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
128295 ~ 0% -27.7% 92701 ~ 0% TOTAL cpuidle.C3-NHM.usage
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
52277488 ~ 4% -26.6% 38366608 ~ 6% lkp-a06/micro/qperf/600s
52277488 ~ 4% -26.6% 38366608 ~ 6% TOTAL cpuidle.C2.time
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
49609 ~ 2% +38.8% 68871 ~19% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
49609 ~ 2% +38.8% 68871 ~19% TOTAL proc-vmstat.nr_active_file
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
198429 ~ 2% +38.8% 275466 ~19% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
198429 ~ 2% +38.8% 275466 ~19% TOTAL meminfo.Active(file)
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
3955 ~ 7% -24.8% 2972 ~14% lkp-a06/micro/qperf/600s
3955 ~ 7% -24.8% 2972 ~14% TOTAL cpuidle.C3.usage
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1.55 ~ 1% +27.6% 1.98 ~ 2% lkp-nex05/micro/will-it-scale/sched_yield
1.55 ~ 1% +27.6% 1.98 ~ 2% TOTAL perf-profile.cpu-cycles.trace_hardirqs_off_thunk.__sched_yield
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
220670 ~ 2% +34.9% 297725 ~17% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
220670 ~ 2% +34.9% 297725 ~17% TOTAL meminfo.Active
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
20.03 ~ 0% +25.8% 25.20 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
20.03 ~ 0% +25.8% 25.20 ~ 0% TOTAL turbostat.%c1
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2.16 ~ 1% +19.9% 2.58 ~ 2% lkp-nex05/micro/will-it-scale/sched_yield
2.16 ~ 1% +19.9% 2.58 ~ 2% TOTAL perf-profile.cpu-cycles.native_read_tsc.native_sched_clock.sched_clock.sched_clock_cpu.update_rq_clock
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
23914 ~ 4% -14.9% 20344 ~ 4% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
26884 ~ 4% -13.4% 23292 ~ 4% lkp-st02/micro/ebizzy/200%-100-10
50798 ~ 4% -14.1% 43636 ~ 4% TOTAL interrupts.IWI
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
7955 ~ 6% -14.7% 6789 ~ 3% lkp-st02/micro/ebizzy/200%-100-10
7955 ~ 6% -14.7% 6789 ~ 3% TOTAL slabinfo.kmalloc-64.active_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
3409 ~ 6% -14.0% 2932 ~ 3% lkp-st02/micro/ebizzy/200%-100-10
3409 ~ 6% -14.0% 2932 ~ 3% TOTAL slabinfo.kmalloc-192.active_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1.18 ~ 1% +15.5% 1.36 ~ 1% lkp-nex05/micro/will-it-scale/sched_yield
1.18 ~ 1% +15.5% 1.36 ~ 1% TOTAL perf-profile.cpu-cycles.rb_erase.__dequeue_entity.pick_next_task_fair.__schedule.schedule
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1.18 ~ 2% +16.6% 1.37 ~ 1% lkp-nex05/micro/will-it-scale/sched_yield
1.18 ~ 2% +16.6% 1.37 ~ 1% TOTAL perf-profile.cpu-cycles.rb_erase.pick_next_task_fair.__schedule.schedule.sys_sched_yield
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2743 ~ 4% -13.4% 2375 ~ 2% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
2743 ~ 4% -13.4% 2375 ~ 2% TOTAL uptime.idle
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
954 ~ 1% -15.0% 811 ~ 1% lkp-nex05/micro/will-it-scale/sched_yield
954 ~ 1% -15.0% 811 ~ 1% TOTAL slabinfo.taskstats.num_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
954 ~ 1% -15.0% 811 ~ 1% lkp-nex05/micro/will-it-scale/sched_yield
954 ~ 1% -15.0% 811 ~ 1% TOTAL slabinfo.taskstats.active_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1.81 ~ 2% -11.7% 1.60 ~ 1% lkp-nex05/micro/will-it-scale/sched_yield
1.81 ~ 2% -11.7% 1.60 ~ 1% TOTAL perf-profile.cpu-cycles.__dequeue_entity.pick_next_task_fair.__schedule.schedule.sys_sched_yield
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
25646 ~ 1% +13.7% 29148 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
25646 ~ 1% +13.7% 29148 ~ 0% TOTAL interrupts.0:IO-APIC-edge.timer
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2294497 ~ 0% -11.1% 2040824 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
2294497 ~ 0% -11.1% 2040824 ~ 0% TOTAL interrupts.LOC
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2972 ~ 0% +15.2% 3423 ~ 8% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
2972 ~ 0% +15.2% 3423 ~ 8% TOTAL slabinfo.radix_tree_node.num_slabs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2972 ~ 0% +15.2% 3423 ~ 8% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
2972 ~ 0% +15.2% 3423 ~ 8% TOTAL slabinfo.radix_tree_node.active_slabs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
83186 ~ 0% +15.2% 95811 ~ 8% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
83186 ~ 0% +15.2% 95811 ~ 8% TOTAL slabinfo.radix_tree_node.active_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
83245 ~ 0% +15.2% 95861 ~ 8% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
83245 ~ 0% +15.2% 95861 ~ 8% TOTAL slabinfo.radix_tree_node.num_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1245903 ~ 0% -10.2% 1118862 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
1245903 ~ 0% -10.2% 1118862 ~ 0% TOTAL softirqs.TIMER
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
6.34 ~ 1% -10.5% 5.67 ~ 2% lkp-nex05/micro/will-it-scale/sched_yield
6.34 ~ 1% -10.5% 5.67 ~ 2% TOTAL perf-profile.cpu-cycles.put_prev_task_fair.__schedule.schedule.sys_sched_yield.system_call_fastpath
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
3621 ~ 3% -9.6% 3275 ~ 2% lkp-st02/micro/ebizzy/200%-100-10
3621 ~ 3% -9.6% 3275 ~ 2% TOTAL slabinfo.kmalloc-192.num_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
9066611 ~ 0% -8.3% 8313872 ~ 1% lkp-a06/micro/qperf/600s
9066611 ~ 0% -8.3% 8313872 ~ 1% TOTAL proc-vmstat.pgalloc_dma32
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
8137 ~ 4% -7.9% 7495 ~ 2% lkp-st02/micro/ebizzy/200%-100-10
8137 ~ 4% -7.9% 7495 ~ 2% TOTAL slabinfo.kmalloc-64.num_objs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
24350865 ~ 0% -8.3% 22328921 ~ 1% lkp-a06/micro/qperf/600s
24350865 ~ 0% -8.3% 22328921 ~ 1% TOTAL proc-vmstat.pgfree
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
15285179 ~ 0% -8.3% 14016032 ~ 1% lkp-a06/micro/qperf/600s
15285179 ~ 0% -8.3% 14016032 ~ 1% TOTAL proc-vmstat.pgalloc_normal
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
91110 ~23% +8.6e+05% 7.845e+08 ~ 2% lkp-nex05/micro/will-it-scale/sched_yield
91110 ~23% +8.6e+05% 7.845e+08 ~ 2% TOTAL time.involuntary_context_switches
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
14152 ~ 1% +2.2% 14464 ~ 0% lkp-a06/micro/qperf/600s
14152 ~ 1% +2.2% 14464 ~ 0% TOTAL vmstat.system.cs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
968 ~ 4% +91.9% 1858 ~34% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
968 ~ 4% +91.9% 1858 ~34% TOTAL vmstat.io.bi
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2027778 ~ 4% +76.3% 3575122 ~33% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
2027778 ~ 4% +76.3% 3575122 ~33% TOTAL time.file_system_inputs
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2961 ~ 3% -19.7% 2378 ~ 3% lkp-a06/micro/qperf/600s
8365 ~ 0% -11.3% 7416 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
11326 ~ 1% -13.5% 9795 ~ 1% TOTAL vmstat.system.in
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
589 ~ 0% -15.6% 497 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
589 ~ 0% -15.6% 497 ~ 0% TOTAL time.user_time
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
904 ~ 0% -13.6% 781 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
904 ~ 0% -13.6% 781 ~ 0% TOTAL time.percent_of_cpu_this_job_got
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
2244 ~ 0% -13.0% 1951 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
2244 ~ 0% -13.0% 1951 ~ 0% TOTAL time.system_time
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
44.92 ~ 0% -11.5% 39.74 ~ 0% lkp-nex05/micro/will-it-scale/sched_yield
44.92 ~ 0% -11.5% 39.74 ~ 0% TOTAL turbostat.%c0
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
63860 ~ 2% +8.7% 69402 ~ 1% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
63860 ~ 2% +8.7% 69402 ~ 1% TOTAL vmstat.io.bo
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
1047 ~ 2% -8.0% 963 ~ 1% kbuildx/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
1047 ~ 2% -8.0% 963 ~ 1% TOTAL time.elapsed_time
v3.14-rc6 373e9ec30ad1efee2c4ba6b58
--------------- -------------------------
3887389 ~20% +9.7% 4262549 ~ 0% lkp-a06/micro/qperf/600s
3887389 ~20% +9.7% 4262549 ~ 0% TOTAL time.voluntary_context_switches
Legend:
~XX% - stddev percent
[+-]XX% - change percent
qperf.udp_bw.send_bw.MB_sec
280 ++-------------------------------------------------------------------+
| .*..... |
275 *+...*.....*.... ...*....*.... .. * |
270 ++ *....*.. *. |
| |
265 ++ |
260 ++ |
| |
255 ++ |
250 ++ O |
| |
245 ++ O |
240 O+ O O O O O O O
| O O O |
235 ++----------------------------------------O--------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Thanks,
Fengguang
8 years, 3 months
[SCSI] WARNING: CPU: 7 PID: 1484 at mm/page_alloc.c:2513 __alloc_pages_nodemask+0x1df/0x986()
by Fengguang Wu
Hi Hannes,
We noticed the below warnings on
commit beba1fc005a56a0597d01d3f381e533427856f5d ("[SCSI] Add EVPD page 0x83 to sysfs")
[ 13.210464] sd 0:0:0:0: [sda] Attached SCSI disk
[ 13.229569] sdb: sdb1 sdb2
[ 13.230918] sd 1:0:0:0: [sdb] Attached SCSI disk
[ 13.272657] igb 0000:01:00.0: eth1: (PCIe:2.5Gb/s:Width x4) 00:30:48:cf:17:26
[ 13.276044] ------------[ cut here ]------------
[ 13.276051] WARNING: CPU: 7 PID: 1484 at mm/page_alloc.c:2513 __alloc_pages_nodemask+0x1df/0x986()
[ 13.276053] Modules linked in:
[ 13.276056] CPU: 7 PID: 1484 Comm: kworker/u50:5 Not tainted 3.14.0-rc7-wl-ath-03670-g3c3af80 #1
[ 13.276057] Hardware name: Supermicro X8DTN/X8DTN, BIOS 4.6.3 01/06/2010
[ 13.276062] Workqueue: events_unbound async_run_entry_fn
[ 13.276065] 0000000000000000 ffff880417b2ba18 ffffffff81a48792 0000000000000000
[ 13.276067] ffff880417b2ba50 ffffffff810de155 ffffffff8118c3ab 00000000001040d0
[ 13.276069] 0000000000000000 0000000000000002 0000000000000000 ffff880417b2ba60
[ 13.276070] Call Trace:
[ 13.276076] [<ffffffff81a48792>] dump_stack+0x4d/0x66
[ 13.276079] [<ffffffff810de155>] warn_slowpath_common+0x7f/0x98
[ 13.276082] [<ffffffff8118c3ab>] ? __alloc_pages_nodemask+0x1df/0x986
[ 13.276085] [<ffffffff810de21c>] warn_slowpath_null+0x1a/0x1c
[ 13.276087] [<ffffffff8118c3ab>] __alloc_pages_nodemask+0x1df/0x986
[ 13.276091] [<ffffffff814eb871>] ? __freed_request+0x42/0x96
[ 13.276093] [<ffffffff814eb90f>] ? freed_request+0x4a/0x69
[ 13.276095] [<ffffffff814ec163>] ? __blk_put_request+0xfe/0x15e
[ 13.276099] [<ffffffff811c217d>] alloc_pages_current+0xc7/0xe2
[ 13.276102] [<ffffffff811889cd>] __get_free_pages+0xe/0x3b
[ 13.276104] [<ffffffff811a1c48>] kmalloc_order_trace+0x2b/0x98
[ 13.276108] [<ffffffff811cb530>] __kmalloc+0x38/0x1f2
[ 13.276112] [<ffffffff815d0362>] scsi_attach_vpd+0x36/0x29a
[ 13.276114] [<ffffffff815d90ea>] scsi_probe_and_add_lun+0x8f6/0xa2b
[ 13.276117] [<ffffffff815d947b>] __scsi_add_device+0xd3/0x10f
[ 13.276121] [<ffffffff816c1ee0>] ata_scsi_scan_host+0x82/0x16e
[ 13.276124] [<ffffffff816be336>] async_port_probe+0x4a/0x4f
[ 13.276127] [<ffffffff810ffeae>] async_run_entry_fn+0x5f/0x115
[ 13.276130] [<ffffffff810f5c72>] process_one_work+0x1f7/0x396
[ 13.276131] [<ffffffff810f62fc>] worker_thread+0x1e8/0x2e2
[ 13.276133] [<ffffffff810f6114>] ? rescuer_thread+0x2d4/0x2d4
[ 13.276136] [<ffffffff810fb273>] kthread+0xdb/0xe3
[ 13.276139] [<ffffffff810fb198>] ? kthread_create_on_node+0x16f/0x16f
[ 13.276142] [<ffffffff81a5743c>] ret_from_fork+0x7c/0xb0
[ 13.276144] [<ffffffff810fb198>] ? kthread_create_on_node+0x16f/0x16f
[ 13.276150] ---[ end trace 3c57e8c3743333ed ]---
[ 13.277434] scsi 5:0:0:0: Attached scsi generic sg2 type 5
Full dmesg is attached.
Thanks,
Fengguang
8 years, 3 months
[cpuidle] BUG: sleeping function called from invalid context at /c/kernel-tests/src/lkp/mm/vmalloc.c:74
by Fengguang Wu
Greetings,
FYI, the below debug patch triggers a warning on cpuidle code path
git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit 3d693a5127e79e79da7c34dc0c776bc620697ce5
Author: Andrew Morton <akpm(a)linux-foundation.org>
AuthorDate: Mon Mar 17 11:23:56 2014 +1100
Commit: Stephen Rothwell <sfr(a)canb.auug.org.au>
CommitDate: Mon Mar 17 11:23:56 2014 +1100
mm-vmalloc-avoid-soft-lockup-warnings-when-vunmaping-large-ranges-fix
add a might_sleep() to catch atomic callers more promptly
Cc: David Vrabel <david.vrabel(a)citrix.com>
Cc: Dietmar Hahn <dietmar.hahn(a)ts.fujitsu.com>
Signed-off-by: Andrew Morton <akpm(a)linux-foundation.org>
[ 26.028136] BUG: sleeping function called from invalid context at /c/kernel-tests/src/lkp/mm/vmalloc.c:74
[ 26.040078] in_atomic(): 1, irqs_disabled(): 1, pid: 0, name: swapper/0
[ 26.040080] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.14.0-rc6-next-20140317 #1
[ 26.040081] Hardware name: Intel Corporation S5520UR/S5520UR, BIOS S5500.86B.01.00.0050.050620101605 05/06/2010
[ 26.040083] 0000000000000000 ffff8801e9c06d00 ffffffff81a3ae8a ffffc90001870000
[ 26.040084] ffff8801e9c06d10 ffffffff81101256 ffff8801e9c06d88 ffffffff811b1540
[ 26.040089] ffffc90001870fff ffffc90001870fff 0000000000000001 000037008ddb0000
[ 26.040089] Call Trace:
[ 26.040094] <NMI> [<ffffffff81a3ae8a>] dump_stack+0x4d/0x66
[ 26.040098] [<ffffffff81101256>] __might_sleep+0x10a/0x10c
[ 26.040101] [<ffffffff811b1540>] vunmap_page_range+0x143/0x2b2
[ 26.040102] [<ffffffff811b16c0>] unmap_kernel_range_noflush+0x11/0x13
[ 26.040105] [<ffffffff8156f578>] ghes_copy_tofrom_phys+0x11f/0x189
[ 26.040106] [<ffffffff8156f66a>] ghes_read_estatus+0x88/0x134
[ 26.040108] [<ffffffff81570379>] ghes_notify_nmi+0x53/0x1e7
[ 26.040110] [<ffffffff81a4370c>] nmi_handle.isra.4+0x68/0x113
[ 26.040112] [<ffffffff81a43e51>] ? perf_ibs_nmi_handler+0x3d/0x3d
[ 26.040113] [<ffffffff81a43867>] do_nmi+0xb0/0x2de
[ 26.040114] [<ffffffff81a42e91>] end_repeat_nmi+0x1e/0x2e
[ 26.040118] [<ffffffff81066ac0>] ? native_write_msr_safe+0xa/0xe
[ 26.040119] [<ffffffff81066ac0>] ? native_write_msr_safe+0xa/0xe
[ 26.040120] [<ffffffff81066ac0>] ? native_write_msr_safe+0xa/0xe
[ 26.040124] <<EOE>> <IRQ> [<ffffffff8104e597>] intel_pmu_enable_all+0x4c/0x9b
[ 26.040125] [<ffffffff8104e607>] intel_pmu_nhm_enable_all+0x21/0x152
[ 26.040127] [<ffffffff81049b00>] x86_pmu_enable+0x134/0x273
[ 26.040129] [<ffffffff81176942>] perf_pmu_enable+0x22/0x24
[ 26.040130] [<ffffffff81048268>] x86_pmu_commit_txn+0x7b/0x98
[ 26.040132] [<ffffffff81112a66>] ? __wake_up+0x44/0x4b
[ 26.040135] [<ffffffff81579c81>] ? tty_wakeup+0x5b/0x60
[ 26.040137] [<ffffffff81593d02>] ? uart_write_wakeup+0x20/0x22
[ 26.040139] [<ffffffff81596c7d>] ? serial8250_tx_chars+0xd9/0x142
[ 26.040140] [<ffffffff81a42396>] ? _raw_spin_unlock_irqrestore+0x25/0x41
[ 26.040141] [<ffffffff81a4220b>] ? _raw_spin_lock_irqsave+0x25/0x56
[ 26.040142] [<ffffffff81a42396>] ? _raw_spin_unlock_irqrestore+0x25/0x41
[ 26.040144] [<ffffffff810fb494>] ? hrtimer_get_next_event+0x83/0x98
[ 26.040145] [<ffffffff81177ad6>] ? event_sched_in+0x133/0x143
[ 26.040146] [<ffffffff81177b79>] group_sched_in+0x93/0x13c
[ 26.040149] [<ffffffff8103edc7>] ? native_sched_clock+0x31/0x93
[ 26.040150] [<ffffffff81178a83>] __perf_event_enable+0x1ad/0x1ea
[ 26.040151] [<ffffffff81175275>] remote_function+0x17/0x40
[ 26.040154] [<ffffffff8113786f>] generic_smp_call_function_single_interrupt+0x74/0xdb
[ 26.040156] [<ffffffff8105bb9e>] smp_call_function_single_interrupt+0x27/0x36
[ 26.040158] [<ffffffff81a4ae32>] call_function_single_interrupt+0x72/0x80
[ 26.040161] <EOI> [<ffffffff818e7546>] ? cpuidle_enter_state+0x59/0xb5
[ 26.040162] [<ffffffff818e7542>] ? cpuidle_enter_state+0x55/0xb5
[ 26.040164] [<ffffffff818e75ce>] cpuidle_enter+0x17/0x19
[ 26.040165] [<ffffffff81113271>] cpu_startup_entry+0x227/0x3b8
[ 26.040167] [<ffffffff81a2ca43>] rest_init+0x87/0x89
[ 26.040169] [<ffffffff82353dda>] start_kernel+0x401/0x40c
[ 26.040170] [<ffffffff823537e7>] ? repair_env_string+0x58/0x58
[ 26.040171] [<ffffffff82353120>] ? early_idt_handlers+0x120/0x120
[ 26.040173] [<ffffffff823534a2>] x86_64_start_reservations+0x2a/0x2c
[ 26.040174] [<ffffffff823535df>] x86_64_start_kernel+0x13b/0x148
[ 26.463198] perf interrupt took too long (2503 > 2500), lowering kernel.perf_event_max_sample_rate to 50000
Thanks,
Fengguang
8 years, 3 months
[mm/vmalloc] BUG: sleeping function called from invalid context at mm/vmalloc.c:74
by Fengguang Wu
Hi David,
FYI, we noticed the below BUG on
git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit 032dda8b6c4021d4be63bcc483b47fd26c6f48a2 ("mm/vmalloc: avoid soft lockup warnings when vunmap()'ing large ranges")
[ 229.097122] BUG: sleeping function called from invalid context at mm/vmalloc.c:74
[ 229.109704] in_atomic(): 1, irqs_disabled(): 0, pid: 13598, name: poll2_threads
[ 229.119755] CPU: 17 PID: 13598 Comm: poll2_threads Not tainted 3.14.0-rc6-next-20140317 #1
[ 229.130914] Hardware name: Intel Corporation BRICKLAND/BRICKLAND, BIOS BKLDSDP1.86B.0031.R01.1304221600 04/22/2013
[ 229.144432] 0000000000000000 ffff881840111d80 ffffffff81a3ae8a ffffc9001cf38000
[ 229.155417] ffff881840111d90 ffffffff81101256 ffff881840111e08 ffffffff811b1540
[ 229.166340] ffffc9001cf48fff ffffc9001cf48fff 0000000000000000 ffff881840111dd0
[ 229.177355] Call Trace:
[ 229.181129] [<ffffffff81a3ae8a>] dump_stack+0x4d/0x66
[ 229.188012] [<ffffffff81101256>] __might_sleep+0x10a/0x10c
[ 229.195320] [<ffffffff811b1540>] vunmap_page_range+0x143/0x2b2
[ 229.203046] [<ffffffff811b2174>] ? map_vm_area+0x2e/0x40
[ 229.210184] [<ffffffff811b2c95>] remove_vm_area+0x58/0x75
[ 229.217361] [<ffffffff811b2ced>] __vunmap+0x3b/0xaf
[ 229.223979] [<ffffffff811b2df5>] vfree+0x67/0x6a
[ 229.230316] [<ffffffff811f4868>] free_fdmem+0x2a/0x33
[ 229.237140] [<ffffffff811f4949>] __free_fdtable+0x16/0x2a
[ 229.244313] [<ffffffff811f4c1e>] expand_files+0x121/0x143
[ 229.251516] [<ffffffff811f5075>] __alloc_fd+0x5e/0xef
[ 229.258363] [<ffffffff811f5136>] get_unused_fd_flags+0x30/0x32
[ 229.266038] [<ffffffff811dcf02>] do_sys_open+0x12e/0x1d6
[ 229.273127] [<ffffffff811dcfc8>] SyS_open+0x1e/0x20
[ 229.279718] [<ffffffff81a49de9>] system_call_fastpath+0x16/0x1b
Thanks,
Fengguang
8 years, 3 months
[sched/balance] BUG: unable to handle kernel NULL pointer dereference at 000000000000015d
by Fengguang Wu
Alex,
FYI, we noticed the below BUG on
https://github.com/alexshi/power-scheduling.git single-balance
commit ac76eed9c784ed577d0f26cc0bfd3bba02465942 ("sched/balance: send resched to load pulled cpu")
[ 55.934564] BUG: unable to handle kernel NULL pointer dereference at 000000000000015d
[ 55.937722] IP: [<ffffffff81a44659>] __schedule+0x585/0x787
[ 55.937722] PGD 103f54f067 PUD 103f528067 PMD 0
[ 55.937722] Oops: 0000 [#1] SMP
[ 55.937722] Modules linked in: x86_pkg_temp_thermal microcode mpt2sas ipmi_si ipmi_msghandler processor
[ 55.937722] CPU: 91 PID: 375 Comm: migration/91 Not tainted 3.14.0-rc6-00004-g018e9d5 #1
[ 55.937722] Hardware name: Intel Corporation BRICKLAND/BRICKLAND, BIOS BKLDSDP1.86B.0031.R01.1304221600 04/22/2013
[ 55.937722] task: ffff8818545ad190 ti: ffff881854604000 task.ti: ffff881854604000
[ 55.937722] RIP: 0010:[<ffffffff81a44659>] [<ffffffff81a44659>] __schedule+0x585/0x787
[ 55.937722] RSP: 0018:ffff881854605d78 EFLAGS: 00010246
[ 55.937722] RAX: 000000000000005b RBX: ffff88185fa13000 RCX: 0000005b00000000
[ 55.937722] RDX: ffff8818545ad640 RSI: ffff8818545ad190 RDI: ffff88185fa13000
[ 55.937722] RBP: 000000000000024d R08: ffff881854604000 R09: 0000000000000073
[ 55.937722] R10: 0000000000005c00 R11: 0000000000005b8d R12: ffff88103eb192c0
[ 55.937722] R13: 0000000000000000 R14: 000000000000005b R15: ffff8818545ad190
[ 55.937722] FS: 0000000000000000(0000) GS:ffff88185fa00000(0000) knlGS:0000000000000000
[ 55.937722] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 55.937722] CR2: 000000000000015d CR3: 000000103f550000 CR4: 00000000001407e0
[ 55.937722] Stack:
[ 55.937722] ffff8818546061f9 0000000000000000 0000000000000000 000000000000001e
[ 55.937722] 0000000000000000 ffffffffffffffe4 0000000000000000 000000000000024d
[ 55.937722] 0000000000000000 ffff881854605e09 0000000000000000 0000000000000000
[ 55.937722] Call Trace:
[ 55.937722] Code: 58 08 00 00 48 8b 40 60 48 8b 50 58 48 85 d2 74 05 48 89 df ff d2 4c 89 e6 48 89 df e8 c3 2e 00 00 c7 83 b4 08 00 00
00 00 00 00 <48> 8b 85 10 ff ff ff 65 ff 0c 25 50 b9 00 00 48 8b 80 38 e0 ff
[ 55.937722] RIP [<ffffffff81a44659>] __schedule+0x585/0x787
[ 55.937722] RSP <ffff881854605d78>
[ 55.937722] CR2: 000000000000015d
[ 55.937722] ---[ end trace 905b5ff6abaedc72 ]---
[ 55.937722] Kernel panic - not syncing: Fatal exception
[ 55.937722] Kernel Offset: 0x0 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffff9fffffff)
[ 55.937722] Rebooting in 10 seconds..
Thanks,
Fengguang
8 years, 3 months
[map_pages] 66431c4de99: -55.4% proc-vmstat.pgfault
by Fengguang Wu
Hi Kirill,
FYI, we noticed decreased page faults and increased mapped pages on
git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit 66431c4de9921a9b3c7f3556bada4285912aedb7 ("mm: implement ->map_pages for page cache")
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
591248 ~ 0% -56.1% 259664 ~ 0% lkp-t410/micro/netperf/120s-200%-TCP_MAERTS
5090162 ~ 0% -55.4% 2272005 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
5681411 ~ 0% -55.4% 2531670 ~ 0% TOTAL proc-vmstat.pgfault
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
1413 ~ 0% +95.2% 2759 ~ 1% lkp-t410/micro/netperf/120s-200%-TCP_MAERTS
1458 ~ 0% +94.4% 2835 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
2872 ~ 0% +94.8% 5594 ~ 1% TOTAL time.maximum_resident_set_size
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
4332 ~ 0% +48.9% 6449 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
4332 ~ 0% +48.9% 6449 ~ 0% TOTAL numa-meminfo.node1.Mapped
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
1082 ~ 0% +48.9% 1612 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
1082 ~ 0% +48.9% 1612 ~ 0% TOTAL numa-vmstat.node1.nr_mapped
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
4349 ~ 0% +48.6% 6465 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
4349 ~ 0% +48.6% 6465 ~ 0% TOTAL numa-meminfo.node0.Mapped
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
1087 ~ 0% +48.7% 1616 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
1087 ~ 0% +48.7% 1616 ~ 0% TOTAL numa-vmstat.node0.nr_mapped
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
7426 ~ 0% +45.1% 10773 ~ 0% lkp-t410/micro/netperf/120s-200%-TCP_MAERTS
8682 ~ 0% +48.7% 12911 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
16108 ~ 0% +47.0% 23684 ~ 0% TOTAL meminfo.Mapped
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
1852 ~ 0% +45.4% 2693 ~ 0% lkp-t410/micro/netperf/120s-200%-TCP_MAERTS
2170 ~ 0% +48.7% 3227 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
4022 ~ 0% +47.2% 5921 ~ 0% TOTAL proc-vmstat.nr_mapped
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
0.93 ~ 4% +24.2% 1.15 ~ 5% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
0.93 ~ 4% +24.2% 1.15 ~ 5% TOTAL perf-profile.cpu-cycles.vfs_write.sys_write.system_call_fastpath.write
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
1968 ~ 0% +17.5% 2313 ~ 1% lkp-t410/micro/netperf/120s-200%-TCP_MAERTS
1968 ~ 0% +17.5% 2313 ~ 1% TOTAL proc-vmstat.pgactivate
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
3.34 ~ 1% -10.7% 2.98 ~ 2% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
3.34 ~ 1% -10.7% 2.98 ~ 2% TOTAL perf-profile.cpu-cycles.ext4_mark_iloc_dirty.ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
3258 ~ 0% -59.1% 1331 ~ 0% lkp-t410/micro/netperf/120s-200%-TCP_MAERTS
162827 ~ 0% -59.3% 66299 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
166085 ~ 0% -59.3% 67630 ~ 0% TOTAL time.minor_page_faults
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
5093318 ~ 0% -55.7% 2257903 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
5093318 ~ 0% -55.7% 2257903 ~ 0% TOTAL perf-stat.minor-faults
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
5092110 ~ 0% -55.7% 2257193 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
5092110 ~ 0% -55.7% 2257193 ~ 0% TOTAL perf-stat.page-faults
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
3.698e+11 ~ 0% -11.3% 3.28e+11 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
3.698e+11 ~ 0% -11.3% 3.28e+11 ~ 0% TOTAL perf-stat.L1-icache-load-misses
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
45.26 ~ 3% +8.4% 49.05 ~ 3% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
45.26 ~ 3% +8.4% 49.05 ~ 3% TOTAL iostat.sdd.wrqm/s
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
1.824e+10 ~ 0% -5.3% 1.727e+10 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
1.824e+10 ~ 0% -5.3% 1.727e+10 ~ 0% TOTAL perf-stat.branch-misses
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
2.802e+12 ~ 0% -4.7% 2.67e+12 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
2.802e+12 ~ 0% -4.7% 2.67e+12 ~ 0% TOTAL perf-stat.L1-icache-loads
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
7.246e+08 ~ 2% -4.5% 6.922e+08 ~ 1% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
7.246e+08 ~ 2% -4.5% 6.922e+08 ~ 1% TOTAL perf-stat.iTLB-load-misses
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
3.314e+09 ~ 1% -4.8% 3.154e+09 ~ 1% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
3.314e+09 ~ 1% -4.8% 3.154e+09 ~ 1% TOTAL perf-stat.LLC-load-misses
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
3.324e+09 ~ 1% -4.4% 3.179e+09 ~ 0% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
3.324e+09 ~ 1% -4.4% 3.179e+09 ~ 0% TOTAL perf-stat.node-loads
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
3.554e+08 ~ 3% +5.7% 3.755e+08 ~ 1% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
3.554e+08 ~ 3% +5.7% 3.755e+08 ~ 1% TOTAL perf-stat.node-store-misses
c9161c06019b342 66431c4de9921a9b3c7f3556b
--------------- -------------------------
8.409e+12 ~ 0% -2.5% 8.196e+12 ~ 1% lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
8.409e+12 ~ 0% -2.5% 8.196e+12 ~ 1% TOTAL perf-stat.cpu-cycles
Legend:
~XX% - stddev percent
[+-]XX% - change percent
time.minor_page_faults
170000 ++----------------------------------------------------------------+
160000 *+*.*..*.*.*.*.*..*.*.*.*.*..*.*.*.*.*..*.*.*.*.*..*.*.*.*.*..*.*.*
| |
150000 ++ |
140000 ++ |
130000 ++ |
120000 ++ |
| |
110000 ++ |
100000 ++ |
90000 ++ |
80000 ++ |
| |
70000 O+O O O O O O O O O O O O O O O O O O O O O O O |
60000 ++----------------------------------------------------------------+
perf-stat.page-faults
5.5e+06 ++---------------------------------------------------------------+
| |
5e+06 *+*.*..*.*.*.*.*.*..*.*.*.*.*.*..*.*.*.*.*.*..*.*.*.*.*.*..*.*.*.*
| |
4.5e+06 ++ |
| |
4e+06 ++ |
| |
3.5e+06 ++ |
| |
3e+06 ++ |
| |
2.5e+06 ++ |
O O O O O O O O O O O O O O O O O O O O O O O O |
2e+06 ++---------------------------------------------------------------+
perf-stat.minor-faults
5.5e+06 ++---------------------------------------------------------------+
| |
5e+06 *+*.*..*.*.*.*.*.*..*.*.*.*.*.*..*.*.*.*.*.*..*.*.*.*.*.*..*.*.*.*
| |
4.5e+06 ++ |
| |
4e+06 ++ |
| |
3.5e+06 ++ |
| |
3e+06 ++ |
| |
2.5e+06 ++ |
O O O O O O O O O O O O O O O O O O O O O O O O |
2e+06 ++---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Thanks,
Fengguang
8 years, 3 months