HEAD is now at 7caf71f... sched: don't queue timers on quiesced CPUs git checkout b97f0291a2504291aef850077f98cab68a5a2f33 ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:b97f0291a2504291aef850077f98cab68a5a2f33:bisect-vfs 2014-04-03-22:30:17 b97f0291a2504291aef850077f98cab68a5a2f33 reuse /kernel/x86_64-rhel/b97f0291a2504291aef850077f98cab68a5a2f33/vmlinuz-3.14.0-rc1-00046-gb97f029 2014-04-03-22:30:17 detecting boot state .... 1. 2. 8 13 18 21. 27 29 31..... 32 SUCCESS bisect: good commit b97f0291a2504291aef850077f98cab68a5a2f33 git bisect start 7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4 b97f0291a2504291aef850077f98cab68a5a2f33 -- /c/kernel-tests/linear-bisect: ["-b", "7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4", "-g", "b97f0291a2504291aef850077f98cab68a5a2f33", "/c/kernel-tests/bisect-test-boot-failure.sh", "/home/wfg/vfs/obj-bisect"] Bisecting: 47 revisions left to test after this (roughly 6 steps) [fe04ef37d949ea92dbc37164eff116fe3c4a0930] hrtimer: make enqueue_hrtimer() return void running /c/kernel-tests/bisect-test-boot-failure.sh /home/wfg/vfs/obj-bisect ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:fe04ef37d949ea92dbc37164eff116fe3c4a0930:bisect-vfs 2014-04-03-22:41:19 fe04ef37d949ea92dbc37164eff116fe3c4a0930 reuse /kernel/x86_64-rhel/fe04ef37d949ea92dbc37164eff116fe3c4a0930/vmlinuz-3.14.0-rc1-00069-gfe04ef3 2014-04-03-22:41:19 detecting boot state ...... 1 2.. 3........... 4..................... 14.. 17...................................................................................................... 18.................................................................................................................................................................................................................. 19 20 22 23 26 29 32 SUCCESS Bisecting: 24 revisions left to test after this (roughly 5 steps) [de1f862abff16ab0a1058181bb541a55b691e64d] hrtimer: Use for_each_active_base() to iterate over active clock bases running /c/kernel-tests/bisect-test-boot-failure.sh /home/wfg/vfs/obj-bisect ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:de1f862abff16ab0a1058181bb541a55b691e64d:bisect-vfs 2014-04-04-01:45:22 de1f862abff16ab0a1058181bb541a55b691e64d compiling Queued build task to /kernel-tests/build-queue/x86_64-rhel-de1f862abff16ab0a1058181bb541a55b691e64d Check for kernel in /kernel/x86_64-rhel/de1f862abff16ab0a1058181bb541a55b691e64d waiting for completion of /kernel-tests/build-queue/x86_64-rhel-de1f862abff16ab0a1058181bb541a55b691e64d waiting for completion of /kernel-tests/build-queue/.x86_64-rhel-de1f862abff16ab0a1058181bb541a55b691e64d kernel: /kernel/x86_64-rhel/de1f862abff16ab0a1058181bb541a55b691e64d/vmlinuz-3.14.0-rc1-00081-gde1f862 2014-04-04-03:27:22 detecting boot state 1 3 7 11 12 19 24 26 27 29 30... 31 32 SUCCESS Bisecting: 12 revisions left to test after this (roughly 4 steps) [6378cb51af5f4743db0dcb3cbcf862eac5908754] timer: don't migrate pinned timers running /c/kernel-tests/bisect-test-boot-failure.sh /home/wfg/vfs/obj-bisect ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:6378cb51af5f4743db0dcb3cbcf862eac5908754:bisect-vfs 2014-04-04-03:35:23 6378cb51af5f4743db0dcb3cbcf862eac5908754 compiling Queued build task to /kernel-tests/build-queue/x86_64-rhel-6378cb51af5f4743db0dcb3cbcf862eac5908754 Check for kernel in /kernel/x86_64-rhel/6378cb51af5f4743db0dcb3cbcf862eac5908754 waiting for completion of /kernel-tests/build-queue/x86_64-rhel-6378cb51af5f4743db0dcb3cbcf862eac5908754 waiting for completion of /kernel-tests/build-queue/.x86_64-rhel-6378cb51af5f4743db0dcb3cbcf862eac5908754 kernel: /kernel/x86_64-rhel/6378cb51af5f4743db0dcb3cbcf862eac5908754/vmlinuz-3.14.0-rc1-00087-g6378cb5 2014-04-04-04:00:24 detecting boot state .. 2.. TEST FAILURE [ 50.733347] Unregister pv shared memory for cpu 1 [ 50.747514] smpboot: CPU 1 is now offline [ 50.749142] ------------[ cut here ]------------ [ 50.750012] WARNING: CPU: 0 PID: 1956 at kernel/timer.c:1621 migrate_timer_list+0xd6/0xf0() [ 50.750012] migrate_timer_list: can't migrate pinned timer: ffffffff81f06a60, deactivating it [ 50.750012] Modules linked in: [ 50.750012] CPU: 0 PID: 1956 Comm: 01-cpu-hotplug Not tainted 3.14.0-rc1-00087-g6378cb5 #1 [ 50.750012] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 50.750012] 0000000000000009 ffff88001d311c38 ffffffff817237bd ffff88001d311c80 [ 50.750012] ffff88001d311c70 ffffffff8106a1dd 0000000000000c90 ffffffff81f06a60 [ 50.750012] ffff88001e04ccb0 ffffffff81e3d4c0 0000000000000000 ffff88001d311cd0 [ 50.750012] Call Trace: [ 50.750012] [] dump_stack+0x4d/0x66 [ 50.750012] [] warn_slowpath_common+0x7d/0xa0 [ 50.750012] [] warn_slowpath_fmt+0x4c/0x50 [ 50.750012] [] ? __internal_add_timer+0xc8/0x130 [ 50.750012] [] migrate_timer_list+0xd6/0xf0 [ 50.750012] [] timer_cpu_notify+0xc1/0x1f0 [ 50.750012] [] notifier_call_chain+0x4c/0x70 [ 50.750012] [] __raw_notifier_call_chain+0xe/0x10 [ 50.750012] [] cpu_notify+0x23/0x50 [ 50.750012] [] cpu_notify_nofail+0xe/0x20 [ 50.750012] [] _cpu_down+0x1ad/0x2e0 [ 50.750012] [] cpu_down+0x34/0x50 [ 50.750012] [] cpu_subsys_offline+0x14/0x20 [ 50.750012] [] device_offline+0x95/0xc0 [ 50.750012] [] online_store+0x40/0x90 [ 50.750012] [] dev_attr_store+0x18/0x30 [ 50.750012] [] sysfs_kf_write+0x3d/0x50 [ 50.750012] [] kernfs_fop_write+0xd2/0x140 [ 50.750012] [] vfs_write+0xba/0x1e0 [ 50.750012] [] SyS_write+0x49/0xa0 [ 50.750012] [] system_call_fastpath+0x16/0x1b [ 50.750012] ---[ end trace 0c6731e39ed13901 ]--- [ 50.892240] blk-mq: CPU -> queue map /kernel/x86_64-rhel/6378cb51af5f4743db0dcb3cbcf862eac5908754/dmesg-nfsroot-roam-32:20140404040246:x86_64-rhel:3.14.0-rc1-00087-g6378cb5:1 1:1:2 all_good:bad:all_bad boots 2014-04-04 04:02:55 REPEAT COUNT: 40 # /cc/wfg/vfs-bisect/.repeat Bisecting: 6 revisions left to test after this (roughly 3 steps) [6b4e6938e2f62e8b7f02453cabff5640f6b4bbdf] hrtimer: call switch_hrtimer_base() after setting new expiry time running /c/kernel-tests/bisect-test-boot-failure.sh /home/wfg/vfs/obj-bisect ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:6b4e6938e2f62e8b7f02453cabff5640f6b4bbdf:bisect-vfs 2014-04-04-04:02:55 6b4e6938e2f62e8b7f02453cabff5640f6b4bbdf reuse /kernel/x86_64-rhel/6b4e6938e2f62e8b7f02453cabff5640f6b4bbdf/vmlinuz-3.14.0-rc1-00084-g6b4e693 2014-04-04-04:02:55 detecting boot state . 1.. 2.... 25 37 39... 40 SUCCESS Bisecting: 3 revisions left to test after this (roughly 3 steps) [e5535a330ccddbe95760a52bba837703ee16926f] hrtimer: fix routine names in comments running /c/kernel-tests/bisect-test-boot-failure.sh /home/wfg/vfs/obj-bisect ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:e5535a330ccddbe95760a52bba837703ee16926f:bisect-vfs 2014-04-04-04:10:56 e5535a330ccddbe95760a52bba837703ee16926f compiling Queued build task to /kernel-tests/build-queue/x86_64-rhel-e5535a330ccddbe95760a52bba837703ee16926f Check for kernel in /kernel/x86_64-rhel/e5535a330ccddbe95760a52bba837703ee16926f waiting for completion of /kernel-tests/build-queue/x86_64-rhel-e5535a330ccddbe95760a52bba837703ee16926f waiting for completion of /kernel-tests/build-queue/.x86_64-rhel-e5535a330ccddbe95760a52bba837703ee16926f kernel: /kernel/x86_64-rhel/e5535a330ccddbe95760a52bba837703ee16926f/vmlinuz-3.14.0-rc1-00085-ge5535a3 2014-04-04-04:31:56 detecting boot state .. 4 11 18 27 32 35 38 40 SUCCESS Bisecting: 2 revisions left to test after this (roughly 2 steps) [5a8530b7c3b1889861949d4e52b2da82d0aff242] timer: track pinned timers with TIMER_PINNED flag running /c/kernel-tests/bisect-test-boot-failure.sh /home/wfg/vfs/obj-bisect ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:5a8530b7c3b1889861949d4e52b2da82d0aff242:bisect-vfs 2014-04-04-04:36:57 5a8530b7c3b1889861949d4e52b2da82d0aff242 compiling Queued build task to /kernel-tests/build-queue/x86_64-rhel-5a8530b7c3b1889861949d4e52b2da82d0aff242 Check for kernel in /kernel/x86_64-rhel/5a8530b7c3b1889861949d4e52b2da82d0aff242 waiting for completion of /kernel-tests/build-queue/x86_64-rhel-5a8530b7c3b1889861949d4e52b2da82d0aff242 waiting for completion of /kernel-tests/build-queue/.x86_64-rhel-5a8530b7c3b1889861949d4e52b2da82d0aff242 kernel: /kernel/x86_64-rhel/5a8530b7c3b1889861949d4e52b2da82d0aff242/vmlinuz-3.14.0-rc1-00086-g5a8530b 2014-04-04-04:50:58 detecting boot state .... 1 3. 4 10. 13 17 19 25 30 32 34. 35... 39.. 40 SUCCESS 6378cb51af5f4743db0dcb3cbcf862eac5908754 is the first bad commit commit 6378cb51af5f4743db0dcb3cbcf862eac5908754 Author: Viresh Kumar AuthorDate: Thu Mar 20 14:29:02 2014 +0530 Commit: Viresh Kumar CommitDate: Wed Apr 2 14:54:57 2014 +0530 timer: don't migrate pinned timers migrate_timer() is called when a CPU goes down and its timers are required to be migrated to some other CPU. Its the responsibility of the users of the timer to remove it before control reaches to migrate_timers(). As these were the pinned timers, the best we can do is: don't migrate these and report to the user as well. That's all this patch does. Signed-off-by: Viresh Kumar kernel/timer.c | 10 ++++++++++ 1 file changed, 10 insertions(+) HEAD is now at 5a8530b... timer: track pinned timers with TIMER_PINNED flag ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:5a8530b7c3b1889861949d4e52b2da82d0aff242:bisect-vfs 2014-04-04-05:03:59 5a8530b7c3b1889861949d4e52b2da82d0aff242 reuse /kernel/x86_64-rhel/5a8530b7c3b1889861949d4e52b2da82d0aff242/vmlinuz-3.14.0-rc1-00086-g5a8530b 2014-04-04-05:03:59 detecting boot state . 48 54 80 112 114 118. 119......... 120 SUCCESS Previous HEAD position was 5a8530b... timer: track pinned timers with TIMER_PINNED flag HEAD is now at 7caf71f... sched: don't queue timers on quiesced CPUs ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4:bisect-vfs TEST FAILURE [ 57.207739] Unregister pv shared memory for cpu 1 [ 57.238377] smpboot: CPU 1 is now offline [ 57.240238] ------------[ cut here ]------------ [ 57.241063] WARNING: CPU: 0 PID: 1953 at kernel/timer.c:1630 migrate_timer_list+0x143/0x150() [ 57.241063] migrate_timer_list: can't migrate pinned timer: ffffffff81f06a60, deactivating it [ 57.241063] Modules linked in: [ 57.241063] CPU: 0 PID: 1953 Comm: 01-cpu-hotplug Not tainted 3.14.0-rc1-00093-g7caf71f #2 [ 57.241063] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 57.241063] 0000000000000009 ffff88001d7dfc00 ffffffff81723bbd ffff88001d7dfc48 [ 57.241063] ffff88001d7dfc38 ffffffff8106a1dd ffff88001e04d100 0000000000000001 [ 57.241063] ffffffff81e3d4c0 ffff88001e04d430 ffffffff81f06a60 ffff88001d7dfc98 [ 57.241063] Call Trace: [ 57.241063] [] dump_stack+0x4d/0x66 [ 57.241063] [] warn_slowpath_common+0x7d/0xa0 [ 57.241063] [] warn_slowpath_fmt+0x4c/0x50 [ 57.241063] [] ? __internal_add_timer+0x113/0x130 [ 57.241063] [] migrate_timer_list+0x143/0x150 [ 57.241063] [] __migrate_timers+0xdf/0x180 [ 57.241063] [] timer_cpu_notify+0x3c/0x80 [ 57.241063] [] notifier_call_chain+0x4c/0x70 [ 57.241063] [] __raw_notifier_call_chain+0xe/0x10 [ 57.241063] [] cpu_notify+0x23/0x50 [ 57.241063] [] cpu_notify_nofail+0xe/0x20 [ 57.241063] [] _cpu_down+0x1ad/0x2e0 [ 57.241063] [] cpu_down+0x34/0x50 [ 57.241063] [] cpu_subsys_offline+0x14/0x20 [ 57.241063] [] device_offline+0x95/0xc0 [ 57.241063] [] online_store+0x40/0x90 [ 57.241063] [] dev_attr_store+0x18/0x30 [ 57.241063] [] sysfs_kf_write+0x3d/0x50 [ 57.241063] [] kernfs_fop_write+0xd2/0x140 [ 57.241063] [] vfs_write+0xba/0x1e0 [ 57.241063] [] SyS_write+0x49/0xa0 [ 57.241063] [] system_call_fastpath+0x16/0x1b [ 57.241063] ---[ end trace 08c30a6f78bb9c60 ]--- [ 57.363441] blk-mq: CPU -> queue map /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-athens-7:20140403222859:x86_64-rhel:3.14.0-rc1-00093-g7caf71f:2 /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-athens-4:20140403222850:x86_64-rhel:3.14.0-rc1-00093-g7caf71f:2 /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-inn-11:20140402185841:x86_64-rhel:: /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-inn-25:20140402185840:x86_64-rhel:: /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-inn-29:20140402185904:x86_64-rhel:: /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-lkp-ib04-47:20140403222903:x86_64-rhel:3.14.0-rc1-00093-g7caf71f:2 /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-jaketown-31:20140403222955:x86_64-rhel:: /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-lkp-ib04-42:20140403222854:x86_64-rhel:3.14.0-rc1-00093-g7caf71f:2 /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-jaketown-21:20140403223007:x86_64-rhel:: /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-inn-21:20140403054338:x86_64-rhel:: /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-lkp-ib04-14:20140403222853:x86_64-rhel:3.14.0-rc1-00093-g7caf71f:2 /kernel/x86_64-rhel/7caf71f403b4758e8e2b2fef1d2e2d7f7a0c5db4/dmesg-nfsroot-inn-19:20140403222909:x86_64-rhel:: 10:12:13 all_good:bad:all_bad boots HEAD is now at 7caf71f sched: don't queue timers on quiesced CPUs ========= upstream ========= Previous HEAD position was 7caf71f... sched: don't queue timers on quiesced CPUs HEAD is now at 32d01dc... Merge branch 'for-3.15' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd:bisect-vfs 2014-04-04-05:13:48 32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd compiling Queued build task to /kernel-tests/build-queue/x86_64-rhel-32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd Check for kernel in /kernel/x86_64-rhel/32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd waiting for completion of /kernel-tests/build-queue/x86_64-rhel-32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd 2014-04-04 05:14:48 Kernel build fail or timeout 2014-04-04-05:14:48 32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd SKIP BROKEN BUILD Check /kernel-tests/build-served/x86_64-rhel-32d01dc7be4e725ab85ce1d74e8f4adc02ad68dd ========= linux-next ========= Previous HEAD position was 32d01dc... Merge branch 'for-3.15' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup HEAD is now at 4b22efd... Add linux-next specific files for 20140403 ls -a /kernel-tests/run-queue/kvm/x86_64-rhel/vireshk:timer-cleanup-for-tglx:4b22efdd5595f0acb48f02bf664a451ee98f9a2e:bisect-vfs 2014-04-04-05:17:30 4b22efdd5595f0acb48f02bf664a451ee98f9a2e reuse /kernel/x86_64-rhel/4b22efdd5595f0acb48f02bf664a451ee98f9a2e/vmlinuz-3.14.0-next-20140403 2014-04-04-05:17:30 detecting boot state .. 64 74 82 91 106 109 112 115 116....... 117 119.. 120 SUCCESS