BUG: soft lockup in discover_timer

5 views
Skip to first unread message

syzbot

unread,
Nov 29, 2019, 8:25:10 PM11/29/19
to syzkaller-upst...@googlegroups.com
Hello,

syzbot found the following crash on:

HEAD commit: 81b6b964 Merge branch 'master' of git://git.kernel.org/pub..
git tree: upstream
console output: https://syzkaller.appspot.com/x/log.txt?x=136af786e00000
kernel config: https://syzkaller.appspot.com/x/.config?x=333b76551307b2a0
dashboard link: https://syzkaller.appspot.com/bug?extid=49999f8c74ba5f3712dd
compiler: gcc (GCC) 9.0.0 20181231 (experimental)
CC: [ax...@kernel.dk jus...@coraid.com
linux...@vger.kernel.org linux-...@vger.kernel.org]

Unfortunately, I don't have any reproducer for this crash yet.

IMPORTANT: if you fix the bug, please add the following tag to the commit:
Reported-by: syzbot+49999f...@syzkaller.appspotmail.com

watchdog: BUG: soft lockup - CPU#2 stuck for 123s! [syz-executor.1:7970]
Modules linked in:
irq event stamp: 5335851
hardirqs last enabled at (5335850): [<ffffffff81006743>]
trace_hardirqs_on_thunk+0x1a/0x1c arch/x86/entry/thunk_64.S:41
hardirqs last disabled at (5335851): [<ffffffff8100675f>]
trace_hardirqs_off_thunk+0x1a/0x1c arch/x86/entry/thunk_64.S:42
softirqs last enabled at (769164): [<ffffffff87e006cd>]
__do_softirq+0x6cd/0x98c kernel/softirq.c:319
softirqs last disabled at (769499): [<ffffffff81474a2b>] invoke_softirq
kernel/softirq.c:373 [inline]
softirqs last disabled at (769499): [<ffffffff81474a2b>]
irq_exit+0x19b/0x1e0 kernel/softirq.c:413
CPU: 2 PID: 7970 Comm: syz-executor.1 Not tainted 5.4.0-syzkaller #0
Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS
rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:752
[inline]
RIP: 0010:slab_alloc_node mm/slab.c:3256 [inline]
RIP: 0010:kmem_cache_alloc_node_trace+0x24d/0x750 mm/slab.c:3592
Code: 7e 0f 85 41 ff ff ff e8 a2 b3 4e ff e9 37 ff ff ff e8 07 b4 c8 ff 48
83 3d 57 80 a1 07 00 0f 84 7d 01 00 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00
e9 c4 fe ff ff 31 d2 be 35 02 00 00 48 c7 c7 9e 9b
RSP: 0018:ffff88802d409a18 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000007 RBX: 0000000000082a20 RCX: 0000000000000002
RDX: 0000000000000000 RSI: ffff888015fec900 RDI: 0000000000000282
RBP: ffff88802d409a90 R08: 1ffffffff15d29b8 R09: fffffbfff15d29b9
R10: fffffbfff15d29b8 R11: ffffffff8ae94dc7 R12: ffff88802cc00c40
R13: ffff88802cc00c40 R14: ffff88801c0fb800 R15: 0000000000082a20
FS: 00007f2e83ce1700(0000) GS:ffff88802d400000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffffffff600400 CR3: 000000002022a000 CR4: 00000000003406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
<IRQ>
__do_kmalloc_node mm/slab.c:3614 [inline]
__kmalloc_node_track_caller+0x3d/0x70 mm/slab.c:3629
__kmalloc_reserve.isra.0+0x40/0xf0 net/core/skbuff.c:141
__alloc_skb+0x10b/0x5e0 net/core/skbuff.c:209
alloc_skb include/linux/skbuff.h:1049 [inline]
new_skb+0x28/0x1d0 drivers/block/aoe/aoecmd.c:67
aoecmd_cfg_pkts drivers/block/aoe/aoecmd.c:426 [inline]
aoecmd_cfg+0x1b5/0x640 drivers/block/aoe/aoecmd.c:1372
discover_timer+0x4e/0x60 drivers/block/aoe/aoemain.c:24
call_timer_fn+0x1ac/0x780 kernel/time/timer.c:1404
expire_timers kernel/time/timer.c:1449 [inline]
__run_timers kernel/time/timer.c:1773 [inline]
__run_timers kernel/time/timer.c:1740 [inline]
run_timer_softirq+0x6c3/0x1790 kernel/time/timer.c:1786
__do_softirq+0x262/0x98c kernel/softirq.c:292
invoke_softirq kernel/softirq.c:373 [inline]
irq_exit+0x19b/0x1e0 kernel/softirq.c:413
exiting_irq arch/x86/include/asm/apic.h:536 [inline]
smp_apic_timer_interrupt+0x1a3/0x610 arch/x86/kernel/apic/apic.c:1137
apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
</IRQ>
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169
[inline]
RIP: 0010:_raw_spin_unlock_irq+0x4f/0x80 kernel/locking/spinlock.c:199
Code: c0 68 34 53 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00
75 33 48 83 3d 12 2a 99 01 00 74 20 fb 66 0f 1f 44 00 00 <bf> 01 00 00 00
e8 e7 6b 96 f9 65 8b 05 18 14 48 78 85 c0 74 06 41
RSP: 0018:ffff888071fc7530 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff12a668d RBX: ffff888015fec040 RCX: 0000000000000000
RDX: dffffc0000000000 RSI: 0000000000000006 RDI: ffff888015fec8d4
RBP: ffff888071fc7538 R08: ffff888015fec040 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff88802d437380
R13: ffff8880298e52c0 R14: 0000000000000000 R15: 0000000000000402
finish_lock_switch kernel/sched/core.c:3124 [inline]
finish_task_switch+0x147/0x750 kernel/sched/core.c:3224
context_switch kernel/sched/core.c:3388 [inline]
__schedule+0x8e9/0x1f30 kernel/sched/core.c:4081
preempt_schedule_common+0x4f/0xe0 kernel/sched/core.c:4236
preempt_schedule+0x4b/0x60 kernel/sched/core.c:4261
___preempt_schedule+0x16/0x18 arch/x86/entry/thunk_64.S:50
__raw_spin_unlock include/linux/spinlock_api_smp.h:152 [inline]
_raw_spin_unlock+0x3c/0x40 kernel/locking/spinlock.c:183
spin_unlock include/linux/spinlock.h:378 [inline]
zap_pte_range mm/memory.c:1130 [inline]
zap_pmd_range mm/memory.c:1178 [inline]
zap_pud_range mm/memory.c:1207 [inline]
zap_p4d_range mm/memory.c:1228 [inline]
unmap_page_range+0x10b1/0x2ac0 mm/memory.c:1249
unmap_single_vma+0x19d/0x300 mm/memory.c:1294
unmap_vmas+0x184/0x2f0 mm/memory.c:1326
exit_mmap+0x2ba/0x530 mm/mmap.c:3161
__mmput kernel/fork.c:1079 [inline]
mmput+0x179/0x4d0 kernel/fork.c:1100
exit_mm kernel/exit.c:485 [inline]
do_exit+0x806/0x2ef0 kernel/exit.c:784
do_group_exit+0x135/0x360 kernel/exit.c:895
get_signal+0x47c/0x24f0 kernel/signal.c:2734
do_signal+0x87/0x1700 arch/x86/kernel/signal.c:815
exit_to_usermode_loop+0x286/0x380 arch/x86/entry/common.c:160
prepare_exit_to_usermode arch/x86/entry/common.c:195 [inline]
syscall_return_slowpath arch/x86/entry/common.c:278 [inline]
do_syscall_64+0x676/0x790 arch/x86/entry/common.c:304
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x45a759
Code: 8b 6c 24 20 48 83 c4 28 c3 48 8b 1d e1 67 67 01 48 8d 0c 19 48 8d 49
ff 48 ff cb 48 f7 d3 48 21 d9 e9 0c ff ff ff 48 8b 6c 24 <20> 48 83 c4 28
c3 48 89 d8 b9 00 00 40 00 e8 14 4f 00 00 4c 89 c0
RSP: 002b:00007f2e83ce0c88 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: 0000000000000003 RBX: 000000000071bf00 RCX: 000000000045a759
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000180
RBP: 0000000000000005 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 00007f2e83ce16d4
R13: 00000000004aec2b R14: 00000000006f1ca8 R15: 00000000ffffffff
Sending NMI from CPU 2 to CPUs 0-1,3:
NMI backtrace for cpu 1 skipped: idling at native_safe_halt+0xe/0x10
arch/x86/include/asm/irqflags.h:60
NMI backtrace for cpu 3 skipped: idling at native_safe_halt+0xe/0x10
arch/x86/include/asm/irqflags.h:60
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.054
msecs
NMI backtrace for cpu 0
CPU: 0 PID: 7971 Comm: syz-executor.0 Not tainted 5.4.0-syzkaller #0
Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS
rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
RIP: 0010:arch_static_branch arch/x86/include/asm/jump_label.h:25 [inline]
RIP: 0010:static_key_false include/linux/jump_label.h:200 [inline]
RIP: 0010:native_write_msr+0x6/0x30 arch/x86/include/asm/msr.h:164
Code: d0 c3 0f 21 d8 c3 0f 21 f0 c3 0f 0b 0f 1f 84 00 00 00 00 00 0f 0b 0f
1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 89 f9 89 f0 0f 30 <0f> 1f 44 00 00
c3 55 48 c1 e2 20 89 f6 48 89 e5 48 09 d6 31 d2 e8
RSP: 0018:ffff88802d2091f8 EFLAGS: 00000082
RAX: 000000006a351aba RBX: 0000000000000000 RCX: 00000000000006e0
RDX: 000000000000006e RSI: 000000006a351aba RDI: 00000000000006e0
RBP: ffff88802d209210 R08: ffff88802704c040 R09: ffff88802704c8d0
R10: fffffbfff146dba0 R11: ffffffff8a36dd07 R12: ffff88802d2227c0
R13: 0000000000000759 R14: 0000000000000000 R15: 0000000000000000
FS: 00007f02bf8a2700(0000) GS:ffff88802d200000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c0003910f8 CR3: 0000000071e47000 CR4: 00000000003406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
<IRQ>
clockevents_program_event+0x25c/0x370 kernel/time/clockevents.c:334
tick_program_event+0xb4/0x130 kernel/time/tick-oneshot.c:44
hrtimer_interrupt+0x369/0x770 kernel/time/hrtimer.c:1651
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
smp_apic_timer_interrupt+0x160/0x610 arch/x86/kernel/apic/apic.c:1135
apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
RIP: 0010:update_stack_state+0x365/0x5f0 arch/x86/kernel/unwind_frame.c:254
Code: 00 0f 85 47 02 00 00 4c 89 f9 4d 89 65 48 48 b8 00 00 00 00 00 fc ff
df 48 c1 e9 03 80 3c 01 00 0f 85 04 02 00 00 4d 8b 65 40 <4d> 85 e4 b8 01
00 00 00 75 28 48 b8 00 00 00 00 00 fc ff df 4c 89
RSP: 0018:ffff88802d209420 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: dffffc0000000000 RBX: ffff888071fcff48 RCX: 1ffff11005a412c2
RDX: 0000000000000010 RSI: 1ffff11005a41200 RDI: ffff88802d209618
RBP: ffff88802d2094e8 R08: ffff88802704c040 R09: ffff88802d209628
R10: ffff88802d2095f8 R11: ffff88802d209608 R12: ffff88802d2095c0
R13: ffff88802d2095d0 R14: 1ffff11005a4128c R15: ffff88802d209610
unwind_next_frame.part.0+0x1a9/0xa20 arch/x86/kernel/unwind_frame.c:311
unwind_next_frame+0x3b/0x50 arch/x86/kernel/unwind_frame.c:265
arch_stack_walk+0x81/0xf0 arch/x86/kernel/stacktrace.c:25
stack_trace_save+0xac/0xe0 kernel/stacktrace.c:123
save_stack+0x23/0x90 mm/kasan/common.c:69
set_track mm/kasan/common.c:77 [inline]
__kasan_kmalloc mm/kasan/common.c:510 [inline]
__kasan_kmalloc.constprop.0+0xcf/0xe0 mm/kasan/common.c:483
kasan_slab_alloc+0xf/0x20 mm/kasan/common.c:518
slab_post_alloc_hook mm/slab.h:584 [inline]
slab_alloc mm/slab.c:3319 [inline]
kmem_cache_alloc+0x121/0x710 mm/slab.c:3483
dst_alloc+0x10e/0x200 net/core/dst.c:93
ip6_dst_alloc+0x34/0xa0 net/ipv6/route.c:353
icmp6_dst_alloc+0x69/0x4a0 net/ipv6/route.c:3130
ndisc_send_skb+0xfb7/0x1490 net/ipv6/ndisc.c:485
ndisc_send_rs+0x134/0x720 net/ipv6/ndisc.c:699
addrconf_rs_timer+0x30f/0x6e0 net/ipv6/addrconf.c:3879
call_timer_fn+0x1ac/0x780 kernel/time/timer.c:1404
expire_timers kernel/time/timer.c:1449 [inline]
__run_timers kernel/time/timer.c:1773 [inline]
__run_timers kernel/time/timer.c:1740 [inline]
run_timer_softirq+0x6c3/0x1790 kernel/time/timer.c:1786
__do_softirq+0x262/0x98c kernel/softirq.c:292
invoke_softirq kernel/softirq.c:373 [inline]
irq_exit+0x19b/0x1e0 kernel/softirq.c:413
exiting_irq arch/x86/include/asm/apic.h:536 [inline]
smp_apic_timer_interrupt+0x1a3/0x610 arch/x86/kernel/apic/apic.c:1137
apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
</IRQ>
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169
[inline]
RIP: 0010:_raw_spin_unlock_irq+0x4f/0x80 kernel/locking/spinlock.c:199
Code: c0 68 34 53 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00
75 33 48 83 3d 12 2a 99 01 00 74 20 fb 66 0f 1f 44 00 00 <bf> 01 00 00 00
e8 e7 6b 96 f9 65 8b 05 18 14 48 78 85 c0 74 06 41
RSP: 0018:ffff888071fcf8d8 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff12a668d RBX: ffff88802704c040 RCX: 0000000000000006
RDX: dffffc0000000000 RSI: 0000000000000008 RDI: ffff88802704c8d4
RBP: ffff888071fcf8e0 R08: 1ffffffff15d29b8 R09: fffffbfff15d29b9
R10: fffffbfff15d29b8 R11: ffffffff8ae94dc7 R12: ffff88802d237380
R13: ffffffff8947a1c0 R14: ffff8880252f27c0 R15: 0000000000000000
finish_lock_switch kernel/sched/core.c:3124 [inline]
finish_task_switch+0x147/0x750 kernel/sched/core.c:3224
context_switch kernel/sched/core.c:3388 [inline]
__schedule+0x8e9/0x1f30 kernel/sched/core.c:4081
preempt_schedule_common+0x4f/0xe0 kernel/sched/core.c:4236
preempt_schedule+0x4b/0x60 kernel/sched/core.c:4261
___preempt_schedule+0x16/0x18 arch/x86/entry/thunk_64.S:50
smp_call_function_single+0x410/0x480 kernel/smp.c:313
task_function_call+0xe9/0x180 kernel/events/core.c:114
perf_install_in_context+0x308/0x5a0 kernel/events/core.c:2746
__do_sys_perf_event_open+0x1cbc/0x2c70 kernel/events/core.c:11543
__se_sys_perf_event_open kernel/events/core.c:11151 [inline]
__x64_sys_perf_event_open+0xbe/0x150 kernel/events/core.c:11151
do_syscall_64+0xfa/0x790 arch/x86/entry/common.c:294
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x45a759
Code: bd b1 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7
48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff
ff 0f 83 8b b1 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007f02bf8a1c88 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 000000000071bf00 RCX: 000000000045a759
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 000000002001d000
RBP: 0000000000000005 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 00007f02bf8a26d4
R13: 00000000004aec2b R14: 00000000006f1ca8 R15: 00000000ffffffff


---
This bug is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.

syzbot will keep track of this bug report. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.

Dmitry Vyukov

unread,
Nov 30, 2019, 11:49:25 AM11/30/19
to syzbot, 'Dmitry Vyukov' via syzkaller-upstream-moderation
false hang on the new qemu instance
#syz invalid
> --
> You received this message because you are subscribed to the Google Groups "syzkaller-upstream-moderation" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to syzkaller-upstream-m...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-upstream-moderation/000000000000956e2c05988637ef%40google.com.
Reply all
Reply to author
Forward
0 new messages