INFO: rcu detected stall in mmap_pgoff

6 views
Skip to first unread message

syzbot

unread,
Feb 11, 2021, 1:33:25 PM2/11/21
to syzkaller...@googlegroups.com
Hello,

syzbot found the following issue on:

HEAD commit: 811218ec Linux 4.19.172
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=10b8f87f500000
kernel config: https://syzkaller.appspot.com/x/.config?x=c1cb1d27398c8808
dashboard link: https://syzkaller.appspot.com/bug?extid=c0c8c6ab6ebab7287dac

Unfortunately, I don't have any reproducer for this issue yet.

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+c0c8c6...@syzkaller.appspotmail.com

rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: (detected by 1, t=10502 jiffies, g=214801, q=305)
rcu: All QSes seen, last rcu_preempt kthread activity 10497 (4295085010-4295074513), jiffies_till_next_fqs=1, root ->qsmask 0x0
syz-executor.2 R running task 26912 28153 27765 0x0000000a
Call Trace:
<IRQ>
sched_show_task.cold+0x332/0x396 syzkaller/managers/linux-4-19/kernel/kernel/sched/core.c:5337
print_other_cpu_stall syzkaller/managers/linux-4-19/kernel/kernel/rcu/tree.c:1430 [inline]
check_cpu_stall syzkaller/managers/linux-4-19/kernel/kernel/rcu/tree.c:1557 [inline]
__rcu_pending syzkaller/managers/linux-4-19/kernel/kernel/rcu/tree.c:3293 [inline]
rcu_pending syzkaller/managers/linux-4-19/kernel/kernel/rcu/tree.c:3336 [inline]
rcu_check_callbacks.cold+0xb37/0xe19 syzkaller/managers/linux-4-19/kernel/kernel/rcu/tree.c:2682
update_process_times+0x2a/0x70 syzkaller/managers/linux-4-19/kernel/kernel/time/timer.c:1650
tick_sched_handle+0x9b/0x180 syzkaller/managers/linux-4-19/kernel/kernel/time/tick-sched.c:168
tick_sched_timer+0xfc/0x290 syzkaller/managers/linux-4-19/kernel/kernel/time/tick-sched.c:1278
__run_hrtimer syzkaller/managers/linux-4-19/kernel/kernel/time/hrtimer.c:1401 [inline]
__hrtimer_run_queues+0x3f6/0xe60 syzkaller/managers/linux-4-19/kernel/kernel/time/hrtimer.c:1463
hrtimer_interrupt+0x32a/0x930 syzkaller/managers/linux-4-19/kernel/kernel/time/hrtimer.c:1521
local_apic_timer_interrupt syzkaller/managers/linux-4-19/kernel/arch/x86/kernel/apic/apic.c:1067 [inline]
smp_apic_timer_interrupt+0x10c/0x550 syzkaller/managers/linux-4-19/kernel/arch/x86/kernel/apic/apic.c:1092
apic_timer_interrupt+0xf/0x20 syzkaller/managers/linux-4-19/kernel/arch/x86/entry/entry_64.S:894
</IRQ>
RIP: 0010:pv_wait_head_or_lock syzkaller/managers/linux-4-19/kernel/kernel/locking/qspinlock_paravirt.h:435 [inline]
RIP: 0010:__pv_queued_spin_lock_slowpath+0x3a6/0xae0 syzkaller/managers/linux-4-19/kernel/kernel/locking/qspinlock.c:474
Code: eb c6 45 01 01 41 bc 00 80 00 00 48 c1 e9 03 83 e3 07 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 4c 8d 2c 01 eb 0c f3 90 <41> 83 ec 01 0f 84 38 04 00 00 41 0f b6 45 00 38 d8 7f 08 84 c0 0f
RSP: 0018:ffff888052e9f628 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000003 RBX: 0000000000000000 RCX: 1ffffffff1404154
RDX: 0000000000000001 RSI: ffffffff81677d85 RDI: 0000000000000286
RBP: ffffffff8a020aa0 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000003be2
R13: fffffbfff1404154 R14: 0000000000000001 R15: ffff8880ba12bd80
pv_queued_spin_lock_slowpath syzkaller/managers/linux-4-19/kernel/./arch/x86/include/asm/paravirt.h:679 [inline]
queued_spin_lock_slowpath syzkaller/managers/linux-4-19/kernel/./arch/x86/include/asm/qspinlock.h:53 [inline]
queued_spin_lock syzkaller/managers/linux-4-19/kernel/./include/asm-generic/qspinlock.h:88 [inline]
do_raw_spin_lock+0x189/0x220 syzkaller/managers/linux-4-19/kernel/kernel/locking/spinlock_debug.c:113
spin_lock syzkaller/managers/linux-4-19/kernel/./include/linux/spinlock.h:329 [inline]
alloc_huge_page+0x3a6/0xea0 syzkaller/managers/linux-4-19/kernel/mm/hugetlb.c:2063
hugetlb_no_page+0x2b0/0x1090 syzkaller/managers/linux-4-19/kernel/mm/hugetlb.c:3823
hugetlb_fault+0xc68/0x1200 syzkaller/managers/linux-4-19/kernel/mm/hugetlb.c:3992
follow_hugetlb_page+0x5da/0x11d0 syzkaller/managers/linux-4-19/kernel/mm/hugetlb.c:4301
__get_user_pages+0x37e/0x1640 syzkaller/managers/linux-4-19/kernel/mm/gup.c:713
populate_vma_page_range+0x200/0x290 syzkaller/managers/linux-4-19/kernel/mm/gup.c:1234
__mm_populate+0x1ea/0x350 syzkaller/managers/linux-4-19/kernel/mm/gup.c:1282
mm_populate syzkaller/managers/linux-4-19/kernel/./include/linux/mm.h:2335 [inline]
vm_mmap_pgoff+0x1e2/0x200 syzkaller/managers/linux-4-19/kernel/mm/util.c:362
ksys_mmap_pgoff+0x298/0x5a0 syzkaller/managers/linux-4-19/kernel/mm/mmap.c:1580
do_syscall_64+0xf9/0x620 syzkaller/managers/linux-4-19/kernel/arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x465b09
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f512a82d188 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
RAX: ffffffffffffffda RBX: 000000000056bf60 RCX: 0000000000465b09
RDX: 0000000002000006 RSI: 0000000000400017 RDI: 0000000020200000
RBP: 00000000004b069f R08: 0000000000000004 R09: 0000000000000000
R10: 0000000000002012 R11: 0000000000000246 R12: 000000000056bf60
R13: 00007fffb0902ecf R14: 00007f512a82d300 R15: 0000000000022000
rcu: rcu_preempt kthread starved for 10538 jiffies! g214801 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: RCU grace-period kthread stack dump:
rcu_preempt R running task 29208 10 2 0x80000000
Call Trace:
context_switch syzkaller/managers/linux-4-19/kernel/kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 syzkaller/managers/linux-4-19/kernel/kernel/sched/core.c:3517
schedule+0x8d/0x1b0 syzkaller/managers/linux-4-19/kernel/kernel/sched/core.c:3561
schedule_timeout+0x4cf/0xfe0 syzkaller/managers/linux-4-19/kernel/kernel/time/timer.c:1818
rcu_gp_kthread+0xdad/0x21c0 syzkaller/managers/linux-4-19/kernel/kernel/rcu/tree.c:2202
kthread+0x33f/0x460 syzkaller/managers/linux-4-19/kernel/kernel/kthread.c:259
ret_from_fork+0x24/0x30 syzkaller/managers/linux-4-19/kernel/arch/x86/entry/entry_64.S:415


---
This report is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.

syzbot will keep track of this issue. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.

syzbot

unread,
Apr 21, 2021, 11:57:17 AM4/21/21
to syzkaller...@googlegroups.com
syzbot has found a reproducer for the following issue on:

HEAD commit: 2965db2e Linux 4.19.188
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=10c53519d00000
kernel config: https://syzkaller.appspot.com/x/.config?x=66e717310a9b0f81
dashboard link: https://syzkaller.appspot.com/bug?extid=c0c8c6ab6ebab7287dac
syz repro: https://syzkaller.appspot.com/x/repro.syz?x=15d7e001d00000

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+c0c8c6...@syzkaller.appspotmail.com

ieee802154 phy0 wpan0: encryption failed: -22
ieee802154 phy1 wpan1: encryption failed: -22
watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [syz-executor.3:20092]
Modules linked in:
irq event stamp: 2272464
hardirqs last enabled at (2272463): [<ffffffff81003ce4>] trace_hardirqs_on_thunk+0x1a/0x1c
hardirqs last disabled at (2272464): [<ffffffff81003d00>] trace_hardirqs_off_thunk+0x1a/0x1c
softirqs last enabled at (2267822): [<ffffffff88400678>] __do_softirq+0x678/0x980 kernel/softirq.c:318
softirqs last disabled at (2267687): [<ffffffff813926d5>] invoke_softirq kernel/softirq.c:372 [inline]
softirqs last disabled at (2267687): [<ffffffff813926d5>] irq_exit+0x215/0x260 kernel/softirq.c:412
CPU: 0 PID: 20092 Comm: syz-executor.3 Not tainted 4.19.188-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:__read_once_size include/linux/compiler.h:261 [inline]
RIP: 0010:trylock_clear_pending kernel/locking/qspinlock_paravirt.h:123 [inline]
RIP: 0010:pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:436 [inline]
RIP: 0010:__pv_queued_spin_lock_slowpath+0x3b0/0xae0 kernel/locking/qspinlock.c:474
Code: 00 48 c1 e9 03 83 e3 07 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 4c 8d 2c 01 eb 0c f3 90 41 83 ec 01 0f 84 38 04 00 00 <41> 0f b6 45 00 38 d8 7f 08 84 c0 0f 85 75 05 00 00 0f b6 45 00 84
RSP: 0018:ffff88807f95f628 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000003 RBX: 0000000000000000 RCX: 1ffffffff140418c
RDX: 0000000000000001 RSI: ffffffff81678675 RDI: 0000000000000286
RBP: ffffffff8a020c60 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 000000000000090f
R13: fffffbfff140418c R14: 0000000000000001 R15: ffff8880ba02bd80
FS: 00007f6f57de2700(0000) GS:ffff8880ba000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000050e110 CR3: 00000000a7d19000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:679 [inline]
queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:53 [inline]
queued_spin_lock include/asm-generic/qspinlock.h:88 [inline]
do_raw_spin_lock+0x189/0x220 kernel/locking/spinlock_debug.c:113
spin_lock include/linux/spinlock.h:329 [inline]
alloc_huge_page+0x3a6/0xea0 mm/hugetlb.c:2103
hugetlb_no_page+0x2b0/0x1090 mm/hugetlb.c:3865
hugetlb_fault+0xc68/0x1200 mm/hugetlb.c:4034
follow_hugetlb_page+0x5da/0x11d0 mm/hugetlb.c:4343
__get_user_pages+0x37e/0x1640 mm/gup.c:713
populate_vma_page_range+0x200/0x290 mm/gup.c:1234
__mm_populate+0x1ea/0x350 mm/gup.c:1282
mm_populate include/linux/mm.h:2335 [inline]
vm_mmap_pgoff+0x1e2/0x200 mm/util.c:362
ksys_mmap_pgoff+0x298/0x5a0 mm/mmap.c:1580
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x466459
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f6f57de2188 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
RAX: ffffffffffffffda RBX: 000000000056bf60 RCX: 0000000000466459
RDX: 0000000002000006 RSI: 0000000000400017 RDI: 0000000020200000
RBP: 00000000004bf9fb R08: 0000000000000004 R09: 0000000000000000
R10: 0000000000002012 R11: 0000000000000246 R12: 000000000056bf60
R13: 00007fff39f7065f R14: 00007f6f57de2300 R15: 0000000000022000
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 9550 Comm: kworker/u4:7 Not tainted 4.19.188-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue: phy2 ieee80211_iface_work
RIP: 0010:__sanitizer_cov_trace_pc+0x22/0x50 kernel/kcov.c:101
Code: 90 90 90 90 90 90 90 90 48 8b 34 24 65 48 8b 04 25 80 df 01 00 65 8b 15 3c 81 9f 7e 81 e2 00 01 1f 00 75 2b 8b 90 60 13 00 00 <83> fa 02 75 20 48 8b 88 68 13 00 00 8b 80 64 13 00 00 48 8b 11 48
RSP: 0018:ffff8880b2e97ca0 EFLAGS: 00000246
RAX: ffff88809eaee080 RBX: 0000000000000000 RCX: 1ffff11013d5dd2a
RDX: 0000000000000000 RSI: ffffffff866fe30f RDI: 0000000000000286
RBP: ffff88809bf3a080 R08: 0000000000400000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff88809bf3a164
R13: 0000000000000080 R14: ffffffff879a2729 R15: dffffc0000000000
FS: 0000000000000000(0000) GS:ffff8880ba100000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000050e110 CR3: 00000000aa8f8000 CR4: 00000000001406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
__kfree_skb net/core/skbuff.c:655 [inline]
kfree_skb+0x11f/0x3d0 net/core/skbuff.c:672
ieee80211_iface_work+0x289/0x8a0 net/mac80211/iface.c:1357
process_one_work+0x864/0x1570 kernel/workqueue.c:2152
worker_thread+0x64c/0x1130 kernel/workqueue.c:2295
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415

Reply all
Reply to author
Forward
0 new messages