[v5.15] INFO: rcu detected stall in corrupted

2 views
Skip to first unread message

syzbot

unread,
Oct 22, 2023, 10:41:47 PM10/22/23
to syzkaller...@googlegroups.com
Hello,

syzbot found the following issue on:

HEAD commit: 00c03985402e Linux 5.15.136
git tree: linux-5.15.y
console output: https://syzkaller.appspot.com/x/log.txt?x=155b750b680000
kernel config: https://syzkaller.appspot.com/x/.config?x=79895f3f9bd63186
dashboard link: https://syzkaller.appspot.com/bug?extid=db961afbd39afc2637c9
compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40
syz repro: https://syzkaller.appspot.com/x/repro.syz?x=17dceda3680000

Downloadable assets:
disk image: https://storage.googleapis.com/syzbot-assets/a858cc1646c6/disk-00c03985.raw.xz
vmlinux: https://storage.googleapis.com/syzbot-assets/4eda697e16d8/vmlinux-00c03985.xz
kernel image: https://storage.googleapis.com/syzbot-assets/e03ea5c73dfd/bzImage-00c03985.xz

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+db961a...@syzkaller.appspotmail.com

rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 0-... } 10505 jiffies s: 3905 root: 0x1/.
rcu: blocking rcu_node structures (internal RCU debug):
Task dump for CPU 0:
task:syz-executor.2 state:R running task stack:26016 pid:15151 ppid: 3544 flags:0x0000400a
Call Trace:
<TASK>
</TASK>


---
This report is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.

syzbot will keep track of this issue. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.

If the bug is already fixed, let syzbot know by replying with:
#syz fix: exact-commit-title

If you want syzbot to run the reproducer, reply with:
#syz test: git://repo/address.git branch-or-commit-hash
If you attach or paste a git patch, syzbot will apply it before testing.

If you want to overwrite bug's subsystems, reply with:
#syz set subsystems: new-subsystem
(See the list of subsystem names on the web dashboard)

If the bug is a duplicate of another bug, reply with:
#syz dup: exact-subject-of-another-report

If you want to undo deduplication, reply with:
#syz undup

syzbot

unread,
Nov 7, 2023, 4:04:23 PM11/7/23
to syzkaller...@googlegroups.com
syzbot has found a reproducer for the following issue on:

HEAD commit: 12952a23a5da Linux 5.15.137
git tree: linux-5.15.y
console output: https://syzkaller.appspot.com/x/log.txt?x=16a532b0e80000
kernel config: https://syzkaller.appspot.com/x/.config?x=fec74236cf840914
dashboard link: https://syzkaller.appspot.com/bug?extid=db961afbd39afc2637c9
compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40
syz repro: https://syzkaller.appspot.com/x/repro.syz?x=122c1787680000
C reproducer: https://syzkaller.appspot.com/x/repro.c?x=161ebd37680000

Downloadable assets:
disk image: https://storage.googleapis.com/syzbot-assets/7e2dc2318d41/disk-12952a23.raw.xz
vmlinux: https://storage.googleapis.com/syzbot-assets/753b1c98a896/vmlinux-12952a23.xz
kernel image: https://storage.googleapis.com/syzbot-assets/2ed1ab0d1e32/bzImage-12952a23.xz

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+db961a...@syzkaller.appspotmail.com

rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 0-...!: (0 ticks this GP) idle=441/1/0x4000000000000002 softirq=4548/4548 fqs=0
(detected by 1, t=10506 jiffies, g=3493, q=79)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 3600 Comm: syz-executor383 Not tainted 5.15.137-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/09/2023
RIP: 0010:check_preemption_disabled+0x7/0x110 lib/smp_processor_id.c:13
Code: 92 8a e8 2c 01 00 00 65 ff 0d b1 cb e7 75 5b c3 cc cc cc 48 c7 c7 e0 7a d8 8a 48 c7 c6 20 7b d8 8a eb 00 41 57 41 56 41 54 53 <48> 83 ec 10 65 48 8b 04 25 28 00 00 00 48 89 44 24 08 65 8b 1d c8
RSP: 0018:ffffc90002edf0b8 EFLAGS: 00000006
RAX: 0000000000000000 RBX: ffffc90002edf140 RCX: ffff88807848d940
RDX: ffff88807848d940 RSI: ffffffff8ad87b20 RDI: ffffffff8ad87ae0
RBP: ffffc90002edf208 R08: ffffffff81a11c8b R09: fffffbfff1f79a21
R10: 0000000000000000 R11: dffffc0000000001 R12: ffffc90002edf1a0
R13: ffff888078f91d60 R14: 0000000000000001 R15: ffffc90002edf300
FS: 0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000428 CR3: 000000001ffa7000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
<NMI>
</NMI>
<TASK>
rcu_dynticks_curr_cpu_in_eqs kernel/rcu/tree.c:330 [inline]
rcu_is_watching+0x11/0xa0 kernel/rcu/tree.c:1122
rcu_read_lock include/linux/rcupdate.h:697 [inline]
__perf_event_output kernel/events/core.c:7675 [inline]
perf_event_output_forward+0xfa/0x310 kernel/events/core.c:7697
__perf_event_overflow+0x35d/0x530 kernel/events/core.c:9392
perf_tp_event+0x363/0xc40 kernel/events/core.c:9924
perf_trace_run_bpf_submit+0xf7/0x1d0 kernel/events/core.c:9898
perf_trace_preemptirq_template+0x31d/0x430 include/trace/events/preemptirq.h:14
trace_irq_enable_rcuidle+0x10e/0x190 include/trace/events/preemptirq.h:40
trace_hardirqs_on+0x57/0x80 kernel/trace/trace_preemptirq.c:44
asm_sysvec_irq_work+0x16/0x20 arch/x86/include/asm/idtentry.h:664
RIP: 0010:rcu_read_unlock_special+0x84/0x520 kernel/rcu/tree_plugin.h:671
Code: f1 f1 f1 00 f2 f2 f2 49 89 04 17 66 41 c7 44 17 09 f3 f3 41 c6 44 17 0b f3 65 44 8b 25 dd ce 96 7e 41 f7 c4 00 00 f0 00 74 45 <48> c7 44 24 20 0e 36 e0 45 4a c7 04 3a 00 00 00 00 66 42 c7 44 3a
RSP: 0018:ffffc90002edf760 EFLAGS: 00000206
RAX: 1bf4468a8b13e600 RBX: 1ffff920005dbef4 RCX: ffffffff8162ea18
RDX: dffffc0000000000 RSI: ffffffff8a8b0be0 RDI: ffffffff8ad87b40
RBP: ffffc90002edf830 R08: dffffc0000000000 R09: fffffbfff1f79a28
R10: 0000000000000000 R11: dffffc0000000001 R12: ffffffff8c923000
R13: ffff88807848dd98 R14: ffffc90002edf7a0 R15: 1ffff920005dbef0
__rcu_read_unlock+0x92/0x100 kernel/rcu/tree_plugin.h:422
rcu_read_unlock include/linux/rcupdate.h:728 [inline]
mutex_spin_on_owner+0x358/0x370 kernel/locking/mutex.c:377
mutex_optimistic_spin+0x38/0x300 kernel/locking/mutex.c:469
__mutex_lock_common+0x1ff/0x25a0 kernel/locking/mutex.c:599
__mutex_lock kernel/locking/mutex.c:729 [inline]
mutex_lock_nested+0x17/0x20 kernel/locking/mutex.c:743
perf_trace_destroy+0x2a/0x140 kernel/trace/trace_event_perf.c:239
_free_event+0x891/0xe60 kernel/events/core.c:5109
put_event kernel/events/core.c:5203 [inline]
perf_event_release_kernel+0x7f2/0x870 kernel/events/core.c:5315
perf_release+0x37/0x40 kernel/events/core.c:5325
__fput+0x3bf/0x890 fs/file_table.c:280
task_work_run+0x129/0x1a0 kernel/task_work.c:164
exit_task_work include/linux/task_work.h:32 [inline]
do_exit+0x6a3/0x2480 kernel/exit.c:872
do_group_exit+0x144/0x310 kernel/exit.c:994
__do_sys_exit_group kernel/exit.c:1005 [inline]
__se_sys_exit_group kernel/exit.c:1003 [inline]
__x64_sys_exit_group+0x3b/0x40 kernel/exit.c:1003
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x3d/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7f2225e39df9
Code: Unable to access opcode bytes at RIP 0x7f2225e39dcf.
RSP: 002b:00007ffd00320bd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f2225e39df9
RDX: 000000000000003c RSI: 00000000000000e7 RDI: 0000000000000000
RBP: 00007f2225eb5290 R08: ffffffffffffffb8 R09: 00000000000000a0
R10: 0000000000001700 R11: 0000000000000246 R12: 00007f2225eb5290
R13: 0000000000000000 R14: 00007f2225eb5d00 R15: 00007f2225e0afa0
</TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.534 msecs
rcu: rcu_preempt kthread timer wakeup didn't happen for 10505 jiffies! g3493 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: Possible timer handling issue on cpu=0 timer-softirq=3929
rcu: rcu_preempt kthread starved for 10506 jiffies! g3493 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:I stack:27000 pid: 15 ppid: 2 flags:0x00004000
Call Trace:
<TASK>
context_switch kernel/sched/core.c:5026 [inline]
__schedule+0x12c4/0x45b0 kernel/sched/core.c:6372
schedule+0x11b/0x1f0 kernel/sched/core.c:6455
schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1884
rcu_gp_fqs_loop+0x2af/0xf70 kernel/rcu/tree.c:1959
rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2132
kthread+0x3f6/0x4f0 kernel/kthread.c:319
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
</TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 3600 Comm: syz-executor383 Not tainted 5.15.137-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/09/2023
RIP: 0010:memset_erms+0xb/0x10 arch/x86/lib/memset_64.S:65
Code: 03 40 0f b6 f6 48 b8 01 01 01 01 01 01 01 01 48 0f af c6 f3 48 ab 89 d1 f3 aa 4c 89 c8 c3 90 49 89 f9 40 88 f0 48 89 d1 f3 aa <4c> 89 c8 c3 90 49 89 fa 40 0f b6 ce 48 b8 01 01 01 01 01 01 01 01
RSP: 0018:ffffc90002edefb8 EFLAGS: 00000002
RAX: ffffffff81a51700 RBX: ffffc90002edf060 RCX: 0000000000000000
RDX: 0000000000000018 RSI: 0000000000000000 RDI: ffffc90002edf078
RBP: ffffc90002edf0f0 R08: dffffc0000000000 R09: ffffc90002edf060
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff920005dbe08
R13: dffffc0000000000 R14: 0000000000000008 R15: ffff888078f91d60
FS: 0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000428 CR3: 000000001ffa7000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
<NMI>
</NMI>
<TASK>
__perf_output_begin kernel/events/ring_buffer.c:161 [inline]
perf_output_begin_forward+0xa6/0xa80 kernel/events/ring_buffer.c:268
__perf_event_output kernel/events/core.c:7679 [inline]
perf_event_output_forward+0x1c8/0x310 kernel/events/core.c:7697
__perf_event_overflow+0x35d/0x530 kernel/events/core.c:9392
perf_tp_event+0x363/0xc40 kernel/events/core.c:9924
perf_trace_run_bpf_submit+0xf7/0x1d0 kernel/events/core.c:9898
perf_trace_preemptirq_template+0x31d/0x430 include/trace/events/preemptirq.h:14
trace_irq_enable_rcuidle+0x10e/0x190 include/trace/events/preemptirq.h:40
trace_hardirqs_on+0x57/0x80 kernel/trace/trace_preemptirq.c:44
asm_sysvec_irq_work+0x16/0x20 arch/x86/include/asm/idtentry.h:664
RIP: 0010:rcu_read_unlock_special+0x84/0x520 kernel/rcu/tree_plugin.h:671
Code: f1 f1 f1 00 f2 f2 f2 49 89 04 17 66 41 c7 44 17 09 f3 f3 41 c6 44 17 0b f3 65 44 8b 25 dd ce 96 7e 41 f7 c4 00 00 f0 00 74 45 <48> c7 44 24 20 0e 36 e0 45 4a c7 04 3a 00 00 00 00 66 42 c7 44 3a
RSP: 0018:ffffc90002edf760 EFLAGS: 00000206
RAX: 1bf4468a8b13e600 RBX: 1ffff920005dbef4 RCX: ffffffff8162ea18
RDX: dffffc0000000000 RSI: ffffffff8a8b0be0 RDI: ffffffff8ad87b40
RBP: ffffc90002edf830 R08: dffffc0000000000 R09: fffffbfff1f79a28
R10: 0000000000000000 R11: dffffc0000000001 R12: ffffffff8c923000
R13: ffff88807848dd98 R14: ffffc90002edf7a0 R15: 1ffff920005dbef0
__rcu_read_unlock+0x92/0x100 kernel/rcu/tree_plugin.h:422
rcu_read_unlock include/linux/rcupdate.h:728 [inline]
mutex_spin_on_owner+0x358/0x370 kernel/locking/mutex.c:377
mutex_optimistic_spin+0x38/0x300 kernel/locking/mutex.c:469
__mutex_lock_common+0x1ff/0x25a0 kernel/locking/mutex.c:599
__mutex_lock kernel/locking/mutex.c:729 [inline]
mutex_lock_nested+0x17/0x20 kernel/locking/mutex.c:743
perf_trace_destroy+0x2a/0x140 kernel/trace/trace_event_perf.c:239
_free_event+0x891/0xe60 kernel/events/core.c:5109
put_event kernel/events/core.c:5203 [inline]
perf_event_release_kernel+0x7f2/0x870 kernel/events/core.c:5315
perf_release+0x37/0x40 kernel/events/core.c:5325
__fput+0x3bf/0x890 fs/file_table.c:280
task_work_run+0x129/0x1a0 kernel/task_work.c:164
exit_task_work include/linux/task_work.h:32 [inline]
do_exit+0x6a3/0x2480 kernel/exit.c:872
do_group_exit+0x144/0x310 kernel/exit.c:994
__do_sys_exit_group kernel/exit.c:1005 [inline]
__se_sys_exit_group kernel/exit.c:1003 [inline]
__x64_sys_exit_group+0x3b/0x40 kernel/exit.c:1003
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x3d/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7f2225e39df9
Code: Unable to access opcode bytes at RIP 0x7f2225e39dcf.
RSP: 002b:00007ffd00320bd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f2225e39df9
RDX: 000000000000003c RSI: 00000000000000e7 RDI: 0000000000000000
RBP: 00007f2225eb5290 R08: ffffffffffffffb8 R09: 00000000000000a0
R10: 0000000000001700 R11: 0000000000000246 R12: 00007f2225eb5290
R13: 0000000000000000 R14: 00007f2225eb5d00 R15: 00007f2225e0afa0
</TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.583 msecs


---
Reply all
Reply to author
Forward
0 new messages