INFO: rcu detected stall in inet_sendmsg (2)
6 views
Skip to first unread message
syzbot
Apr 27, 2020, 12:05:11 AM4/27/20
to syzkaller...@googlegroups.com
Hello,
syzbot found the following crash on:
HEAD commit: 7edd66cf Linux 4.19.118
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=104b420fe00000
kernel config: https://syzkaller.appspot.com/x/.config?x=8dd19d0705ec9e0
dashboard link: https://syzkaller.appspot.com/bug?extid=2b4c94192f13de6d8ded
compiler: gcc (GCC) 9.0.0 20181231 (experimental)
Unfortunately, I don't have any reproducer for this crash yet.
IMPORTANT: if you fix the bug, please add the following tag to the commit:
Reported-by: syzbot+2b4c94...@syzkaller.appspotmail.com
device bond542 entered promiscuous mode
8021q: adding VLAN 0 to HW filter on device macvlan2
device bond542 left promiscuous mode
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 0-...!: (1 GPs behind) idle=5da/1/0x4000000000000002 softirq=219110/219111 fqs=45
rcu: (t=10500 jiffies g=315353 q=136)
rcu: rcu_preempt kthread starved for 10405 jiffies! g315353 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: RCU grace-period kthread stack dump:
rcu_preempt R running task 29136 10 2 0x80000000
Call Trace:
schedule+0x8d/0x1b0 kernel/sched/core.c:3559
schedule_timeout+0x4d1/0xf20 kernel/time/timer.c:1806
rcu_gp_kthread+0xcee/0x2060 kernel/rcu/tree.c:2202
kthread+0x34a/0x420 kernel/kthread.c:246
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
NMI backtrace for cpu 0
CPU: 0 PID: 472 Comm: syz-executor.3 Not tainted 4.19.118-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
<IRQ>
__dump_stack lib/dump_stack.c:77 [inline]
dump_stack+0x188/0x20d lib/dump_stack.c:118
nmi_cpu_backtrace.cold+0x63/0xa2 lib/nmi_backtrace.c:101
nmi_trigger_cpumask_backtrace+0x1a6/0x1eb lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_dump_cpu_stacks+0x170/0x1bb kernel/rcu/tree.c:1340
print_cpu_stall kernel/rcu/tree.c:1478 [inline]
check_cpu_stall kernel/rcu/tree.c:1550 [inline]
__rcu_pending kernel/rcu/tree.c:3293 [inline]
rcu_pending kernel/rcu/tree.c:3336 [inline]
rcu_check_callbacks.cold+0x634/0xddc kernel/rcu/tree.c:2682
update_process_times+0x2a/0x70 kernel/time/timer.c:1638
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:168
tick_sched_timer+0x42/0x130 kernel/time/tick-sched.c:1278
__run_hrtimer kernel/time/hrtimer.c:1401 [inline]
__hrtimer_run_queues+0x2fc/0xd50 kernel/time/hrtimer.c:1463
hrtimer_interrupt+0x312/0x770 kernel/time/hrtimer.c:1521
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1067 [inline]
smp_apic_timer_interrupt+0x10c/0x550 arch/x86/kernel/apic/apic.c:1092
apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:893
</IRQ>
RIP: 0010:sfq_dequeue+0x167/0xd40 net/sched/sch_sfq.c:500
Code: c1 e8 03 42 0f b6 14 30 4c 89 e8 83 e0 07 83 c0 01 38 d0 7c 08 84 d2 0f 85 f2 0a 00 00 48 8b 44 24 08 44 0f b7 63 1a 0f b6 00 <38> 44 24 10 7c 08 84 c0 0f 85 bb 0a 00 00 66 44 03 a5 a2 02 00 00
RSP: 0018:ffff88820d18e870 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000000 RBX: ffff888059364628 RCX: ffffc9000c0d7000
RDX: 0000000000000000 RSI: ffffffff85bb2502 RDI: 0000000000000003
RBP: ffff8880924f4a80 R08: ffff888040b18240 R09: ffffed101249e96e
R10: ffffed101249e96d R11: ffff8880924f4b6b R12: 0000000000000000
R13: ffff888059364642 R14: dffffc0000000000 R15: 0000000000000003
dequeue_skb net/sched/sch_generic.c:282 [inline]
qdisc_restart net/sched/sch_generic.c:385 [inline]
__qdisc_run+0x1b7/0x1720 net/sched/sch_generic.c:403
__dev_xmit_skb net/core/dev.c:3492 [inline]
__dev_queue_xmit+0x1dad/0x3040 net/core/dev.c:3814
neigh_hh_output include/net/neighbour.h:491 [inline]
neigh_output include/net/neighbour.h:499 [inline]
ip_finish_output2+0x104d/0x1740 net/ipv4/ip_output.c:229
ip_finish_output+0x721/0xcd0 net/ipv4/ip_output.c:317
NF_HOOK_COND include/linux/netfilter.h:278 [inline]
ip_output+0x1fb/0x5f0 net/ipv4/ip_output.c:405
dst_output include/net/dst.h:447 [inline]
ip_local_out+0xaf/0x170 net/ipv4/ip_output.c:124
iptunnel_xmit+0x5ec/0xa20 net/ipv4/ip_tunnel_core.c:91
ip_tunnel_xmit+0x118b/0x374b net/ipv4/ip_tunnel.c:781
erspan_xmit+0x9b4/0x28b0 net/ipv4/ip_gre.c:756
__netdev_start_xmit include/linux/netdevice.h:4314 [inline]
netdev_start_xmit include/linux/netdevice.h:4323 [inline]
xmit_one net/core/dev.c:3260 [inline]
dev_hard_start_xmit+0x1a4/0x950 net/core/dev.c:3276
sch_direct_xmit+0x345/0xfc0 net/sched/sch_generic.c:332
qdisc_restart net/sched/sch_generic.c:395 [inline]
__qdisc_run+0x4df/0x1720 net/sched/sch_generic.c:403
qdisc_run include/net/pkt_sched.h:120 [inline]
qdisc_run include/net/pkt_sched.h:117 [inline]
__dev_xmit_skb net/core/dev.c:3455 [inline]
__dev_queue_xmit+0x229a/0x3040 net/core/dev.c:3814
neigh_hh_output include/net/neighbour.h:491 [inline]
neigh_output include/net/neighbour.h:499 [inline]
ip_finish_output2+0x104d/0x1740 net/ipv4/ip_output.c:229
ip_finish_output+0x721/0xcd0 net/ipv4/ip_output.c:317
NF_HOOK_COND include/linux/netfilter.h:278 [inline]
ip_output+0x1fb/0x5f0 net/ipv4/ip_output.c:405
dst_output include/net/dst.h:447 [inline]
ip_local_out+0xaf/0x170 net/ipv4/ip_output.c:124
ip_send_skb+0x3e/0xe0 net/ipv4/ip_output.c:1446
udp_send_skb.isra.0+0x6c2/0x11f0 net/ipv4/udp.c:845
udp_sendmsg+0x1df1/0x25d0 net/ipv4/udp.c:1132
inet_sendmsg+0x12e/0x590 net/ipv4/af_inet.c:798
sock_sendmsg_nosec net/socket.c:622 [inline]
sock_sendmsg+0xcf/0x120 net/socket.c:632
___sys_sendmsg+0x3e2/0x920 net/socket.c:2115
__sys_sendmmsg+0x195/0x470 net/socket.c:2210
__do_sys_sendmmsg net/socket.c:2239 [inline]
__se_sys_sendmmsg net/socket.c:2236 [inline]
__x64_sys_sendmmsg+0x99/0x100 net/socket.c:2236
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x45c829
Code: 0d b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 db b6 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007f2a1ba2cc78 EFLAGS: 00000246 ORIG_RAX: 0000000000000133
RAX: ffffffffffffffda RBX: 00000000004fc080 RCX: 000000000045c829
RDX: 0400000000000075 RSI: 0000000020007fc0 RDI: 0000000000000004
RBP: 000000000078bf00 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00000000ffffffff
R13: 00000000000008d7 R14: 00000000004cb7aa R15: 00007f2a1ba2d6d4
---
This bug is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.
syzbot will keep track of this bug report. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
syzbot found the following crash on:
HEAD commit: 7edd66cf Linux 4.19.118
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=104b420fe00000
kernel config: https://syzkaller.appspot.com/x/.config?x=8dd19d0705ec9e0
dashboard link: https://syzkaller.appspot.com/bug?extid=2b4c94192f13de6d8ded
compiler: gcc (GCC) 9.0.0 20181231 (experimental)
Unfortunately, I don't have any reproducer for this crash yet.
IMPORTANT: if you fix the bug, please add the following tag to the commit:
Reported-by: syzbot+2b4c94...@syzkaller.appspotmail.com
device bond542 entered promiscuous mode
8021q: adding VLAN 0 to HW filter on device macvlan2
device bond542 left promiscuous mode
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 0-...!: (1 GPs behind) idle=5da/1/0x4000000000000002 softirq=219110/219111 fqs=45
rcu: (t=10500 jiffies g=315353 q=136)
rcu: rcu_preempt kthread starved for 10405 jiffies! g315353 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: RCU grace-period kthread stack dump:
rcu_preempt R running task 29136 10 2 0x80000000
Call Trace:
schedule+0x8d/0x1b0 kernel/sched/core.c:3559
schedule_timeout+0x4d1/0xf20 kernel/time/timer.c:1806
rcu_gp_kthread+0xcee/0x2060 kernel/rcu/tree.c:2202
kthread+0x34a/0x420 kernel/kthread.c:246
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
NMI backtrace for cpu 0
CPU: 0 PID: 472 Comm: syz-executor.3 Not tainted 4.19.118-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
<IRQ>
__dump_stack lib/dump_stack.c:77 [inline]
dump_stack+0x188/0x20d lib/dump_stack.c:118
nmi_cpu_backtrace.cold+0x63/0xa2 lib/nmi_backtrace.c:101
nmi_trigger_cpumask_backtrace+0x1a6/0x1eb lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_dump_cpu_stacks+0x170/0x1bb kernel/rcu/tree.c:1340
print_cpu_stall kernel/rcu/tree.c:1478 [inline]
check_cpu_stall kernel/rcu/tree.c:1550 [inline]
__rcu_pending kernel/rcu/tree.c:3293 [inline]
rcu_pending kernel/rcu/tree.c:3336 [inline]
rcu_check_callbacks.cold+0x634/0xddc kernel/rcu/tree.c:2682
update_process_times+0x2a/0x70 kernel/time/timer.c:1638
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:168
tick_sched_timer+0x42/0x130 kernel/time/tick-sched.c:1278
__run_hrtimer kernel/time/hrtimer.c:1401 [inline]
__hrtimer_run_queues+0x2fc/0xd50 kernel/time/hrtimer.c:1463
hrtimer_interrupt+0x312/0x770 kernel/time/hrtimer.c:1521
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1067 [inline]
smp_apic_timer_interrupt+0x10c/0x550 arch/x86/kernel/apic/apic.c:1092
apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:893
</IRQ>
RIP: 0010:sfq_dequeue+0x167/0xd40 net/sched/sch_sfq.c:500
Code: c1 e8 03 42 0f b6 14 30 4c 89 e8 83 e0 07 83 c0 01 38 d0 7c 08 84 d2 0f 85 f2 0a 00 00 48 8b 44 24 08 44 0f b7 63 1a 0f b6 00 <38> 44 24 10 7c 08 84 c0 0f 85 bb 0a 00 00 66 44 03 a5 a2 02 00 00
RSP: 0018:ffff88820d18e870 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000000 RBX: ffff888059364628 RCX: ffffc9000c0d7000
RDX: 0000000000000000 RSI: ffffffff85bb2502 RDI: 0000000000000003
RBP: ffff8880924f4a80 R08: ffff888040b18240 R09: ffffed101249e96e
R10: ffffed101249e96d R11: ffff8880924f4b6b R12: 0000000000000000
R13: ffff888059364642 R14: dffffc0000000000 R15: 0000000000000003
dequeue_skb net/sched/sch_generic.c:282 [inline]
qdisc_restart net/sched/sch_generic.c:385 [inline]
__qdisc_run+0x1b7/0x1720 net/sched/sch_generic.c:403
__dev_xmit_skb net/core/dev.c:3492 [inline]
__dev_queue_xmit+0x1dad/0x3040 net/core/dev.c:3814
neigh_hh_output include/net/neighbour.h:491 [inline]
neigh_output include/net/neighbour.h:499 [inline]
ip_finish_output2+0x104d/0x1740 net/ipv4/ip_output.c:229
ip_finish_output+0x721/0xcd0 net/ipv4/ip_output.c:317
NF_HOOK_COND include/linux/netfilter.h:278 [inline]
ip_output+0x1fb/0x5f0 net/ipv4/ip_output.c:405
dst_output include/net/dst.h:447 [inline]
ip_local_out+0xaf/0x170 net/ipv4/ip_output.c:124
iptunnel_xmit+0x5ec/0xa20 net/ipv4/ip_tunnel_core.c:91
ip_tunnel_xmit+0x118b/0x374b net/ipv4/ip_tunnel.c:781
erspan_xmit+0x9b4/0x28b0 net/ipv4/ip_gre.c:756
__netdev_start_xmit include/linux/netdevice.h:4314 [inline]
netdev_start_xmit include/linux/netdevice.h:4323 [inline]
xmit_one net/core/dev.c:3260 [inline]
dev_hard_start_xmit+0x1a4/0x950 net/core/dev.c:3276
sch_direct_xmit+0x345/0xfc0 net/sched/sch_generic.c:332
qdisc_restart net/sched/sch_generic.c:395 [inline]
__qdisc_run+0x4df/0x1720 net/sched/sch_generic.c:403
qdisc_run include/net/pkt_sched.h:120 [inline]
qdisc_run include/net/pkt_sched.h:117 [inline]
__dev_xmit_skb net/core/dev.c:3455 [inline]
__dev_queue_xmit+0x229a/0x3040 net/core/dev.c:3814
neigh_hh_output include/net/neighbour.h:491 [inline]
neigh_output include/net/neighbour.h:499 [inline]
ip_finish_output2+0x104d/0x1740 net/ipv4/ip_output.c:229
ip_finish_output+0x721/0xcd0 net/ipv4/ip_output.c:317
NF_HOOK_COND include/linux/netfilter.h:278 [inline]
ip_output+0x1fb/0x5f0 net/ipv4/ip_output.c:405
dst_output include/net/dst.h:447 [inline]
ip_local_out+0xaf/0x170 net/ipv4/ip_output.c:124
ip_send_skb+0x3e/0xe0 net/ipv4/ip_output.c:1446
udp_send_skb.isra.0+0x6c2/0x11f0 net/ipv4/udp.c:845
udp_sendmsg+0x1df1/0x25d0 net/ipv4/udp.c:1132
inet_sendmsg+0x12e/0x590 net/ipv4/af_inet.c:798
sock_sendmsg_nosec net/socket.c:622 [inline]
sock_sendmsg+0xcf/0x120 net/socket.c:632
___sys_sendmsg+0x3e2/0x920 net/socket.c:2115
__sys_sendmmsg+0x195/0x470 net/socket.c:2210
__do_sys_sendmmsg net/socket.c:2239 [inline]
__se_sys_sendmmsg net/socket.c:2236 [inline]
__x64_sys_sendmmsg+0x99/0x100 net/socket.c:2236
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x45c829
Code: 0d b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 db b6 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007f2a1ba2cc78 EFLAGS: 00000246 ORIG_RAX: 0000000000000133
RAX: ffffffffffffffda RBX: 00000000004fc080 RCX: 000000000045c829
RDX: 0400000000000075 RSI: 0000000020007fc0 RDI: 0000000000000004
RBP: 000000000078bf00 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00000000ffffffff
R13: 00000000000008d7 R14: 00000000004cb7aa R15: 00007f2a1ba2d6d4
---
This bug is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.
syzbot will keep track of this bug report. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
syzbot
Feb 8, 2021, 2:43:13 AM2/8/21
to syzkaller...@googlegroups.com
Auto-closing this bug as obsolete.
Crashes did not happen for a while, no reproducer and no activity.
Crashes did not happen for a while, no reproducer and no activity.
Reply all
Reply to author
Forward
0 new messages