BUG: soft lockup in tcp_write_timer (3)
5 views
Skip to first unread message
syzbot
Dec 17, 2022, 4:41:36 PM12/17/22
to syzkaller...@googlegroups.com
Hello,
syzbot found the following issue on:
HEAD commit: 3f8a27f9e27b Linux 4.19.211
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=11c00abf880000
kernel config: https://syzkaller.appspot.com/x/.config?x=9b9277b418617afe
dashboard link: https://syzkaller.appspot.com/bug?extid=4b44cbef2716e6bf7ce8
compiler: gcc version 10.2.1 20210110 (Debian 10.2.1-6)
Unfortunately, I don't have any reproducer for this issue yet.
Downloadable assets:
disk image: https://storage.googleapis.com/syzbot-assets/98c0bdb4abb3/disk-3f8a27f9.raw.xz
vmlinux: https://storage.googleapis.com/syzbot-assets/ea228ff02669/vmlinux-3f8a27f9.xz
IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+4b44cb...@syzkaller.appspotmail.com
IPVS: ftp: loaded support on port[0] = 21
watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/u4:4:3120]
Modules linked in:
irq event stamp: 155430223
hardirqs last enabled at (155430222): [<ffffffff81549445>] seqcount_lockdep_reader_access include/linux/seqlock.h:83 [inline]
hardirqs last enabled at (155430222): [<ffffffff81549445>] read_seqcount_begin include/linux/seqlock.h:164 [inline]
hardirqs last enabled at (155430222): [<ffffffff81549445>] ktime_get+0x235/0x2f0 kernel/time/timekeeping.c:756
hardirqs last disabled at (155430223): [<ffffffff81003d00>] trace_hardirqs_off_thunk+0x1a/0x1c
softirqs last enabled at (109248184): [<ffffffff86a43e12>] get_next_corpse net/netfilter/nf_conntrack_core.c:1897 [inline]
softirqs last enabled at (109248184): [<ffffffff86a43e12>] nf_ct_iterate_cleanup+0x212/0x520 net/netfilter/nf_conntrack_core.c:1930
softirqs last disabled at (109248185): [<ffffffff88200daa>] do_softirq_own_stack+0x2a/0x40 arch/x86/entry/entry_64.S:1092
CPU: 0 PID: 3120 Comm: kworker/u4:4 Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Workqueue: netns cleanup_net
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:789 [inline]
RIP: 0010:lock_release+0x429/0x8b0 kernel/locking/lockdep.c:3930
Code: 84 08 00 00 00 00 00 00 48 c1 e8 03 80 3c 10 00 0f 85 95 03 00 00 48 83 3d 7b 34 a6 08 00 0f 84 cc 01 00 00 48 8b 3c 24 57 9d <0f> 1f 44 00 00 48 b8 00 00 00 00 00 fc ff df 49 c7 04 04 00 00 00
RSP: 0018:ffff8880ba007380 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff13e3051 RBX: ffff8880ab1f0400 RCX: 1ffff1101563e1c3
RDX: dffffc0000000000 RSI: 000000000000000b RDI: 0000000000000286
RBP: 000000000000000a R08: ffffffff8c665018 R09: 000000000000000a
R10: 0000000000000005 R11: ffffffff8c66501b R12: 1ffff11017400e73
R13: 2430d83bd2060855 R14: ffff8880ab1f0400 R15: 000000000000000b
FS: 0000000000000000(0000) GS:ffff8880ba000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b2fe2d000 CR3: 00000000a6f5e000 CR4: 00000000003426f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
Call Trace:
<IRQ>
__raw_spin_unlock include/linux/spinlock_api_smp.h:150 [inline]
_raw_spin_unlock+0x17/0x40 kernel/locking/spinlock.c:176
spin_unlock include/linux/spinlock.h:369 [inline]
tcf_police_act+0x786/0xe60 net/sched/act_police.c:268
tcf_action_exec net/sched/act_api.c:618 [inline]
tcf_action_exec+0x160/0x400 net/sched/act_api.c:598
tcf_exts_exec include/net/pkt_cls.h:388 [inline]
basic_classify+0x184/0x2b0 net/sched/cls_basic.c:52
tcf_classify+0x120/0x3c0 net/sched/cls_api.c:979
prio_classify net/sched/sch_prio.c:46 [inline]
prio_enqueue+0x3bb/0x7a0 net/sched/sch_prio.c:78
__dev_xmit_skb net/core/dev.c:3494 [inline]
__dev_queue_xmit+0x140a/0x2e00 net/core/dev.c:3807
neigh_hh_output include/net/neighbour.h:491 [inline]
neigh_output include/net/neighbour.h:499 [inline]
ip_finish_output2+0xb6d/0x15a0 net/ipv4/ip_output.c:230
ip_finish_output+0xae9/0x10b0 net/ipv4/ip_output.c:318
NF_HOOK_COND include/linux/netfilter.h:278 [inline]
ip_output+0x203/0x5f0 net/ipv4/ip_output.c:406
dst_output include/net/dst.h:455 [inline]
ip_local_out+0xaf/0x170 net/ipv4/ip_output.c:125
__ip_queue_xmit+0x91e/0x1c10 net/ipv4/ip_output.c:507
__tcp_transmit_skb+0x1b9c/0x3400 net/ipv4/tcp_output.c:1148
tcp_transmit_skb net/ipv4/tcp_output.c:1164 [inline]
tcp_xmit_probe_skb+0x2e8/0x390 net/ipv4/tcp_output.c:3682
tcp_write_wakeup+0x1bd/0x610 net/ipv4/tcp_output.c:3735
tcp_send_probe0+0x46/0x400 net/ipv4/tcp_output.c:3750
tcp_probe_timer net/ipv4/tcp_timer.c:380 [inline]
tcp_write_timer_handler+0x8c2/0xa60 net/ipv4/tcp_timer.c:597
tcp_write_timer+0x103/0x1b0 net/ipv4/tcp_timer.c:613
call_timer_fn+0x177/0x700 kernel/time/timer.c:1338
expire_timers+0x243/0x4e0 kernel/time/timer.c:1375
__run_timers kernel/time/timer.c:1696 [inline]
run_timer_softirq+0x21c/0x670 kernel/time/timer.c:1709
__do_softirq+0x265/0x980 kernel/softirq.c:292
do_softirq_own_stack+0x2a/0x40 arch/x86/entry/entry_64.S:1092
</IRQ>
do_softirq.part.0+0x160/0x1c0 kernel/softirq.c:336
do_softirq kernel/softirq.c:328 [inline]
__local_bh_enable_ip+0x20e/0x270 kernel/softirq.c:189
local_bh_enable include/linux/bottom_half.h:32 [inline]
get_next_corpse net/netfilter/nf_conntrack_core.c:1907 [inline]
nf_ct_iterate_cleanup+0x239/0x520 net/netfilter/nf_conntrack_core.c:1930
nf_ct_iterate_cleanup_net net/netfilter/nf_conntrack_core.c:2015 [inline]
nf_ct_iterate_cleanup_net+0x113/0x170 net/netfilter/nf_conntrack_core.c:2000
masq_device_event+0xd6/0x110 net/ipv4/netfilter/nf_nat_masquerade_ipv4.c:100
notifier_call_chain+0xc0/0x230 kernel/notifier.c:93
call_netdevice_notifiers net/core/dev.c:1762 [inline]
dev_close_many+0x323/0x670 net/core/dev.c:1514
rollback_registered_many+0x2f7/0xe70 net/core/dev.c:8173
unregister_netdevice_many.part.0+0x1a/0x300 net/core/dev.c:9324
unregister_netdevice_many+0x36/0x50 net/core/dev.c:9323
ip6gre_exit_batch_net+0x4c8/0x6c0 net/ipv6/ip6_gre.c:1635
ops_exit_list+0xf9/0x150 net/core/net_namespace.c:156
cleanup_net+0x3b4/0x8b0 net/core/net_namespace.c:554
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1 skipped: idling at native_safe_halt+0xe/0x10 arch/x86/include/asm/irqflags.h:60
---
This report is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.
syzbot will keep track of this issue. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
syzbot found the following issue on:
HEAD commit: 3f8a27f9e27b Linux 4.19.211
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=11c00abf880000
kernel config: https://syzkaller.appspot.com/x/.config?x=9b9277b418617afe
dashboard link: https://syzkaller.appspot.com/bug?extid=4b44cbef2716e6bf7ce8
compiler: gcc version 10.2.1 20210110 (Debian 10.2.1-6)
Unfortunately, I don't have any reproducer for this issue yet.
Downloadable assets:
disk image: https://storage.googleapis.com/syzbot-assets/98c0bdb4abb3/disk-3f8a27f9.raw.xz
vmlinux: https://storage.googleapis.com/syzbot-assets/ea228ff02669/vmlinux-3f8a27f9.xz
IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+4b44cb...@syzkaller.appspotmail.com
IPVS: ftp: loaded support on port[0] = 21
watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/u4:4:3120]
Modules linked in:
irq event stamp: 155430223
hardirqs last enabled at (155430222): [<ffffffff81549445>] seqcount_lockdep_reader_access include/linux/seqlock.h:83 [inline]
hardirqs last enabled at (155430222): [<ffffffff81549445>] read_seqcount_begin include/linux/seqlock.h:164 [inline]
hardirqs last enabled at (155430222): [<ffffffff81549445>] ktime_get+0x235/0x2f0 kernel/time/timekeeping.c:756
hardirqs last disabled at (155430223): [<ffffffff81003d00>] trace_hardirqs_off_thunk+0x1a/0x1c
softirqs last enabled at (109248184): [<ffffffff86a43e12>] get_next_corpse net/netfilter/nf_conntrack_core.c:1897 [inline]
softirqs last enabled at (109248184): [<ffffffff86a43e12>] nf_ct_iterate_cleanup+0x212/0x520 net/netfilter/nf_conntrack_core.c:1930
softirqs last disabled at (109248185): [<ffffffff88200daa>] do_softirq_own_stack+0x2a/0x40 arch/x86/entry/entry_64.S:1092
CPU: 0 PID: 3120 Comm: kworker/u4:4 Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Workqueue: netns cleanup_net
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:789 [inline]
RIP: 0010:lock_release+0x429/0x8b0 kernel/locking/lockdep.c:3930
Code: 84 08 00 00 00 00 00 00 48 c1 e8 03 80 3c 10 00 0f 85 95 03 00 00 48 83 3d 7b 34 a6 08 00 0f 84 cc 01 00 00 48 8b 3c 24 57 9d <0f> 1f 44 00 00 48 b8 00 00 00 00 00 fc ff df 49 c7 04 04 00 00 00
RSP: 0018:ffff8880ba007380 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff13e3051 RBX: ffff8880ab1f0400 RCX: 1ffff1101563e1c3
RDX: dffffc0000000000 RSI: 000000000000000b RDI: 0000000000000286
RBP: 000000000000000a R08: ffffffff8c665018 R09: 000000000000000a
R10: 0000000000000005 R11: ffffffff8c66501b R12: 1ffff11017400e73
R13: 2430d83bd2060855 R14: ffff8880ab1f0400 R15: 000000000000000b
FS: 0000000000000000(0000) GS:ffff8880ba000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b2fe2d000 CR3: 00000000a6f5e000 CR4: 00000000003426f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
Call Trace:
<IRQ>
__raw_spin_unlock include/linux/spinlock_api_smp.h:150 [inline]
_raw_spin_unlock+0x17/0x40 kernel/locking/spinlock.c:176
spin_unlock include/linux/spinlock.h:369 [inline]
tcf_police_act+0x786/0xe60 net/sched/act_police.c:268
tcf_action_exec net/sched/act_api.c:618 [inline]
tcf_action_exec+0x160/0x400 net/sched/act_api.c:598
tcf_exts_exec include/net/pkt_cls.h:388 [inline]
basic_classify+0x184/0x2b0 net/sched/cls_basic.c:52
tcf_classify+0x120/0x3c0 net/sched/cls_api.c:979
prio_classify net/sched/sch_prio.c:46 [inline]
prio_enqueue+0x3bb/0x7a0 net/sched/sch_prio.c:78
__dev_xmit_skb net/core/dev.c:3494 [inline]
__dev_queue_xmit+0x140a/0x2e00 net/core/dev.c:3807
neigh_hh_output include/net/neighbour.h:491 [inline]
neigh_output include/net/neighbour.h:499 [inline]
ip_finish_output2+0xb6d/0x15a0 net/ipv4/ip_output.c:230
ip_finish_output+0xae9/0x10b0 net/ipv4/ip_output.c:318
NF_HOOK_COND include/linux/netfilter.h:278 [inline]
ip_output+0x203/0x5f0 net/ipv4/ip_output.c:406
dst_output include/net/dst.h:455 [inline]
ip_local_out+0xaf/0x170 net/ipv4/ip_output.c:125
__ip_queue_xmit+0x91e/0x1c10 net/ipv4/ip_output.c:507
__tcp_transmit_skb+0x1b9c/0x3400 net/ipv4/tcp_output.c:1148
tcp_transmit_skb net/ipv4/tcp_output.c:1164 [inline]
tcp_xmit_probe_skb+0x2e8/0x390 net/ipv4/tcp_output.c:3682
tcp_write_wakeup+0x1bd/0x610 net/ipv4/tcp_output.c:3735
tcp_send_probe0+0x46/0x400 net/ipv4/tcp_output.c:3750
tcp_probe_timer net/ipv4/tcp_timer.c:380 [inline]
tcp_write_timer_handler+0x8c2/0xa60 net/ipv4/tcp_timer.c:597
tcp_write_timer+0x103/0x1b0 net/ipv4/tcp_timer.c:613
call_timer_fn+0x177/0x700 kernel/time/timer.c:1338
expire_timers+0x243/0x4e0 kernel/time/timer.c:1375
__run_timers kernel/time/timer.c:1696 [inline]
run_timer_softirq+0x21c/0x670 kernel/time/timer.c:1709
__do_softirq+0x265/0x980 kernel/softirq.c:292
do_softirq_own_stack+0x2a/0x40 arch/x86/entry/entry_64.S:1092
</IRQ>
do_softirq.part.0+0x160/0x1c0 kernel/softirq.c:336
do_softirq kernel/softirq.c:328 [inline]
__local_bh_enable_ip+0x20e/0x270 kernel/softirq.c:189
local_bh_enable include/linux/bottom_half.h:32 [inline]
get_next_corpse net/netfilter/nf_conntrack_core.c:1907 [inline]
nf_ct_iterate_cleanup+0x239/0x520 net/netfilter/nf_conntrack_core.c:1930
nf_ct_iterate_cleanup_net net/netfilter/nf_conntrack_core.c:2015 [inline]
nf_ct_iterate_cleanup_net+0x113/0x170 net/netfilter/nf_conntrack_core.c:2000
masq_device_event+0xd6/0x110 net/ipv4/netfilter/nf_nat_masquerade_ipv4.c:100
notifier_call_chain+0xc0/0x230 kernel/notifier.c:93
call_netdevice_notifiers net/core/dev.c:1762 [inline]
dev_close_many+0x323/0x670 net/core/dev.c:1514
rollback_registered_many+0x2f7/0xe70 net/core/dev.c:8173
unregister_netdevice_many.part.0+0x1a/0x300 net/core/dev.c:9324
unregister_netdevice_many+0x36/0x50 net/core/dev.c:9323
ip6gre_exit_batch_net+0x4c8/0x6c0 net/ipv6/ip6_gre.c:1635
ops_exit_list+0xf9/0x150 net/core/net_namespace.c:156
cleanup_net+0x3b4/0x8b0 net/core/net_namespace.c:554
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1 skipped: idling at native_safe_halt+0xe/0x10 arch/x86/include/asm/irqflags.h:60
---
This report is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.
syzbot will keep track of this issue. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
Reply all
Reply to author
Forward
0 new messages