INFO: rcu detected stall in nr_t1timer_expiry
4 views
Skip to first unread message
syzbot
Mar 12, 2020, 11:56:12 PM3/12/20
to syzkaller...@googlegroups.com
Hello,
syzbot found the following crash on:
HEAD commit: 12cd844a Linux 4.14.173
git tree: linux-4.14.y
console output: https://syzkaller.appspot.com/x/log.txt?x=17fea3dde00000
kernel config: https://syzkaller.appspot.com/x/.config?x=8a9d0602a0f7791e
dashboard link: https://syzkaller.appspot.com/bug?extid=92d92c5a84a5307183e1
compiler: gcc (GCC) 9.0.0 20181231 (experimental)
Unfortunately, I don't have any reproducer for this crash yet.
IMPORTANT: if you fix the bug, please add the following tag to the commit:
Reported-by: syzbot+92d92c...@syzkaller.appspotmail.com
INFO: rcu_preempt detected stalls on CPUs/tasks:
(detected by 1, t=10502 jiffies, g=24013, c=24012, q=0)
All QSes seen, last rcu_preempt kthread activity 10502 (4295040859-4295030357), jiffies_till_next_fqs=1, root ->qsmask 0x0
syz-executor.0 R running task 25264 30362 7320 0x0000000c
Call Trace:
<IRQ>
sched_show_task kernel/sched/core.c:5168 [inline]
sched_show_task.cold+0x2e3/0x347 kernel/sched/core.c:5143
print_other_cpu_stall kernel/rcu/tree.c:1501 [inline]
check_cpu_stall kernel/rcu/tree.c:1616 [inline]
__rcu_pending kernel/rcu/tree.c:3390 [inline]
rcu_pending kernel/rcu/tree.c:3452 [inline]
rcu_check_callbacks.cold+0xd3f/0xdaa kernel/rcu/tree.c:2792
update_process_times+0x29/0x60 kernel/time/timer.c:1590
tick_sched_handle+0x7d/0x150 kernel/time/tick-sched.c:165
tick_sched_timer+0x3e/0x120 kernel/time/tick-sched.c:1223
__run_hrtimer kernel/time/hrtimer.c:1223 [inline]
__hrtimer_run_queues+0x25c/0xbb0 kernel/time/hrtimer.c:1287
hrtimer_interrupt+0x1e6/0x5e0 kernel/time/hrtimer.c:1321
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1075 [inline]
smp_apic_timer_interrupt+0x117/0x5e0 arch/x86/kernel/apic/apic.c:1100
apic_timer_interrupt+0x8f/0xa0 arch/x86/entry/entry_64.S:792
RIP: 0010:kernel_text_address+0x93/0xe0 kernel/extable.c:158
RSP: 0018:ffff8880aeb07850 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff10
RAX: 0000000000000001 RBX: ffffffff818326b7 RCX: 0000000000000000
RDX: 1ffff11015d60f19 RSI: 0000000000000000 RDI: ffffffff818326b7
RBP: ffff8880aeb078c8 R08: ffffffff88efc662 R09: ffff888026206f90
R10: ffff8880aeb078b5 R11: 0000000000058071 R12: 0000000000000000
R13: 0000000000000000 R14: ffff888027be8080 R15: ffff88807dcae0e7
__kernel_text_address+0x9/0x30 kernel/extable.c:105
unwind_get_return_address arch/x86/kernel/unwind_orc.c:255 [inline]
unwind_get_return_address+0x5a/0xa0 arch/x86/kernel/unwind_orc.c:250
__save_stack_trace+0x7b/0xd0 arch/x86/kernel/stacktrace.c:45
save_stack+0x32/0xa0 mm/kasan/kasan.c:447
set_track mm/kasan/kasan.c:459 [inline]
kasan_kmalloc mm/kasan/kasan.c:551 [inline]
kasan_kmalloc+0xbf/0xe0 mm/kasan/kasan.c:529
slab_post_alloc_hook mm/slab.h:442 [inline]
slab_alloc_node mm/slab.c:3333 [inline]
kmem_cache_alloc_node+0x135/0x7a0 mm/slab.c:3640
__alloc_skb+0x9a/0x4c0 net/core/skbuff.c:193
alloc_skb include/linux/skbuff.h:980 [inline]
nr_loopback_queue+0x50/0x210 net/netrom/nr_loopback.c:37
nr_route_frame+0x5bd/0x815 net/netrom/nr_route.c:799
nr_transmit_buffer+0x120/0x180 net/netrom/nr_out.c:212
nr_write_internal+0x642/0xd10 net/netrom/nr_subr.c:208
nr_t1timer_expiry+0x279/0x310 net/netrom/nr_timer.c:230
call_timer_fn+0x14a/0x650 kernel/time/timer.c:1279
expire_timers kernel/time/timer.c:1318 [inline]
__run_timers kernel/time/timer.c:1636 [inline]
__run_timers kernel/time/timer.c:1604 [inline]
run_timer_softirq+0x52a/0x1390 kernel/time/timer.c:1649
__do_softirq+0x254/0x9bf kernel/softirq.c:288
invoke_softirq kernel/softirq.c:368 [inline]
irq_exit+0x15b/0x1a0 kernel/softirq.c:409
exiting_irq arch/x86/include/asm/apic.h:648 [inline]
smp_apic_timer_interrupt+0x141/0x5e0 arch/x86/kernel/apic/apic.c:1102
apic_timer_interrupt+0x8f/0xa0 arch/x86/entry/entry_64.S:792
</IRQ>
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:779 [inline]
RIP: 0010:lock_acquire+0x1ec/0x3f0 kernel/locking/lockdep.c:3997
RSP: 0018:ffff888026206f40 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff10
RAX: 1ffffffff0fa2cd1 RBX: ffff888027be8080 RCX: 00000000c1ba2cc1
RDX: dffffc0000000000 RSI: ffff888027be8950 RDI: 0000000000000282
RBP: ffffffff87de5fc0 R08: 000000000000048a R09: ffffffff8a05dcd0
R10: ffff888027be8950 R11: ffff888027be8080 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
fs_reclaim_acquire.part.0+0x20/0x30 mm/page_alloc.c:3551
slab_pre_alloc_hook mm/slab.h:416 [inline]
slab_alloc_node mm/slab.c:3297 [inline]
kmem_cache_alloc_node+0x37/0x7a0 mm/slab.c:3640
__alloc_skb+0x9a/0x4c0 net/core/skbuff.c:193
alloc_skb include/linux/skbuff.h:980 [inline]
kobject_uevent_env+0x6d1/0xc50 lib/kobject_uevent.c:479
netdev_queue_add_kobject net/core/net-sysfs.c:1347 [inline]
netdev_queue_update_kobjects+0x283/0x350 net/core/net-sysfs.c:1364
register_queue_kobjects net/core/net-sysfs.c:1406 [inline]
netdev_register_kobject+0x287/0x390 net/core/net-sysfs.c:1612
register_netdevice+0x7ce/0xc70 net/core/dev.c:7660
veth_newlink+0x3ba/0x8a0 drivers/net/veth.c:416
rtnl_newlink+0xecb/0x1720 net/core/rtnetlink.c:2728
rtnetlink_rcv_msg+0x3be/0xb10 net/core/rtnetlink.c:4315
netlink_rcv_skb+0x127/0x370 net/netlink/af_netlink.c:2433
netlink_unicast_kernel net/netlink/af_netlink.c:1287 [inline]
netlink_unicast+0x437/0x620 net/netlink/af_netlink.c:1313
netlink_sendmsg+0x733/0xbe0 net/netlink/af_netlink.c:1878
sock_sendmsg_nosec net/socket.c:646 [inline]
sock_sendmsg+0xc5/0x100 net/socket.c:656
___sys_sendmsg+0x70a/0x840 net/socket.c:2062
__sys_sendmsg+0xa3/0x120 net/socket.c:2096
SYSC_sendmsg net/socket.c:2107 [inline]
SyS_sendmsg+0x27/0x40 net/socket.c:2103
do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
entry_SYSCALL_64_after_hwframe+0x42/0xb7
RIP: 0033:0x45c679
RSP: 002b:00007f4136364c78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 00007f41363656d4 RCX: 000000000045c679
RDX: 0000000000000000 RSI: 0000000020000040 RDI: 0000000000000018
RBP: 000000000076bf00 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00000000ffffffff
R13: 00000000000009f9 R14: 00000000004cc937 R15: 000000000076bf0c
rcu_preempt kthread starved for 10502 jiffies! g24013 c24012 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x0 ->cpu=0
rcu_preempt R running task 29920 8 2 0x80000000
Call Trace:
schedule+0x8d/0x1b0 kernel/sched/core.c:3428
schedule_timeout+0x43c/0xe40 kernel/time/timer.c:1746
rcu_gp_kthread+0xb8e/0x1ce0 kernel/rcu/tree.c:2255
kthread+0x30d/0x420 kernel/kthread.c:232
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:404
---
This bug is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.
syzbot will keep track of this bug report. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
syzbot found the following crash on:
HEAD commit: 12cd844a Linux 4.14.173
git tree: linux-4.14.y
console output: https://syzkaller.appspot.com/x/log.txt?x=17fea3dde00000
kernel config: https://syzkaller.appspot.com/x/.config?x=8a9d0602a0f7791e
dashboard link: https://syzkaller.appspot.com/bug?extid=92d92c5a84a5307183e1
compiler: gcc (GCC) 9.0.0 20181231 (experimental)
Unfortunately, I don't have any reproducer for this crash yet.
IMPORTANT: if you fix the bug, please add the following tag to the commit:
Reported-by: syzbot+92d92c...@syzkaller.appspotmail.com
INFO: rcu_preempt detected stalls on CPUs/tasks:
(detected by 1, t=10502 jiffies, g=24013, c=24012, q=0)
All QSes seen, last rcu_preempt kthread activity 10502 (4295040859-4295030357), jiffies_till_next_fqs=1, root ->qsmask 0x0
syz-executor.0 R running task 25264 30362 7320 0x0000000c
Call Trace:
<IRQ>
sched_show_task kernel/sched/core.c:5168 [inline]
sched_show_task.cold+0x2e3/0x347 kernel/sched/core.c:5143
print_other_cpu_stall kernel/rcu/tree.c:1501 [inline]
check_cpu_stall kernel/rcu/tree.c:1616 [inline]
__rcu_pending kernel/rcu/tree.c:3390 [inline]
rcu_pending kernel/rcu/tree.c:3452 [inline]
rcu_check_callbacks.cold+0xd3f/0xdaa kernel/rcu/tree.c:2792
update_process_times+0x29/0x60 kernel/time/timer.c:1590
tick_sched_handle+0x7d/0x150 kernel/time/tick-sched.c:165
tick_sched_timer+0x3e/0x120 kernel/time/tick-sched.c:1223
__run_hrtimer kernel/time/hrtimer.c:1223 [inline]
__hrtimer_run_queues+0x25c/0xbb0 kernel/time/hrtimer.c:1287
hrtimer_interrupt+0x1e6/0x5e0 kernel/time/hrtimer.c:1321
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1075 [inline]
smp_apic_timer_interrupt+0x117/0x5e0 arch/x86/kernel/apic/apic.c:1100
apic_timer_interrupt+0x8f/0xa0 arch/x86/entry/entry_64.S:792
RIP: 0010:kernel_text_address+0x93/0xe0 kernel/extable.c:158
RSP: 0018:ffff8880aeb07850 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff10
RAX: 0000000000000001 RBX: ffffffff818326b7 RCX: 0000000000000000
RDX: 1ffff11015d60f19 RSI: 0000000000000000 RDI: ffffffff818326b7
RBP: ffff8880aeb078c8 R08: ffffffff88efc662 R09: ffff888026206f90
R10: ffff8880aeb078b5 R11: 0000000000058071 R12: 0000000000000000
R13: 0000000000000000 R14: ffff888027be8080 R15: ffff88807dcae0e7
__kernel_text_address+0x9/0x30 kernel/extable.c:105
unwind_get_return_address arch/x86/kernel/unwind_orc.c:255 [inline]
unwind_get_return_address+0x5a/0xa0 arch/x86/kernel/unwind_orc.c:250
__save_stack_trace+0x7b/0xd0 arch/x86/kernel/stacktrace.c:45
save_stack+0x32/0xa0 mm/kasan/kasan.c:447
set_track mm/kasan/kasan.c:459 [inline]
kasan_kmalloc mm/kasan/kasan.c:551 [inline]
kasan_kmalloc+0xbf/0xe0 mm/kasan/kasan.c:529
slab_post_alloc_hook mm/slab.h:442 [inline]
slab_alloc_node mm/slab.c:3333 [inline]
kmem_cache_alloc_node+0x135/0x7a0 mm/slab.c:3640
__alloc_skb+0x9a/0x4c0 net/core/skbuff.c:193
alloc_skb include/linux/skbuff.h:980 [inline]
nr_loopback_queue+0x50/0x210 net/netrom/nr_loopback.c:37
nr_route_frame+0x5bd/0x815 net/netrom/nr_route.c:799
nr_transmit_buffer+0x120/0x180 net/netrom/nr_out.c:212
nr_write_internal+0x642/0xd10 net/netrom/nr_subr.c:208
nr_t1timer_expiry+0x279/0x310 net/netrom/nr_timer.c:230
call_timer_fn+0x14a/0x650 kernel/time/timer.c:1279
expire_timers kernel/time/timer.c:1318 [inline]
__run_timers kernel/time/timer.c:1636 [inline]
__run_timers kernel/time/timer.c:1604 [inline]
run_timer_softirq+0x52a/0x1390 kernel/time/timer.c:1649
__do_softirq+0x254/0x9bf kernel/softirq.c:288
invoke_softirq kernel/softirq.c:368 [inline]
irq_exit+0x15b/0x1a0 kernel/softirq.c:409
exiting_irq arch/x86/include/asm/apic.h:648 [inline]
smp_apic_timer_interrupt+0x141/0x5e0 arch/x86/kernel/apic/apic.c:1102
apic_timer_interrupt+0x8f/0xa0 arch/x86/entry/entry_64.S:792
</IRQ>
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:779 [inline]
RIP: 0010:lock_acquire+0x1ec/0x3f0 kernel/locking/lockdep.c:3997
RSP: 0018:ffff888026206f40 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff10
RAX: 1ffffffff0fa2cd1 RBX: ffff888027be8080 RCX: 00000000c1ba2cc1
RDX: dffffc0000000000 RSI: ffff888027be8950 RDI: 0000000000000282
RBP: ffffffff87de5fc0 R08: 000000000000048a R09: ffffffff8a05dcd0
R10: ffff888027be8950 R11: ffff888027be8080 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
fs_reclaim_acquire.part.0+0x20/0x30 mm/page_alloc.c:3551
slab_pre_alloc_hook mm/slab.h:416 [inline]
slab_alloc_node mm/slab.c:3297 [inline]
kmem_cache_alloc_node+0x37/0x7a0 mm/slab.c:3640
__alloc_skb+0x9a/0x4c0 net/core/skbuff.c:193
alloc_skb include/linux/skbuff.h:980 [inline]
kobject_uevent_env+0x6d1/0xc50 lib/kobject_uevent.c:479
netdev_queue_add_kobject net/core/net-sysfs.c:1347 [inline]
netdev_queue_update_kobjects+0x283/0x350 net/core/net-sysfs.c:1364
register_queue_kobjects net/core/net-sysfs.c:1406 [inline]
netdev_register_kobject+0x287/0x390 net/core/net-sysfs.c:1612
register_netdevice+0x7ce/0xc70 net/core/dev.c:7660
veth_newlink+0x3ba/0x8a0 drivers/net/veth.c:416
rtnl_newlink+0xecb/0x1720 net/core/rtnetlink.c:2728
rtnetlink_rcv_msg+0x3be/0xb10 net/core/rtnetlink.c:4315
netlink_rcv_skb+0x127/0x370 net/netlink/af_netlink.c:2433
netlink_unicast_kernel net/netlink/af_netlink.c:1287 [inline]
netlink_unicast+0x437/0x620 net/netlink/af_netlink.c:1313
netlink_sendmsg+0x733/0xbe0 net/netlink/af_netlink.c:1878
sock_sendmsg_nosec net/socket.c:646 [inline]
sock_sendmsg+0xc5/0x100 net/socket.c:656
___sys_sendmsg+0x70a/0x840 net/socket.c:2062
__sys_sendmsg+0xa3/0x120 net/socket.c:2096
SYSC_sendmsg net/socket.c:2107 [inline]
SyS_sendmsg+0x27/0x40 net/socket.c:2103
do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
entry_SYSCALL_64_after_hwframe+0x42/0xb7
RIP: 0033:0x45c679
RSP: 002b:00007f4136364c78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 00007f41363656d4 RCX: 000000000045c679
RDX: 0000000000000000 RSI: 0000000020000040 RDI: 0000000000000018
RBP: 000000000076bf00 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00000000ffffffff
R13: 00000000000009f9 R14: 00000000004cc937 R15: 000000000076bf0c
rcu_preempt kthread starved for 10502 jiffies! g24013 c24012 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x0 ->cpu=0
rcu_preempt R running task 29920 8 2 0x80000000
Call Trace:
schedule+0x8d/0x1b0 kernel/sched/core.c:3428
schedule_timeout+0x43c/0xe40 kernel/time/timer.c:1746
rcu_gp_kthread+0xb8e/0x1ce0 kernel/rcu/tree.c:2255
kthread+0x30d/0x420 kernel/kthread.c:232
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:404
---
This bug is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.
syzbot will keep track of this bug report. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
syzbot
Jul 10, 2020, 11:56:10 PM7/10/20
to syzkaller...@googlegroups.com
Auto-closing this bug as obsolete.
Crashes did not happen for a while, no reproducer and no activity.
Crashes did not happen for a while, no reproducer and no activity.
Reply all
Reply to author
Forward
0 new messages