INFO: task hung in xfs_buf_delwri_pushbuf

[syzbot]

Hello,

syzbot found the following issue on:

HEAD commit: 3f8a27f9e27b Linux 4.19.211
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=125a1ad7880000
kernel config: https://syzkaller.appspot.com/x/.config?x=9b9277b418617afe
dashboard link: https://syzkaller.appspot.com/bug?extid=29c3fb6d3b41829c51b3
compiler: gcc version 10.2.1 20210110 (Debian 10.2.1-6)

Unfortunately, I don't have any reproducer for this issue yet.

Downloadable assets:
disk image: https://storage.googleapis.com/syzbot-assets/98c0bdb4abb3/disk-3f8a27f9.raw.xz
vmlinux: https://storage.googleapis.com/syzbot-assets/ea228ff02669/vmlinux-3f8a27f9.xz

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+29c3fb...@syzkaller.appspotmail.com

Bluetooth: hci5: command 0x0406 tx timeout
Bluetooth: hci3: command 0x0406 tx timeout
Bluetooth: hci4: command 0x0406 tx timeout
ieee802154 phy0 wpan0: encryption failed: -22
ieee802154 phy1 wpan1: encryption failed: -22
INFO: task syz-executor.4:11628 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.4 D23096 11628 8146 0x00000004
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
schedule_timeout+0x92d/0xfe0 kernel/time/timer.c:1794
do_wait_for_common kernel/sched/completion.c:83 [inline]
__wait_for_common kernel/sched/completion.c:104 [inline]
wait_for_common+0x29c/0x470 kernel/sched/completion.c:115
xfs_buf_iowait+0x74/0x5d0 fs/xfs/xfs_buf.c:1483
xfs_buf_delwri_pushbuf+0x25e/0x5b0 fs/xfs/xfs_buf.c:2129
xfs_qm_flush_one+0x242/0x310 fs/xfs/xfs_qm.c:1247
xfs_qm_dquot_walk.isra.0+0x1a2/0x3a0 fs/xfs/xfs_qm.c:87
xfs_qm_quotacheck+0x6ba/0x880 fs/xfs/xfs_qm.c:1339
xfs_qm_mount_quotas+0x124/0x680 fs/xfs/xfs_qm.c:1445
xfs_mountfs+0x17e2/0x1bf0 fs/xfs/xfs_mount.c:1001
xfs_fs_fill_super+0xd0e/0x1540 fs/xfs/xfs_super.c:1720
mount_bdev+0x2fc/0x3b0 fs/super.c:1158
mount_fs+0xa3/0x310 fs/super.c:1261
vfs_kern_mount.part.0+0x68/0x470 fs/namespace.c:961
vfs_kern_mount fs/namespace.c:951 [inline]
do_new_mount fs/namespace.c:2492 [inline]
do_mount+0x115c/0x2f50 fs/namespace.c:2822
ksys_mount+0xcf/0x130 fs/namespace.c:3038
__do_sys_mount fs/namespace.c:3052 [inline]
__se_sys_mount fs/namespace.c:3049 [inline]
__x64_sys_mount+0xba/0x150 fs/namespace.c:3049
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f434960760a
Code: Bad RIP value.
RSP: 002b:00007f4347b56f88 EFLAGS: 00000206 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 000000000000baed RCX: 00007f434960760a
RDX: 000000002000bb00 RSI: 000000002000bb40 RDI: 00007f4347b56fe0
RBP: 00007f4347b57020 R08: 00007f4347b57020 R09: 0000000002000000
R10: 0000000002000000 R11: 0000000000000206 R12: 000000002000bb00
R13: 000000002000bb40 R14: 00007f4347b56fe0 R15: 0000000020000100
INFO: task syz-executor.5:11802 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.5 D24040 11802 8133 0x80000004
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
schedule_preempt_disabled+0xf/0x20 kernel/sched/core.c:3619
__mutex_lock_common kernel/locking/mutex.c:1016 [inline]
__mutex_lock+0x5f0/0x1190 kernel/locking/mutex.c:1078
xfs_qm_dqfree_one+0x6f/0x1a0 fs/xfs/xfs_qm.c:1611
xfs_qm_shrink_scan fs/xfs/xfs_qm.c:527 [inline]
xfs_qm_shrink_scan+0x293/0x380 fs/xfs/xfs_qm.c:499
do_shrink_slab+0x397/0xa40 mm/vmscan.c:537
shrink_slab+0x16f/0x550 mm/vmscan.c:693
drop_slab_node+0x33/0x70 mm/vmscan.c:724
drop_slab+0x4b/0x90 mm/vmscan.c:734
drop_caches_sysctl_handler+0xf6/0x110 fs/drop_caches.c:65
proc_sys_call_handler.isra.0+0x1f3/0x3b0 fs/proc/proc_sysctl.c:597
__vfs_write+0xf7/0x770 fs/read_write.c:485
__kernel_write+0x109/0x370 fs/read_write.c:506
write_pipe_buf+0x153/0x1f0 fs/splice.c:798
splice_from_pipe_feed fs/splice.c:503 [inline]
__splice_from_pipe+0x389/0x800 fs/splice.c:627
splice_from_pipe fs/splice.c:662 [inline]
default_file_splice_write+0xd8/0x180 fs/splice.c:810
do_splice_from fs/splice.c:852 [inline]
direct_splice_actor+0x115/0x160 fs/splice.c:1025
splice_direct_to_actor+0x33f/0x8d0 fs/splice.c:980
do_splice_direct+0x1a7/0x270 fs/splice.c:1068
do_sendfile+0x550/0xc30 fs/read_write.c:1447
__do_sys_sendfile64 fs/read_write.c:1502 [inline]
__se_sys_sendfile64+0xc4/0x160 fs/read_write.c:1494
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f8a4db950d9
Code: Bad RIP value.
RSP: 002b:00007f8a4c107168 EFLAGS: 00000246 ORIG_RAX: 0000000000000028
RAX: ffffffffffffffda RBX: 00007f8a4dcb4f80 RCX: 00007f8a4db950d9
RDX: 0000000020002080 RSI: 0000000000000006 RDI: 0000000000000007
RBP: 00007f8a4dbf0ae9 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000870 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffc5768519f R14: 00007f8a4c107300 R15: 0000000000022000

Showing all locks held in the system:
1 lock held by khungtaskd/1567:
#0: 0000000081c6dfbd (rcu_read_lock){....}, at: debug_show_all_locks+0x53/0x265 kernel/locking/lockdep.c:4441
4 locks held by kworker/0:3/4717:
#0: 0000000048dbc208 ((wq_completion)"events"){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000abc3c0cb ((work_completion)(&ns->proc_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000097c3c930 (&type->s_umount_key#28){++++}, at: deactivate_super+0x16c/0x1a0 fs/super.c:359
#3: 00000000efa2e130 (shrinker_rwsem){++++}, at: unregister_memcg_shrinker mm/vmscan.c:221 [inline]
#3: 00000000efa2e130 (shrinker_rwsem){++++}, at: unregister_shrinker+0x24d/0x300 mm/vmscan.c:436
1 lock held by in:imklog/7746:
#0: 000000008280a27d (&f->f_pos_lock){+.+.}, at: __fdget_pos+0x26f/0x310 fs/file.c:767
3 locks held by syz-executor.4/11628:
#0: 00000000d690b998 (&type->s_umount_key#50/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
#0: 00000000d690b998 (&type->s_umount_key#50/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
#1: 000000002797ed08 (&qinf->qi_tree_lock){+.+.}, at: xfs_qm_dquot_walk.isra.0+0xfb/0x3a0 fs/xfs/xfs_qm.c:74
#2: 00000000d75ce9ed (&dqp->q_qlock){+.+.}, at: xfs_dqlock fs/xfs/xfs_dquot.h:94 [inline]
#2: 00000000d75ce9ed (&dqp->q_qlock){+.+.}, at: xfs_qm_flush_one+0x9d/0x310 fs/xfs/xfs_qm.c:1223
3 locks held by syz-executor.5/11802:
#0: 00000000afce695d (sb_writers#4){.+.+}, at: file_start_write include/linux/fs.h:2779 [inline]
#0: 00000000afce695d (sb_writers#4){.+.+}, at: do_sendfile+0x97d/0xc30 fs/read_write.c:1446
#1: 00000000efa2e130 (shrinker_rwsem){++++}, at: shrink_slab+0xc7/0x550 mm/vmscan.c:683
#2: 000000002797ed08 (&qinf->qi_tree_lock){+.+.}, at: xfs_qm_dqfree_one+0x6f/0x1a0 fs/xfs/xfs_qm.c:1611
2 locks held by syz-executor.4/11844:
#0: 00000000e7bc5e1a (&type->s_umount_key#4/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
#0: 00000000e7bc5e1a (&type->s_umount_key#4/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
#1: 00000000efa2e130 (shrinker_rwsem){++++}, at: prealloc_memcg_shrinker mm/vmscan.c:194 [inline]
#1: 00000000efa2e130 (shrinker_rwsem){++++}, at: prealloc_shrinker+0x176/0x340 mm/vmscan.c:382
2 locks held by syz-executor.5/11846:
#0: 0000000004c2cafc (&type->s_umount_key#4/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
#0: 0000000004c2cafc (&type->s_umount_key#4/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
#1: 00000000efa2e130 (shrinker_rwsem){++++}, at: prealloc_memcg_shrinker mm/vmscan.c:194 [inline]
#1: 00000000efa2e130 (shrinker_rwsem){++++}, at: prealloc_shrinker+0x176/0x340 mm/vmscan.c:382

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1567 Comm: khungtaskd Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Call Trace:
__dump_stack lib/dump_stack.c:77 [inline]
dump_stack+0x1fc/0x2ef lib/dump_stack.c:118
nmi_cpu_backtrace.cold+0x63/0xa2 lib/nmi_backtrace.c:101
nmi_trigger_cpumask_backtrace+0x1a6/0x1f0 lib/nmi_backtrace.c:62
trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
check_hung_uninterruptible_tasks kernel/hung_task.c:203 [inline]
watchdog+0x991/0xe60 kernel/hung_task.c:287
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 4688 Comm: systemd-journal Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
RIP: 0010:__lock_release kernel/locking/lockdep.c:3684 [inline]
RIP: 0010:lock_release+0x264/0x8b0 kernel/locking/lockdep.c:3927
Code: fa 48 89 ee 4c 89 f7 e8 ba 72 ff ff 48 85 c0 0f 84 a9 03 00 00 48 8d 78 24 48 ba 00 00 00 00 00 fc ff df 48 89 f9 48 c1 e9 03 <0f> b6 0c 11 48 89 fa 83 e2 07 83 c2 03 38 ca 7c 08 84 c9 0f 85 19
RSP: 0018:ffff8880a12cfd98 EFLAGS: 00000807
RAX: ffff8880a12c4d08 RBX: ffffffff8d243760 RCX: 1ffff110142589a5
RDX: dffffc0000000000 RSI: ffff8880a1120c98 RDI: ffff8880a12c4d2c
RBP: ffff8880a1120c98 R08: 0000000000000001 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000000 R12: 1ffff11014259fb6
R13: ffffffff81a20828 R14: ffff8880a12c4480 R15: 0000000000000001
FS: 00007fc9879dd8c0(0000) GS:ffff8880ba100000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc984e0c000 CR3: 00000000a1307000 CR4: 00000000003406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
__raw_spin_unlock include/linux/spinlock_api_smp.h:150 [inline]
_raw_spin_unlock+0x17/0x40 kernel/locking/spinlock.c:176
do_sys_open+0x4f8/0x520 fs/open.c:1087
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7fc986f6c840
Code: 73 01 c3 48 8b 0d 68 77 20 00 f7 d8 64 89 01 48 83 c8 ff c3 66 0f 1f 44 00 00 83 3d 89 bb 20 00 00 75 10 b8 02 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 1e f6 ff ff 48 89 04 24
RSP: 002b:00007ffd6a772c38 EFLAGS: 00000246 ORIG_RAX: 0000000000000002
RAX: ffffffffffffffda RBX: 00007ffd6a772f40 RCX: 00007fc986f6c840
RDX: 00000000000001a0 RSI: 0000000000080042 RDI: 000055877fc74770
RBP: 000000000000000d R08: 000000000000ffc0 R09: 00000000ffffffff
R10: 0000000000000069 R11: 0000000000000246 R12: 00000000ffffffff
R13: 000055877fc6f040 R14: 00007ffd6a772f00 R15: 000055877fc74590


---
This report is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.

syzbot will keep track of this issue. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.

[syzbot]

Auto-closing this bug as obsolete.
Crashes did not happen for a while, no reproducer and no activity.