INFO: task hung in __generic_file_fsync

7 views
Skip to first unread message

syzbot

unread,
Dec 24, 2021, 10:26:23 PM12/24/21
to syzkaller...@googlegroups.com
Hello,

syzbot found the following issue on:

HEAD commit: 3f8a27f9e27b Linux 4.19.211
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=17649171b00000
kernel config: https://syzkaller.appspot.com/x/.config?x=9b9277b418617afe
dashboard link: https://syzkaller.appspot.com/bug?extid=375997d5567b1984518c
compiler: gcc version 10.2.1 20210110 (Debian 10.2.1-6)

Unfortunately, I don't have any reproducer for this issue yet.

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+375997...@syzkaller.appspotmail.com

ieee802154 phy1 wpan1: encryption failed: -22
Bluetooth: hci5: command 0x0406 tx timeout
Bluetooth: hci1: command 0x0406 tx timeout
ieee802154 phy0 wpan0: encryption failed: -22
ieee802154 phy1 wpan1: encryption failed: -22
INFO: task kworker/0:2:3557 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:2 D25696 3557 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:4:9335 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:4 D25264 9335 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:1:9034 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:1 D26208 9034 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:0:26491 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:0 D25712 26491 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task dio/sda1:19576 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
dio/sda1 D29936 19576 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
process_scheduled_works kernel/workqueue.c:2212 [inline]
rescuer_thread+0x5b4/0xce0 kernel/workqueue.c:2403
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:3:19916 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:3 D30056 19916 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task syz-executor.2:3167 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.2 D28384 3167 31359 0x00000004
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__inode_dio_wait fs/inode.c:2068 [inline]
inode_dio_wait+0x22a/0x270 fs/inode.c:2086
ext4_setattr+0x16c6/0x2560 fs/ext4/inode.c:5690
notify_change+0x70b/0xfc0 fs/attr.c:334
do_truncate+0x134/0x1f0 fs/open.c:63
do_sys_ftruncate+0x492/0x560 fs/open.c:194
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7fb22ac68e99
Code: Bad RIP value.
RSP: 002b:00007fb2295de168 EFLAGS: 00000246 ORIG_RAX: 000000000000004d
RAX: ffffffffffffffda RBX: 00007fb22ad7bf60 RCX: 00007fb22ac68e99
RDX: 0000000000000000 RSI: 0000000000208200 RDI: 0000000000000004
RBP: 00007fb22acc2ff1 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffd1dac826f R14: 00007fb2295de300 R15: 0000000000022000
INFO: task syz-executor.2:3178 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.2 D26432 3178 31359 0x00000004
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
ext4_file_write_iter+0x283/0xf20 fs/ext4/file.c:241
call_write_iter include/linux/fs.h:1821 [inline]
aio_write+0x37f/0x5c0 fs/aio.c:1574
__io_submit_one fs/aio.c:1858 [inline]
io_submit_one+0xecd/0x20c0 fs/aio.c:1909
__do_sys_io_submit fs/aio.c:1953 [inline]
__se_sys_io_submit+0x11b/0x4a0 fs/aio.c:1924
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7fb22ac68e99
Code: Bad RIP value.
RSP: 002b:00007fb2295bd168 EFLAGS: 00000246 ORIG_RAX: 00000000000000d1
RAX: ffffffffffffffda RBX: 00007fb22ad7c030 RCX: 00007fb22ac68e99
RDX: 0000000020000540 RSI: 0000000000000008 RDI: 00007fb22ad5e000
RBP: 00007fb22acc2ff1 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffd1dac826f R14: 00007fb2295bd300 R15: 0000000000022000
INFO: task kworker/0:5:3183 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:5 D29776 3183 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:6:3184 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:6 D29776 3184 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415

Showing all locks held in the system:
2 locks held by systemd/1:
#0: 000000009cbf6774 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272
#1: 0000000088eaea12 (&tty->atomic_write_lock){+.+.}, at: tty_write_lock drivers/tty/tty_io.c:886 [inline]
#1: 0000000088eaea12 (&tty->atomic_write_lock){+.+.}, at: do_tty_write drivers/tty/tty_io.c:909 [inline]
#1: 0000000088eaea12 (&tty->atomic_write_lock){+.+.}, at: tty_write+0x24e/0x810 drivers/tty/tty_io.c:1044
3 locks held by kworker/u4:3/227:
#0: 0000000063c62b42 (&rq->lock){-.-.}, at: idle_balance kernel/sched/fair.c:9702 [inline]
#0: 0000000063c62b42 (&rq->lock){-.-.}, at: pick_next_task_fair+0x556/0x1570 kernel/sched/fair.c:6841
#1: 00000000297b5a92 (rcu_read_lock){....}, at: cpu_of kernel/sched/sched.h:923 [inline]
#1: 00000000297b5a92 (rcu_read_lock){....}, at: __update_idle_core+0x39/0x3e0 kernel/sched/fair.c:6057
#2: 000000003784fbad (&base->lock){-.-.}, at: lock_timer_base+0x55/0x1b0 kernel/time/timer.c:950
1 lock held by khungtaskd/1570:
#0: 00000000297b5a92 (rcu_read_lock){....}, at: debug_show_all_locks+0x53/0x265 kernel/locking/lockdep.c:4441
3 locks held by kworker/0:2/3557:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000043d8202b ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
1 lock held by systemd-journal/4686:
#0: 0000000063c62b42 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1826 [inline]
#0: 0000000063c62b42 (&rq->lock){-.-.}, at: __schedule+0x1f9/0x2040 kernel/sched/core.c:3455
2 locks held by in:imklog/7812:
#0: 000000003534cac1 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0x26f/0x310 fs/file.c:767
#1: 00000000297b5a92 (rcu_read_lock){....}, at: is_bpf_text_address+0x0/0x1b0 kernel/bpf/core.c:533
3 locks held by kworker/0:4/9335:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000002272d234 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:1/9034:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009109d552 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:0/26491:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000006ee4c311 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by dio/sda1/19576:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000567413c1 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:3/19916:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000e905247d ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
2 locks held by agetty/31377:
#0: 00000000df7cdba6 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272
#1: 00000000d7d088e3 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1950 drivers/tty/n_tty.c:2154
2 locks held by syz-executor.2/3167:
#0: 00000000f803baba (sb_writers#3){.+.+}, at: sb_start_write include/linux/fs.h:1579 [inline]
#0: 00000000f803baba (sb_writers#3){.+.+}, at: do_sys_ftruncate+0x297/0x560 fs/open.c:189
#1: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#1: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: do_truncate+0x125/0x1f0 fs/open.c:61
1 lock held by syz-executor.2/3178:
#0: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#0: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: ext4_file_write_iter+0x283/0xf20 fs/ext4/file.c:241
3 locks held by kworker/0:5/3183:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000e1089198 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:6/3184:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000006592b30e ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:7/3185:
#0: 000000000cead23f ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000068fdea12 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 0000000065a83bad (&sb->s_type->i_mutex_key#10){++++}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1570 Comm: khungtaskd Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
__dump_stack lib/dump_stack.c:77 [inline]
dump_stack+0x1fc/0x2ef lib/dump_stack.c:118
nmi_cpu_backtrace.cold+0x63/0xa2 lib/nmi_backtrace.c:101
nmi_trigger_cpumask_backtrace+0x1a6/0x1f0 lib/nmi_backtrace.c:62
trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
check_hung_uninterruptible_tasks kernel/hung_task.c:203 [inline]
watchdog+0x991/0xe60 kernel/hung_task.c:287
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 4686 Comm: systemd-journal Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:unwind_next_frame+0x41a/0x1400 arch/x86/kernel/unwind_orc.c:427
Code: 01 00 00 8b 90 60 02 00 00 4c 89 f9 4c 89 c7 e8 3c f2 ff ff 48 85 c0 49 89 c7 74 6a 4d 8d 47 04 48 b8 00 00 00 00 00 fc ff df <4c> 89 c2 48 c1 ea 03 0f b6 04 02 4c 89 c2 83 e2 07 38 d0 7f 08 84
RSP: 0018:ffff8880a12176c8 EFLAGS: 00000286
RAX: dffffc0000000000 RBX: 1ffff11014242ee2 RCX: ffffffff81a206e2
RDX: 0000000000000000 RSI: ffffffff8b9a9336 RDI: ffffffff8b3979d8
RBP: 0000000000000001 R08: ffffffff8b9a936a R09: ffffffff8b9a9336
R10: ffff8880a1217857 R11: 0000000000074071 R12: ffff8880a1217840
R13: ffff8880a121782d R14: ffff8880a12177f8 R15: ffffffff8b9a9366
FS: 00007f9c8afeb8c0(0000) GS:ffff8880ba100000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9c86d57028 CR3: 00000000a15fa000 CR4: 00000000003406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
__save_stack_trace+0x9f/0x190 arch/x86/kernel/stacktrace.c:44
save_stack mm/kasan/kasan.c:448 [inline]
set_track mm/kasan/kasan.c:460 [inline]
kasan_kmalloc+0xeb/0x160 mm/kasan/kasan.c:553
slab_post_alloc_hook mm/slab.h:445 [inline]
slab_alloc mm/slab.c:3397 [inline]
kmem_cache_alloc+0x110/0x370 mm/slab.c:3557
kmem_cache_zalloc include/linux/slab.h:699 [inline]
__alloc_file+0x21/0x340 fs/file_table.c:100
alloc_empty_file+0x6d/0x170 fs/file_table.c:150
path_openat+0xe9/0x2df0 fs/namei.c:3526
do_filp_open+0x18c/0x3f0 fs/namei.c:3567
do_sys_open+0x3b3/0x520 fs/open.c:1085
do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f9c8a57a85d
Code: bb 20 00 00 75 10 b8 02 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 1e f6 ff ff 48 89 04 24 b8 02 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 67 f6 ff ff 48 89 d0 48 83 c4 08 48 3d 01
RSP: 002b:00007fffcecd8360 EFLAGS: 00000293 ORIG_RAX: 0000000000000002
RAX: ffffffffffffffda RBX: 00007fffcecd8670 RCX: 00007f9c8a57a85d
RDX: 00000000000001a0 RSI: 0000000000080042 RDI: 000055b082b42d20
RBP: 000000000000000d R08: 0000000000000000 R09: 00000000ffffffff
R10: 0000000000000069 R11: 0000000000000293 R12: 00000000ffffffff
R13: 000055b082b3f040 R14: 00007fffcecd8630 R15: 000055b082b49e80
----------------
Code disassembly (best guess):
0: 01 00 add %eax,(%rax)
2: 00 8b 90 60 02 00 add %cl,0x26090(%rbx)
8: 00 4c 89 f9 add %cl,-0x7(%rcx,%rcx,4)
c: 4c 89 c7 mov %r8,%rdi
f: e8 3c f2 ff ff callq 0xfffff250
14: 48 85 c0 test %rax,%rax
17: 49 89 c7 mov %rax,%r15
1a: 74 6a je 0x86
1c: 4d 8d 47 04 lea 0x4(%r15),%r8
20: 48 b8 00 00 00 00 00 movabs $0xdffffc0000000000,%rax
27: fc ff df
* 2a: 4c 89 c2 mov %r8,%rdx <-- trapping instruction
2d: 48 c1 ea 03 shr $0x3,%rdx
31: 0f b6 04 02 movzbl (%rdx,%rax,1),%eax
35: 4c 89 c2 mov %r8,%rdx
38: 83 e2 07 and $0x7,%edx
3b: 38 d0 cmp %dl,%al
3d: 7f 08 jg 0x47
3f: 84 .byte 0x84


---
This report is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.

syzbot will keep track of this issue. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.

syzbot

unread,
Feb 7, 2022, 3:09:28 AM2/7/22
to syzkaller...@googlegroups.com
syzbot has found a reproducer for the following issue on:

HEAD commit: 3f8a27f9e27b Linux 4.19.211
git tree: linux-4.19.y
console output: https://syzkaller.appspot.com/x/log.txt?x=101ea5dc700000
kernel config: https://syzkaller.appspot.com/x/.config?x=9b9277b418617afe
dashboard link: https://syzkaller.appspot.com/bug?extid=375997d5567b1984518c
compiler: gcc version 10.2.1 20210110 (Debian 10.2.1-6)
syz repro: https://syzkaller.appspot.com/x/repro.syz?x=12a06e62700000
C reproducer: https://syzkaller.appspot.com/x/repro.c?x=12fa902c700000

IMPORTANT: if you fix the issue, please add the following tag to the commit:
Reported-by: syzbot+375997...@syzkaller.appspotmail.com

INFO: task kworker/0:1:14 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:1 D27000 14 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:2:3688 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:2 D28216 3688 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:0:8130 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:0 D28216 8130 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:3:8131 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:3 D28216 8131 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:4:8132 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:4 D28216 8132 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:5:8133 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:5 D28216 8133 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:6:8134 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:6 D28216 8134 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:7:8135 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:7 D28216 8135 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:8:8136 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:8 D28216 8136 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task kworker/0:9:8137 blocked for more than 140 seconds.
Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/0:9 D28216 8137 2 0x80000000
Workqueue: dio/sda1 dio_aio_complete_work
Call Trace:
context_switch kernel/sched/core.c:2828 [inline]
__schedule+0x887/0x2040 kernel/sched/core.c:3517
schedule+0x8d/0x1b0 kernel/sched/core.c:3561
__rwsem_down_write_failed_common kernel/locking/rwsem-xadd.c:589 [inline]
rwsem_down_write_failed+0x3aa/0x760 kernel/locking/rwsem-xadd.c:618
call_rwsem_down_write_failed+0x13/0x20 arch/x86/lib/rwsem.S:117
__down_write arch/x86/include/asm/rwsem.h:142 [inline]
down_write+0x4f/0x90 kernel/locking/rwsem.c:72
inode_lock include/linux/fs.h:748 [inline]
__generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
ext4_sync_file+0xa35/0x1420 fs/ext4/fsync.c:118
vfs_fsync_range+0x13a/0x220 fs/sync.c:197
generic_write_sync include/linux/fs.h:2750 [inline]
dio_complete+0x763/0xac0 fs/direct-io.c:329
process_one_work+0x864/0x1570 kernel/workqueue.c:2153
worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
kthread+0x33f/0x460 kernel/kthread.c:259
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415

Showing all locks held in the system:
3 locks held by kworker/0:1/14:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000011e5df8e ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
1 lock held by khungtaskd/1571:
#0: 0000000031a5f4bb (rcu_read_lock){....}, at: debug_show_all_locks+0x53/0x265 kernel/locking/lockdep.c:4441
3 locks held by kworker/0:2/3688:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000014629dc7 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:0/8130:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000f3eb7e14 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:3/8131:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000a3479c56 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:4/8132:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000005aba42ce ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:5/8133:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000007602e7e ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:6/8134:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000fddd1a69 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:7/8135:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009f3f8a8a ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:8/8136:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000004c4a022b ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:9/8137:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000ab324502 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:10/8138:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000c8f349a4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:11/8139:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000046848c2c ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:12/8140:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000e57921e5 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:13/8141:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000008eb03ac4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:14/8142:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000412ba6a7 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:15/8143:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000001990c877 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:16/8144:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000041143cd4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:17/8145:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000413fbed0 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:18/8146:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000008db16fc6 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:19/8147:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000031d11d62 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:20/8148:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009e7adc07 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:21/8149:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000c64fa5c2 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:22/8150:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000f9c52351 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:23/8151:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000a76e8973 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:24/8152:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000005851403a ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:25/8153:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000d1f0f66d ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:26/8154:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000044c92e39 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:27/8155:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000074b93d47 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:28/8156:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000000c713006 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:29/8157:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000017682bfb ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:30/8158:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000584a2db3 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:31/8159:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000f9490802 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:32/8160:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009eb661e1 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:33/8161:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000778c43a3 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:34/8162:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000047cc54bb ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:35/8163:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000000f2da5a4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:36/8164:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000005a748188 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:37/8165:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000d780d02f ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:38/8166:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000040162b1b ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:39/8167:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000007be82a6f ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:40/8168:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000002410ce49 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:41/8169:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000f11825bf ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:42/8170:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000000b69d415 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:43/8171:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000d5126839 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:44/8172:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000e61d8331 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:45/8173:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000d9860308 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:46/8174:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000cb2bf7f7 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:47/8175:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000000f31ea90 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:48/8176:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009448e727 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:49/8177:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000290405d5 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:50/8178:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000b7b45828 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:51/8179:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000163ec000 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:52/8180:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000766e0a08 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:53/8181:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000001e64e7ff ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:54/8182:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000094060da ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:55/8183:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000dc95674e ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:56/8184:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000029182c50 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:57/8185:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000381c9387 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:58/8186:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000003a68de91 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:59/8187:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000bcc663f3 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:60/8188:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000f8d94c92 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:61/8189:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000005d12cbf4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:62/8190:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000403875be ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:63/8191:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000006a345b56 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:64/8192:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000a1dd3b20 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:65/8193:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000002718c396 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:66/8194:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000a6393f06 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:67/8195:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000052f0486b ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:68/8196:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000d39f5cc5 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:69/8197:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000002f2b9f59 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:70/8198:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000003f60f0a7 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:71/8199:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000aa098484 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:72/8200:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000008219d2c2 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:73/8201:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000ef79ab2e ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:74/8202:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000a12979ae ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:75/8203:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000e607f2cc ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:76/8204:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000e9a07d91 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:77/8205:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000859cdb97 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:78/8206:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000fd5fde52 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:79/8207:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000c8725576 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:80/8208:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000f30d55e3 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:81/8209:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009458c3dd ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:82/8210:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000afd0f981 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:83/8211:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000007fcd1f99 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:84/8212:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000003bf70b38 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:85/8213:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000968aeca4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:86/8214:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000001c2e38e4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:87/8215:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000cf39c512 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:88/8216:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000069585448 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:89/8217:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000c33b59d0 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:90/8218:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000001eccc0a1 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:91/8219:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000004fdbab1c ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:92/8220:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000081aa453b ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:93/8221:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000be98ddf7 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:94/8222:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000024c69e41 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:95/8223:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000052c3cf08 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:96/8224:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000048f19b4 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:97/8225:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000a7b9ef8c ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:98/8226:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000009f292fcd ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:99/8227:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000ad916198 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:100/8228:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000018e4b830 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:101/8229:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000ad445618 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:102/8230:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 00000000484a8703 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:103/8231:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000021a3bda1 ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:104/8232:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 000000008649072f ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:105/8233:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570 kernel/workqueue.c:2124
#1: 0000000055eeb8fa ((work_completion)(&dio->complete_work)){+.+.}, at: process_one_work+0x79c/0x1570 kernel/workqueue.c:2128
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: inode_lock include/linux/fs.h:748 [inline]
#2: 00000000ad5df3b7 (&sb->s_type->i_mutex_key#10){+.+.}, at: __generic_file_fsync+0xb0/0x1f0 fs/libfs.c:989
3 locks held by kworker/0:106/8234:
#0: 0000000039f8ce27 ((wq_completion)"dio/%s"sb->s_id){+.+.}, at: process_one_work+0x767/0x1570
Reply all
Reply to author
Forward
0 new messages