Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
Bug#1007141: BUG Report - OCFS2 Hangs when mount volume in second node
344 views
Skip to first unread message
Dayvison
Mar 11, 2022, 4:50:03 PM3/11/22
to
Package: ocfs2-tools
Version: 8.7.1 and 8.6.6
Hi, I'm sending this email to report a problem:
OCFS2 filesystem with more than 1 node is not working with Debian 11 with 5.13, 5.15 and newer kernels.
OK, what's the problem behavior? Answer: When you mount ocfs2 on the second node with the "mount" command, the second node is stuck and unresponsive at the prompt, when viewing /var/log/syslog, there are several error messages in /var/log/syslog and no mounting the ocfs volume on the second node.
The ocfs2-tools that is in Debian 11 is version 8.6.6 (debian stable) and something changed in kernel 5.13 and 5.15 that stopped OCFS2 working when mounting the volume on the second node onwards.
When using the 8.7.1 version (available from debian testing) of ocfs-tools on the 5.13 and 5.15 kernels, the filesystem worked correctly again on the second node.
But in kernel 5.17 versions 8.6.6 and 8.7.1 no longer work.
So I see two problems:
1 - Version 8.6.6 of ocfs2-tools is no longer sufficient for kernel 5.13 and 5.15 from linux repository and will need to be replaced soon by version 8.7.1;
2 - Version 8.7.1 is enough to work on 5.13 and 5.15 kernels, however, it no longer works on 5.17 kernel and the ocfs2-tools package needs to be corrected for a new version of this kernel or other newer versions.
How to reproduce the problem:
1 - Configure the ocfs2 cluster and format the volume as ocfs2;
2 - mount the volume with the "mount" command on the first node
3 - mount the volume with the "mount" command on the second node"
4 - At this moment, the second node will have no response and messages in the syslog of failures, and the client will be stuck waiting for the assembly, which does not happen.
Tested environment:
System: Debian 11 64bit
Tested kernels to help developers:
4.9.0-13-amd64 + ocfs2-tools 8.6.6 (stable) = works
4.9.0-13-amd64 + ocfs2-tools 8.7.1 (sid) = works
5.10.6-1 + ocfs2-tools 8.6.6 (stable) = works
5.10.6-1 + ocfs2-tools 8.7.1 (sid) = works
5.10.0-11-amd64 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.10.0-11-amd64 + ocfs2-tools 8.7.1 (sid) = works
5.13.19-4 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.13.19-4 + ocfs2-tools 8.7.1 (sid) = works
5.14.0-0.bpo.2-amd64 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
5.15.0-0.bpo.3-amd64 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.15.0-0.bpo.3-amd64 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
5.15.19-2 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.15.19-2 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
5.17-rc5-amd64 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.17-rc5-amd64 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
Hope it helps to find the problem. It would be interesting to report this to the OCFS2 developers, I don't know how to do this. If anyone knows and can help with this, I would be grateful.
Version: 8.7.1 and 8.6.6
Hi, I'm sending this email to report a problem:
OCFS2 filesystem with more than 1 node is not working with Debian 11 with 5.13, 5.15 and newer kernels.
OK, what's the problem behavior? Answer: When you mount ocfs2 on the second node with the "mount" command, the second node is stuck and unresponsive at the prompt, when viewing /var/log/syslog, there are several error messages in /var/log/syslog and no mounting the ocfs volume on the second node.
The ocfs2-tools that is in Debian 11 is version 8.6.6 (debian stable) and something changed in kernel 5.13 and 5.15 that stopped OCFS2 working when mounting the volume on the second node onwards.
When using the 8.7.1 version (available from debian testing) of ocfs-tools on the 5.13 and 5.15 kernels, the filesystem worked correctly again on the second node.
But in kernel 5.17 versions 8.6.6 and 8.7.1 no longer work.
So I see two problems:
1 - Version 8.6.6 of ocfs2-tools is no longer sufficient for kernel 5.13 and 5.15 from linux repository and will need to be replaced soon by version 8.7.1;
2 - Version 8.7.1 is enough to work on 5.13 and 5.15 kernels, however, it no longer works on 5.17 kernel and the ocfs2-tools package needs to be corrected for a new version of this kernel or other newer versions.
How to reproduce the problem:
1 - Configure the ocfs2 cluster and format the volume as ocfs2;
2 - mount the volume with the "mount" command on the first node
3 - mount the volume with the "mount" command on the second node"
4 - At this moment, the second node will have no response and messages in the syslog of failures, and the client will be stuck waiting for the assembly, which does not happen.
Tested environment:
System: Debian 11 64bit
Tested kernels to help developers:
4.9.0-13-amd64 + ocfs2-tools 8.6.6 (stable) = works
4.9.0-13-amd64 + ocfs2-tools 8.7.1 (sid) = works
5.10.6-1 + ocfs2-tools 8.6.6 (stable) = works
5.10.6-1 + ocfs2-tools 8.7.1 (sid) = works
5.10.0-11-amd64 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.10.0-11-amd64 + ocfs2-tools 8.7.1 (sid) = works
5.13.19-4 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.13.19-4 + ocfs2-tools 8.7.1 (sid) = works
5.14.0-0.bpo.2-amd64 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
5.15.0-0.bpo.3-amd64 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.15.0-0.bpo.3-amd64 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
5.15.19-2 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.15.19-2 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
5.17-rc5-amd64 + ocfs2-tools 8.6.6 (stable) = DOES NOT WORK
5.17-rc5-amd64 + ocfs2-tools 8.7.1 (sid) = DOES NOT WORK
Hope it helps to find the problem. It would be interesting to report this to the OCFS2 developers, I don't know how to do this. If anyone knows and can help with this, I would be grateful.
Valentin Vidic
Mar 13, 2022, 10:40:03 AM3/13/22
to
On Fri, Mar 11, 2022 at 06:45:32PM -0300, Dayvison wrote:
> Package: ocfs2-tools
> Version: 8.7.1 and 8.6.6
>
> Hi, I'm sending this email to report a problem:
>
> OCFS2 filesystem with more than 1 node is not working with Debian 11
> with 5.13, 5.15 and newer kernels.
>
> OK, what's the problem behavior? Answer: When you mount ocfs2 on the
> second node with the "mount" command, the second node is stuck and
> unresponsive at the prompt, when viewing /var/log/syslog, there are
> several error messages in /var/log/syslog and no mounting the ocfs
> volume on the second node.
Thanks for the report, I will try to reproduce the problem with the
> Package: ocfs2-tools
> Version: 8.7.1 and 8.6.6
>
> Hi, I'm sending this email to report a problem:
>
> OCFS2 filesystem with more than 1 node is not working with Debian 11
> with 5.13, 5.15 and newer kernels.
>
> OK, what's the problem behavior? Answer: When you mount ocfs2 on the
> second node with the "mount" command, the second node is stuck and
> unresponsive at the prompt, when viewing /var/log/syslog, there are
> several error messages in /var/log/syslog and no mounting the ocfs
> volume on the second node.
versions in unstable, but it would be good if you could share the errors
that are being reported and perhaps also the cluster configuration for
reproducing this problem.
Also I assume you mean ocfs2-tools versions 1.8.6-6 and 1.8.7-1 that
are available in stable and testing, since the versions you listed
(8.7.1 and 8.6.6) do not exist in Debian?
--
Valentin
Dayvison Sathler
Mar 14, 2022, 5:30:03 PM3/14/22
to
I made a mistake in the nomenclature of the versions of ocfs2-tools. Excuse me.
The correct bug information is for versions 1.8.7-1 (testing) and 1.8.6-6 (stable) of ocfs2-tools.
I'm putting the settings of my test environment and also the error outputs caused when using the "mount" command on the second node. I have another new information: In kernel 5.17, the problem already occurs when trying to mount on the first node. The other kernels, the error only happens with the second node onwards.
My configuration:
# multipath -ll
ISCSI-VOL1 (360014050c13f5ba581b4d90beb578f4e) dm-0 LIO-ORG,md_block0
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
|- 6:0:0:1 sda 8:0 active ready running
|- 9:0:0:1 sdd 8:48 active ready running
|- 8:0:0:1 sdc 8:32 active ready running
`- 7:0:0:1 sdb 8:16 active ready running
The volume was formated with command below:
# mkfs.ocfs2 --fs-feature-level=max-features -T vmstore -L "OCFS2_VOL1" /dev/mapper/ISCSI-VOL1
Simple Cluster configuration (node1 and node2):
# cat /etc/ocfs2/cluster.conf
cluster:
name = ocfs2cluster
heartbeat_mode = local
node_count = 2
node:
cluster = ocfs2cluster
number = 0
ip_port = 7777
ip_address = 172.16.10.10
name = cliente1
node:
cluster = ocfs2cluster
number = 1
ip_port = 7777
ip_address = 172.16.10.20
name = cliente2
Startup configuration (node1 and node2):
# cat /etc/default/o2cb
O2CB_ENABLED=true
O2CB_BOOTCLUSTER=ocfs2cluster
O2CB_HEARTBEAT_THRESHOLD=31
O2CB_IDLE_TIMEOUT_MS=30000
O2CB_KEEPALIVE_DELAY_MS=2000
O2CB_RECONNECT_DELAY_MS=2000
On node 1:
# mount -t ocfs2 /dev/mapper/ISCSI-VOL1 /mnt/ ( results mount OK )
On node 2:
# mount -t ocfs2 /dev/mapper/ISCSI-VOL1 /mnt/ ( system hangs on mount and show error messages in /var/log/syslog after some time )
********************************************************
Results (kernels + ocfs2-tools versions):
with KERNEL 5.17.0-rc5-amd64 + OCFS2-TOOLS 1.8.7-1:
output messages in /var/log/syslog on node 2 when mount:
----NODE 1 - Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sda
Mar 14 18:02:33 cliente1 kernel: [ 110.514499] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 18:02:33 cliente1 kernel: [ 110.514507] (
Mar 14 18:02:33 cliente1 kernel: [ 110.514508] 0
Mar 14 18:02:33 cliente1 kernel: [ 110.514509] ) 1 nodes
Mar 14 18:02:33 cliente1 kernel: [ 110.592656] ocfs2: Mounting device (253,0) on (node 0, slot 1) with ordered data mode.
Mar 14 18:02:33 cliente1 kernel: [ 110.595170] ocfs2: Begin replay journal (node 1, slot 0) on device (253,0)
Mar 14 18:02:33 cliente1 kernel: [ 110.603091] ocfs2: End replay journal (node 1, slot 0) on device (253,0)
Mar 14 18:02:33 cliente1 kernel: [ 110.603126] BUG: kernel NULL pointer dereference, address: 0000000000000398
Mar 14 18:02:33 cliente1 kernel: [ 110.603199] #PF: supervisor read access in kernel mode
Mar 14 18:02:33 cliente1 kernel: [ 110.603234] #PF: error_code(0x0000) - not-present page
Mar 14 18:02:33 cliente1 kernel: [ 110.603264] PGD 0 P4D 0
Mar 14 18:02:33 cliente1 kernel: [ 110.603279] Oops: 0000 [#1] PREEMPT SMP NOPTI
Mar 14 18:02:33 cliente1 kernel: [ 110.603297] CPU: 2 PID: 747 Comm: mount.ocfs2 Not tainted 5.17.0-rc5-amd64 #1 Debian 5.17~rc5-1~exp1
Mar 14 18:02:33 cliente1 kernel: [ 110.603324] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.14.0-2 04/01/2014
Mar 14 18:02:33 cliente1 kernel: [ 110.603578] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.603675] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 60 c9 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:02:33 cliente1 kernel: [ 110.603738] RSP: 0018:ffffb60c00677be8 EFLAGS: 00010282
Mar 14 18:02:33 cliente1 kernel: [ 110.603768] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c960a0
Mar 14 18:02:33 cliente1 kernel: [ 110.603803] RDX: 0000000000000008 RSI: ffff9661c3fba430 RDI: ffffb60c00677bb8
Mar 14 18:02:33 cliente1 kernel: [ 110.603830] RBP: ffff9661c3fba400 R08: ffff9661c3fba400 R09: 0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.603945] R10: ffffb60c00677bb0 R11: ffffffffc0c57030 R12: ffff9661c3fba418
Mar 14 18:02:33 cliente1 kernel: [ 110.603970] R13: ffff9661f4ec1588 R14: 0000000000000000 R15: ffff9661c860c800
Mar 14 18:02:33 cliente1 kernel: [ 110.604002] FS: 00007fc0ee21a7c0(0000) GS:ffff96623dd00000(0000) knlGS:0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.604024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:02:33 cliente1 kernel: [ 110.604040] CR2: 0000000000000398 CR3: 0000000034390000 CR4: 0000000000350ee0
Mar 14 18:02:33 cliente1 kernel: [ 110.604062] Call Trace:
Mar 14 18:02:33 cliente1 kernel: [ 110.604076] <TASK>
Mar 14 18:02:33 cliente1 kernel: [ 110.604085] ocfs2_local_read_info+0xb9/0x6f0 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604147] ? ocfs2_local_check_quota_file+0x197/0x390 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604192] dquot_load_quota_sb+0x216/0x470
Mar 14 18:02:33 cliente1 kernel: [ 110.604230] ? preempt_count_add+0x68/0xa0
Mar 14 18:02:33 cliente1 kernel: [ 110.604244] dquot_load_quota_inode+0x85/0x100
Mar 14 18:02:33 cliente1 kernel: [ 110.604258] ocfs2_enable_quotas+0xa0/0x1c0 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604300] ocfs2_fill_super.cold+0xc8/0x1bf [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604367] mount_bdev+0x185/0x1b0
Mar 14 18:02:33 cliente1 kernel: [ 110.604386] ? ocfs2_initialize_super.isra.0+0xf40/0xf40 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604608] legacy_get_tree+0x27/0x40
Mar 14 18:02:33 cliente1 kernel: [ 110.604658] vfs_get_tree+0x25/0xb0
Mar 14 18:02:33 cliente1 kernel: [ 110.604692] path_mount+0x465/0xac0
Mar 14 18:02:33 cliente1 kernel: [ 110.604733] __x64_sys_mount+0x103/0x140
Mar 14 18:02:33 cliente1 kernel: [ 110.604761] do_syscall_64+0x3b/0xc0
Mar 14 18:02:33 cliente1 kernel: [ 110.604782] entry_SYSCALL_64_after_hwframe+0x44/0xae
Mar 14 18:02:33 cliente1 kernel: [ 110.604805] RIP: 0033:0x7fc0ee6dd9ea
Mar 14 18:02:33 cliente1 kernel: [ 110.604825] Code: 48 8b 0d a9 f4 0b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 f4 0b 00 f7 d8 64 89 01 48
Mar 14 18:02:33 cliente1 kernel: [ 110.604880] RSP: 002b:00007fffec053988 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 18:02:33 cliente1 kernel: [ 110.604907] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fc0ee6dd9ea
Mar 14 18:02:33 cliente1 kernel: [ 110.604930] RDX: 000055af2d1680ae RSI: 000055af2e821370 RDI: 000055af2e8283b0
Mar 14 18:02:33 cliente1 kernel: [ 110.604955] RBP: 00007fffec053b40 R08: 000055af2e821fe0 R09: 00007fffec0525e0
Mar 14 18:02:33 cliente1 kernel: [ 110.604979] R10: 0000000000000000 R11: 0000000000000246 R12: 000055af2d1680ae
Mar 14 18:02:33 cliente1 kernel: [ 110.605004] R13: 000055af2e821301 R14: 00007fffec053a30 R15: 00007fffec0539b0
Mar 14 18:02:33 cliente1 kernel: [ 110.605833] </TASK>
Mar 14 18:02:33 cliente1 kernel: [ 110.606566] Modules linked in: ocfs2 quota_tree dm_round_robin ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager sd_mod t10_pi crc_t10dif ocfs2_stackglue crct10dif_generic sg intel_rapl_msr intel_rapl_common kvm_amd ccp kvm irqbypass ghash_clmulni_intel snd_hda_codec_generic ledtrig_audio snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec snd_hda_core qxl aesni_intel snd_hwdep drm_ttm_helper ttm snd_pcm evdev crypto_simd cryptd serio_raw drm_kms_helper pcspkr snd_timer virtio_console cec virtio_balloon snd rc_core soundcore qemu_fw_cfg button ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi drm scsi_transport_iscsi fuse configfs virtio_rng rng_core ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua ahci libahci libata xhci_pci crct10dif_pclmul crct10dif_common crc32_pclmul xhci_hcd virtio_net virtio_blk net_failover failover usbcore scsi_mod virtio_pci virtio_pci_legacy_dev
Mar 14 18:02:33 cliente1 kernel: [ 110.606627] virtio_pci_modern_dev i2c_i801 virtio crc32c_intel psmouse usb_common scsi_common i2c_smbus lpc_ich virtio_ring
Mar 14 18:02:33 cliente1 kernel: [ 110.614517] CR2: 0000000000000398
Mar 14 18:02:33 cliente1 kernel: [ 110.615696] ---[ end trace 0000000000000000 ]---
Mar 14 18:02:33 cliente1 kernel: [ 110.616451] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.617005] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 60 c9 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:02:33 cliente1 kernel: [ 110.618045] RSP: 0018:ffffb60c00677be8 EFLAGS: 00010282
Mar 14 18:02:33 cliente1 kernel: [ 110.618866] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c960a0
Mar 14 18:02:33 cliente1 kernel: [ 110.619613] RDX: 0000000000000008 RSI: ffff9661c3fba430 RDI: ffffb60c00677bb8
Mar 14 18:02:33 cliente1 kernel: [ 110.620969] RBP: ffff9661c3fba400 R08: ffff9661c3fba400 R09: 0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.621678] R10: ffffb60c00677bb0 R11: ffffffffc0c57030 R12: ffff9661c3fba418
Mar 14 18:02:33 cliente1 kernel: [ 110.622340] R13: ffff9661f4ec1588 R14: 0000000000000000 R15: ffff9661c860c800
Mar 14 18:02:33 cliente1 kernel: [ 110.622912] FS: 00007fc0ee21a7c0(0000) GS:ffff96623dd00000(0000) knlGS:0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.623679] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:02:33 cliente1 kernel: [ 110.624330] CR2: 0000000000000398 CR3: 0000000034390000 CR4: 0000000000350ee0
Mar 14 18:02:33 cliente1 kernel: [ 110.665635] ocfs2: Beginning quota recovery on device (253,0) for slot 0
Mar 14 18:02:59 cliente1 kernel: [ 137.283021] o2net: Accepted connection from node cliente2 (num 1) at 172.16.10.20:7777
Mar 14 18:03:04 cliente1 kernel: [ 141.497434] o2dlm: Node 1 joins domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 18:03:04 cliente1 kernel: [ 141.497442] (
Mar 14 18:03:04 cliente1 kernel: [ 141.498856] 0
Mar 14 18:03:04 cliente1 kernel: [ 141.500356] 1
Mar 14 18:03:04 cliente1 kernel: [ 141.501859] ) 2 nodes
----End OUTPUT ERROR----------
----NODE 2 - Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 18:02:59 cliente2 kernel: [ 131.087051] o2net: Connected to node cliente1 (num 0) at 172.16.10.10:7777
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sda
Mar 14 18:03:04 cliente2 kernel: [ 135.310692] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 18:03:04 cliente2 kernel: [ 135.310706] (
Mar 14 18:03:04 cliente2 kernel: [ 135.310708] 0
Mar 14 18:03:04 cliente2 kernel: [ 135.310710] 1
Mar 14 18:03:04 cliente2 kernel: [ 135.310711] ) 2 nodes
Mar 14 18:03:04 cliente2 kernel: [ 135.389862] ocfs2: Mounting device (253,0) on (node 1, slot 0) with ordered data mode.
Mar 14 18:03:04 cliente2 kernel: [ 135.399047] BUG: kernel NULL pointer dereference, address: 0000000000000398
Mar 14 18:03:04 cliente2 kernel: [ 135.399126] #PF: supervisor read access in kernel mode
Mar 14 18:03:04 cliente2 kernel: [ 135.399160] #PF: error_code(0x0000) - not-present page
Mar 14 18:03:04 cliente2 kernel: [ 135.399194] PGD 0 P4D 0
Mar 14 18:03:04 cliente2 kernel: [ 135.399216] Oops: 0000 [#1] PREEMPT SMP NOPTI
Mar 14 18:03:04 cliente2 kernel: [ 135.399248] CPU: 1 PID: 740 Comm: mount.ocfs2 Not tainted 5.17.0-rc5-amd64 #1 Debian 5.17~rc5-1~exp1
Mar 14 18:03:04 cliente2 kernel: [ 135.399306] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.14.0-2 04/01/2014
Mar 14 18:03:04 cliente2 kernel: [ 135.399355] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.399481] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 e0 c3 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:03:04 cliente2 kernel: [ 135.399590] RSP: 0018:ffffa188406bfbe8 EFLAGS: 00010282
Mar 14 18:03:04 cliente2 kernel: [ 135.399625] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c3e0a0
Mar 14 18:03:04 cliente2 kernel: [ 135.399669] RDX: 0000000000000008 RSI: ffff9150c4351c30 RDI: ffffa188406bfbb8
Mar 14 18:03:04 cliente2 kernel: [ 135.399712] RBP: ffff9150c4351c00 R08: ffff9150c4351c00 R09: 0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.399756] R10: ffffa188406bfbb0 R11: ffffffffc0bff030 R12: ffff9150c4351c18
Mar 14 18:03:04 cliente2 kernel: [ 135.399798] R13: ffff9150f447b688 R14: 0000000000000000 R15: ffff9150c4952000
Mar 14 18:03:04 cliente2 kernel: [ 135.399849] FS: 00007fd4424f97c0(0000) GS:ffff91513dc80000(0000) knlGS:0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.399899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:03:04 cliente2 kernel: [ 135.399935] CR2: 0000000000000398 CR3: 0000000005872000 CR4: 0000000000350ee0
Mar 14 18:03:04 cliente2 kernel: [ 135.399984] Call Trace:
Mar 14 18:03:04 cliente2 kernel: [ 135.400006] <TASK>
Mar 14 18:03:04 cliente2 kernel: [ 135.400023] ocfs2_local_read_info+0xb9/0x6f0 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400148] ? ocfs2_local_check_quota_file+0x197/0x390 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400263] dquot_load_quota_sb+0x216/0x470
Mar 14 18:03:04 cliente2 kernel: [ 135.400319] ? preempt_count_add+0x68/0xa0
Mar 14 18:03:04 cliente2 kernel: [ 135.400351] dquot_load_quota_inode+0x85/0x100
Mar 14 18:03:04 cliente2 kernel: [ 135.400382] ocfs2_enable_quotas+0xa0/0x1c0 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400489] ocfs2_fill_super.cold+0xc8/0x1bf [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400611] mount_bdev+0x185/0x1b0
Mar 14 18:03:04 cliente2 kernel: [ 135.400639] ? ocfs2_initialize_super.isra.0+0xf40/0xf40 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400752] legacy_get_tree+0x27/0x40
Mar 14 18:03:04 cliente2 kernel: [ 135.400781] vfs_get_tree+0x25/0xb0
Mar 14 18:03:04 cliente2 kernel: [ 135.400809] path_mount+0x465/0xac0
Mar 14 18:03:04 cliente2 kernel: [ 135.400838] __x64_sys_mount+0x103/0x140
Mar 14 18:03:04 cliente2 kernel: [ 135.400868] do_syscall_64+0x3b/0xc0
Mar 14 18:03:04 cliente2 kernel: [ 135.400898] entry_SYSCALL_64_after_hwframe+0x44/0xae
Mar 14 18:03:04 cliente2 kernel: [ 135.400935] RIP: 0033:0x7fd4429bc9ea
Mar 14 18:03:04 cliente2 kernel: [ 135.400961] Code: 48 8b 0d a9 f4 0b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 f4 0b 00 f7 d8 64 89 01 48
Mar 14 18:03:04 cliente2 kernel: [ 135.401068] RSP: 002b:00007ffdfb28a748 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 18:03:04 cliente2 kernel: [ 135.401115] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd4429bc9ea
Mar 14 18:03:04 cliente2 kernel: [ 135.401159] RDX: 00005630e1c4b0ae RSI: 00005630e35f8370 RDI: 00005630e35ff3b0
Mar 14 18:03:04 cliente2 kernel: [ 135.401202] RBP: 00007ffdfb28a900 R08: 00005630e35f8fe0 R09: 00007ffdfb2893a0
Mar 14 18:03:04 cliente2 kernel: [ 135.401244] R10: 0000000000000000 R11: 0000000000000246 R12: 00005630e1c4b0ae
Mar 14 18:03:04 cliente2 kernel: [ 135.401288] R13: 00005630e35f8301 R14: 00007ffdfb28a7f0 R15: 00007ffdfb28a770
Mar 14 18:03:04 cliente2 kernel: [ 135.402666] </TASK>
Mar 14 18:03:04 cliente2 kernel: [ 135.404068] Modules linked in: ocfs2 quota_tree dm_round_robin ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm sd_mod t10_pi ocfs2_nodemanager crc_t10dif crct10dif_generic sg ocfs2_stackglue intel_rapl_msr intel_rapl_common kvm_amd snd_hda_codec_generic ccp ledtrig_audio kvm irqbypass snd_hda_intel snd_intel_dspcfg ghash_clmulni_intel snd_intel_sdw_acpi snd_hda_codec qxl snd_hda_core snd_hwdep aesni_intel drm_ttm_helper snd_pcm ttm crypto_simd snd_timer snd drm_kms_helper cryptd evdev soundcore serio_raw pcspkr virtio_balloon virtio_console cec rc_core button qemu_fw_cfg ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi drm fuse configfs virtio_rng rng_core ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua virtio_net virtio_blk net_failover failover xhci_pci ahci libahci xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul psmouse libata usbcore crc32c_intel scsi_mod i2c_i801
Mar 14 18:03:04 cliente2 kernel: [ 135.404184] virtio_pci virtio_pci_legacy_dev virtio_pci_modern_dev virtio lpc_ich i2c_smbus scsi_common usb_common virtio_ring
Mar 14 18:03:04 cliente2 kernel: [ 135.419261] CR2: 0000000000000398
Mar 14 18:03:04 cliente2 kernel: [ 135.420751] ---[ end trace 0000000000000000 ]---
Mar 14 18:03:04 cliente2 kernel: [ 135.422266] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.423933] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 e0 c3 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:03:04 cliente2 kernel: [ 135.427028] RSP: 0018:ffffa188406bfbe8 EFLAGS: 00010282
Mar 14 18:03:04 cliente2 kernel: [ 135.428580] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c3e0a0
Mar 14 18:03:04 cliente2 kernel: [ 135.430190] RDX: 0000000000000008 RSI: ffff9150c4351c30 RDI: ffffa188406bfbb8
Mar 14 18:03:04 cliente2 kernel: [ 135.431803] RBP: ffff9150c4351c00 R08: ffff9150c4351c00 R09: 0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.433444] R10: ffffa188406bfbb0 R11: ffffffffc0bff030 R12: ffff9150c4351c18
Mar 14 18:03:04 cliente2 kernel: [ 135.435051] R13: ffff9150f447b688 R14: 0000000000000000 R15: ffff9150c4952000
Mar 14 18:03:04 cliente2 kernel: [ 135.436710] FS: 00007fd4424f97c0(0000) GS:ffff91513dc80000(0000) knlGS:0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.438332] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:03:04 cliente2 kernel: [ 135.440017] CR2: 0000000000000398 CR3: 0000000005872000 CR4: 0000000000350ee0
----End OUTPUT ERROR----------
********************************************************
with KERNEL 5.15.0-0.bpo.3-amd64 + OCFS2-TOOLS 1.8.7-1:
output messages in /var/log/syslog on node 2 when mount:
----Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 17:51:11 cliente2 kernel: [ 155.679239] o2net: Connected to node cliente1 (num 0) at 172.16.10.10:7777
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sda
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 17:51:15 cliente2 kernel: [ 159.897036] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 17:51:15 cliente2 kernel: [ 159.897044] (
Mar 14 17:51:15 cliente2 kernel: [ 159.897046] 0
Mar 14 17:51:15 cliente2 kernel: [ 159.897048] 1
Mar 14 17:51:15 cliente2 kernel: [ 159.897049] ) 2 nodes
Mar 14 17:54:39 cliente2 kernel: [ 363.549274] INFO: task mount.ocfs2:773 blocked for more than 120 seconds.
Mar 14 17:54:39 cliente2 kernel: [ 363.549342] Not tainted 5.15.0-0.bpo.3-amd64 #1 Debian 5.15.15-2~bpo11+1
Mar 14 17:54:39 cliente2 kernel: [ 363.549385] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 14 17:54:39 cliente2 kernel: [ 363.549429] task:mount.ocfs2 state:D stack: 0 pid: 773 ppid: 772 flags:0x00004000
Mar 14 17:54:39 cliente2 kernel: [ 363.549436] Call Trace:
Mar 14 17:54:39 cliente2 kernel: [ 363.549439] <TASK>
Mar 14 17:54:39 cliente2 kernel: [ 363.549441] ? usleep_range_state+0x90/0x90
Mar 14 17:54:39 cliente2 kernel: [ 363.549455] __schedule+0x2f0/0x940
Mar 14 17:54:39 cliente2 kernel: [ 363.549481] ? usleep_range_state+0x90/0x90
Mar 14 17:54:39 cliente2 kernel: [ 363.549486] schedule+0x44/0xa0
Mar 14 17:54:39 cliente2 kernel: [ 363.549489] schedule_timeout+0xfc/0x140
Mar 14 17:54:39 cliente2 kernel: [ 363.549494] ? __prepare_to_swait+0x4b/0x70
Mar 14 17:54:39 cliente2 kernel: [ 363.549500] __wait_for_common+0xae/0x160
Mar 14 17:54:39 cliente2 kernel: [ 363.549510] __ocfs2_cluster_lock.constprop.0+0x1a5/0x780 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549598] ocfs2_inode_lock_full_nested+0x2f1/0xa50 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549675] ocfs2_journal_init+0x91/0x340 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549754] ? ocfs2_find_slot+0xa0/0x290 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549833] ocfs2_fill_super+0xdcc/0x1990 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549925] mount_bdev+0x185/0x1b0
Mar 14 17:54:39 cliente2 kernel: [ 363.549932] ? ocfs2_remount+0x440/0x440 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.550007] legacy_get_tree+0x27/0x40
Mar 14 17:54:39 cliente2 kernel: [ 363.550013] vfs_get_tree+0x25/0xb0
Mar 14 17:54:39 cliente2 kernel: [ 363.550017] path_mount+0x469/0xa40
Mar 14 17:54:39 cliente2 kernel: [ 363.550023] __x64_sys_mount+0x103/0x140
Mar 14 17:54:39 cliente2 kernel: [ 363.550027] do_syscall_64+0x3b/0xc0
Mar 14 17:54:39 cliente2 kernel: [ 363.550032] entry_SYSCALL_64_after_hwframe+0x44/0xae
Mar 14 17:54:39 cliente2 kernel: [ 363.550039] RIP: 0033:0x7fe8146ff9ea
Mar 14 17:54:39 cliente2 kernel: [ 363.550043] RSP: 002b:00007fff588d9e08 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 17:54:39 cliente2 kernel: [ 363.550048] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fe8146ff9ea
Mar 14 17:54:39 cliente2 kernel: [ 363.550050] RDX: 00005649c5dbf0ae RSI: 00005649c7003370 RDI: 00005649c700a3b0
Mar 14 17:54:39 cliente2 kernel: [ 363.550053] RBP: 00007fff588d9fc0 R08: 00005649c7003fe0 R09: 00007fff588d8a60
Mar 14 17:54:39 cliente2 kernel: [ 363.550055] R10: 0000000000000000 R11: 0000000000000246 R12: 00005649c5dbf0ae
Mar 14 17:54:39 cliente2 kernel: [ 363.550057] R13: 00005649c7003301 R14: 00007fff588d9eb0 R15: 00007fff588d9e30
Mar 14 17:54:39 cliente2 kernel: [ 363.550061] </TASK>
----End OUTPUT ERROR----------
********************************************************
with KERNEL 5.10.0-11-amd64 + OCFS2-TOOLS 1.8.6-6:
output messages in /var/log/syslog on node 2 when mount:
----Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 17:29:02 cliente2 kernel: [ 224.516306] o2net: Connected to node cliente1 (num 0) at 172.16.10.10:7777
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sda
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 17:29:06 cliente2 kernel: [ 228.647028] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 17:29:06 cliente2 kernel: [ 228.647032] (
Mar 14 17:29:06 cliente2 kernel: [ 228.647034] 0
Mar 14 17:29:06 cliente2 kernel: [ 228.647034] 1
Mar 14 17:29:06 cliente2 kernel: [ 228.647035] ) 2 nodes
Mar 14 17:29:13 cliente2 systemd[1]: Started Session 3 of user root.
Mar 14 17:29:35 cliente2 systemd[1]: Started Session 4 of user root.
Mar 14 17:31:21 cliente2 kernel: [ 363.506025] INFO: task mount.ocfs2:763 blocked for more than 120 seconds.
Mar 14 17:31:21 cliente2 kernel: [ 363.507241] Not tainted 5.10.0-11-amd64 #1 Debian 5.10.92-1
Mar 14 17:31:21 cliente2 kernel: [ 363.508303] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 14 17:31:21 cliente2 kernel: [ 363.509366] task:mount.ocfs2 state:D stack: 0 pid: 763 ppid: 762 flags:0x00004000
Mar 14 17:31:21 cliente2 kernel: [ 363.509372] Call Trace:
Mar 14 17:31:21 cliente2 kernel: [ 363.509420] __schedule+0x282/0x870
Mar 14 17:31:21 cliente2 kernel: [ 363.509444] ? usleep_range+0x80/0x80
Mar 14 17:31:21 cliente2 kernel: [ 363.509447] schedule+0x46/0xb0
Mar 14 17:31:21 cliente2 kernel: [ 363.509455] schedule_timeout+0xff/0x140
Mar 14 17:31:21 cliente2 kernel: [ 363.509474] ? __prepare_to_swait+0x4b/0x70
Mar 14 17:31:21 cliente2 kernel: [ 363.509478] __wait_for_common+0xae/0x160
Mar 14 17:31:21 cliente2 kernel: [ 363.509529] __ocfs2_cluster_lock.constprop.0+0x1a5/0x780 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509670] ocfs2_inode_lock_full_nested+0x306/0x990 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509736] ocfs2_journal_init+0x91/0x340 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509805] ocfs2_fill_super+0xdcf/0x1990 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509894] ? idr_replace+0x99/0xa0
Mar 14 17:31:21 cliente2 kernel: [ 363.509912] mount_bdev+0x185/0x1b0
Mar 14 17:31:21 cliente2 kernel: [ 363.509989] ? ocfs2_remount+0x440/0x440 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.510001] legacy_get_tree+0x27/0x40
Mar 14 17:31:21 cliente2 kernel: [ 363.510019] vfs_get_tree+0x25/0xb0
Mar 14 17:31:21 cliente2 kernel: [ 363.510025] path_mount+0x454/0xa70
Mar 14 17:31:21 cliente2 kernel: [ 363.510045] __x64_sys_mount+0x103/0x140
Mar 14 17:31:21 cliente2 kernel: [ 363.510051] do_syscall_64+0x33/0x80
Mar 14 17:31:21 cliente2 kernel: [ 363.510076] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Mar 14 17:31:21 cliente2 kernel: [ 363.510092] RIP: 0033:0x7fbe93bba9ea
Mar 14 17:31:21 cliente2 kernel: [ 363.510094] RSP: 002b:00007fffd9fd2188 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 17:31:21 cliente2 kernel: [ 363.510104] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fbe93bba9ea
Mar 14 17:31:21 cliente2 kernel: [ 363.510107] RDX: 000055d0c33270ae RSI: 000055d0c529d370 RDI: 000055d0c52a43b0
Mar 14 17:31:21 cliente2 kernel: [ 363.510108] RBP: 00007fffd9fd2330 R08: 000055d0c529dfe0 R09: 00007fffd9fd0de0
Mar 14 17:31:21 cliente2 kernel: [ 363.510110] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fffd9fd2220
Mar 14 17:31:21 cliente2 kernel: [ 363.510112] R13: 00007fffd9fd21a0 R14: 000055d0c52a1000 R15: 0000000000000000
----End OUTPUT ERROR----------
The correct bug information is for versions 1.8.7-1 (testing) and 1.8.6-6 (stable) of ocfs2-tools.
I'm putting the settings of my test environment and also the error outputs caused when using the "mount" command on the second node. I have another new information: In kernel 5.17, the problem already occurs when trying to mount on the first node. The other kernels, the error only happens with the second node onwards.
My configuration:
# multipath -ll
ISCSI-VOL1 (360014050c13f5ba581b4d90beb578f4e) dm-0 LIO-ORG,md_block0
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
|- 6:0:0:1 sda 8:0 active ready running
|- 9:0:0:1 sdd 8:48 active ready running
|- 8:0:0:1 sdc 8:32 active ready running
`- 7:0:0:1 sdb 8:16 active ready running
The volume was formated with command below:
# mkfs.ocfs2 --fs-feature-level=max-features -T vmstore -L "OCFS2_VOL1" /dev/mapper/ISCSI-VOL1
Simple Cluster configuration (node1 and node2):
# cat /etc/ocfs2/cluster.conf
cluster:
name = ocfs2cluster
heartbeat_mode = local
node_count = 2
node:
cluster = ocfs2cluster
number = 0
ip_port = 7777
ip_address = 172.16.10.10
name = cliente1
node:
cluster = ocfs2cluster
number = 1
ip_port = 7777
ip_address = 172.16.10.20
name = cliente2
Startup configuration (node1 and node2):
# cat /etc/default/o2cb
O2CB_ENABLED=true
O2CB_BOOTCLUSTER=ocfs2cluster
O2CB_HEARTBEAT_THRESHOLD=31
O2CB_IDLE_TIMEOUT_MS=30000
O2CB_KEEPALIVE_DELAY_MS=2000
O2CB_RECONNECT_DELAY_MS=2000
On node 1:
# mount -t ocfs2 /dev/mapper/ISCSI-VOL1 /mnt/ ( results mount OK )
On node 2:
# mount -t ocfs2 /dev/mapper/ISCSI-VOL1 /mnt/ ( system hangs on mount and show error messages in /var/log/syslog after some time )
********************************************************
Results (kernels + ocfs2-tools versions):
with KERNEL 5.17.0-rc5-amd64 + OCFS2-TOOLS 1.8.7-1:
output messages in /var/log/syslog on node 2 when mount:
----NODE 1 - Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 18:02:32 cliente1 multipath: ISCSI-VOL1: adding new path sda
Mar 14 18:02:33 cliente1 kernel: [ 110.514499] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 18:02:33 cliente1 kernel: [ 110.514507] (
Mar 14 18:02:33 cliente1 kernel: [ 110.514508] 0
Mar 14 18:02:33 cliente1 kernel: [ 110.514509] ) 1 nodes
Mar 14 18:02:33 cliente1 kernel: [ 110.592656] ocfs2: Mounting device (253,0) on (node 0, slot 1) with ordered data mode.
Mar 14 18:02:33 cliente1 kernel: [ 110.595170] ocfs2: Begin replay journal (node 1, slot 0) on device (253,0)
Mar 14 18:02:33 cliente1 kernel: [ 110.603091] ocfs2: End replay journal (node 1, slot 0) on device (253,0)
Mar 14 18:02:33 cliente1 kernel: [ 110.603126] BUG: kernel NULL pointer dereference, address: 0000000000000398
Mar 14 18:02:33 cliente1 kernel: [ 110.603199] #PF: supervisor read access in kernel mode
Mar 14 18:02:33 cliente1 kernel: [ 110.603234] #PF: error_code(0x0000) - not-present page
Mar 14 18:02:33 cliente1 kernel: [ 110.603264] PGD 0 P4D 0
Mar 14 18:02:33 cliente1 kernel: [ 110.603279] Oops: 0000 [#1] PREEMPT SMP NOPTI
Mar 14 18:02:33 cliente1 kernel: [ 110.603297] CPU: 2 PID: 747 Comm: mount.ocfs2 Not tainted 5.17.0-rc5-amd64 #1 Debian 5.17~rc5-1~exp1
Mar 14 18:02:33 cliente1 kernel: [ 110.603324] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.14.0-2 04/01/2014
Mar 14 18:02:33 cliente1 kernel: [ 110.603578] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.603675] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 60 c9 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:02:33 cliente1 kernel: [ 110.603738] RSP: 0018:ffffb60c00677be8 EFLAGS: 00010282
Mar 14 18:02:33 cliente1 kernel: [ 110.603768] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c960a0
Mar 14 18:02:33 cliente1 kernel: [ 110.603803] RDX: 0000000000000008 RSI: ffff9661c3fba430 RDI: ffffb60c00677bb8
Mar 14 18:02:33 cliente1 kernel: [ 110.603830] RBP: ffff9661c3fba400 R08: ffff9661c3fba400 R09: 0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.603945] R10: ffffb60c00677bb0 R11: ffffffffc0c57030 R12: ffff9661c3fba418
Mar 14 18:02:33 cliente1 kernel: [ 110.603970] R13: ffff9661f4ec1588 R14: 0000000000000000 R15: ffff9661c860c800
Mar 14 18:02:33 cliente1 kernel: [ 110.604002] FS: 00007fc0ee21a7c0(0000) GS:ffff96623dd00000(0000) knlGS:0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.604024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:02:33 cliente1 kernel: [ 110.604040] CR2: 0000000000000398 CR3: 0000000034390000 CR4: 0000000000350ee0
Mar 14 18:02:33 cliente1 kernel: [ 110.604062] Call Trace:
Mar 14 18:02:33 cliente1 kernel: [ 110.604076] <TASK>
Mar 14 18:02:33 cliente1 kernel: [ 110.604085] ocfs2_local_read_info+0xb9/0x6f0 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604147] ? ocfs2_local_check_quota_file+0x197/0x390 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604192] dquot_load_quota_sb+0x216/0x470
Mar 14 18:02:33 cliente1 kernel: [ 110.604230] ? preempt_count_add+0x68/0xa0
Mar 14 18:02:33 cliente1 kernel: [ 110.604244] dquot_load_quota_inode+0x85/0x100
Mar 14 18:02:33 cliente1 kernel: [ 110.604258] ocfs2_enable_quotas+0xa0/0x1c0 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604300] ocfs2_fill_super.cold+0xc8/0x1bf [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604367] mount_bdev+0x185/0x1b0
Mar 14 18:02:33 cliente1 kernel: [ 110.604386] ? ocfs2_initialize_super.isra.0+0xf40/0xf40 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.604608] legacy_get_tree+0x27/0x40
Mar 14 18:02:33 cliente1 kernel: [ 110.604658] vfs_get_tree+0x25/0xb0
Mar 14 18:02:33 cliente1 kernel: [ 110.604692] path_mount+0x465/0xac0
Mar 14 18:02:33 cliente1 kernel: [ 110.604733] __x64_sys_mount+0x103/0x140
Mar 14 18:02:33 cliente1 kernel: [ 110.604761] do_syscall_64+0x3b/0xc0
Mar 14 18:02:33 cliente1 kernel: [ 110.604782] entry_SYSCALL_64_after_hwframe+0x44/0xae
Mar 14 18:02:33 cliente1 kernel: [ 110.604805] RIP: 0033:0x7fc0ee6dd9ea
Mar 14 18:02:33 cliente1 kernel: [ 110.604825] Code: 48 8b 0d a9 f4 0b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 f4 0b 00 f7 d8 64 89 01 48
Mar 14 18:02:33 cliente1 kernel: [ 110.604880] RSP: 002b:00007fffec053988 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 18:02:33 cliente1 kernel: [ 110.604907] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fc0ee6dd9ea
Mar 14 18:02:33 cliente1 kernel: [ 110.604930] RDX: 000055af2d1680ae RSI: 000055af2e821370 RDI: 000055af2e8283b0
Mar 14 18:02:33 cliente1 kernel: [ 110.604955] RBP: 00007fffec053b40 R08: 000055af2e821fe0 R09: 00007fffec0525e0
Mar 14 18:02:33 cliente1 kernel: [ 110.604979] R10: 0000000000000000 R11: 0000000000000246 R12: 000055af2d1680ae
Mar 14 18:02:33 cliente1 kernel: [ 110.605004] R13: 000055af2e821301 R14: 00007fffec053a30 R15: 00007fffec0539b0
Mar 14 18:02:33 cliente1 kernel: [ 110.605833] </TASK>
Mar 14 18:02:33 cliente1 kernel: [ 110.606566] Modules linked in: ocfs2 quota_tree dm_round_robin ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager sd_mod t10_pi crc_t10dif ocfs2_stackglue crct10dif_generic sg intel_rapl_msr intel_rapl_common kvm_amd ccp kvm irqbypass ghash_clmulni_intel snd_hda_codec_generic ledtrig_audio snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec snd_hda_core qxl aesni_intel snd_hwdep drm_ttm_helper ttm snd_pcm evdev crypto_simd cryptd serio_raw drm_kms_helper pcspkr snd_timer virtio_console cec virtio_balloon snd rc_core soundcore qemu_fw_cfg button ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi drm scsi_transport_iscsi fuse configfs virtio_rng rng_core ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua ahci libahci libata xhci_pci crct10dif_pclmul crct10dif_common crc32_pclmul xhci_hcd virtio_net virtio_blk net_failover failover usbcore scsi_mod virtio_pci virtio_pci_legacy_dev
Mar 14 18:02:33 cliente1 kernel: [ 110.606627] virtio_pci_modern_dev i2c_i801 virtio crc32c_intel psmouse usb_common scsi_common i2c_smbus lpc_ich virtio_ring
Mar 14 18:02:33 cliente1 kernel: [ 110.614517] CR2: 0000000000000398
Mar 14 18:02:33 cliente1 kernel: [ 110.615696] ---[ end trace 0000000000000000 ]---
Mar 14 18:02:33 cliente1 kernel: [ 110.616451] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:02:33 cliente1 kernel: [ 110.617005] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 60 c9 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:02:33 cliente1 kernel: [ 110.618045] RSP: 0018:ffffb60c00677be8 EFLAGS: 00010282
Mar 14 18:02:33 cliente1 kernel: [ 110.618866] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c960a0
Mar 14 18:02:33 cliente1 kernel: [ 110.619613] RDX: 0000000000000008 RSI: ffff9661c3fba430 RDI: ffffb60c00677bb8
Mar 14 18:02:33 cliente1 kernel: [ 110.620969] RBP: ffff9661c3fba400 R08: ffff9661c3fba400 R09: 0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.621678] R10: ffffb60c00677bb0 R11: ffffffffc0c57030 R12: ffff9661c3fba418
Mar 14 18:02:33 cliente1 kernel: [ 110.622340] R13: ffff9661f4ec1588 R14: 0000000000000000 R15: ffff9661c860c800
Mar 14 18:02:33 cliente1 kernel: [ 110.622912] FS: 00007fc0ee21a7c0(0000) GS:ffff96623dd00000(0000) knlGS:0000000000000000
Mar 14 18:02:33 cliente1 kernel: [ 110.623679] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:02:33 cliente1 kernel: [ 110.624330] CR2: 0000000000000398 CR3: 0000000034390000 CR4: 0000000000350ee0
Mar 14 18:02:33 cliente1 kernel: [ 110.665635] ocfs2: Beginning quota recovery on device (253,0) for slot 0
Mar 14 18:02:59 cliente1 kernel: [ 137.283021] o2net: Accepted connection from node cliente2 (num 1) at 172.16.10.20:7777
Mar 14 18:03:04 cliente1 kernel: [ 141.497434] o2dlm: Node 1 joins domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 18:03:04 cliente1 kernel: [ 141.497442] (
Mar 14 18:03:04 cliente1 kernel: [ 141.498856] 0
Mar 14 18:03:04 cliente1 kernel: [ 141.500356] 1
Mar 14 18:03:04 cliente1 kernel: [ 141.501859] ) 2 nodes
----End OUTPUT ERROR----------
----NODE 2 - Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 18:02:59 cliente2 kernel: [ 131.087051] o2net: Connected to node cliente1 (num 0) at 172.16.10.10:7777
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 18:03:03 cliente2 multipath: ISCSI-VOL1: adding new path sda
Mar 14 18:03:04 cliente2 kernel: [ 135.310692] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 18:03:04 cliente2 kernel: [ 135.310706] (
Mar 14 18:03:04 cliente2 kernel: [ 135.310708] 0
Mar 14 18:03:04 cliente2 kernel: [ 135.310710] 1
Mar 14 18:03:04 cliente2 kernel: [ 135.310711] ) 2 nodes
Mar 14 18:03:04 cliente2 kernel: [ 135.389862] ocfs2: Mounting device (253,0) on (node 1, slot 0) with ordered data mode.
Mar 14 18:03:04 cliente2 kernel: [ 135.399047] BUG: kernel NULL pointer dereference, address: 0000000000000398
Mar 14 18:03:04 cliente2 kernel: [ 135.399126] #PF: supervisor read access in kernel mode
Mar 14 18:03:04 cliente2 kernel: [ 135.399160] #PF: error_code(0x0000) - not-present page
Mar 14 18:03:04 cliente2 kernel: [ 135.399194] PGD 0 P4D 0
Mar 14 18:03:04 cliente2 kernel: [ 135.399216] Oops: 0000 [#1] PREEMPT SMP NOPTI
Mar 14 18:03:04 cliente2 kernel: [ 135.399248] CPU: 1 PID: 740 Comm: mount.ocfs2 Not tainted 5.17.0-rc5-amd64 #1 Debian 5.17~rc5-1~exp1
Mar 14 18:03:04 cliente2 kernel: [ 135.399306] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.14.0-2 04/01/2014
Mar 14 18:03:04 cliente2 kernel: [ 135.399355] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.399481] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 e0 c3 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:03:04 cliente2 kernel: [ 135.399590] RSP: 0018:ffffa188406bfbe8 EFLAGS: 00010282
Mar 14 18:03:04 cliente2 kernel: [ 135.399625] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c3e0a0
Mar 14 18:03:04 cliente2 kernel: [ 135.399669] RDX: 0000000000000008 RSI: ffff9150c4351c30 RDI: ffffa188406bfbb8
Mar 14 18:03:04 cliente2 kernel: [ 135.399712] RBP: ffff9150c4351c00 R08: ffff9150c4351c00 R09: 0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.399756] R10: ffffa188406bfbb0 R11: ffffffffc0bff030 R12: ffff9150c4351c18
Mar 14 18:03:04 cliente2 kernel: [ 135.399798] R13: ffff9150f447b688 R14: 0000000000000000 R15: ffff9150c4952000
Mar 14 18:03:04 cliente2 kernel: [ 135.399849] FS: 00007fd4424f97c0(0000) GS:ffff91513dc80000(0000) knlGS:0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.399899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:03:04 cliente2 kernel: [ 135.399935] CR2: 0000000000000398 CR3: 0000000005872000 CR4: 0000000000350ee0
Mar 14 18:03:04 cliente2 kernel: [ 135.399984] Call Trace:
Mar 14 18:03:04 cliente2 kernel: [ 135.400006] <TASK>
Mar 14 18:03:04 cliente2 kernel: [ 135.400023] ocfs2_local_read_info+0xb9/0x6f0 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400148] ? ocfs2_local_check_quota_file+0x197/0x390 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400263] dquot_load_quota_sb+0x216/0x470
Mar 14 18:03:04 cliente2 kernel: [ 135.400319] ? preempt_count_add+0x68/0xa0
Mar 14 18:03:04 cliente2 kernel: [ 135.400351] dquot_load_quota_inode+0x85/0x100
Mar 14 18:03:04 cliente2 kernel: [ 135.400382] ocfs2_enable_quotas+0xa0/0x1c0 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400489] ocfs2_fill_super.cold+0xc8/0x1bf [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400611] mount_bdev+0x185/0x1b0
Mar 14 18:03:04 cliente2 kernel: [ 135.400639] ? ocfs2_initialize_super.isra.0+0xf40/0xf40 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.400752] legacy_get_tree+0x27/0x40
Mar 14 18:03:04 cliente2 kernel: [ 135.400781] vfs_get_tree+0x25/0xb0
Mar 14 18:03:04 cliente2 kernel: [ 135.400809] path_mount+0x465/0xac0
Mar 14 18:03:04 cliente2 kernel: [ 135.400838] __x64_sys_mount+0x103/0x140
Mar 14 18:03:04 cliente2 kernel: [ 135.400868] do_syscall_64+0x3b/0xc0
Mar 14 18:03:04 cliente2 kernel: [ 135.400898] entry_SYSCALL_64_after_hwframe+0x44/0xae
Mar 14 18:03:04 cliente2 kernel: [ 135.400935] RIP: 0033:0x7fd4429bc9ea
Mar 14 18:03:04 cliente2 kernel: [ 135.400961] Code: 48 8b 0d a9 f4 0b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 f4 0b 00 f7 d8 64 89 01 48
Mar 14 18:03:04 cliente2 kernel: [ 135.401068] RSP: 002b:00007ffdfb28a748 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 18:03:04 cliente2 kernel: [ 135.401115] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd4429bc9ea
Mar 14 18:03:04 cliente2 kernel: [ 135.401159] RDX: 00005630e1c4b0ae RSI: 00005630e35f8370 RDI: 00005630e35ff3b0
Mar 14 18:03:04 cliente2 kernel: [ 135.401202] RBP: 00007ffdfb28a900 R08: 00005630e35f8fe0 R09: 00007ffdfb2893a0
Mar 14 18:03:04 cliente2 kernel: [ 135.401244] R10: 0000000000000000 R11: 0000000000000246 R12: 00005630e1c4b0ae
Mar 14 18:03:04 cliente2 kernel: [ 135.401288] R13: 00005630e35f8301 R14: 00007ffdfb28a7f0 R15: 00007ffdfb28a770
Mar 14 18:03:04 cliente2 kernel: [ 135.402666] </TASK>
Mar 14 18:03:04 cliente2 kernel: [ 135.404068] Modules linked in: ocfs2 quota_tree dm_round_robin ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm sd_mod t10_pi ocfs2_nodemanager crc_t10dif crct10dif_generic sg ocfs2_stackglue intel_rapl_msr intel_rapl_common kvm_amd snd_hda_codec_generic ccp ledtrig_audio kvm irqbypass snd_hda_intel snd_intel_dspcfg ghash_clmulni_intel snd_intel_sdw_acpi snd_hda_codec qxl snd_hda_core snd_hwdep aesni_intel drm_ttm_helper snd_pcm ttm crypto_simd snd_timer snd drm_kms_helper cryptd evdev soundcore serio_raw pcspkr virtio_balloon virtio_console cec rc_core button qemu_fw_cfg ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi drm fuse configfs virtio_rng rng_core ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua virtio_net virtio_blk net_failover failover xhci_pci ahci libahci xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul psmouse libata usbcore crc32c_intel scsi_mod i2c_i801
Mar 14 18:03:04 cliente2 kernel: [ 135.404184] virtio_pci virtio_pci_legacy_dev virtio_pci_modern_dev virtio lpc_ich i2c_smbus scsi_common usb_common virtio_ring
Mar 14 18:03:04 cliente2 kernel: [ 135.419261] CR2: 0000000000000398
Mar 14 18:03:04 cliente2 kernel: [ 135.420751] ---[ end trace 0000000000000000 ]---
Mar 14 18:03:04 cliente2 kernel: [ 135.422266] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
Mar 14 18:03:04 cliente2 kernel: [ 135.423933] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 e0 c3 c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
Mar 14 18:03:04 cliente2 kernel: [ 135.427028] RSP: 0018:ffffa188406bfbe8 EFLAGS: 00010282
Mar 14 18:03:04 cliente2 kernel: [ 135.428580] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0c3e0a0
Mar 14 18:03:04 cliente2 kernel: [ 135.430190] RDX: 0000000000000008 RSI: ffff9150c4351c30 RDI: ffffa188406bfbb8
Mar 14 18:03:04 cliente2 kernel: [ 135.431803] RBP: ffff9150c4351c00 R08: ffff9150c4351c00 R09: 0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.433444] R10: ffffa188406bfbb0 R11: ffffffffc0bff030 R12: ffff9150c4351c18
Mar 14 18:03:04 cliente2 kernel: [ 135.435051] R13: ffff9150f447b688 R14: 0000000000000000 R15: ffff9150c4952000
Mar 14 18:03:04 cliente2 kernel: [ 135.436710] FS: 00007fd4424f97c0(0000) GS:ffff91513dc80000(0000) knlGS:0000000000000000
Mar 14 18:03:04 cliente2 kernel: [ 135.438332] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 14 18:03:04 cliente2 kernel: [ 135.440017] CR2: 0000000000000398 CR3: 0000000005872000 CR4: 0000000000350ee0
----End OUTPUT ERROR----------
********************************************************
with KERNEL 5.15.0-0.bpo.3-amd64 + OCFS2-TOOLS 1.8.7-1:
output messages in /var/log/syslog on node 2 when mount:
----Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 17:51:11 cliente2 kernel: [ 155.679239] o2net: Connected to node cliente1 (num 0) at 172.16.10.10:7777
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sda
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 17:51:15 cliente2 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 17:51:15 cliente2 kernel: [ 159.897036] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 17:51:15 cliente2 kernel: [ 159.897044] (
Mar 14 17:51:15 cliente2 kernel: [ 159.897046] 0
Mar 14 17:51:15 cliente2 kernel: [ 159.897048] 1
Mar 14 17:51:15 cliente2 kernel: [ 159.897049] ) 2 nodes
Mar 14 17:54:39 cliente2 kernel: [ 363.549274] INFO: task mount.ocfs2:773 blocked for more than 120 seconds.
Mar 14 17:54:39 cliente2 kernel: [ 363.549342] Not tainted 5.15.0-0.bpo.3-amd64 #1 Debian 5.15.15-2~bpo11+1
Mar 14 17:54:39 cliente2 kernel: [ 363.549385] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 14 17:54:39 cliente2 kernel: [ 363.549429] task:mount.ocfs2 state:D stack: 0 pid: 773 ppid: 772 flags:0x00004000
Mar 14 17:54:39 cliente2 kernel: [ 363.549436] Call Trace:
Mar 14 17:54:39 cliente2 kernel: [ 363.549439] <TASK>
Mar 14 17:54:39 cliente2 kernel: [ 363.549441] ? usleep_range_state+0x90/0x90
Mar 14 17:54:39 cliente2 kernel: [ 363.549455] __schedule+0x2f0/0x940
Mar 14 17:54:39 cliente2 kernel: [ 363.549481] ? usleep_range_state+0x90/0x90
Mar 14 17:54:39 cliente2 kernel: [ 363.549486] schedule+0x44/0xa0
Mar 14 17:54:39 cliente2 kernel: [ 363.549489] schedule_timeout+0xfc/0x140
Mar 14 17:54:39 cliente2 kernel: [ 363.549494] ? __prepare_to_swait+0x4b/0x70
Mar 14 17:54:39 cliente2 kernel: [ 363.549500] __wait_for_common+0xae/0x160
Mar 14 17:54:39 cliente2 kernel: [ 363.549510] __ocfs2_cluster_lock.constprop.0+0x1a5/0x780 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549598] ocfs2_inode_lock_full_nested+0x2f1/0xa50 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549675] ocfs2_journal_init+0x91/0x340 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549754] ? ocfs2_find_slot+0xa0/0x290 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549833] ocfs2_fill_super+0xdcc/0x1990 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.549925] mount_bdev+0x185/0x1b0
Mar 14 17:54:39 cliente2 kernel: [ 363.549932] ? ocfs2_remount+0x440/0x440 [ocfs2]
Mar 14 17:54:39 cliente2 kernel: [ 363.550007] legacy_get_tree+0x27/0x40
Mar 14 17:54:39 cliente2 kernel: [ 363.550013] vfs_get_tree+0x25/0xb0
Mar 14 17:54:39 cliente2 kernel: [ 363.550017] path_mount+0x469/0xa40
Mar 14 17:54:39 cliente2 kernel: [ 363.550023] __x64_sys_mount+0x103/0x140
Mar 14 17:54:39 cliente2 kernel: [ 363.550027] do_syscall_64+0x3b/0xc0
Mar 14 17:54:39 cliente2 kernel: [ 363.550032] entry_SYSCALL_64_after_hwframe+0x44/0xae
Mar 14 17:54:39 cliente2 kernel: [ 363.550039] RIP: 0033:0x7fe8146ff9ea
Mar 14 17:54:39 cliente2 kernel: [ 363.550043] RSP: 002b:00007fff588d9e08 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 17:54:39 cliente2 kernel: [ 363.550048] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fe8146ff9ea
Mar 14 17:54:39 cliente2 kernel: [ 363.550050] RDX: 00005649c5dbf0ae RSI: 00005649c7003370 RDI: 00005649c700a3b0
Mar 14 17:54:39 cliente2 kernel: [ 363.550053] RBP: 00007fff588d9fc0 R08: 00005649c7003fe0 R09: 00007fff588d8a60
Mar 14 17:54:39 cliente2 kernel: [ 363.550055] R10: 0000000000000000 R11: 0000000000000246 R12: 00005649c5dbf0ae
Mar 14 17:54:39 cliente2 kernel: [ 363.550057] R13: 00005649c7003301 R14: 00007fff588d9eb0 R15: 00007fff588d9e30
Mar 14 17:54:39 cliente2 kernel: [ 363.550061] </TASK>
----End OUTPUT ERROR----------
********************************************************
with KERNEL 5.10.0-11-amd64 + OCFS2-TOOLS 1.8.6-6:
output messages in /var/log/syslog on node 2 when mount:
----Begin OUTPUT ERROR in /var/log/syslog--------
Mar 14 17:29:02 cliente2 kernel: [ 224.516306] o2net: Connected to node cliente1 (num 0) at 172.16.10.10:7777
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sda
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sdd
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sdc
Mar 14 17:29:06 cliente2 multipath: ISCSI-VOL1: adding new path sdb
Mar 14 17:29:06 cliente2 kernel: [ 228.647028] o2dlm: Joining domain 82E353C8C231404FA0C66C8C4EB4F618
Mar 14 17:29:06 cliente2 kernel: [ 228.647032] (
Mar 14 17:29:06 cliente2 kernel: [ 228.647034] 0
Mar 14 17:29:06 cliente2 kernel: [ 228.647034] 1
Mar 14 17:29:06 cliente2 kernel: [ 228.647035] ) 2 nodes
Mar 14 17:29:13 cliente2 systemd[1]: Started Session 3 of user root.
Mar 14 17:29:35 cliente2 systemd[1]: Started Session 4 of user root.
Mar 14 17:31:21 cliente2 kernel: [ 363.506025] INFO: task mount.ocfs2:763 blocked for more than 120 seconds.
Mar 14 17:31:21 cliente2 kernel: [ 363.507241] Not tainted 5.10.0-11-amd64 #1 Debian 5.10.92-1
Mar 14 17:31:21 cliente2 kernel: [ 363.508303] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 14 17:31:21 cliente2 kernel: [ 363.509366] task:mount.ocfs2 state:D stack: 0 pid: 763 ppid: 762 flags:0x00004000
Mar 14 17:31:21 cliente2 kernel: [ 363.509372] Call Trace:
Mar 14 17:31:21 cliente2 kernel: [ 363.509420] __schedule+0x282/0x870
Mar 14 17:31:21 cliente2 kernel: [ 363.509444] ? usleep_range+0x80/0x80
Mar 14 17:31:21 cliente2 kernel: [ 363.509447] schedule+0x46/0xb0
Mar 14 17:31:21 cliente2 kernel: [ 363.509455] schedule_timeout+0xff/0x140
Mar 14 17:31:21 cliente2 kernel: [ 363.509474] ? __prepare_to_swait+0x4b/0x70
Mar 14 17:31:21 cliente2 kernel: [ 363.509478] __wait_for_common+0xae/0x160
Mar 14 17:31:21 cliente2 kernel: [ 363.509529] __ocfs2_cluster_lock.constprop.0+0x1a5/0x780 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509670] ocfs2_inode_lock_full_nested+0x306/0x990 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509736] ocfs2_journal_init+0x91/0x340 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509805] ocfs2_fill_super+0xdcf/0x1990 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.509894] ? idr_replace+0x99/0xa0
Mar 14 17:31:21 cliente2 kernel: [ 363.509912] mount_bdev+0x185/0x1b0
Mar 14 17:31:21 cliente2 kernel: [ 363.509989] ? ocfs2_remount+0x440/0x440 [ocfs2]
Mar 14 17:31:21 cliente2 kernel: [ 363.510001] legacy_get_tree+0x27/0x40
Mar 14 17:31:21 cliente2 kernel: [ 363.510019] vfs_get_tree+0x25/0xb0
Mar 14 17:31:21 cliente2 kernel: [ 363.510025] path_mount+0x454/0xa70
Mar 14 17:31:21 cliente2 kernel: [ 363.510045] __x64_sys_mount+0x103/0x140
Mar 14 17:31:21 cliente2 kernel: [ 363.510051] do_syscall_64+0x33/0x80
Mar 14 17:31:21 cliente2 kernel: [ 363.510076] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Mar 14 17:31:21 cliente2 kernel: [ 363.510092] RIP: 0033:0x7fbe93bba9ea
Mar 14 17:31:21 cliente2 kernel: [ 363.510094] RSP: 002b:00007fffd9fd2188 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Mar 14 17:31:21 cliente2 kernel: [ 363.510104] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fbe93bba9ea
Mar 14 17:31:21 cliente2 kernel: [ 363.510107] RDX: 000055d0c33270ae RSI: 000055d0c529d370 RDI: 000055d0c52a43b0
Mar 14 17:31:21 cliente2 kernel: [ 363.510108] RBP: 00007fffd9fd2330 R08: 000055d0c529dfe0 R09: 00007fffd9fd0de0
Mar 14 17:31:21 cliente2 kernel: [ 363.510110] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fffd9fd2220
Mar 14 17:31:21 cliente2 kernel: [ 363.510112] R13: 00007fffd9fd21a0 R14: 000055d0c52a1000 R15: 0000000000000000
----End OUTPUT ERROR----------
Valentin Vidic
Mar 21, 2022, 5:30:04 PM3/21/22
to
On Sun, Mar 13, 2022 at 03:19:55PM +0100, Valentin Vidic wrote:
> Thanks for the report, I will try to reproduce the problem with the
> versions in unstable, but it would be good if you could share the errors
> that are being reported and perhaps also the cluster configuration for
> reproducing this problem.
Ok, it seems I can reproduce the problem with linux-image-5.16.0-4-amd64
> Thanks for the report, I will try to reproduce the problem with the
> versions in unstable, but it would be good if you could share the errors
> that are being reported and perhaps also the cluster configuration for
> reproducing this problem.
(5.16.12-1) and ocfs2-tools (1.8.7-1). It is caused by FS features
usrquota and grpquota enabled by --fs-feature-level=max-features. If
these are not enabled the filesystem mounts without problems. Otherwise
the error is as follows:
[ 389.111864] ocfs2: Mounting device (254,16) on (node 2, slot 0) with ordered data mode.
[ 389.160182] BUG: kernel NULL pointer dereference, address: 0000000000000398
[ 389.160295] #PF: supervisor read access in kernel mode
[ 389.160343] #PF: error_code(0x0000) - not-present page
[ 389.160390] PGD 0 P4D 0
[ 389.160432] Oops: 0000 [#1] PREEMPT SMP PTI
[ 389.160477] CPU: 0 PID: 836 Comm: mount.ocfs2 Not tainted 5.16.0-4-amd64 #1 Debian 5.16.12-1
[ 389.160591] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.14.0-2 04/01/2014
[ 389.160714] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
[ 389.161290] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 e0 dc c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
[ 389.161460] RSP: 0018:ffffb2c0c0047be8 EFLAGS: 00010282
[ 389.161510] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0dce0a0
[ 389.161619] RDX: 0000000000000008 RSI: ffff8b685c343c30 RDI: ffffb2c0c0047bb8
[ 389.161747] RBP: ffff8b685c343c00 R08: ffff8b685c343c00 R09: 0000000000000000
[ 389.161809] R10: ffffb2c0c0047bb0 R11: ffffffffc0d8f030 R12: ffff8b685c343c18
[ 389.161868] R13: ffff8b68462d3ec8 R14: 0000000000000000 R15: ffff8b6848fb6800
[ 389.161929] FS: 00007f7956901c00(0000) GS:ffff8b687ec00000(0000) knlGS:0000000000000000
[ 389.162009] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 389.162060] CR2: 0000000000000398 CR3: 000000000554a004 CR4: 0000000000370ef0
[ 389.162129] Call Trace:
[ 389.162184] <TASK>
[ 389.162211] ocfs2_local_read_info+0xb9/0x6f0 [ocfs2]
[ 389.162479] ? ocfs2_local_check_quota_file+0x197/0x390 [ocfs2]
[ 389.162774] dquot_load_quota_sb+0x216/0x470
[ 389.162849] ? preempt_count_add+0x68/0xa0
[ 389.162895] dquot_load_quota_inode+0x85/0x100
[ 389.162943] ocfs2_enable_quotas+0xa0/0x1c0 [ocfs2]
[ 389.163151] ocfs2_fill_super.cold+0xc8/0x1bf [ocfs2]
[ 389.163374] mount_bdev+0x185/0x1b0
[ 389.163431] ? ocfs2_initialize_super.isra.0+0xf40/0xf40 [ocfs2]
[ 389.163673] legacy_get_tree+0x27/0x40
[ 389.163726] vfs_get_tree+0x25/0xb0
[ 389.163764] path_mount+0x465/0xac0
[ 389.163804] __x64_sys_mount+0x103/0x140
[ 389.163844] do_syscall_64+0x3b/0xc0
[ 389.163919] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 389.164016] RIP: 0033:0x7f7956e0258a
[ 389.164057] Code: 48 8b 0d e9 28 0d 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d b6 28 0d 00 f7 d8 64 89 01 48
[ 389.164206] RSP: 002b:00007fff9be78718 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
[ 389.164273] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f7956e0258a
[ 389.164334] RDX: 000055bffbe230ae RSI: 000055bffc7ec370 RDI: 000055bffc7f33f0
[ 389.164395] RBP: 00007fff9be788d0 R08: 000055bffc7f3390 R09: 00007fff9be76110
[ 389.164454] R10: 0000000000000000 R11: 0000000000000246 R12: 000055bffbe230ae
[ 389.164514] R13: 000055bffc7ec301 R14: 00007fff9be787c0 R15: 00007fff9be78740
[ 389.166469] </TASK>
[ 389.168355] Modules linked in: ocfs2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue sctp ip6_udp_tunnel udp_tunnel libcrc32c intel_rapl_msr intel_rapl_common intel_pmc_core_pltdrv intel_pmc_core kvm_intel kvm irqbypass ghash_clmulni_intel snd_hda_codec_generic ledtrig_audio snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi aesni_intel crypto_simd qxl snd_hda_codec cryptd drm_ttm_helper rapl snd_hda_core ttm snd_hwdep snd_pcm serio_raw snd_timer iTCO_wdt pcspkr intel_pmc_bxt iTCO_vendor_support drm_kms_helper snd virtio_rng rng_core soundcore virtio_balloon virtio_console cec evdev joydev i6300esb rc_core watchdog qemu_fw_cfg button auth_rpcgss sunrpc drm fuse configfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic hid_generic usbhid hid virtio_net net_failover failover virtio_blk ahci xhci_pci libahci libata xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel virtio_pci virtio_pci_legacy_dev virtio_pci_modern_dev
[ 389.168645] virtio psmouse usbcore scsi_mod i2c_i801 i2c_smbus scsi_common lpc_ich usb_common virtio_ring
[ 389.187016] CR2: 0000000000000398
[ 389.188963] ---[ end trace 571e3ca036b59855 ]---
[ 389.190493] RIP: 0010:ocfs2_qinfo_lock_res_init+0x44/0x50 [ocfs2]
[ 389.191903] Code: 00 00 00 48 63 b3 b8 01 00 00 e8 87 bb ff ff 49 89 d8 48 89 ee ba 08 00 00 00 48 8b 83 b0 01 00 00 48 c7 c1 a0 e0 dc c0 5b 5d <48> 8b b8 98 03 00 00 e9 70 c4 ff ff 0f 1f 44 00 00 41 56 41 89 ce
[ 389.194688] RSP: 0018:ffffb2c0c0047be8 EFLAGS: 00010282
[ 389.195777] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffc0dce0a0
[ 389.196882] RDX: 0000000000000008 RSI: ffff8b685c343c30 RDI: ffffb2c0c0047bb8
[ 389.197984] RBP: ffff8b685c343c00 R08: ffff8b685c343c00 R09: 0000000000000000
[ 389.199068] R10: ffffb2c0c0047bb0 R11: ffffffffc0d8f030 R12: ffff8b685c343c18
[ 389.200057] R13: ffff8b68462d3ec8 R14: 0000000000000000 R15: ffff8b6848fb6800
[ 389.200938] FS: 00007f7956901c00(0000) GS:ffff8b687ec00000(0000) knlGS:0000000000000000
[ 389.201825] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 389.202721] CR2: 0000000000000398 CR3: 000000000554a004 CR4: 0000000000370ef0
--
Valentin
0 new messages