inconsistency in usage reporting
Pinkesh Valdria
When I tried to update the file list with the beegfs-fsck --enablequota command, the following error occurred.
[opc@t-oci-l01 ~]$ sudo beegfs-fsck --enablequota
BeeGFS File System Check Version : 7.1.4
--------------------------------------------------------------------
Started BeeGFS fsck in enableQuota mode [Fri Sep 25 10:29:22 2020]
Log will be written to /var/log/beegfs-fsck.log
Database files will be saved in /var/lib/beegfs/
--------------------------------------------------------------------
Step 1: Check reachability of nodes: Finished
Processed 5989860 entries
1 errors occurred. Please see Metadata server logs for more details.
[opc@t-oci-l01 ~]$
When I checked the log of the metadata server, the following was recorded.
(2) Sep25 10:41:00 CommSlave6 [Set chunk file attribs work] >> Communication with storage target failed. TargetID: 3; entryID: 0-5F33529A-1
(2) Sep25 10:41:00 CommSlave118 [Set chunk file attribs work] >> Communication with storage target failed. TargetID: 5; entryID: 0-5F33529A-1
(2) Sep25 10:41:00 CommSlave4 [Set chunk file attribs work] >> Communication with storage target failed. TargetID: 4; entryID: 0-5F33529A-1
(2) Sep25 10:41:00 CommSlave126 [Set chunk file attribs work] >> Communication with storage target failed. TargetID: 1; entryID: 0-5F33529A-1
(2) Sep25 10:41:00 Worker20 [AdjustChunkPermissionsMsgEx::sendSetAttrMsg] >> Problems occurred during setting of chunk file attribs. fileID: 0-5F33529A-1
When I ran fsck read-only, I got the following results: (I am only showing the lines where it showed errors)
[opc@t-oci-l01 ~]$ sudo beegfs-fsck --checkfs --readOnly --databasePath=/var/tmp/beegfs-fsck_readonly
BeeGFS File System Check Version : 7.1.4
----
--------------------------------------------------------------------
Started BeeGFS fsck in forward check mode [Fri Sep 25 11:16:25 2020]
Log will be written to /var/log/beegfs-fsck.log
Database will be saved in /var/tmp/beegfs-fsck_readonly
--------------------------------------------------------------------
Step 1: Check reachability of nodes: Finished
-----
Waiting for metadata servers to start modification logging. This might take some time.
-----
Step 3: Gather data from nodes:
Fetched data > Directory entries: 5990005 | Inodes: 5990006 | Chunks: 5602580
-----
Waiting for metadata servers to stop modification logging. This might take some time.
-----
Step 4: Check for errors...
* Checking: File has a missing target in stripe pattern ...
>>> Found 1 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
* Checking: Dangling directory entry ...
>>> Found 1 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
* Checking: Attributes of file inode are wrong ...
>>> Found 88 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
* Checking: Chunk has wrong permissions ...
>>> Found 12 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
Found 102 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
> Entry ID: 0-5F33529A-1; Path: /dir-list; Node: 1 - [ra: ]
>>> Found 1 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
* Checking: Dentry-by-ID file is present, but no corresponding dentry ...
>>> None found
* Checking: Dentry-by-ID file is broken or missing ...
>>> None found
* Checking: Chunk without an inode pointing to it (orphaned chunk) ...
>>> None found
* Checking: Chunk is saved in wrong path ...
>>> None found
* Checking: Wrong owner node saved in inode ...
>>> None found
* Checking: Dentry points to inode on wrong node ...
>>> None found
* Checking: Content directory without an inode ...
>>> None found
* Checking: Dir inode without a dentry pointing to it (orphaned inode) ...
>>> None found
* Checking: File inode without a dentry pointing to it (orphaned inode) ...
>>> None found
* Checking: Dangling directory entry ...
> Entry ID: 86-5EF1B691-1; Path: [<disposal>]/86-5EF1B691-1; Node: 1 - [ra: ]
>>> Found 1 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
* Checking: Directory inode without a content directory ...
>>> None found
* Checking: Attributes of file inode are wrong ...
> File ID: 0-5F33529A-1; Path: /dir-list; Node: 1 - [ra: ]
> File ID: 0-5F6D4DF3-1; Path: [<disposal>]/0-5F6D4DF3-1; Node: 1 - [ra: ]
> File ID: 1-5F6D4B1A-1; Path: [<disposal>]/1-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: 2-5F647F02-1; Path: [<disposal>]/2-5F647F02-1; Node: 1 - [ra: ]
> File ID: 2-5F6D4DB7-1; Path: [<disposal>]/2-5F6D4DB7-1; Node: 1 - [ra: ]
> File ID: 3-5F647F02-1; Path: [<disposal>]/3-5F647F02-1; Node: 1 - [ra: ]
> File ID: 3-5F6D30DE-1; Path: [<disposal>]/3-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: 4-5F6D4B1A-1; Path: [<disposal>]/4-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: 5-5F6D4DB7-1; Path: [<disposal>]/5-5F6D4DB7-1; Node: 1 - [ra: ]
> File ID: 6-5F433EFB-1; Path: [<disposal>]/6-5F433EFB-1; Node: 1 - [ra: ]
> File ID: 6-5F6D30DE-1; Path: [<disposal>]/6-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: 6-5F6D49EB-1; Path: [<disposal>]/6-5F6D49EB-1; Node: 1 - [ra: ]
> File ID: 6-5F6D4B1A-1; Path: [<disposal>]/6-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: 8-5F648DC2-1; Path: [<disposal>]/8-5F648DC2-1; Node: 1 - [ra: ]
> File ID: 9-5F6D30DE-1; Path: [<disposal>]/9-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: 9-5F6D4B1A-1; Path: [<disposal>]/9-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: 9-5F6D4DB7-1; Path: [<disposal>]/9-5F6D4DB7-1; Node: 1 - [ra: ]
> File ID: A-5F6D309F-1; Path: /home/knt03497/.star-12.06.011/var/log/messages.log.1; Node: 1 - [ra: ]
> File ID: A-5F6D3BB2-1; Path: [<disposal>]/A-5F6D3BB2-1; Node: 1 - [ra: ]
> File ID: A-5F6D4B1A-1; Path: [<disposal>]/A-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: B-5F433EFB-1; Path: [<disposal>]/B-5F433EFB-1; Node: 1 - [ra: ]
> File ID: B-5F6BE99D-1; Path: [<disposal>]/B-5F6BE99D-1; Node: 1 - [ra: ]
> File ID: B-5F6D30DE-1; Path: [<disposal>]/B-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: B-5F6D440F-1; Path: [<disposal>]/B-5F6D440F-1; Node: 1 - [ra: ]
> File ID: B-5F6D4B1A-1; Path: [<disposal>]/B-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: C-5F6BE99D-1; Path: [<disposal>]/C-5F6BE99D-1; Node: 1 - [ra: ]
> File ID: C-5F6D30DE-1; Path: [<disposal>]/C-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: C-5F6D4B1A-1; Path: [<disposal>]/C-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: D-5F6D3BB2-1; Path: [<disposal>]/D-5F6D3BB2-1; Node: 1 - [ra: ]
> File ID: E-5F6D3FA2-1; Path: [<disposal>]/E-5F6D3FA2-1; Node: 1 - [ra: ]
> File ID: E-5F6D4B1A-1; Path: [<disposal>]/E-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: F-5F6D4DB7-1; Path: [<disposal>]/F-5F6D4DB7-1; Node: 1 - [ra: ]
> File ID: 10-5F6D30DE-1; Path: [<disposal>]/10-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: 10-5F6D3BB2-1; Path: [<disposal>]/10-5F6D3BB2-1; Node: 1 - [ra: ]
> File ID: 11-5F6D3BB2-1; Path: [<disposal>]/11-5F6D3BB2-1; Node: 1 - [ra: ]
> File ID: 11-5F6D3FA2-1; Path: [<disposal>]/11-5F6D3FA2-1; Node: 1 - [ra: ]
> File ID: 11-5F6D5126-1; Path: /prj/vcfd/work01/TEMP/PAS/RUN_1/RUN_1_3/RUN_1_3.discerr; Node: 1 - [ra: ]
> File ID: 12-5F6D2E68-1; Path: [<disposal>]/12-5F6D2E68-1; Node: 1 - [ra: ]
> File ID: 12-5F6D30DE-1; Path: [<disposal>]/12-5F6D30DE-1; Node: 1 - [ra: ]
> File ID: 13-5F62B2AF-1; Path: [<disposal>]/13-5F62B2AF-1; Node: 1 - [ra: ]
> File ID: 13-5F6D50A8-1; Path: /prj/vcfd/work01/TEMP/PAS/RUN_1/RUN_1_4/watch_after.log; Node: 1 - [ra: ]
> File ID: 14-5F62B270-1; Path: [<disposal>]/14-5F62B270-1; Node: 1 - [ra: ]
> File ID: 14-5F6D3BB2-1; Path: [<disposal>]/14-5F6D3BB2-1; Node: 1 - [ra: ]
> File ID: 14-5F6D3FA2-1; Path: [<disposal>]/14-5F6D3FA2-1; Node: 1 - [ra: ]
> File ID: 14-5F6D50A8-1; Path: /prj/vcfd/work01/TEMP/PAS/RUN_1/RUN_1_4/PowerFlowPRE.log; Node: 1 - [ra: ]
> File ID: 15-5F6D5069-1; Path: /prj/vcfd/work01/TEMP/PAS/RUN_1/RUN_1_3/watch_after.log; Node: 1 - [ra: ]
> File ID: 16-5F6D3BB2-1; Path: [<disposal>]/16-5F6D3BB2-1; Node: 1 - [ra: ]
> File ID: 16-5F6D3FA2-1; Path: [<disposal>]/16-5F6D3FA2-1; Node: 1 - [ra: ]
> File ID: 17-5F47185C-1; Path: [<disposal>]/17-5F47185C-1; Node: 1 - [ra: ]
> File ID: 18-5F47185C-1; Path: [<disposal>]/18-5F47185C-1; Node: 1 - [ra: ]
> File ID: 18-5F6D3FA2-1; Path: [<disposal>]/18-5F6D3FA2-1; Node: 1 - [ra: ]
> File ID: 18-5F6D5165-1; Path: /prj/vcfd/work01/TEMP/PAS/RUN_1/RUN_1_4/RUN_1_4.discerr; Node: 1 - [ra: ]
> File ID: 1B-5F6D3609-1; Path: [<disposal>]/1B-5F6D3609-1; Node: 1 - [ra: ]
> File ID: 1B-5F6D3FA2-1; Path: [<disposal>]/1B-5F6D3FA2-1; Node: 1 - [ra: ]
> File ID: 1C-5F6D4F6D-1; Path: [<disposal>]/1C-5F6D4F6D-1; Node: 1 - [ra: ]
> File ID: 1D-5F6D2784-1; Path: [<disposal>]/1D-5F6D2784-1; Node: 1 - [ra: ]
> File ID: 20-5F6D2784-1; Path: [<disposal>]/20-5F6D2784-1; Node: 1 - [ra: ]
> File ID: 21-5F6D2DAB-1; Path: [<disposal>]/21-5F6D2DAB-1; Node: 1 - [ra: ]
> File ID: 23-5F6D2784-1; Path: [<disposal>]/23-5F6D2784-1; Node: 1 - [ra: ]
> File ID: 24-5F6D2784-1; Path: [<disposal>]/24-5F6D2784-1; Node: 1 - [ra: ]
> File ID: 24-5F6D50A8-1; Path: /prj/vcfd/work01/TEMP/PAS/RUN_1/RUN_1_4/RUN_1_4.stats; Node: 1 - [ra: ]
> File ID: 26-5F6C49D2-1; Path: [<disposal>]/26-5F6C49D2-1; Node: 1 - [ra: ]
> File ID: 27-5F6C49D2-1; Path: [<disposal>]/27-5F6C49D2-1; Node: 1 - [ra: ]
> File ID: 28-5F6D4FAC-1; Path: [<disposal>]/28-5F6D4FAC-1; Node: 1 - [ra: ]
> File ID: 29-5F6BD6EA-1; Path: [<disposal>]/29-5F6BD6EA-1; Node: 1 - [ra: ]
> File ID: 2A-5F62B270-1; Path: [<disposal>]/2A-5F62B270-1; Node: 1 - [ra: ]
> File ID: 2A-5F6D2784-1; Path: [<disposal>]/2A-5F6D2784-1; Node: 1 - [ra: ]
> File ID: 2C-5F62B2AF-1; Path: [<disposal>]/2C-5F62B2AF-1; Node: 1 - [ra: ]
> File ID: 2C-5F6D2784-1; Path: [<disposal>]/2C-5F6D2784-1; Node: 1 - [ra: ]
> File ID: 2C-5F6D315C-1; Path: [<disposal>]/2C-5F6D315C-1; Node: 1 - [ra: ]
> File ID: 2E-5F6D27C3-1; Path: [<disposal>]/2E-5F6D27C3-1; Node: 1 - [ra: ]
> File ID: 2E-5F6D2DEA-1; Path: [<disposal>]/2E-5F6D2DEA-1; Node: 1 - [ra: ]
> File ID: 30-5F6C303B-1; Path: [<disposal>]/30-5F6C303B-1; Node: 1 - [ra: ]
> File ID: 34-5F6D2FA3-1; Path: [<disposal>]/34-5F6D2FA3-1; Node: 1 - [ra: ]
> File ID: 36-5F6D2DEA-1; Path: [<disposal>]/36-5F6D2DEA-1; Node: 1 - [ra: ]
> File ID: 3A-5F6D2DEA-1; Path: [<disposal>]/3A-5F6D2DEA-1; Node: 1 - [ra: ]
> File ID: 3C-5F6D2DEA-1; Path: [<disposal>]/3C-5F6D2DEA-1; Node: 1 - [ra: ]
> File ID: 41-5F6D2DEA-1; Path: [<disposal>]/41-5F6D2DEA-1; Node: 1 - [ra: ]
> File ID: 42-5F6C29D6-1; Path: [<disposal>]/42-5F6C29D6-1; Node: 1 - [ra: ]
> File ID: 45-5F6D2DEA-1; Path: [<disposal>]/45-5F6D2DEA-1; Node: 1 - [ra: ]
> File ID: 49-5F6D2F25-1; Path: [<disposal>]/49-5F6D2F25-1; Node: 1 - [ra: ]
> File ID: 55-5F6C4E7F-1; Path: [<disposal>]/55-5F6C4E7F-1; Node: 1 - [ra: ]
> File ID: 5D-5F6D2B74-1; Path: /prj/ptparts/work03/CFD-2U/knt03497/03_Low-Coupling_UI6-Java-macro_test/star.log; Node: 1 - [ra: ]
> File ID: 73-5F6D315C-1; Path: [<disposal>]/73-5F6D315C-1; Node: 1 - [ra: ]
> File ID: 83-5F575557-1; Path: [<disposal>]/83-5F575557-1; Node: 1 - [ra: ]
> File ID: 84-5F575557-1; Path: [<disposal>]/84-5F575557-1; Node: 1 - [ra: ]
> File ID: 8C-5F6D4B1A-1; Path: [<disposal>]/8C-5F6D4B1A-1; Node: 1 - [ra: ]
> File ID: 1D3-5F645E8A-1; Path: [<disposal>]/1D3-5F645E8A-1; Node: 1 - [ra: ]
>>> Found 88 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
* Checking: Attributes of dir inode are wrong ...
>>> None found
* Checking: Chunk has wrong permissions ...
> Chunk ID: 0-5F6D4DF3-1; Target: 101; File path: [<disposal>]/0-5F6D4DF3-1 - [ra: ]
> Chunk ID: 1-5F6D4B1A-1; Target: 101; File path: [<disposal>]/1-5F6D4B1A-1 - [ra: ]
> Chunk ID: 2-5F6D4DB7-1; Target: 101; File path: [<disposal>]/2-5F6D4DB7-1 - [ra: ]
> Chunk ID: 3-5F6D30DE-1; Target: 101; File path: [<disposal>]/3-5F6D30DE-1 - [ra: ]
> Chunk ID: 6-5F433EFB-1; Target: 101; File path: [<disposal>]/6-5F433EFB-1 - [ra: ]
> Chunk ID: A-5F6D3BB2-1; Target: 101; File path: [<disposal>]/A-5F6D3BB2-1 - [ra: ]
> Chunk ID: E-5F6D3FA2-1; Target: 101; File path: [<disposal>]/E-5F6D3FA2-1 - [ra: ]
> Chunk ID: 14-5F62B270-1; Target: 101; File path: [<disposal>]/14-5F62B270-1 - [ra: ]
> Chunk ID: 1C-5F6D4F6D-1; Target: 101; File path: [<disposal>]/1C-5F6D4F6D-1 - [ra: ]
> Chunk ID: 1D-5F6D2784-1; Target: 101; File path: [<disposal>]/1D-5F6D2784-1 - [ra: ]
> Chunk ID: 2A-5F62B270-1; Target: 101; File path: [<disposal>]/2A-5F62B270-1 - [ra: ]
> Chunk ID: 2E-5F6D2DEA-1; Target: 101; File path: [<disposal>]/2E-5F6D2DEA-1 - [ra: ]
>>> Found 12 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.
Found 102 errors. Detailed information can also be found in /var/log/beegfs-fsck.out.