same nodeID mapped across multiple storage targetIDs

[test01]

Hi,

I have a beegfs setup in which there are 2 storage servers, each serving 4 storage targets. When i tried to check the target details , it seems that 1 nodeID got registered 4 times - 

[root@client1 ]# beegfs-ctl --listtargets --nodetype=storage  --state  --longnodes

TargetID     Reachability  Consistency   NodeID

========     ============  ===========   ======

       1           Online         Good   beegfs-storage storageA-storage1-d01 [ID: 1]

       2           Online         Good   beegfs-storage storageA-storage1-d01 [ID: 1]

       3           Online         Good   beegfs-storage storageA-storage1-d01 [ID: 1]

       4           Online         Good   beegfs-storage storageA-storage1-d01 [ID: 1]

       5           Online         Good   beegfs-storage storageB-storage1-d05 [ID: 2]

       6           Online         Good   beegfs-storage storageB-storage1-d05 [ID: 2]

       7           Online         Good   beegfs-storage storageB-storage1-d05 [ID: 2]

       8           Online         Good   beegfs-storage storageB-storage1-d05 [ID: 2]

I intended to setup the following storage targets from serverA and B- 
[root@storageA ~]# cat /beegfs/storageA-storage1-*/nodeID

storageA-storage1-d01

storageA-storage1-d02

storageA-storage1-d03

storageA-storage1-d04

[root@storageB ~]# cat /beegfs/storageB-storage1-*/nodeID

storageB-storage1-d05

storageB-storage1-d06

storageB-storage1-d07

storageB-storage1-d08

i am setting the beegfs for the first time, so i think the output should have been - 

TargetID     Reachability  Consistency   NodeID

========     ============  ===========   ======

       1           Online         Good   beegfs-storage storageA-storage1-d01 [ID: ??]

       2           Online         Good   beegfs-storage storageA-storage1-d02 [ID: ??]

       3           Online         Good   beegfs-storage storageA-storage1-d03 [ID: ??]

       4           Online         Good   beegfs-storage storageA-storage1-d04 [ID: ??]

       5           Online         Good   beegfs-storage storageB-storage1-d05 [ID: ??]

       6           Online         Good   beegfs-storage storageB-storage1-d06 [ID: ??]

       7           Online         Good   beegfs-storage storageB-storage1-d07 [ID: ??]

       8           Online         Good   beegfs-storage storageB-storage1-d08 [ID: ??]

We had a script to set things up so, looking at the output which may have registered storageA-storage1-d01 4 times  for serverA and 4 times  storageB-storage1-d05 for serverB. 

example - 

beegfs-setup-storage -c /etc/beegfs/beegfs-storage.conf -p /beegfs/storageA-storage1-d${d} -m mgmt -S storageA-storage1-d${d}

but when i check the free space i get - 

[root@client1 ]# beegfs-ctl --listtargets --nodetype=storage  --state   --spaceinfo

beegfs-ctl --listtargets --nodetype=storage  --state  --longnodes --spaceinfo

TargetID     Reachability  Consistency        Total         Free    %      ITotal       IFree    %   NodeID

========     ============  ===========        =====         ====    =      ======       =====    =   ======

       1           Online         Good   17864.1GiB   16649.2GiB  93%     1873.4M     1873.4M 100%   beegfs-storage storageA-storage1-d01 [ID: 1]

       2           Online         Good   17864.1GiB   16214.5GiB  91%     1873.4M     1873.4M 100%   beegfs-storage storageA-storage1-d01 [ID: 1]

       3           Online         Good   17864.1GiB   16360.7GiB  92%     1873.4M     1873.4M 100%   beegfs-storage storageA-storage1-d01 [ID: 1]

       4           Online         Good   17864.1GiB   17174.2GiB  96%     1873.4M     1873.4M 100%   beegfs-storage storageA-storage1-d01 [ID: 1]

       5           Online         Good   17864.1GiB   16971.7GiB  95%     1873.4M     1873.4M 100%   beegfs-storage storageB-storage1-d05 [ID: 2]

       6           Online         Good   17864.1GiB   15174.0GiB  85%     1873.4M     1873.4M 100%   beegfs-storage storageB-storage1-d05 [ID: 2]

       7           Online         Good   17864.1GiB   17358.4GiB  97%     1873.4M     1873.4M 100%   beegfs-storage storageB-storage1-d05 [ID: 2]

       8           Online         Good   17864.1GiB   14442.4GiB  81%     1873.4M     1873.4M 100%   beegfs-storage storageB-storage1-d05 [ID: 2]

if same NodeID was registered as different storage targetID, i would expect identical free space across TargetID 1-4 and 5-8. 

So i am a bit confused here. Is there a way to confirm that same path was not used to initialize multiple target iDs? or is that the expected output?. I have following in cnf file on storageA - 

storeStorageDirectory        = ,/beegfs/storageA-storage1-d01 ,/beegfs/storageA-storage1-d02 ,/beegfs/storageA-storage1-d03 ,/beegfs/storageA-storage1-d04

please advice.

- puneet

[test01]

Was going through one of the posts in the forum, https://groups.google.com/g/fhgfs-user/c/a9B8HYnFG2M
here , the user's setup has 3 storage nodes with 6,8,6 storage targets.

TargetID     Reachability  Consistency   NodeID
========     ============  ===========   ======

      1           Online         Good   beegfs-storage b1 [ID: 1]
      2           Online         Good   beegfs-storage b1 [ID: 1]
      3           Online         Good   beegfs-storage b1 [ID: 1]
      4           Online         Good   beegfs-storage b1 [ID: 1]
      5           Online         Good   beegfs-storage b1 [ID: 1]
      6           Online         Good   beegfs-storage b1 [ID: 1]
      7           Online         Good   beegfs-storage b2 [ID: 2]
      8           Online         Good   beegfs-storage b2 [ID: 2]
     10           Online         Good   beegfs-storage b2 [ID: 2]
     11           Online         Good   beegfs-storage b2 [ID: 2]
     12           Online         Good   beegfs-storage b2 [ID: 2]
     13           Online         Good   beegfs-storage b2 [ID: 2]
     14           Online         Good   beegfs-storage b2 [ID: 2]
     15           Online         Good   beegfs-storage b2 [ID: 2]
     16           Online         Good   beegfs-storage b3 [ID: 3]
     17           Online         Good   beegfs-storage b3 [ID: 3]
     18           Online         Good   beegfs-storage b3 [ID: 3]
     19           Online         Good   beegfs-storage b3 [ID: 3]
     20           Online         Good   beegfs-storage b3 [ID: 3]
     21           Online         Good   beegfs-storage b3 [ID: 3]

So i guess the beegfs output in my setup is normal. The source of confusion is  that i have a very large file striped across 8 ST, and i am trying t somehow confirm that it has been striped across multiple "different" STs.

[root@client1]# beegfs-ctl --getentryinfo --verbose testFile.0

Entry type: file

EntryID: B-612A6896-5

Metadata node: metaA-numa1-2 [ID: 5]

Stripe pattern details:

+ Type: RAID0

+ Chunksize: 1M

+ Number of storage targets: desired: 8; actual: 8

+ Storage targets:

  + 6 @ storageB-storage1-d05 [ID: 2]

  + 7 @ storageB-storage1-d05 [ID: 2]

  + 8 @ storageB-storage1-d05 [ID: 2]

  + 1 @ storageA-storage1-d01 [ID: 1]

  + 2 @ storageA-storage1-d01 [ID: 1]

  + 3 @ storageA-storage1-d01 [ID: 1]

  + 4 @ storageA-storage1-d01 [ID: 1]

  + 5 @ storageB-storage1-d05 [ID: 2]

Chunk path: u0/612A/0/0-612A0DC6-1/B-612A6896-5

Dentry path: 71/73/0-612A0DC6-1/

[root@client1]#

so, i can see that the file is striped across 8 ST, but i am in doubt because of the nodeID displayed in aforementiones stdout.
This is what i have on storage servers - 

root@storageA ~]# cat /beegfs/storageA-storage1-*/nodeID

storageA-storage1-d01

storageA-storage1-d02

storageA-storage1-d03

storageA-storage1-d04

[root@storageB ~]# cat /beegfs/storageB-storage1-*/nodeID

storageB-storage1-d05

storageB-storage1-d06

storageB-storage1-d07

storageB-storage1-d08

This output would have looked very convincing - 

+ Storage targets:

  + 6 @ storageB-storage1-d06 [ID: 2]

  + 7 @ storageB-storage1-d07 [ID: 2]

  + 8 @ storageB-storage1-d08 [ID: 2]

  + 1 @ storageA-storage1-d01 [ID: 1]

  + 2 @ storageA-storage1-d02 [ID: 1]

  + 3 @ storageA-storage1-d03 [ID: 1]

  + 4 @ storageA-storage1-d04 [ID: 1]

  + 5 @ storageB-storage1-d05 [ID: 2]

please advice in case am missing out on something here.