[slurm-users] Regarding Multi-Cluster Accounting Information

[Shaghuf Rahman]

Hi,

I am new to slurm. I am setting up a multi cluster environment. I  have 1 small doubt with respect to the user accounting. My setup will look like below:

Cluster name A: Alpha (Slurmctld)

Cluster name B: Beta (Slurmctld)

Both controllers are pointing to the same database server.

My slurm accounting name is hpc_acc_db.

I have added unique users as:

user1 alpha_grp (belongs to alpha cluster).  

user1 beta_grp {belongs to beta c.luster).

My question is if this accounting should be unique in both the clusters or it should be 2 different entries mentioned above.

do we need to add user as

sacctmgr add user user1 account=alpha_grp cluster=Alpha,Beta  or

it should be different like:

sacctmgr add user user1 account=alpha_grp cluster=Alpha

sacctmgr add user1 account=beta_grp cluster=Beta

Please let me know in case of any additional information.

Regards,

Shaghuf Rahman

[Shaghuf Rahman]

Hi,

I tried adding the 2 individual account in cluster A and ClusterB respectively

and 1 account which is added to both the cluster 

# sacctmgr show user cluster=alpha
      User   Def Acct     Admin
---------- ---------- ---------
   user1         alpha_grp None
   user2         test      None
   user3         beta_grp  None
      root       root Administ+
# sacctmgr show user cluster=beta
      User   Def Acct     Admin
---------- ---------- ---------
   user1         beta_grp  None
   user2         test      None
   user3         beta_grp  None
      root       root Administ+

So my question is does the account should be available on both the cluster or should it be unique accounts on both the cluster.

Regards,

Shaghuf

[Yair Yarom]

Hi,

We have several clusters on the same database. There are some entities which are per cluster and some which are per database.

accounts - per cluster (you can have same account name with a different account hierarchy, and different limits per cluster)

association - per cluster

qos - per database (we prefix our qos name with the cluster name to distinguish).

partitions/nodes - per cluster (not really in the database though)

users - I'm not sure. On one hand an admin user is an admin for all clusters. On the other hand, a user can have a different default account per cluster.

HTH,

--

  /|       |
  \/       | Yair Yarom | System Group (DevOps)
  []       | The Rachel and Selim Benin School
  [] /\    | of Computer Science and Engineering
  []//\\/  | The Hebrew University of Jerusalem
  [//  \\  | T +972-2-5494522 | F +972-2-5494522
  //    \  | ir...@cs.huji.ac.il
 //        |

[Shaghuf Rahman]

Hi Yair,

Thank you for clarification.

Could you please tell me which way is better for accounting related reports.

Thanks & Regards,

Shaghuf

[Yair Yarom]

Hi,

I'm not sure what you mean - what type of accounting and between which ways?

You need to create each account per cluster you want it in, and you need to add the users to the account in the relevant clusters separately.

We use different clusters as they operate differently with regards to limits and pricing. We use a single database because otherwise it will be very difficult to manage (we have a local framework to manage users within the clusters).

For reporting we have various scripts that collect all the data and we analyze it outside of slurm, though for general reporting sreport is quite handy.