[slurm-dev] sample slurm/slurmdbd conf files
Williams, Kevin E. (Federal SIP)
Just started working on configuring a multi-system and multi-partition layout. I was wondering if anyone has a working slurmdbd.conf and associated slurm.conf pair that they would share?
I am assuming that the implementation model is that multiple slurmctld's would use a common database instance.
I am especially curious how slurmdbd keeps the slurm_accounting areas 'separated' and how the jobid gets handled across different instances of the slurmctld. Or, is it such that all of the systems have to be handled by a single instance of slurmctld with the various partitions all under one roof.
Many thanks in advance,
kevin
Danny Auble
Kevin, have you read
https://computing.llnl.gov/linux/slurm/accounting.html
?
man slurmdbd.conf should also help.
If you still have questions let us know.
The slurmdbd.conf should be pretty simple.
The basic line in the slurm.conf dealing with it would be
AccountingStorageType=accounting_storage/slurmdbd
the other options you can see from the man or web page.
Attached is the slurmdbd.conf I use on one of my systems.
Danny
Williams, Kevin E. (Federal SIP)
Looked in the man pages, and followed the notes there. I did a quick set up and the slurmdbd looks to be talking to the db as hoped, but the use of sacct throws a permissions error, and I have to flush the connections on the mysql side to get things back in sync. Tht's why I wanted to see a paired set of conf files that was working. I am not discounting the securities I have placed within mysql as the culprit.
Thanks,
kevin
________________________________
From: owner-s...@lists.llnl.gov [owner-s...@lists.llnl.gov] On Behalf Of Danny Auble [d...@llnl.gov]
Sent: Thursday, September 02, 2010 12:00 PM
To: slur...@lists.llnl.gov
Subject: Re: [slurm-dev] sample slurm/slurmdbd conf files
Kevin, have you read
https://*computing.llnl.gov/linux/slurm/accounting.html
Danny Auble
sacct shouldn't be talking to mysql at all if using the slurmdbd. What does the slurmdbd.log say about your sacct connection? The slurmdbd.conf should only be where the slurmdbd runs btw.
Do you have 2 munges keys or 1? I am guessing you are using munge for authentication.
Having to flush the connections seem very strange since the dbd should be the only entity talking to mysql. Are you saying the connections from the slurmdbd are not cleaning up correctly? I haven't seen that. Please inform.
Danny
Williams, Kevin E. (Federal SIP)
Quick answer is that munge is in place, and with only one key. sacct looks to be trying to talk to slurmdbd, and is getting refused. Can't send along log info, regretfully. I will continue with your sample and the accounting page as a guide. As for the flush, this has to happen after sacct tries to use slurmdbd to get info, and it gets errored. No subsequent queries will work, and a restart of slurmdbd is not possible until the connections are flushed, as per a call out by slurnmdbd.
Will let you know how this goes.
Again, thanks,
kevin
________________________________
From: owner-s...@lists.llnl.gov [owner-s...@lists.llnl.gov] On Behalf Of Danny Auble [d...@llnl.gov]
Sent: Thursday, September 02, 2010 2:14 PM
To: slur...@lists.llnl.gov
Subject: Re: [slurm-dev] sample slurm/slurmdbd conf files
sacct shouldn't be talking to mysql at all if using the slurmdbd. What does the slurmdbd.log say about your sacct connection? The slurmdbd.conf should only be where the slurmdbd runs btw.
Do you have 2 munges keys or 1? I am guessing you are using munge for authentication.
Having to flush the connections seem very strange since the dbd should be the only entity talking to mysql. Are you saying the connections from the slurmdbd are not cleaning up correctly? I haven't seen that. Please inform.
Danny
> Danny,
>
> Looked in the man pages, and followed the notes there. I did a quick set up and the slurmdbd looks to be talking to the db as hoped, but the use of sacct throws a permissions error, and I have to flush the connections on the mysql side to get things back in sync. Tht's why I wanted to see a paired set of conf files that was working. I am not discounting the securities I have placed within mysql as the culprit.
>
> Thanks,
>
> kevin
> ________________________________
> From: owner-s...@lists.llnl.gov [owner-s...@lists.llnl.gov] On Behalf Of Danny Auble [d...@llnl.gov]
> Sent: Thursday, September 02, 2010 12:00 PM
> To: slur...@lists.llnl.gov
> Subject: Re: [slurm-dev] sample slurm/slurmdbd conf files
>
>
> Kevin, have you read
>
> https://**computing.llnl.gov/linux/slurm/accounting.html