[slurm-users] Moving Job form local to remote Cluster

[Shaghuf Rahman]

Hi,

Greetings of the day!

Need your suggestions on the below use cases.

I have 2 Slurm clusters pointing to the same database server. I'm submitting a job in a local cluster and once my local cluster resources get full I want to move the pending jobs to my remote cluster. Is there any way to achieve this?

My intention is that instead of the user submitting the job using -M option I want to do it on their behalf only for the Pending jobs to be moved to my remote cluster. Assuming the remote server is on cloud, and I don't want users to submit the job directly and exhaust the cloud resources even though my local cluster resources are not full.

I have not tried but does it solve my problem if i keep the database separate for both the clusters.

Please advise some suggestions or methods to achieve by some modifications.

Thanks,

Shaghuf