[slurm-users] Job pre / post submit scripts

[Bhaskar Chakraborty via slurm-users]

Hi,

Is there an option in slurm to launch a custom script at the time of job submission through sbatch

or salloc? The script should run with submit user permission in submit area.

The idea is that we need to enquire something which characterises our job’s requirement like CPU

slots, memory etc from a central server and we do need read access to user area prior to that.

In our use case the user doesn’t necessarily know beforehand what kind of resource his job needs.

(Hence, the need for such a script which will contact the server with user area info.)

Based on it we can modify the job a little later. A post submit script, if available, would inform us the slurm job id as well, it would get called just after the job has entered the system and prior to its scheduling.

Thanks,

Bhaskar.

Sent from Yahoo Mail for iPad

[Davide DelVento via slurm-users]

Not sure if I understand your use case, but if I do I am not sure if Slurm provides that functionality.

If it doesn't (and if my understanding is correct), you can still achieve your goal by:

1) removing sbatch and salloc from user's path

2) writing your own custom scripts named sbatch (and hard/symbolic linked to salloc) which does what you want and at the end (with $0 variable or similar thing) it actually invokes full-path to sbatch and salloc -- actually it could do that after, rather than before, if you so prefer

Hope this helps

--
slurm-users mailing list -- slurm...@lists.schedmd.com
To unsubscribe send an email to slurm-us...@lists.schedmd.com

[Christopher Samuel via slurm-users]

On 10/28/24 10:56 am, Bhaskar Chakraborty via slurm-users wrote:

> Is there an option in slurm to launch a custom script at the time of job
> submission through sbatch
> or salloc? The script should run with submit user permission in submit area.

I think you are after the cli_filter functionality which can run plugins
in that environment. There is a Lua plugin for that which will allow you
to write your code in something a little less fraught than C.

https://slurm.schedmd.com/cli_filter_plugins.html

There is example Lua code for this here:

https://github.com/SchedMD/slurm/blob/master/etc/cli_filter.lua.example

All the best,
Chris
--
Chris Samuel : http://www.csamuel.org/ : Berkeley, CA, USA

[Di Bernardini, Fabio via slurm-users]

Have you already seen if SrunProlog or TaskProlog could be useful for your case?
The documentation is here: https://slurm.schedmd.com/prolog_epilog.html

 

--

Fabio

 

From: Bhaskar Chakraborty via slurm-users <slurm...@lists.schedmd.com>
Sent: Monday, October 28, 2024 6:56 PM
To: slurm...@schedmd.com
Subject: [EXTERNAL] [slurm-users] Job pre / post submit scripts

 

CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.

NICE SRL, viale Monte Grappa 3/5, 20124 Milano, Italia, Registro delle Imprese di Milano Monza Brianza Lodi REA n. 2096882, Capitale Sociale: 10.329,14 EUR i.v., Cod. Fisc. e P.IVA 01133050052, Societa con Socio Unico

[Bhaskar Chakraborty via slurm-users]

Thanks for the help.

Shall try to check the client plugin option 1st else have to revert to the other alternative which, though more of a workaround, also looks good & promising.

-Bhaskar.