Issue with sbatch

[Harsimran Singh]

Hi folks,

tl;dr: getting sbatch: error: Batch job submission failed: Invalid qos specification 

I'm trying to flatten some data files using FlattenForFSRoot. I am using a python file to make a shell script which submits sbatch jobs for flattening. (I got this file from the last tutorial.) My version of the file exists at: /w/halld-scshelf2101/hsingh/etapr_eta/flattening_scripts/flatten_data.py

Now, this python script is working and I am able to get the master shell script (/w/halld-scshelf2101/hsingh/etapr_eta/scripts/dataSubmitJobs_flatten_trees_2018-08.sh) which further has individual shell scripts (/w/halld-scshelf2101/hsingh/etapr_eta/scripts/subScripts/*.sh). But when I source this master shell script. I get the error: 

sbatch: error: Batch job submission failed: Invalid qos specification

I interactively ran the command from one of the many individual shell scripts:

/w/halld-scshelf2101/hsingh/hd_utilities/FlattenForFSRoot/flatten -in /cache/halld/RunPeriod-2018-08/analysis/ver15/tree_pippimetaeta__B4/merged/tree_pippimetaeta__B4_050685.root -out /w/halld-scshelf2101/hsingh/etapr_eta/dataTrees/RunPeriod-2018-08/tree_pippimetaeta__B4_flat_050685.root -chi2 20 -numUnusedTracks 1 -numUnusedNeutrals 2 -shQuality 0.5 -usePolarization 1 -combos 2

and it worked well.

Anyone have any idea what I might be missing? I googled and it said that it could be because I have requested a resource to which I do not have access. I'm assuming the data files here. But in that case why would interactive command works? I'm not sure if that's the actual reason. Can anyone help?

Best,

Harsimran

[Alexander Austregesilo]

Hi Harsimran,

I believe, the "resource" describes the requested account, cpu, memory, etc in slurm. You can find some documentation about slurm at JLab here:

https://scicomp.jlab.org/docs/farm_slurm_batch

You definitely have to specify the account "halld" and the partition "production" for your jobs to be scheduled properly.

Please let me know if it works. Cheers,

Alex

--
You received this message because you are subscribed to the Google Groups "GlueX Software Help" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gluex-softwar...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/gluex-software/CAMN_qfd0m1T2tZE90aKxx_5xNLnrTXn9wU8BCk8_baq0qZha-A%40mail.gmail.com.

-- 
Alexander Austregesilo

Staff Scientist - Experimental Nuclear Physics
Thomas Jefferson National Accelerator Facility
Newport News, VA
aaus...@jlab.org
(757) 269-6982

[Harsimran Singh]

Hi Folks,

The solution to this problem was removing the line:
#SBATCH -q phi

from the individual shell scripts.

Thanks to Alex and Josh!

Best,

Harsimran 

To view this discussion visit https://groups.google.com/d/msgid/gluex-software/9e5c8455-32f2-4407-8585-c1aee9c517c8%40jlab.org.