Very simple makeflow fails

14 views
Skip to first unread message

sprock

unread,
Apr 6, 2022, 12:37:59 PM4/6/22
to Cooperative Computing Tools
Hello,

Just getting back to work after a long layoff.   I have a very simple workflow:

URL="/home/rmason/Scratch/elkjobs"
CP=/bin/cp

run: ./mpi_mixed_species_sources.sh
    $(CP) mpi_mixed_species_sources.sh $(URL)/run

When executed the file $(URL)/run is created but makeflow does not recognise its own success:

parsing runelk.mfl...
local resources: 1.000 cores, 0 MB memory, 2062145 MB disk
max running local jobs: 1
checking runelk.mfl for consistency...
runelk.mfl has 1 rules.
recovering from log file runelk.mfl.makeflowlog...
checking for old running or failed jobs...
will retry failed rule: /bin/cp mpi_mixed_species_sources.sh "/home/rmason/Scratch/elkjobs"/run
deleted run  
checking files for unexpected changes...  (use --skip-file-check to skip this step)
starting workflow....
submitting job: /bin/cp mpi_mixed_species_sources.sh "/home/rmason/Scratch/elkjobs"/run
submitted job 95098
job 95098 completed
/bin/cp mpi_mixed_species_sources.sh "/home/rmason/Scratch/elkjobs"/run did not create file run
deleted makeflow.failed.0
rule 0 failed, moving any outputs to makeflow.failed.0
deleted run
2022/04/06 14:03:42.59 makeflow[95008] notice: will retry failed job /bin/cp mpi_mixed_species_sources.sh "/home/rmason/Scratch/elkjobs"/run
submitting job: /bin/cp mpi_mixed_species_sources.sh "/home/rmason/Scratch/elkjobs"/run
submitted job 95142
job 95142 completed

and after several repeat attempts it ends thus:

2022/04/06 14:03:42.67 makeflow[95008] notice: job /bin/cp mpi_mixed_species_sources.sh "/home/rmason/Scratch/elkjobs"/run failed too many times.

I'm sure there is something I'm missing.

I appreciate any help.

Thanks,
Roger

Ben Tovar

unread,
Apr 6, 2022, 1:03:27 PM4/6/22
to cctoo...@googlegroups.com
Roger,

makeflow is looking for the file "run" in the current directory. You want something like:

URL="/home/rmason/Scratch/elkjobs"
CP=/bin/cp

$(URL)/run: ./mpi_mixed_species_sources.sh
    $(CP) mpi_mixed_species_sources.sh $(URL)/run


Ben


--
You received this message because you are subscribed to the Google Groups "Cooperative Computing Tools" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cctools-nd+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cctools-nd/091877b7-4337-442f-b054-4801a3289bc4n%40googlegroups.com.

Roger Mason

unread,
Apr 6, 2022, 1:22:29 PM4/6/22
to cctoo...@googlegroups.com
Thank you Ben, That was indeed the problem. Well spotted!

Ben Tovar

unread,
Apr 6, 2022, 1:24:29 PM4/6/22
to cctoo...@googlegroups.com
Nice, thanks for letting us know!


Ben

--
You received this message because you are subscribed to the Google Groups "Cooperative Computing Tools" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cctools-nd+...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages