Stopping a task mid-run

[Michelle Brenner]

When I have a task that needs to be terminated I can change the firework status. However, that does not stop the task on the firework from finishing whatever it was doing. Say the scenario is the task is copying files from one drive to another and the second drive is filling up. I want to stop it before it does. The only way I know of is manually killing the task runner. Is there anyway to say stop all tasks on this firework immediately?

Thanks!

[Anubhav Jain]

Hi Michelle,

There is really no way for FireWorks to terminate your job midway. You will need to interact with your queue scheduler to kill the job (e.g., qdel or scancel, etc).  If you are using "reservation mode", FireWorks can help you get the queue id for a particular job ("lpad get_qid" command) to help you know which job to cancel but that's about it.

There are also ways you could write your task to check for things like disk space while copying and terminate if the disk is getting full, but you'd have to set that up in advance. This could be done with a custom Firework or using the BackgroundTask functionality. These would be pre-coded checks, not an all of a sudden "kill my job" request.

Best,

Anubhav

On Fri, Feb 9, 2018 at 12:01 PM, Michelle Brenner <mbren...@gmail.com> wrote:

When I have a task that needs to be terminated I can change the firework status. However, that does not stop the task on the firework from finishing whatever it was doing. Say the scenario is the task is copying files from one drive to another and the second drive is filling up. I want to stop it before it does. The only way I know of is manually killing the task runner. Is there anyway to say stop all tasks on this firework immediately?

Thanks!

--
You received this message because you are subscribed to the Google Groups "fireworkflows" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fireworkflows+unsubscribe@googlegroups.com.
To post to this group, send email to firewo...@googlegroups.com.
Visit this group at https://groups.google.com/group/fireworkflows.
To view this discussion on the web visit https://groups.google.com/d/msgid/fireworkflows/64de621f-bcca-4cb2-ac6e-75809d6923fd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Best,
Anubhav

[Anubhav Jain]

I just realized you never specified you were running through a queue, so the things about queue schedulers and queue ids might not be relevant for you. If you are just running "rlaunch rapidfire" or something to run jobs, you'd need to abort/kill the rlaunch command.

Best,

Anubhav

--

Best,
Anubhav