Running Jobs in Parallel
3 views
Skip to first unread message
Jonathan Clark
Dec 4, 2012, 1:07:19 PM12/4/12
to ducttap...@googlegroups.com, Nathan Schneider
You can run jobs in ducttape in parallel without needing to start many
instances of ducttape in parallel. Just use the jobs flag "-j" like in
Make.
Example: ducttape workflow.tape -j50
This would run up to 50 jobs in parallel, where each job is eligible
to begin running as soon as its dependencies are met.
-Jon
---------- Original message ----------
From: Nathan Schneider <nat...@cmu.edu>
Date: Tue, Dec 4, 2012 at 11:50 AM
Subject: Re: ducttape!
To: Jonathan Clark <jhc...@cs.cmu.edu>
OK, so now I'm working with some slow jobs that I really want to be
able to run in parallel. Can I do this by running multiple ducttape
instances at once, one for each realization? Or can I hack it by
generating bash files and submitting them to the scheduler directly?
instances of ducttape in parallel. Just use the jobs flag "-j" like in
Make.
Example: ducttape workflow.tape -j50
This would run up to 50 jobs in parallel, where each job is eligible
to begin running as soon as its dependencies are met.
-Jon
---------- Original message ----------
From: Nathan Schneider <nat...@cmu.edu>
Date: Tue, Dec 4, 2012 at 11:50 AM
Subject: Re: ducttape!
To: Jonathan Clark <jhc...@cs.cmu.edu>
OK, so now I'm working with some slow jobs that I really want to be
able to run in parallel. Can I do this by running multiple ducttape
instances at once, one for each realization? Or can I hack it by
generating bash files and submitting them to the scheduler directly?
Nathan Schneider
Dec 4, 2012, 1:18:30 PM12/4/12
to Jonathan Clark, ducttap...@googlegroups.com
Oh I missed that flag somehow. Brilliant!
> --
>
>
>
>
Reply all
Reply to author
Forward
0 new messages