Hi,
I have a very simple workflow using only PyTask and custom functions. This linear workflow takes one input and then calculate stuff using this input.
Then, I needed to calculate lots of different inputs. Easy, I just used a loop:
for i, work_path in enumerate(work_paths):
fw2a = Firework(PyTask(func='workflow_functions.run_command', [...])
fw2b = Firework(PyTask(func='workflow_functions.run_command', [...])
wf = Workflow([fw2a, fw2b, [...]],
{fw2a: fw2b,
[...]},
name="Workflow %s" % str(i))
launchpad.add_wf(wf)
rapidfire(launchpad,
FWorker(),
CommonAdapter("SGE",
"fireworks_queue",
rocket_launch="rlaunch -l %s singleshot" % os.path.join(root_path, "fireworks/my_launchpad.yaml")),
reserve=False)
This is working fine. But now I need to join all those workflows to use their outputs as input for a "finishing" workflow. How can I do that?
I would have:
wf1 wf2 [...] wfn
\ | /
\ | /
\ | /
\ | /
\ | /
final_workflow
Thanks!