Implementation of separate_process flag

[Walter de Donato]

Hi,

I'm using PyF version 2.0.3 and I tried to use the "Advanced option" to make PyF components run as separate processes.

It seems that the XML representation of the workflow does not change when this flag is enabled.

Can someone give me an example of XML tube with this flag enabled?

Digging into the code, I found parts of the code related to the separate_process flag commented out.

Is there any possibility to enable such feature?

Should I consider it deprecated or unstable?

If the effort for re-enabling it is not huge, I would like to have some suggestions about where to apply patches into the code.

Thanks,

-Walter

[Jonathan Schemoul]

Hi,

It doesn't seem disabled (what kind of code has this commented out ? I didn't find it. I didn't check the GUI and xml generator though). This flag can be set on each node/components.

If I recal well, just add this to its xml (to the node xml) :
<advanced><separate_process>True</separate_process></advanced>

That will deffer it to another process using multiprocessing : Setting this xml node sets the argument deffer_to_process to True on the node (as per https://bitbucket.org/taieb/pyf.componentized/src/7b65fa3cce96d4e0774235e96857b9b8171f8874/pyf/componentized/core/manager.py?at=default#cl-214) and it is then picked up by the Node (in pyf.manager) :
https://bitbucket.org/faide/pyf/src/63baa665ccd8f5a3d86565d4353ffa2a92e9157c/pyf.manager/pyf/manager/network.py?at=default#cl-356

There is some commented code but it looks like it comes from earlier optimization of the garbage collecting system. Please check if it works, if not, consider tweaking it.

Jonathan

--
Vous recevez ce message, car vous êtes abonné au groupe Google Groupes "PyF Framework Users".
Pour vous désabonner de ce groupe et ne plus recevoir d'e-mails le concernant, envoyez un e-mail à l'adresse pyf-users+...@googlegroups.com.
Pour obtenir davantage d'options, consultez la page https://groups.google.com/d/optout.