Does Bpipe support Docker/Singularity container technology or Conda environments ?

27 views
Skip to first unread message

Neulhyo

unread,
May 5, 2020, 8:24:21 AM5/5/20
to bpipe-discuss
Hello,
Everything is in the question title : Does Bpipe support Docker/Singularity container technology or Conda environments ?
I have not seen anything about in it the documentation or in Q/A so I'm unsure about it. There is a paper about Nextflow (Di Tommaso, P., Chatzou, M., Floden, E. W., Barja, P. P., Palumbo, E., & Notredame, C. (2017). Nextflow enables reproducible computational workflows. Nature Biotechnology, 35(4), 316–319. doi:10.1038/nbt.3820) assuming that Bpipe does not support Docker containers but since I have seen that Bpipe does now support AWS and GCS cloud computing and storage, I've thought that the information about Docker may be out to date. 

Thank you in advance !

Simon Sadedin

unread,
May 5, 2020, 9:54:00 PM5/5/20
to bpipe-discuss on behalf of Neulhyo
Hi Neulhyo,

Bpipe doesn't currently provide any specific support for running commands or pipelines in containers.

Of course, it doesn't stop you at all from doing that if docker is available in your environment. But you have to, of course, provision (or build) the container image yourself, and then prefix your commands with the appropriate "docker run" and volume mounts so that the files are visible and mapped to the right locations etc.

I'd be curious to know what the kinds of features would be useful in this space - potentially it will not require too much work to add them and I can see it will be very generally useful to do so.

Cheers,

Simon


--
You received this message because you are subscribed to the Google Groups "bpipe-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bpipe-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bpipe-discuss/678bd1c1-1cbc-492e-ad72-621b0ff9476e%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages