Is there a way to build a singularity container from a docker file on github?

675 views
Skip to first unread message

Jonathan Greenberg

unread,
Mar 9, 2018, 4:59:44 PM3/9/18
to singularity
Specifically, I want to build a container from:


Is there a way to build a singularity definition that grabs that and builds the dockerfile (e.g. via Singularity Hub)?

v

unread,
Mar 9, 2018, 6:51:36 PM3/9/18
to singu...@lbl.gov
If you don't want to have a Singularity recipe that you need to dually update, then just add one that references the build on Docker Hub, like

Bootstrap:docker
From: namespace/repo:tag

There was experimental support for Dockerfiles (and I might add this back, because it's pretty easy to do) but it wasn't used by anyone, and you know what happens to those features...

So it's not currently active!

--
You received this message because you are subscribed to the Google Groups "singularity" group.
To unsubscribe from this group and stop receiving emails from it, send an email to singularity+unsubscribe@lbl.gov.



--
Vanessa Villamia Sochat
Stanford University '16

Aaron Culich

unread,
Mar 9, 2018, 6:56:44 PM3/9/18
to singu...@lbl.gov
I'd be interested in seeing this experimental support for Dockerfiles if it can be easily revived since we have several use cases here at Berkeley like the PDAL one that Jonathan mentioned.

Thanks,
 Aaron

--
Aaron Culich <acu...@berkeley.edu>
Research IT Service Architect
Berkeley Research Computing (BRC)
XSEDE Campus Champion
University of California, Berkeley
http://research-it.berkeley.edu/brc



To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.



--
Vanessa Villamia Sochat
Stanford University '16

v

unread,
Mar 9, 2018, 7:36:51 PM3/9/18
to singu...@lbl.gov
It came down to a very stupid (but challenging given all the possible ways to write the two files) procedure - a mapping from a Dockerfile to Singularity, done via commands. It used to be provided as an interface (GUI) on Singularity Hub but I removed it. If you have interest, then let's do it! If I open up a repo with this conversion, would you be able to help test it out? We would want the converter to have been tested for high accuracy for different kids of recipes. If yes, I can definitely rekindle this for a fun weekend project :) I'm huge +1 to kill two birds with one stone, two containers with one file!

To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.

--
You received this message because you are subscribed to the Google Groups "singularity" group.
To unsubscribe from this group and stop receiving emails from it, send an email to singularity+unsubscribe@lbl.gov.

Jeffrey Layton

unread,
Mar 10, 2018, 12:18:00 PM3/10/18
to singu...@lbl.gov
+100

Being able to make either a Singularity or Docker container from a single file is really attractive on so many levels. I'm glad to test it out :)

Thanks!

Jeff


To unsubscribe from this group and stop receiving emails from it, send an email to singularity+unsubscribe@lbl.gov.

Jonathan Greenberg

unread,
Mar 10, 2018, 2:46:21 PM3/10/18
to singularity
Me too!  Let me know!

--j
To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.

v

unread,
Mar 10, 2018, 3:31:51 PM3/10/18
to singu...@lbl.gov
Will do! I'm on it!




To unsubscribe from this group and stop receiving emails from it, send an email to singularity+unsubscribe@lbl.gov.

v

unread,
Mar 11, 2018, 3:50:19 PM3/11/18
to singu...@lbl.gov
Hey everyone! The converter is ready to go, ready for your testing, that is!

The pull request to add to the Singularity Python client are here:


and please note the branch you will be testing from is my fork (master):


And I've done this so you can easily see the rendered documentation (also on my fork):


More detail is provided in the notes for the PR linked above. Please test things out, ask for changes (I didn't test all the weird possible recipe options that exist... I need your help!)  and we can make changes to the vsoch fork until it's good to go. Also please note that the Singularity back to Docker converter is in place to be written, but not done yet, TBA!

I am likely braking (breaking) on this for the day, but look forward to working with everyone!

Best,

Vanessa

Reply all
Reply to author
Forward
0 new messages