No space left on device

[George Zaki]

Hi,

I am on the master branch and I run:

sudo singularity build  candle.simg ./swift-hypervisor.def

I kept building till I get this error with a python package:
IOError: [Errno 28] No space left on device
ABORT: Aborting with RETVAL=255


As in 2.4, there is no mention of the contianer size, what am I missing? This used be build fine with 2.3.

Here is the def file, and the other R and python dependencies:

https://github.com/ECP-CANDLE/Distribution/blob/master/swift-hypervisor.def

Thanks,
George.

[Thomas Hartmann]

Hi George,

have you run out of inodes?
(I run once into the trap once when I build on a smallish fs with many
maildir etc. files)

Cheers,
Thomas

> --
> You received this message because you are subscribed to the Google
> Groups "singularity" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to singularity...@lbl.gov
> <mailto:singularity...@lbl.gov>.

[George Zaki]

Thanks Thomas, 

I don't think that I run out of inodes on the host OS. I built the container using the sandbox option with no problem. I am not sure why I can't build the simg directly from the def file.

Best regards,

George.

You received this message because you are subscribed to a topic in the Google Groups "singularity" group.
To unsubscribe from this topic, visit https://groups.google.com/a/lbl.gov/d/topic/singularity/c1g2tZO3Q-8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to singularity...@lbl.gov.

[George Zaki]

Hi singularity group, 

Did anybody face the same problem before. As I understand in 2.4 there is no reason to define the container size. What would cause that problem then? 

To give more context, I was able to generate a container using the sandbox option and convert it back to simg. However I would like to generate the simg directly.

Thanks,

George.

[Oliver Freyermuth]

Hi George,

I'm not fully sure, but my best guess is that your TMPDIR is overflowing. Potentially, you have a small tmpfs mounted there?
Singularity uses TMPDIR for the build before squashing things together to an simg as far as I know.
You should be able to control that by setting the environment variable SINGULARITY_CACHEDIR to a different location with more space
(we use a ramdisk for this purpose). Too bad documentation does not clearly state that, I also had to figure that our from the code a while ago,
and asked for documentation improvements.

Cheers,
Oliver

> https://github.com/ECP-CANDLE/Distribution/blob/master/swift-hypervisor.def <https://github.com/ECP-CANDLE/Distribution/blob/master/swift-hypervisor.def>

[v]

Hey George and Oliver,

Aw, let's fix up the docs! How is this for a first shot?

http://singularity.lbl.gov/faq#no-space-left-on-device

> To unsubscribe from this group and stop receiving emails from it, send an email to singularity+unsubscribe@lbl.gov <mailto:singularity+unsub...@lbl.gov>.

--
You received this message because you are subscribed to the Google Groups "singularity" group.

To unsubscribe from this group and stop receiving emails from it, send an email to singularity+unsubscribe@lbl.gov.

--

Vanessa Villamia Sochat
Stanford University '16

(603) 321-0676

[Levi Baber]

I also added some info about the $TMPDIR to this page:

http://singularity.lbl.gov/build-environment

> To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov <mailto:singularity...@lbl.gov>.

--
You received this message because you are subscribed to the Google Groups "singularity" group.

To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.

--

Vanessa Villamia Sochat
Stanford University '16

(603) 321-0676

--

You received this message because you are subscribed to the Google Groups "singularity" group.

To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.

[George Zaki]

Thanks Levi. 

From the documentation, do you set SINGULARITY_LOCALCACHEDIR or SINGULARITY_TMPDIR or both?

> To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov <mailto:singularity+unsub...@lbl.gov>.

--
You received this message because you are subscribed to the Google Groups "singularity" group.
To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.

[Rutu Pandya]

Hi Vanessa,

How to  set the $SINGULARITY_CACHEDIR to a different location?

Or what other alternatives to deal with "No space left" error?

Thanks and sorry if this is a repetition!

Rutu

On Wednesday, January 24, 2018 at 10:10:13 AM UTC-5, George Zaki wrote:

[v]

Hey Rutu,

You can export SINGULARITY_CACHEDIR to somewhere with more space, see here https://www.sylabs.io/guides/3.0/user-guide/build_env.html for the docs.

Best,

Vanessa

--

You received this message because you are subscribed to the Google Groups "singularity" group.
To unsubscribe from this group and stop receiving emails from it, send an email to singularity...@lbl.gov.

To view this discussion on the web visit https://groups.google.com/a/lbl.gov/d/msgid/singularity/3af1206c-45d7-495f-9331-fa35eaf6553a%40lbl.gov.