I'm developing an analytic platform for agriculture that will use slurm to manage computing resources and singularity to manage the run time environment. In this platform, an authorised developer can upload a package in the form of a tar.gz file containing a singularity image and how the image is used to analyse data. Because of the complex software dependency like R, it is hard to build a singularity image under 500MB. I like singularity because of its simplicity and there is no need to have an image depends on other image.
We knew and encountered the apache file upload before. When I lowered the upload limit to only 50MB, and my upload is 300MB, at my curl client side I got a 500 internal server error message delivered in the HTML format and at the server error log I got an message saying the upload is exceeding the limit. With this 50MB upload limit, if the upload is 600MB, there is the same error message. When the upload limit in the apache is raised to 800MB, and the upload is 600MB, on my curl client side I got empty reply from the server and there is a segmentation fault at the apache log. If the upload is only below 500MB with upload limit of 800MB, the upload is successful.
I just realised that on openSUSE I have singularity 3.7.2 while on Centos I have 3.8.0.