Unable to download large artifacts from Nexus

Saatviga Sudhahar

unread,

May 20, 2018, 6:17:16 PM5/20/18

to Nexus Users

Hi,

I'm using Nexus Repository connector and Artifact Resolver from Jenkins to download a specific version of a .zip artifact from nexus snapshots which is around 3.3 GB.

I usually download and copy to staging environment.

But the file is not downloaded to my local nexus repository fully. It seems to download around 2 GB and then the file size gets reset and download starts again.

This results in a corruputed .zip file which I'm not able to open.

Is there a fix for this? Can I increase the size somewhere in the config or any other suggestions please?

Thanks

Rich Seddon

unread,

May 20, 2018, 6:21:33 PM5/20/18

to Nexus Users

There is no artifact size limit built into Nexus Repository Manager.

Do you have a reverse proxy such as nginx running in front of Nexus? If so, check it's configuration, it may be limiting the maximum response size.

Saatviga Sudhahar

unread,

May 20, 2018, 6:39:15 PM5/20/18

to Nexus Users

Hi Rich,

I'm not running any reverse proxy. Anything else that might cause it?

Thanks

niristotle okram

unread,

May 20, 2018, 7:25:09 PM5/20/18

to Saatviga Sudhahar, Nexus Users

Logs ?

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.
To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/9716af15-cf99-41bf-80cd-1cbc311e7189%40glists.sonatype.com.
For more options, visit https://groups.google.com/a/glists.sonatype.com/d/optout.

--

Sent from mobile device, excuse typos if any.

Alexei Znamensky

unread,

May 21, 2018, 5:33:04 AM5/21/18

to Saatviga Sudhahar, Nexus Users

Saatviga, to be on the safe side, please check whether you can create a file >2Gb in that server, using the same id you use ti run Nexus. I am thinking on ulimit - I *think* I recall seeing the 2Gb magic number as a default limit for file size, back in the day, but I am not able to check that information right now. Maybe tomorrow.

Cheers

--

You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.
To post to this group, send email to nexus...@glists.sonatype.com.

To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/8f353ba0-e1d0-42ef-9970-9bc0348446f9%40glists.sonatype.com.

For more options, visit https://groups.google.com/a/glists.sonatype.com/d/optout.

--

Alexei "RUSSOZ" Znamensky | russoz EM gmail com
"I don't know... fly casual!" -- Han Solo

Rich Seddon

unread,

May 21, 2018, 12:03:54 PM5/21/18

to Nexus Users, saat...@gmail.com

There is no artifact size limit built into Nexus Repository Manager, we have many, many users successfully deploying and retrieving very large artifacts from Nexus.

So far in all the cases I've seen it's been something on the network outside of Nexus that causes issues like this one.

On Monday, May 21, 2018 at 4:33:04 AM UTC-5, Alexei Znamensky wrote:

Saatviga, to be on the safe side, please check whether you can create a file >2Gb in that server, using the same id you use ti run Nexus. I am thinking on ulimit - I *think* I recall seeing the 2Gb magic number as a default limit for file size, back in the day, but I am not able to check that information right now. Maybe tomorrow.

Cheers

On Mon, 21 May 2018 at 10:17, Saatviga Sudhahar <saat...@gmail.com> wrote:

Hi,

I'm using Nexus Repository connector and Artifact Resolver from Jenkins to download a specific version of a .zip artifact from nexus snapshots which is around 3.3 GB.
I usually download and copy to staging environment.
But the file is not downloaded to my local nexus repository fully. It seems to download around 2 GB and then the file size gets reset and download starts again.
This results in a corruputed .zip file which I'm not able to open.

Is there a fix for this? Can I increase the size somewhere in the config or any other suggestions please?

Thanks

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/8f353ba0-e1d0-42ef-9970-9bc0348446f9%40glists.sonatype.com.
For more options, visit https://groups.google.com/a/glists.sonatype.com/d/optout.

Saatviga Sudhahar

unread,

May 22, 2018, 5:50:58 AM5/22/18

to Nexus Users, saat...@gmail.com

Thanks Alexei. I'm using a Windows Server 2008 Amazon EC2 instance to run this. Not sure how to set the ulimit in this setting.

I understand that there should be some restriction for that user in download size.

I will have a look.

Thanks

Peter Lynch

unread,

May 22, 2018, 12:58:25 PM5/22/18

to Saatviga Sudhahar, Nexus Users

On Tue, May 22, 2018 at 6:50 AM, Saatviga Sudhahar <saat...@gmail.com> wrote:

Thanks Alexei. I'm using a Windows Server 2008 Amazon EC2 instance to run this. Not sure how to set the ulimit in this setting.
I understand that there should be some restriction for that user in download size.

I will have a look.

ulimit should have nothing to do with this.

32 bit operating systems, FAT32 file systems, and Nexus running with 32bit Java have 2GB file size limits.

It is not clear if "my local nexus repository" is where the nexus-snapshots repository is which hosts this 3.3GB file. Are there two Nexus instances involved here? - one in EC2 running on Windows Server 2008 and your "local" one running on your desktop?

Regardless of the scenario, there must be log messages either by the local client which is doing the downloading or in the Nexus Repository Manager which is proxying the file from another remote server. Start by looking closely at all log messages at the time of the file size "reset" and proceed from there. Check the Logging UI in Nexus right after the problem happens and look for ERROR or WARN messages.

Thanks

On Monday, 21 May 2018 10:33:04 UTC+1, Alexei Znamensky wrote:
Saatviga, to be on the safe side, please check whether you can create a file >2Gb in that server, using the same id you use ti run Nexus. I am thinking on ulimit - I *think* I recall seeing the 2Gb magic number as a default limit for file size, back in the day, but I am not able to check that information right now. Maybe tomorrow.

Cheers

On Mon, 21 May 2018 at 10:17, Saatviga Sudhahar <saat...@gmail.com> wrote:
Hi,

I'm using Nexus Repository connector and Artifact Resolver from Jenkins to download a specific version of a .zip artifact from nexus snapshots which is around 3.3 GB.
I usually download and copy to staging environment.
But the file is not downloaded to my local nexus repository fully. It seems to download around 2 GB and then the file size gets reset and download starts again.
This results in a corruputed .zip file which I'm not able to open.

Is there a fix for this? Can I increase the size somewhere in the config or any other suggestions please?

Thanks

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.
To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/8f353ba0-e1d0-42ef-9970-9bc0348446f9%40glists.sonatype.com.
For more options, visit https://groups.google.com/a/glists.sonatype.com/d/optout.

--
Alexei "RUSSOZ" Znamensky | russoz EM gmail com
"I don't know... fly casual!" -- Han Solo

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.

To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/f66366ab-3a52-449d-ac2d-5aa18808cb45%40glists.sonatype.com.

Saatviga Sudhahar

unread,

May 22, 2018, 5:30:14 PM5/22/18

to Nexus Users, saat...@gmail.com

Thanks Peter.

After looking at the logs, it seems that some program is blocking the download. I tried turning the firewall off, but still it happens.

Here are the log messages.

2018-05-22 21:27:35,799+0000 WARN [qtp395034094-48] anonymous org.sonatype.nexus.content.internal.ContentServlet - org.eclipse.jetty.io.EofException, caused by: java.io.IOException: An established connection was aborted by the software in your host machine [client=34.209.162.157,ua=Aether,req=GET http://34.209.162.157:8081/nexus/content/groups/Ontomatrix_projects/swd/swd_web/1.0.4/swd_web-1.0.4.zip]

2018-05-22 21:27:35,856+0000 ERROR [qtp395034094-48] org.sonatype.nexus.web.internal.ErrorPageFilter - Internal error

org.eclipse.jetty.io.EofException: null

at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:914)

at org.eclipse.jetty.http.AbstractGenerator.blockForOutput(AbstractGenerator.java:528)

at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:170)

at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)

at org.sonatype.nexus.util.io.StreamSupport.copy(StreamSupport.java:59)

at org.sonatype.nexus.web.WebUtils.sendContent(WebUtils.java:105)

at org.sonatype.nexus.content.internal.ContentServlet.doGetFile(ContentServlet.java:522)

at org.sonatype.nexus.content.internal.ContentServlet.doGet(ContentServlet.java:402)

at org.sonatype.nexus.content.internal.ContentServlet.service(ContentServlet.java:352)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)

at com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:297)

at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:281)

at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:186)

at com.google.inject.servlet.AbstractServletPipeline.service(AbstractServletPipeline.java:65)

at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:112)

at com.google.inject.servlet.AbstractFilterPipeline.dispatch(AbstractFilterPipeline.java:100)

at org.sonatype.nexus.web.internal.NexusGuiceFilter$MultiFilterChain.doFilter(NexusGuiceFilter.java:82)

at com.google.inject.servlet.AbstractFilterPipeline.dispatch(AbstractFilterPipeline.java:100)

at org.sonatype.nexus.web.internal.NexusGuiceFilter$MultiFilterChain.doFilter(NexusGuiceFilter.java:82)

at com.google.inject.servlet.AbstractFilterPipeline.dispatch(AbstractFilterPipeline.java:100)

at org.sonatype.nexus.web.internal.NexusGuiceFilter$MultiFilterChain.doFilter(NexusGuiceFilter.java:82)

at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)

at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)

at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)

at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)

at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)