Reverse proxy large file upload restlet timeout

[legacy....@gmail.com]

All,

     First, thanks everyone for helping me out with getting XNAT working, I have only been working with it for a two months now.  

     I'm having an issue uploading large files (2gb+) into XNAT v1.7.3.1 using the compressed uploader.  It works fine if I use tomcat (localhost:8080), I tested with a 5.5gb file.  I have my all the timeouts I can find in my proxy set to 40 minutes and I keep getting 'Processing of multipart/form-data request failed.  Read timed out' errors.  The upload seems to be going fine, the XNAT upload progress indicator moves to 96% at a steady rate then slows to a crawl but never gets past 98%.  Using chrome on my client machine, which displays a uploading status box, substantially lags behind the XNAT progress bar.  When XNAT hits 96% chrome shows around 40% uploaded.  The only log that shows any kind of error is the restlet log (attached).  Now is the point I should mention that I'm using Windows Server 2016, IIS 10, ARR, and URL Rewrite for my reverse proxy.

Thanks again 

Sean

[McKay, Mike]

Have you set both connectionTimeout and connectionUploadTimeout to a large time period in the Tomcat server.xml file?

-Mike

---

From: xnat_di...@googlegroups.com <xnat_di...@googlegroups.com> on behalf of legacy....@gmail.com <legacy....@gmail.com>
Sent: Wednesday, September 6, 2017 11:15:49 AM
To: xnat_discussion
Subject: [XNAT Discussion] Reverse proxy large file upload restlet timeout

 

--
You received this message because you are subscribed to the Google Groups "xnat_discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xnat_discussi...@googlegroups.com.
To post to this group, send email to xnat_di...@googlegroups.com.
Visit this group at https://groups.google.com/group/xnat_discussion.
For more options, visit https://groups.google.com/d/optout.

 

---

The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

[legacy....@gmail.com]

Mike,

    Thanks for the reply, I made those changes (both 10 minutes) and the XNAT upload indicator sticks at 98% and the Chrome upload stops at 97%.  Everything is pointing towards IIS reverse proxy but I have request filter max allowed content length set to 4gb and all the timeouts I can find set to 20 minutes.  I'm not getting any errors from IIS or Tomcat.  It seems that Tomcat times out waiting for the upload through the proxy.  At this point we may push our sites to use the upload assistant tool.  The drawbacks for us using that tool is the fact that the sites cannot upload to prearchive (we use it for data validation by our project managers and statisticians) and it requires installation on the client computers (they may not have the required access to do that).  I'm going to keep tinkering away.

Sean

[McKay, Mike]

I'm not very familiar with your proxy configuration so I don't know what might be going wrong with that (I'm assuming the files you're trying to upload are significantly less than 4gb).

If you go with the upload assistant route, is there a reason you couldn't set the prearchive settings in the projects your users are uploading to so that the data ends up in the prearchive? The setting is under the 'Manage' tab at the top of the project page in the 'Define Prearchive Settings' section.

-Mike

---

From: xnat_di...@googlegroups.com <xnat_di...@googlegroups.com> on behalf of legacy....@gmail.com <legacy....@gmail.com>

Sent: Wednesday, September 6, 2017 2:25:15 PM
To: xnat_discussion
Subject: Re: [XNAT Discussion] Reverse proxy large file upload restlet timeout

 

Mike,

    Thanks for the reply, I made those changes (both 10 minutes) and the XNAT upload indicator sticks at 98% and the Chrome upload stops at 97%.  Everything is pointing towards IIS reverse proxy but I have request filter max allowed content length set to 4gb and all the timeouts I can find set to 20 minutes.  I'm not getting any errors from IIS or Tomcat.  It seems that Tomcat times out waiting for the upload through the proxy.  At this point we may push our sites to use the upload assistant tool.  The drawbacks for us using that tool is the fact that the sites cannot upload to prearchive (we use it for data validation by our project managers and statisticians) and it requires installation on the client computers (they may not have the required access to do that).  I'm going to keep tinkering away.

Sean

--

You received this message because you are subscribed to the Google Groups "xnat_discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xnat_discussi...@googlegroups.com.
To post to this group, send email to xnat_di...@googlegroups.com.
Visit this group at https://groups.google.com/group/xnat_discussion.
For more options, visit https://groups.google.com/d/optout.

[legacy....@gmail.com]

Mike,

    I didn't see the prearchive settings for the projects in XNAT.  Thanks for pointing it out to me.  I just ran a test and it worked perfectly.  Now I just need to make sure that the sites can get the desktop uploader installed.  I'm going to play around with IIS reverse proxy settings.  I may look into using ngnix as a proxy instead.

Sean