Uploading ZIP file using API

[Rafael Segovia]

Hello!

We have been using the API to upload different files (png, dcm, pdf...) to QATrack. We are now trying to upload a ZIP file (we have done it before in the web app with File Upload) using the API in a python script, but it crushes. I think it's related to the value and encode parameters, but I don't know how to solve it. If I substitute the path to the zip file for a pdf file, it works perfectly. 

'tests': {
'rt_dicom_xvi_catphan_503_zip': {
'filename': 'catphan_503.zip',
'value': base64.b64encode(open(self.zip_path, 'rb').read()).decode(),
'encoding': 'base64'
},
'rt_informe_catphan_503': {
'filename': 'informe_catphan_503.pdf',
'value': base64.b64encode(open(self.pdf_path, 'rb').read()).decode(),
'encoding': 'base64'
}
},

I could use some help!

Thank you in advance,

Rafael

[Alex Bredikin]

Are you getting a particular error message when it crashes? Not sure if it is related, but earlier this year I was trying to upload Catphan images (.zip file) via the API, and I was getting a returned status code of (I think) 400 - I ended up having to adjust a particular setting in IIS... I think it was maybe either maxRequestLength or maxAllowedContentLength? Sorry, my memory is foggy.

Alex

[Rafael Segovia]

Hi!

Thank you for your answer. We are getting the status code 200. We have done some tests and it is related to the size of the zip file. Does anybody know how to change the limitation? Is it possible?

Thank you in advance,

Rafael

--
You received this message because you are subscribed to the Google Groups "QATrack+" group.
To unsubscribe from this group and stop receiving emails from it, send an email to qatrack+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/qatrack/d15331ae-f242-461e-843c-ddad454f0645n%40googlegroups.com.

[Alex Bredikin]

Here are some Microsoft articles I found on Google.

For maxRequestLength: https://learn.microsoft.com/en-us/iis/configuration/system.webserver/security/requestfiltering/requestlimits/#how-to-edit-the-request-filtering-feature-settings-and-request-limits

For maxAllowedContentLength, https://learn.microsoft.com/en-us/answers/questions/1191697/request-entity-too-large-iis-10-error-on-request-s

Alex

--

Alex Bredikin

alexbr...@gmail.com | 610.425.1222

[Jose Macias Jaen]

Hello everyone,

We're encountering the same issue with uploading a ZIP file using the QATrack API. The status code returned is 500. The upload works perfectly when done manually. Does anyone know if QATrack supports file chunking or a similar option? If the API allows it, we could try uploading the file in chunks or dividing it into smaller parts for separate uploads.

Thanks!

To view this discussion on the web visit https://groups.google.com/d/msgid/qatrack/CAJdZph4qoYbz%2BHZse%3D4fwQmar%3DZ6qg8O8Uv0Ss%3DOvP4jcMxUWg%40mail.gmail.com.

--

José Macías Jaén

Facultativo Especialista de Área Radiofísica Hospitalaria

Hospital Universitario Virgen Macarena

Avda. Dr. Fedriani nº3 41009 Sevilla

Móvil: 679602892

[Randle Taylor]

Hi,

QATrack+ does not have any chunked upload options.  If you're getting a 500 error you should be able to look in the QATrack log files and see if an exception was logged there to help diagnose the issue.  B64 encoding a file increases the size of the data significantly so it could be people are bumping into the maxRequestLength/maxAllowedContentLength that Alex pointed out, or there could be a server out of memory issue.

Rafael did you try to adjust maxRequestLength/maxAllowedContentLength?  If so, what were the results?

Randy

To view this discussion visit https://groups.google.com/d/msgid/qatrack/CABRer09Fc%3Dk0mm5EymE27pSpAcHnkLwB0mZwvPbHGtFXJzbhUQ%40mail.gmail.com.

[Rafael Segovia]

Hello Randle!

Thanks for your answer. I've just found the log file with the mistake (image below). Not sure if it is related with QATrack or with our server (Linux). The parameters maxRequestLength/maxAllowedContentLength should be configured in the QATrack files or in our server?

Thank you in advance.

Regards,

Rafael

To view this discussion visit https://groups.google.com/d/msgid/qatrack/CA%2BwpsayvcFj-wG6HMwO9EEz80dNaBC8HHBr%2Bdr0HhworHKqXqg%40mail.gmail.com.

[Randle Taylor]

Hi Rafael,

Sorry for the slow response.  The maxRequestLength parameter is only relevant to MSSQL so that's not the issue.  The MemoryError indicates that the server is running out of memory when trying to determine the encoding of the uploaded file.

If you are comfortable with it, you can edit the qatrack/api/qa/serializers.py file and edit the offending line from:

if not BASE64_RE.match(content):

to

if not BASE64_RE.match(content[:200]):

then restart Apache, that may reduce the memory used when determining the file encoding and allow your upload to proceed.

Randy

[Rafael Segovia]

Hi Randle,

There's no need to apologize. We implemented the modification you suggested, and it solved the problem! 🎉

Thank you very much for your assistance and hard work.

Best regards from Spain,

Rafa