Still chasing RS 10 Uppy/tus upload problems

[Mike Perry]

RS 10.1 r22588
Ubuntu 22.04.1 LTS (Shared Server)
PHP 8.0.30
MySQL 8.0.33

All Installation checks OK

Single small file uploads (< 7-8 MB) usually succeed. Multiple files uploads always fail to upload most files.

I have browser headers captured as .har files.

First file of 2

"startedDateTime": "2023-08-23T10:23:40.947-04:00",
        "request": {
          "bodySize": 0,
          "method": "HEAD",
          "url": "http://mysite/pages/upload_batch.php/files/ecddd62a-7cc5-42a4-93f2-80bbaecaf356",
          "httpVersion": "HTTP/1.1",

Note: /files/ecddd62a-7cc5-42a4-93f2-80bbaecaf356 -- as upload_batch.php is a file there is no discreet directory 'files', and no discreet file asset 'ecddd62a-7cc5-42a4-93f2-80bbaecaf356'. I'm presuming these are created server variables referenced in cookies. As best I can tell tus breaks down larger assets in to smller buckets (~5MB each). When I look at filestore/tmp/tus after a failed upload there are folders with uncompleted file uploads. Completed folders and files are cleaned/deleted.

After a 410 error captured in the headers there is this:

"cookies": [
            {
              "name": "upload_session",
              "value": "deleted"
            },

Important?

Uppy/tus seems to make multiple upload attempts, getting a 410 error for whatever they are trying to upload. Occasionally I can keep clicking "Retry" in the upload window and get the upload to eventually complete.

Filestore/tmp/tus/ has 777 permissions.

The latest updates have minimized uppy.js -- it's impossible to try and track what's happening in debug.

Any Uppy/tus gurus out there who can tell me what to look for? I've tried multiple OSs (Windows/MacOS/IOS), and even bypassed my router. No joy. The problem has to be server based. I have PHP error reporting on, get no logged Apache server errors. Short of trying a real-time session with my hosting company tech support I'm not sure where to turn. Having a specific functionality in the process to target might help.

Uppy and tus forums have to date been useless.

Thanks for reading. . .

Mike

[Mike Perry]

Sorry -- RS version is 10.2

[Mike Perry]

Ongoing journey - some new findings.

I've been monitoring browser network communications during upload sessions. When logged into RS there is a constant and frequent GET call:

http://pbtest10.mysite.com/pages/ajax/message.php?ajax=true&check_upgrade_in_progress=true&_=1694009186694 which in the stack trace calls upload_batch.php:456.5, which I presume is an attempt to return to the uppy/tus upload. 

jquery-3-6-0.min.js is the initiator.

Does jquery really need to check for updates this frequently? And could these frequent checks be creating collisions and disruptions with the uppy/tus functions resulting in the 410 "Gone" status messages for the upload?

This is getting incredibly frustrating. . .

[Mike Perry]

Thinking this through probably not the issue, as it would most likely manifest itself in other installations. I can't imagine other Ubuntu servers would react differently.

[Mike Perry]

Appears to be resolved.

Spent almost 2 hours with hosting tech support, attempting uploads, monitoring server activity. Solution seems to have been moving to PHP 8.1. Thought I had tried that, but may have not successfully done so.

Won't claim this is a global solution, but worth trying to solve issues.

Mike

[Mike Perry]

Wasn't fixed, but now finally have the answer as to the cause of the problems.

I'm currently on a shared server. My hosting vendor informed me today that the PHP extension apcu will not function in their shared server environment. It can be loaded via php.ini and shows as OK in the RS installation test, but does not perform. The tech said I should use a dedicated server; I will investigate the viability of a virtual private server if they advise me it will function in that environment.

Those in shared server environment be aware of this potential shortcoming.

[Fleming, Bill]

We are also on a shared server using cPanel.  RS upload has always been working for us however it stopped working for us few version ago and We are also trying to troubleshoot this as well too. 

I don’t think this is the case because we been using it since version 9 then it was still working for on version 10 when it was released about a month ago then a few version later it would no longer upload for us. 

All we get is like a stick upload progressive bar.  

We are still trying to troubleshoot this. 

Bill Fleming

Web Developer / Programmer, Assemblies of God World Missions

AG National Office | (417) 268-9555

On Sep 15, 2023, at 4:07 PM, Mike Perry <mi...@incitevisual.com> wrote:



[EXTERNAL EMAIL]

--
ResourceSpace: Open Source Digital Asset Management
http://www.resourcespace.com
---
You received this message because you are subscribed to the Google Groups "ResourceSpace" group.
To unsubscribe from this group and stop receiving emails from it, send an email to resourcespac...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/resourcespace/c65424d3-53aa-45bc-bb76-e238cb24bd48n%40googlegroups.com.

[Mike Perry]

Bill - 

I needed to confirm with my hosting provider that apcu was functional in the shared hosting environment. They informed me due to load issues and server configuration it was not functional in the shared server environment.

You should confirm that apcu will function in your shared server. It may load fine as an extension via php.ini and show as OK in Installation Check, but the server won't run it as needed. My hosting service says it will function in their Virtual Private Systems (VPS) as well as a dedicated server.

Your mileage may vary 😀

Mike

[Fleming, Bill]

Mike 

Have you tried disabling apcu then test the upload? 

RS still should work without the apcu but it’ll be a slower process.  From my understanding, apcu is just a cache extension to speed up the querying.

Bill Fleming

Web Developer / Programmer, Assemblies of God World Missions

AG National Office | (417) 268-9555



[EXTERNAL EMAIL]

To view this discussion on the web, visit https://groups.google.com/d/msgid/resourcespace/ab1274be-207b-4a9e-a808-aa526fc6dae9n%40googlegroups.com.

[Mike Perry]

No I haven't -- will test. . .

[Mike Perry]

Great call, Bill -- that works.

Disabling apcu eliminated the 410 upload errors, and also the stalling of the post-upload Processing image. I have 500Mb upload bandwidth, and the server upload speeds don't seem to be greatly compromised not using apcu.

Moral of this story (for me) -- the apcu extension may be recommended for faster uploads; it does not appear to be an absolute functional requirement.

👋👋👋

[Fleming, Bill]

That great to know! .. I am having upload issue as well on RS 10.1+ since I upgraded from 9.  I’ll go disable mine as well too to see if that fixes mine end. I just didn’t have the time to go reconfigure my php.

 

Bill Fleming

Web Developer / Programmer, Assemblies of God World Missions

AG National Office | (417) 268-9555

 

From: resour...@googlegroups.com <resour...@googlegroups.com> on behalf of Mike Perry <mi...@incitevisual.com>
Date: Tuesday, September 19, 2023 at 8:38 AM
To: ResourceSpace <resour...@googlegroups.com>
Subject: Re: Still chasing RS 10 Uppy/tus upload problems

[EXTERNAL EMAIL]

To view this discussion on the web, visit https://groups.google.com/d/msgid/resourcespace/4898e4a3-4c43-4593-b4c6-b0f2473398e4n%40googlegroups.com.