Featured Collections slow to load

[Benjamin Jones]

So I have a bit of a mystery.. Featured Collections is probably the slowest part of my entire site.  Yet recently added and search features are screaming fast. 

Any info you guys can provide?  I'm willing to post up whatever configs you need to see.

[Carlos Alonso]

Hi benajmin, is the same for me, i have a site with Staticsync ingest and autopopulated Featured Collectios and Themes, and when i set the the Themes Simple view so get the Fetured collection to Tiles, its spend 30 to 45 seconds to navigate form page to page, I must to deactivate the Simple view for Featured collection and the navigation is perfect, i would like to have the other nice view but with this slow navigation is not acceptable

Cheers

[Carlos Alonso]

Not pretty sure if could be causes by the reescaling of the "pre" cuality pictures to show avery feaured collection because the navigation in Text View is fast and good

Regards

El viernes, 26 de abril de 2019, 22:29:57 (UTC+2), Benjamin Jones escribió:

[Benjamin Jones]

Thank you Carlos,

While it's not as pretty, it is much faster.  Might have to make do with it :)

[afatac]

I am curious. How many featured collections and resources within them in both of your systems?

[Benjamin Jones]

Oh goodness.. lots.  Probably at least 200k+ photos and videos.  Along with a very detailed folder structure (which staticsync is replicating).  I can post my config if you'd like to see it.

[Carlos Alonso]

Yes is the same for me in my case are using the RS system to DAM Adobe Premmiere Project and we are using the Staticsync proccess to ingest with $staticsync_ingest=false; $staticsync_autotheme=true; and $staticsync_folder_structure=true; and the $theme_category_levels=20; because its a deep folder structure. The idea is can Download all the Folder via FTP to the Adobe Premiere Editing Station when the project need to be edited to modify or update some video results. obviously the Simple Theme view is pretty much nicer, but there is low control about the Pictures in the Tiles (changing based on the ingest, i guess is the last ingested one) In order to use This view thats is real Pretty to show the content would need to be faster and more customizable by variables or editable in order to can select de resource ID for the Thumbnails or Theme backgrounds

I got 110K recources in that system

El viernes, 26 de abril de 2019, 22:29:57 (UTC+2), Benjamin Jones escribió:

[afatac]

Thanks both of you for the information. I am asking the question because I want to know with this large amount of resources, what performance deterioration will we have. 

From both of your responses, it seems that the slowness is Featured Collection related (browsing in Featured Collection?). But searching and page browsing in main page are fine. Correct?

[Benjamin Jones]

You are correct.. search seems to be unaffected.

[Carlos Alonso]

I would say that it is particularly the way to visualize the outstanding collections, if you have enabled the simple view of outstanding collections, it is that it has the miniatures and you go into each category, when you have several levels of depth, in this mode of visualization becomes impracticable. If you deactivate the Simple View of Featured Collections mode, navigation becomes much lighter and you can work.

Let's say that the platform has a couple of weak points in terms of usability, I have other systems working with more than 2 million photographic resources that are penalized in terms of searches, even when the parameters of mysql, memory and storage, have been extended properly. In this case I had to hire a programmer who implements a cache dynamic, so that the navigation between resources once the search was done would be effective. We're talking about how it took up to 2 minutes to move from one resource to another using the link in the upper right corner of the viewing page. With the programmer we checked that the database response to the search query was resolved in less than 2 seconds and that the rest was processed from PHP and the application, so we implemented a cache method so that once the result was obtained, the navigation over the resources was produced over the cache.

I am not an expert in systems and surely many of our friends in the forum are working with different methods of cache, which streamline navigation between resources.

[Steve]

It appears the slowness is due to a SQL count being made on each collection.  We have the same issue.  If the collection resource count value was stored in the database predetermined, the page should load significantly faster.  However, the collection resource count would need to be updated anytime a resource was added to or deleted from a collection.

Steve

[jum...@gmail.com]

I seem to experience similar issues. Installed RS last year and it worked fine, the installation (using Google Cloud + Serverpilot) was lightning fast most of the time. 

Now recently, and seemingly after updating the system to the latest version, I experience a lot of 'spinning wheels'. We have a system that shows a public collection to non logged-in users, the results there are usually slow. And CPU utilisation on our Google Cloud machine seems to spike, despite the RS being hardly in use. 

After logging in, when browsing through these same pages the results load almost instantly. Any searches also load without noticeable delay.

Have you been able to find a workaround to these SQL issues?

[jum...@gmail.com]

To be specific, the delays I get are sometimes over 30 seconds for a results page (large thumbs).

When loading a list (text mode, no thumbs) it loads without delay, too.

[jum...@gmail.com]

Update: I managed to fix my slow load issue which was related to a Guest user role, see my response here: 

https://groups.google.com/g/resourcespace/c/Dvoe3KW5yoQ

[David Lee]

Has anyone managed to solve this issue? My issue doesn't seem to be related to the Guest user role