Media Library Timeout: filebrowser_safe + Django Storage + S3 Issue?

[Evan Cordulack]

I have Mezzanine-powered site running on Heroku and hooked up to Amazon S3 to serve static files. To interact with S3, I have set up django-storages using the S3boto backend. For the most part, this setup is working well. (I really happy with Mezzanine!)

However, when uploading content, I started to notice a problem with the media browser. When browsing a directory of images using the Media Library, the request will stop. This only happens for directories that have a fair number of images--10 or so images won't cause a problem, but 100 will. This problem appeared only after switching to django-storages.

After having issues with this using Heroku and locally running Foreman, I tried Django's server locally (manage.py runserver). It turned out that the media browser would eventually open, but it took a very long time. Based on Heroku's documentation, this seems to make sense that that these requests would not finish before Heroku stops the request from completing.

I then enabled logging for Boto. The log files it was generating were very large (25-50 MB) filled mostly with XML concerning the images in my S3 bucket. These log files were generated when loading the main media browser page in the admin (the one that lists all your directories) as well as browsing individual directories from a specific page type. I had hoped that this might be something with the number of items returned per page, but lowering the FILEBROWSER_LIST_PER_PAGE option changed the number of items displayed, but did not speed solve anything.

I haven't been able to track down other people posting about this problem, but I did find these threads about django-storages:

https://bitbucket.org/david/django-storages/issue/178/storageexists-s3boto-storages-is-making-a

https://bitbucket.org/david/django-storages/issue/186/the-size-property-is-eating-gigs-of-ram

I was hoping someone might have some suggestions about the next steps to get this working or point me in the right direction. Should I look into filebrowser_safe? django-storages?

Thanks!

[Evan Cordulack]

I am wondering if this is the same/similar issue here:

https://groups.google.com/d/msg/mezzanine-users/kjsAw6WFqMY/BtQjs5lyVJEJ

[JayL]

I just ran into the same problem. Have you solved it yet?

Does anyone know how to solve this time out problem on Heroku?

Thanks

[Evan Cordulack]

Sadly, I didn't solve this issue.

I ended up hosting the project on Gondor.io and everything worked fine.

--
You received this message because you are subscribed to a topic in the Google Groups "Mezzanine Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mezzanine-users/SDtXpEdi85c/unsubscribe.
To unsubscribe from this group and all its topics, send an email to mezzanine-use...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.