Considering disabling /api/videos without an filter param

13 views
Skip to first unread message

Ben Dean-Kawamura

unread,
Dec 1, 2015, 2:02:22 PM12/1/15
to amara-ap...@googlegroups.com
Hi all, we've been getting a lot of performance issues lately and one of the causes are robots that crawl the /api/videos (or /api2/partners/videos) listings.  Those listings are disallowed in our robots.txt file, but that doesn't stop all web crawlers.

We considered various ways to speed up the page, but after a bit of thinking we realized we couldn't think of a realistic use case for iterating through all videos on the amara site.  Does anyone have one?

We are considering simply disabling this listing without one of the filter args (team, video_url, project, etc).  So if you want to view your team's videos with /api/videos?team=my-team that will continue to work, but if you simply tried to fetch /api/videos, then we would return a 400 error.

If no one gets back to me with a realistic use case for this listing, then I will probably disable it in 24-48 hours.  Sorry for the short time-frame.  Normally, I would like to go through the regular API transition process, but the performance issues are very pressing.

Ben
Reply all
Reply to author
Forward
0 new messages