API Slow performance

29 views
Skip to first unread message

Justin Estruch

unread,
Feb 28, 2020, 8:48:23 AM2/28/20
to SherpaDesk API
Hi,

I am seeing very slow performance with the API over the past few days. Particularly with GET /users lately. Any reason for this?

Justin Estruch

unread,
Feb 28, 2020, 11:10:22 AM2/28/20
to SherpaDesk API
Also I am noticing the API is taking 25 seconds to respond after making our first API call. For example, if I call GET /users and then based on the user.id of the user I call GET /assets. The GET /assets call takes 25 seconds to respond while the GET /users call only takes 500ms. Is there some sort of rate limiting/ DDOS prevention going on here? 

Justin Estruch

unread,
Mar 2, 2020, 11:13:27 AM3/2/20
to SherpaDesk API
Hello any update on this?


On Friday, February 28, 2020 at 8:48:23 AM UTC-5, Justin Estruch wrote:

Eugene

unread,
Mar 2, 2020, 11:45:56 AM3/2/20
to SherpaDesk API
Hi,

>Also I am noticing the API is taking 25 seconds to respond after making our first API call. For example, if I call GET /users and then based on the user.id of the user I call GET /assets. The GET /assets call takes 25 seconds to respond while the GET /users call only takes 500ms. Is there some sort of rate limiting/ DDOS prevention going on here? 


If servers are in High DTU mode (overloaded), we delay group of items requests for 25 seconds and item request for 5 sec.

If servers has normal load, we dont limit requests. You can see it on presence of 
X-Highdtu-Mode:
header. more value is servers more overloaded.

high dtu.PNG



Eugene

high dtu.PNG

пятница, 28 февраля 2020 г., 15:48:23 UTC+2 пользователь Justin Estruch написал:

Justin Estruch

unread,
Mar 2, 2020, 11:56:14 AM3/2/20
to SherpaDesk API
Thank you. But according to the Wiki, API requests are limited to 600 per hour? Is that 600 per authenticated API account? Or is it 600 API calls for the SherpaDesk API globally? 

Because I am nowhere near 600 per hour.

Is there a way to not be affected by the High DTU header as a paying customer?

Thanks,
Justin

Eugene

unread,
Mar 2, 2020, 12:21:25 PM3/2/20
to sherpad...@googlegroups.com
Hi,

Thanks for reply. I need to update wiki for High DTU mode.
we limit requests per organization. But there are time periods, when users do a lot of heavy requests.
So we need to protect our servers from DDOS attack. 
When we detect high load on Database, we add High DTU limit and add additional limit for frequent requests.
from 25 seconds. If you detect this header. please do your request rate longer, not every millisecond.

according to our logs. only 6 requests were in high load times. others were done instantly.

rate limit.PNG



Eugene

понедельник, 2 марта 2020 г., 18:56:14 UTC+2 пользователь Justin Estruch написал:

Justin Estruch

unread,
Mar 2, 2020, 3:39:50 PM3/2/20
to SherpaDesk API
Thanks Eugeen,

Is it possible for SherpaDesk to override or whitelist our public IP or organization API key? Reason being, we've created an application that accesses in Real time what assets are assigned to our users. So we need this data to be realtime and not a nightly sync or something along that line.

Thanks,
Justin

Eugene Tolmachev

unread,
Mar 2, 2020, 4:39:15 PM3/2/20
to 'Justin Estruch' via SherpaDesk API
yea, this is possible
how many requests and total data size you expect each day?

Eugene

От: 'Justin Estruch' via SherpaDesk API <sherpad...@googlegroups.com>
Отправлено: 2 марта 2020 г. 22:39
Кому: SherpaDesk API <sherpad...@googlegroups.com>
Тема: Re: API Slow performance
 

This email message, including any attachment(s), may contain confidential and privileged information. It is for the sole use of the intended recipient and  therefore, any unauthorized review, use, disclosure, duplication or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.  Thank you.

 

--
You received this message because you are subscribed to the Google Groups "SherpaDesk API" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sherpadesk-ap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sherpadesk-api/7843ea3c-eddd-4d5a-8766-01c05fd5afc6%40googlegroups.com.

Justin Estruch

unread,
Mar 3, 2020, 12:06:51 PM3/3/20
to SherpaDesk API
Thanks Eugene. Do I need to send you my Org API key or my public IP? Also throughout the year we only do a few API calls during the day (maybe 100 per day) then for two weeks a year we will likely do (1000 to 3000 API calls per day). This is when we check in and out our Chromebooks for the district for all our students.

Thanks.
To unsubscribe from this group and stop receiving emails from it, send an email to sherpad...@googlegroups.com.

Eugene Tolmachev

unread,
Mar 3, 2020, 12:09:26 PM3/3/20
to 'Justin Estruch' via SherpaDesk API
Hi,

I whitelisted your org for now. 
When I optimize API limits logic, I'll notify you to test.

Please keep updated on any problems with API,

Eugene

От: 'Justin Estruch' via SherpaDesk API <sherpad...@googlegroups.com>
Отправлено: 3 марта 2020 г. 19:06
To unsubscribe from this group and stop receiving emails from it, send an email to sherpadesk-ap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sherpadesk-api/42a1d4bf-910c-4eef-bef0-c7c46089093c%40googlegroups.com.

Eugene

unread,
Mar 6, 2020, 6:10:26 AM3/6/20
to SherpaDesk API
Hi,

no thanks. I added SBOE org to whitelist. Your limits 600 calls each hour.

Eugene

вторник, 3 марта 2020 г., 19:06:51 UTC+2 пользователь Justin Estruch написал:
Reply all
Reply to author
Forward
0 new messages