NDE Access IP ban/block problem
15 views
Skip to first unread message
Ilya Kazansky
Feb 14, 2014, 6:32:26 AM2/14/14
to ness-data...@googlegroups.com
I would like to enquire about access to the Neighbourhood Statistics Data Exchange API. We are currently in the process of loading some data from this API for R&D purposes and we are coming across a problem that our IP address appears to get banned after we download certain amount of data.
We are ensuring we do not exceed the 10,000 cell limit, and leaving plenty of time between requests, in order to avoid triggering any DDOS detection mechanism. These efforts seem to be ineffective and we still get banned.
We are trying to access quite large amounts of data in one process, which is split into smaller cells with multiple API calls, but pauses in between.
Could you please suggest some best practices or advice on how we can correctly operate the API to use a dataset of all output areas in UK.
We are ensuring we do not exceed the 10,000 cell limit, and leaving plenty of time between requests, in order to avoid triggering any DDOS detection mechanism. These efforts seem to be ineffective and we still get banned.
We are trying to access quite large amounts of data in one process, which is split into smaller cells with multiple API calls, but pauses in between.
Could you please suggest some best practices or advice on how we can correctly operate the API to use a dataset of all output areas in UK.
Reply all
Reply to author
Forward
0 new messages