bulk request

33 views
Skip to first unread message

divadpoc

unread,
Aug 2, 2012, 12:00:43 PM8/2/12
to zemanta-d...@googlegroups.com
Hy,

I'm currently indexing my data w/ fields i get from your service. As it's lots of data there are a lot of requests, and this might influence your server, I assume. Is there a way to combine a number of requests into one request, or should I just put a delay for each new request on my side? what happens if I just keep requesting, will the service just stop returning me results?
an example w/ the amount of data: i have around 2000 tweets, and i'd request a new result one after another, that would be alot even within a second. I just tested w/ just around 200 tweets, and i'd just assume that you would have noticed it? the good thing, once it is done, it's done :)

thanks, and also thanks for offering this API!

cheers

Andraz Tori

unread,
Aug 5, 2012, 10:21:46 PM8/5/12
to zemanta-d...@googlegroups.com, divadpoc
That shouldn't be a problem, as a free user you are automatically
throttled at 1 request/second, so there's no worry of hurting the
systems behind our API.

Also, if you disable recommendations of images, you will get your
results back much faster.

bye
andraz

> cheers
> --
> You received this message because you are subscribed to the Google
> Groups "Zemanta Developers" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/zemanta-developers/-/1Py4zcztCUEJ.
> To post to this group, send email to zemanta-d...@googlegroups.com.
> To unsubscribe from this group, send email to
> zemanta-develop...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/zemanta-developers?hl=en.

divadpoc

unread,
Aug 6, 2012, 3:25:36 PM8/6/12
to zemanta-d...@googlegroups.com, divadpoc
On Monday, August 6, 2012 4:21:46 AM UTC+2, Andraz Tori wrote:
On 08/02/2012 06:00 PM, divadpoc wrote:
> I'm currently indexing my data w/ fields i get from your service. As
> it's lots of data there are a lot of requests, and this might
> influence your server, I assume. Is there a way to combine a number of
> requests into one request, or should I just put a delay for each new
> request on my side? what happens if I just keep requesting, will the
> service just stop returning me results?
> an example w/ the amount of data: i have around 2000 tweets, and i'd
> request a new result one after another, that would be alot even within
> a second. I just tested w/ just around 200 tweets, and i'd just assume
> that you would have noticed it? the good thing, once it is done, it's
> done :)
>
> thanks, and also thanks for offering this API!
>

That shouldn't be a problem, as a free user you are automatically
throttled at 1 request/second, so there's no worry of hurting the
systems behind our API.

thanks for your answer.
I read sthg about the rate-limit after i posted this, so I just adapted my code to wait for at least one second. but it's nice to hear that i can't hurt you if I wouldn't have done that.

Also, if you disable recommendations of images, you will get your
results back much faster.
 
and thanks for the hint not to request any image recommendations, it's good to know if i plan on doing so some time.

bye
andraz

bye
 

> cheers
> --
Reply all
Reply to author
Forward
0 new messages