How block bing bot by ip

[João Verissimo Ribeiro]

Hello,

I am suffering with bingbot. At times there are 10 robots at the same time, consume about 3,000 requests.

I tried to block ips with blacklist. But they use a different ip.

I would like to block bingbot, could be a range of ip, but do not know how to do it.

Thanks for your time.

[Google Tasks Backup Moderator]

You could try setting up a robots.txt file, which bingbot should hopefully adhere to.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[Vinny P]

On Wed, Sep 25, 2013 at 4:18 AM, Julie wrote:

You could try setting up a robots.txt file, which bingbot should hopefully adhere to.

+1. 

There is also a Crawl-Delay directive in robots.txt, which can be used to slow down the pace of BingBot's requests. See http://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl-delay_directive

 

-----------------

-Vinny P

Technology & Media Advisor

Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com