My site bombarded with thousands of URL requests from different IPs - how to stop them

[Kate]

I've posted about this problem before but I don't think I have explained it adequately.

I am getting tens of thousands of CURL requests throwing HEAD method errors. This is thousands of times more than normal browser requests.

I can't block them as they come from different IPs and you are only allowed to block 100 IPs.

So - is there way of stopping them with code. If not, I can set up my site somewhere else but it seems a pity to have to do this.

First I was concerned that these requests were throwing errors and it was suggested I enable the head method, but I can't see any point in doing this as the CURL requests are no no use to me. I have stopped being a billable  site as I can't afford to support these requests.

[Joshua Smith]

It really sounds like your site is under attack (specifically, a DDOS attack). Switching hosting providers won't help (they'll just attack the new site). Blocking based on the UA string (to reject curl requests only) is not a standard feature of any hosting service. And besides, spoofing the UA  in curl is a trivial command-line argument, so it would be ineffective if this is really a hostile act.

File a production issue, to see if the folks at google can come up with a way to thwart the attack.

-Joshua

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Kc8kRRoDKKkJ.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

[Kate]

Thanks Joshue,
How do I file a production issue?

[Joshua Smith]

http://code.google.com/p/googleappengine/issues/list

New Issue

Production Issue template

Follow the instructions in the template

On Aug 1, 2012, at 6:56 PM, Kate <mss....@gmail.com> wrote:

> Thanks Joshue,
> How do I file a production issue?
>

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.

> To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/xPmxxyiQfPsJ.

[hyperflame]

In the interim, it would be a good idea to put up a static page
stating that your website is under emergency maintenance or similar,
just so your customers have some information.

On Aug 1, 6:01 pm, Joshua Smith <JoshuaESm...@charter.net> wrote:
> http://code.google.com/p/googleappengine/issues/list
>
> New Issue
>
> Production Issue template
>
> Follow the instructions in the template
>

> On Aug 1, 2012, at 6:56 PM, Kate <mss.ka...@gmail.com> wrote:
>
>
>
> > Thanks Joshue,
> > How do I file a production issue?
>
> > --
> > You received this message because you are subscribed to the Google Groups "Google App Engine" group.

> > To view this discussion on the web visithttps://groups.google.com/d/msg/google-appengine/-/xPmxxyiQfPsJ.

[Kate]

Thanks. Done. Issue Issue 7916

On Wednesday, August 1, 2012 7:01:10 PM UTC-4, Joshua Smith wrote:

http://code.google.com/p/googleappengine/issues/list

New Issue

Production Issue template

Follow the instructions in the template

On Aug 1, 2012, at 6:56 PM, Kate <mss....@gmail.com> wrote:

> Thanks Joshue,
> How do I file a production issue?
>
> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/xPmxxyiQfPsJ.

> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to google-appengine+unsubscribe@googlegroups.com.