HR down?

[bFlood]

nothing in the Status page so I'm assuming this is localized to a few
apps but HR instance serving and DB operations are breaking for me
right now

lots of these errors: "The API call datastore_v3.Get() took too long
to respond and was cancelled."

started about 9:30 EST

cheers
brian

[bFlood]

the instance serving warnings are:

"Request was aborted after waiting too long to attempt to service your
request. This may happen sporadically when the App Engine serving
cluster is under unexpectedly high or uneven load. If you see this
message frequently, please contact the App Engine team."

using Python27 with threadsafe turned off

[Will]

Same here. HR, python 2.7, threadsafe:false. Over 10K DEEs, seems back to normal about an hour ago.

 

A similar incident happened on last Monday I believe.

 

Will

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

[Anand Mistry]

What are your apps that are being affected?

[Will]

Mine are mostly datastore writes. When writes time out, I put them into a task queue, and then putting into task queue times out, typically you see this error:

 

CancelledError: The API call taskqueue.BulkAdd() was explicitly cancelled.

 

Sometimes I saw just a "DeadlineExceededError" without other errors.

Thanks,

 

Will

On Wed, Nov 23, 2011 at 9:49 AM, Anand Mistry <ami...@google.com> wrote:

What are your apps that are being affected?

--

You received this message because you are subscribed to the Google Groups "Google App Engine" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KVcMX9J_94UJ.

[Brandon Wirtz]

I was never down, but Data Strore writes error and I get a lot more Local Instance Memory exceeded errors than usual.  But I’m over the 10% of requests Error thresh-hold and have been for 11 hours  with 11-10 hours ago being well over 30% errors.

 

My app is written to survive data store being in read-only mode but it isn’t happy about it.