Minor datastore service degradation - August 31st, 2010
7 views
Skip to first unread message
App Engine Team
Sep 1, 2010, 12:24:12 AM9/1/10
to Google App Engine Downtime Notify
At approximately 1:15PM PST, we began receiving feedback from
customers that applications were seeing elevated error rates on
datastore queries (~2% of requests at peak). We determined that this
was a result of a recent change to the datastore which cause one of
our datastore nodes to get in a non-functioning state. This resulted
in immediate errors for the percentage of datastore requests sent to
the affect node. We isolated the node and issued a fix to the
datastore shortly before 1:00PM PST at which point the issue was
resolved.
We are working to ensure that the cause of the datastore task getting
in that state cannot recur and to ensure our monitoring is more
efficient with regard to this type of error.
customers that applications were seeing elevated error rates on
datastore queries (~2% of requests at peak). We determined that this
was a result of a recent change to the datastore which cause one of
our datastore nodes to get in a non-functioning state. This resulted
in immediate errors for the percentage of datastore requests sent to
the affect node. We isolated the node and issued a fix to the
datastore shortly before 1:00PM PST at which point the issue was
resolved.
We are working to ensure that the cause of the datastore task getting
in that state cannot recur and to ensure our monitoring is more
efficient with regard to this type of error.
Reply all
Reply to author
Forward
0 new messages