GAE Standard Datastore increased rate of "Internal Error" errors

[PK]

I see quite a few of these in my logs the past couple of days. Anybody else with a similar issue?

File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/ext/db/__init__.py", line 1540, in get

    return get_async(keys, **kwargs).get_result()

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/ext/db/__init__.py", line 1518, in get_async

    return datastore.GetAsync(keys, extra_hook=extra_hook, **kwargs)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/datastore.py", line 646, in GetAsync

    return _GetConnection().async_get(config, keys, local_extra_hook)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1609, in async_get

    txn = self._set_request_transaction(base_req)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 2374, in _set_request_transaction

    transaction = self.transaction

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 2350, in transaction

    self.__transaction = self.__transaction_rpc.get_result()

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 613, in get_result

    return self.__get_result_hook(self)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 2038, in __begin_transaction_hook

    self.check_rpc_success(rpc)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1371, in check_rpc_success

    raise _ToDatastoreError(err)

InternalError: internal error.

[Evan Jones]

Yes, I'm seeing some more of these, in a slightly different forms: 

InternalError: Server is not responding

However, may very well be our fault: We are also getting an increased rate of "contention" exceptions, on a time frame that could line up with us deploying new code. I haven't tracked it down yet, but it wouldn't surprise me if we were doing significantly increased datastore operations due to some unintended change. More specifically, we are seeing a bunch of the following types of errors:

Timeout: The datastore operation timed out, or the data was temporarily unavailable

TransactionFailedError: too much contention on these datastore entities. please try again. entity group key: ...

Evan

[Adam (Cloud Platform Support)]

The incidences of 'InternalError: internal error' may have been related to a transient issue that had since been resolved. Please let us know if these still occur.