Extremely slow db.get([keys])

50 views
Skip to first unread message

Zygimantas Berziunas

unread,
Oct 28, 2011, 1:43:05 PM10/28/11
to google-a...@googlegroups.com
I am using db.get([keys]) and experiencing extremely slow reads. It takes at least "9008cpu_ms 2125api_cpu_ms" for simple test. Keys array length is ~200. Is it normal?
Entities are small:

 p1 = db.StringProperty(indexed=False) - ~20 characters
 p2 = db.StringProperty(indexed=False, required=True) ~10 characters
 p3 = db.GeoPtProperty(indexed=False, required=True)
 p4 = db.StringListProperty(indexed=False) 10 items x ~10 characters

Total entities: ~1000. HRD.

Zygimantas Berziunas

unread,
Oct 28, 2011, 2:40:34 PM10/28/11
to google-a...@googlegroups.com
Appstats shows:

datastore_v3.RunQuery    9ms (29ms api)
datastore_v3.Next    32ms (16ms api)
datastore_v3.Next    11ms (16ms api)
datastore_v3.Next    16ms (16ms api)
datastore_v3.Next    86ms (16ms api)
datastore_v3.Next    8ms (16ms api)
datastore_v3.Next    84ms (16ms api)
datastore_v3.Next    8ms (16ms api)
datastore_v3.Next    92ms (16ms api)
datastore_v3.Next    14ms (16ms api)
datastore_v3.Next    82ms (16ms api)
datastore_v3.Next    8ms (16ms api)
datastore_v3.Next    86ms (16ms api)
datastore_v3.Next    96ms (16ms api)
datastore_v3.Next    7ms (16ms api)
datastore_v3.Next    92ms (16ms api)
datastore_v3.Next    92ms (16ms api)
datastore_v3.Next    9ms (16ms api)
datastore_v3.Next    89ms (16ms api)
datastore_v3.Next    7ms (4ms api)
datastore_v3.Get    5692ms (8ms api)
datastore_v3.Get    5688ms (8ms api)
datastore_v3.Get    5684ms (8ms api)

And hundreds of:
datastore_v3.Get    ~ 5681ms (8ms api)

Zygimantas Berziunas

unread,
Oct 30, 2011, 4:48:27 PM10/30/11
to google-a...@googlegroups.com
Source:

logging.debug('Fetching ' + str(len(m.keys())) + ' entities')
items = db.get(m.keys())
logging.debug('Done fetching items')

Log:

D 2011-10-30 22:46:41.495 Fetching 238 entities
D 2011-10-30 22:46:50.009 Done fetching items
W 2011-10-30 22:46:54.407 Full proto too large to save, cleared variables.
Reply all
Reply to author
Forward
0 new messages