Datastore index overhead?

[Richard Arrano]

Hello,
I recently uploaded quite a bit of data using the bulkloader. I
noticed that my "stored data" quota has gone up by a significant
amount. The data statistics tell me that I'm using 33MBytes for the
"size of all entities." I realize there's some overhead for indexes,
but the type that I uploaded ~40,000 instances of is only indexed on
two properties. I'm using 30% of the 1.00 GB storage now. So I'm
wondering a) does "metadata" not include the storage for indexes and
b) does the discrepancy make sense given my situation?

Thanks,
Richard Arrano

[Richard Arrano]

And for the record, I did the upload before the datastore statistics
had been refreshed, so those stats are indeed current.

-Richard

[Tim Hoffman]

Hi Richard

The amount of data taken up by indexes is dependant on the property type

if your properties are ListProperties with a lot of values you will get a very large index overhead, and yes Metadata doesn't include indexes.

Metadata is the overhead your entities incur with things like property names, keys etc... (remember the name, type and value of the property 

is stored in the entity)

Just to give you a comparison, in one instance, I have from the stats 455,000 records, 267MB data, 129MB of Metadata

and have used 1.52GB of quota. 

So your numbers look about right. Without knowing what you entities look like.

Rgds

T