Blank entity count and storage columns for Datastore Indexes

131 views
Skip to first unread message

Anil S

unread,
Dec 27, 2013, 5:41:49 PM12/27/13
to google-a...@googlegroups.com
Hi,

In GAE Admin Console, under Datastore Indexes, all of my indexes are listed as Serving. However, few of them are blank in the Index Entry Count and Index Storage columns. All queries associated with those blank fields are failing. One thing that I observed is one of the field in index is ENUM. Any clues?

Thanks for your help!!!

Thanks,
Anil.

Vinny P

unread,
Dec 28, 2013, 12:05:33 AM12/28/13
to google-a...@googlegroups.com
On Fri, Dec 27, 2013 at 4:41 PM, Anil S <sadine...@gmail.com> wrote:
All queries associated with those blank fields are failing. One thing that I observed is one of the field in index is ENUM. Any clues?


When you say the queries are failing, are there any error messages being printed out?

Try removing one of the index definitions from your application (deleting the entry from index.yaml) then running vacuum_indexes to remove the index from the production datastore. Then redefine the index in index.yaml and let App Engine rebuild the index from scratch. 
 
-----------------
-Vinny P
Technology & Media Advisor
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

Anil Sadineni

unread,
Dec 28, 2013, 2:53:22 PM12/28/13
to google-a...@googlegroups.com
Thanks for the response. 

I don't have any errors in log file, but don't show any results when my query goes against those fields.

I tried vacuum_indexes option by removing and adding index, but no luck.

Is there any limitation on number of composite indexes you can have on a given entity. I already had 10 indexes on this entity and the index that is showing blank count and storage columns is 11th one.

Thanks,
Anil.




--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/GmJAYggSlEc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Vinny P

unread,
Dec 30, 2013, 12:57:08 PM12/30/13
to google-a...@googlegroups.com
On Sat, Dec 28, 2013 at 1:53 PM, Anil Sadineni <sadine...@gmail.com> wrote:
I already had 10 indexes on this entity and the index that is showing blank count and storage columns is 11th one.



Is that the only index that is failing, or are there multiple indexes failing? If multiple indexes are failing, do all of the failing indexes share the same traits? Do all these failing indexes track the same or similar properties, and if so, what do the properties track (for instance, are the properties extra-long, or use a lot of non-Latin characters)?

The fastest way to solve this issue would probably be to file a production issue here: https://code.google.com/p/googleappengine/issues/entry?template=Production%20issue . The App Engine folks can peer into your indexes and datastore and see what's going on. More than likely it's a simple issue.

Anil S

unread,
Dec 30, 2013, 1:29:09 PM12/30/13
to google-a...@googlegroups.com
Hi Vinny,

Thanks for response and link.

There are only two indexes failing. Both of them had Enum type present. One index is with datatype long and Enum. Another one is with long, Enum and date.

I will also post issue in link provided to app engine team.

Thanks,
Anil.

Anil S

unread,
Dec 30, 2013, 6:18:15 PM12/30/13
to google-a...@googlegroups.com
Update: Opened a production issue, got response back from app engine team. 

One of the field in composite index is not indexed in datastore. 

I have to get and put all records in this entity to have index built for the field. 

Reference - Setting a property as indexed does not index existing data. Please see the note at the bottom of this section: https://developers.google.com/appengine/docs/java/datastore/indexes#Java_Unindexed_properties

Thanks,
Anil.
Reply all
Reply to author
Forward
0 new messages