Entities disappearing from index

[Rodrigo Moraes]

Hi,
Last week two of my users complained about entities that
"disappeared". I searched for the records using a simple query with no
composite index and found them, and confirmed that they were not
returned by a composite index that should return them. The index was
up and running, and as far as I know the entities disappeared
randomly.

I re-saved the same entities, and they appeared in the index again. I
have no idea if other entities are missing from the index, because I
only know if someone reports it, which is sad and a bit scary.

Question is: in which cases can this happen? Which tricks can we use
to check/ensure that an index is complete?

thanks,
rodrigo

[Rodrigo Moraes]

this happened again today. my user reported: "i can find it and access
it after a google search, but it is not listed in the page". he
referred to another entity that "disappeared from the index". when
accessing the entity's page linked in google, the system uses the
entity id, so that's ok. but when listing entities, it uses a query
which should include the entity in the results, but the entity was not
included.

the sad conclusion is that indexes are still not reliable. :-(

-- rodrigo

[Rodrigo Moraes]

One more update: during the night, I deleted all related indexes and
rebuilt them again, hoping to fix the issue.

After the rebuild, surprise: now many more entities that should be
listed are missing. It got even worst.

/sigh

-- rodrigo

[Michael Edland]

Hey Rodrigo,

Did you find a solution for this?  I'm having the same issue. 
Items in the composite index seem to randomly disappear.

I see it was a while ago.  There aren't many posts with this issue.

Thanks.
Mike