Facebook3.2.1 Java App
Alke Stilwell
Am getting the following exception
Failed to execute phase [query], all shards failed
org.elasticsearch.action.search.SearchPhaseExecutionException: Failed to execute phase [query], all shards failed
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.onFirstPhaseResult(TransportSearchTypeAction.java:238)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.start(TransportSearchTypeAction.java:161)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction.doExecute(TransportSearchQueryThenFetchAction.java:62)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction.doExecute(TransportSearchQueryThenFetchAction.java:52)
at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:75)
at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:100)
at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:43)
at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:75)
at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:63)
at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:51)
at org.elasticsearch.transport.netty.MessageChannelHandler.handleRequest(MessageChannelHandler.java:220)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:114)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
========================
translog corruption while reading from stream]; nested: ElasticsearchIllegalArgumentException[No version type match [114]]; ]]
[2015-08-12 04:29:04,872][WARN ][index.engine ] [Black Crow] [beta][3] failed to sync translog
[2015-08-12 04:29:04,928][WARN ][indices.cluster ] [Black Crow] [[beta][3]] marking and sending shard failed due to [failed recovery]
org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException: [beta][3] failed to recover shard
at org.elasticsearch.index.gateway.local.LocalIndexShardGateway.recover(LocalIndexShardGateway.java:290)
at org.elasticsearch.index.gateway.IndexShardGatewayService$1.run(IndexShardGatewayService.java:112)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.elasticsearch.index.translog.TranslogCorruptedException: translog corruption while reading from stream
at org.elasticsearch.index.translog.ChecksummedTranslogStream.read(ChecksummedTranslogStream.java:72)
at org.elasticsearch.index.gateway.local.LocalIndexShardGateway.recover(LocalIndexShardGateway.java:260)
... 4 more
Caused by: org.elasticsearch.ElasticsearchIllegalArgumentException: No version type match [115]
at org.elasticsearch.index.VersionType.fromValue(VersionType.java:307)
at org.elasticsearch.index.translog.Translog$Create.readFrom(Translog.java:376)
at org.elasticsearch.index.translog.ChecksummedTranslogStream.read(ChecksummedTranslogStream.java:68)
... 5 more
As the corruption is happened in prod index , why do I have to re-index the beta data? And for re-indexing I don't have backup data..
Is there any way to delete only a particular shard data?
And My machine is having heap memory of '40GB'.....
If you have ES_HEAP_SIZE (is java min and max) set to 40GG, that's too much. You should keep it to 30.5Gb or less.
There's no way to fix this at startup as something bad has happened and made the data corrupt. And if you delete the shard you lose the data in it.
Figure out where your ES data directory is.
Stop Elasticsearch and find the directory holding shard 3 of the beta index and then move the translog file to somewhere else.
Then restart ES. That will at least clear your translog corruption issue.
Elasticsearch doesn't store everything in memory, it just puts certain things in there as needed (that's a gross simplification, but it seems like you are still learning).
Setting the heap size will depend on how you installed Elasticsearch to begin with.
Yes Thanks Mart, the logs that I got next time having prod [0], so based on that I said,
Mark I just copied few shards in new index.
But when I see the mappings of that new index it is not showing any mappings..
Inorder to remove the data for every 3 mins...
And I copied an index called facebook shards in this new index by stopping elasticsearch, after i copied those shards I again started ES,
When I run the search query am getting records:
GET facebook3/_search
I created a project in Maven with WildFly, Java 8 and ICEfaces 4.0.0.In Maven's pom.xml I have added the ICEfaces and ICEfaces-ACE dependencies. The ACE components are shown properly, but if I click on any component I get this error:
This is my build.xml. I have excluded the javax.faces from org.icefaces, because it comes with WildFly and I get other errors ("ConfigurationException: The tag named inputFile from namespace has a null handler-class defined") if I don't remove it.
7fc3f7cf58