Hi folks,
running AtoM 2.6.4
Trying to browse by any of the four categories (archival descriptions,authority records, digital objects or Subjects) gives this error:
Elasticsearch error: Elastica\Exception\ResponseException
Elasticsearch_deprecation log is full of these lines:
[2025-11-27T10:31:44,309][WARN ][o.e.d.i.m.TypeParsers ] field [include_in_all] is deprecated, as [_all] is deprecated, and will be disallowed in 6.0, use [copy_to] instead.
Elasticsearch log has these:
[2025-11-27T10:31:45,819][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,819][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,820][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,819][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,820][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,820][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,821][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
[2025-11-27T10:31:45,820][WARN ][r.suppressed ] path: /atom/QubitInformationObject/_search, params: {index=atom, type=QubitInformationObject}
org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed
at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseFailure(AbstractSearchAsyncAction.java:272) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.AbstractSearchAsyncAction.executeNextPhase(AbstractSearchAsyncAction.java:130) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseDone(AbstractSearchAsyncAction.java:241) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.InitialSearchPhase.onShardFailure(InitialSearchPhase.java:107) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.InitialSearchPhase.access$100(InitialSearchPhase.java:49) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.InitialSearchPhase$2.lambda$onFailure$1(InitialSearchPhase.java:217) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.InitialSearchPhase.maybeFork(InitialSearchPhase.java:171) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.InitialSearchPhase.access$000(InitialSearchPhase.java:49) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.InitialSearchPhase$2.onFailure(InitialSearchPhase.java:217) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.ActionListenerResponseHandler.handleException(ActionListenerResponseHandler.java:51) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1085) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:1189) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.transport.TransportService$DirectResponseChannel.sendResponse(TransportService.java:1167) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.transport.TransportService$7.onFailure(TransportService.java:673) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.onFailure(ThreadContext.java:660) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:39) [elasticsearch-5.6.16.jar:5.6.16]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
[2025-11-27T10:31:45,850][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] All shards failed for phase: [query]
and
org.elasticsearch.transport.RemoteTransportException: [EQ-HwQ6][xxx.xxx.xxx.xxx:9300][indices:data/read/search[phase/query]]
Caused by: org.elasticsearch.index.query.QueryShardException: No mapping found for [i18n.en_US.title.alphasort] in order to sort on
at org.elasticsearch.search.sort.FieldSortBuilder.build(FieldSortBuilder.java:262) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.search.sort.SortBuilder.buildSort(SortBuilder.java:156) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.search.SearchService.parseSource(SearchService.java:634) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.search.SearchService.createContext(SearchService.java:485) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:461) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:257) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.SearchTransportService$6.messageReceived(SearchTransportService.java:343) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.action.search.SearchTransportService$6.messageReceived(SearchTransportService.java:340) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:69) ~[elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:662) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:675) [elasticsearch-5.6.16.jar:5.6.16]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.6.16.jar:5.6.16]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
[2025-11-27T10:31:50,013][DEBUG][o.e.a.s.TransportSearchAction] [EQ-HwQ6] [atom][1], node[EQ-HwQ6VTv-MqL44HwSBWA], [P], s[STARTED], a[id=B9YeuOByRYyOszkhVRdmEw]: Failed to execute [SearchRequest{searchType=QUERY_THEN_FETCH, indices=[atom], indicesOptions=IndicesOptions[id=38, ignore_unavailable=false, allow_no_indices=true, expand_wildcards_open=true, expand_wildcards_closed=false, allow_alisases_to_multiple_indices=true, forbid_closed_indices=true], types=[QubitInformationObject], routing='null', preference='null', requestCache=null, scroll=null, maxConcurrentShardRequests=5, batchedReduceSize=512, preFilterShardSize=128, source={
"from" : 250,
Further troublshooting comes up with this:
{
"cluster_name" : "elasticsearch",
"status" : "yellow",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 4,
"active_shards" : 4,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 4,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 50.0,
"indices" : {
"atom" : {
"status" : "yellow",
"number_of_shards" : 4,
"number_of_replicas" : 1,
"active_primary_shards" : 4,
"active_shards" : 4,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 4,
"shards" : {
"0" : {
"status" : "yellow",
"primary_active" : true,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 1
},
"1" : {
"status" : "yellow",
"primary_active" : true,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 1
},
"2" : {
"status" : "yellow",
"primary_active" : true,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 1
},
"3" : {
"status" : "yellow",
"primary_active" : true,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 1
}
}
}
}
}
Having said that, the home page is accessible and the list of popular visits this week works fine - you can go to the direct urls..
Any suggestions on how to proceed ?
Thanks