Default install with external db and elasticsearch

95 views
Skip to first unread message

Ben Horne

unread,
Jul 7, 2021, 5:44:16 PM7/7/21
to dotCMS User Group
I am trying to install dotcms in a kops cluster. I have the DB and elasticsearch cluster running in AWS as an RDS instance and an ES cluster in the same namespace. I have followed the documentation but the startup procedure does not appear to be trying to connect to the ES cluster.

Here are the ENV Vars that are getting set:
Resetting 'ES_ENDPOINTS'
ES_AUTH_TYPE=BASIC
ES_AUTH_BASIC_USER=dotcms-system
ES_AUTH_BASIC_PASSWORD=<secure-password>
PROVIDER_ELASTICSEARCH_DNSNAMES=elasticsearch-es-http
dotCMS environment ....
Tomcat config ....
Database config ....
Hazelcast Config ....
Elasticsearch Config ....
PROVIDER_ELASTICSEARCH_DNSNAMES=elasticsearch-es-http
PROVIDER_ELASTICSEARCH_CLUSTER_NAME=dotCMSContentIndex

PROVIDER_ELASTICSEARCH_ADDR_TRANSPORT=
PROVIDER_ELASTICSEARCH_ADDR_TRANSPORT=elasticsearch-es-http

PROVIDER_ELASTICSEARCH_PORT_TRANSPORT=9300
PROVIDER_ELASTICSEARCH_ADDR_HTTP=elasticsearch-es-http
PROVIDER_ELASTICSEARCH_PORT_HTTP=9200
PROVIDER_ELASTICSEARCH_ENABLE_HTTP=true
PROVIDER_ELASTICSEARCH_AUTH_TYPE=BASIC
PROVIDER_ELASTICSEARCH_AUTH_BASIC_USER=dotcms-system
PROVIDER_ELASTICSEARCH_AUTH_BASIC_PASSWORD=<secure password>
PROVIDER_ELASTICSEARCH_ENDPOINTS=http://elasticsearch-es-http:9200

Here is the output of the error I get:
20:27:17.318  WARN  business.ESContentFactoryImpl - ----------------------------------------------
20:27:17.318  WARN  business.ESContentFactoryImpl - Elasticsearch error in index 'cluster_ebdf7909e4.working_20210706224230'
20:27:17.319  WARN  business.ESContentFactoryImpl - ES Query: {"size":10000,"timeout":"15000ms","query":{"query_string":{"query":"+contenttype:host +working:true +host.hostname:localhost -basetype:6 -basetype:3","fields":[],"type":"best_fields","default_operator":"or","max_determinized_states":10000,"enable_position_increments":true,"fuzziness":"AUTO","fuzzy_prefix_length":0,"fuzzy_max_expansions":50,"phrase_slop":0,"escape":false,"auto_generate_synonyms_phrase_query":true,"fuzzy_transpositions":true,"boost":1.0}},"_source":{"includes":["inode","identifier"],"excludes":[]},"sort":[{"moddate":{"order":"desc"}}],"track_total_hits":10000000}
20:27:17.319  WARN  business.ESContentFactoryImpl - Class org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]

Docker file is pretty straight forward:
FROM dotcms/dotcms:21.05.1

USER root
RUN [[ -d /data ]] || mkdir /data
RUN [[ -d /data/shared ]] || mkdir /data/shared
RUN [[ -d /data/shared/assets ]] || mkdir /data/shared/assets

ENTRYPOINT ["/sbin/ti
Thanks for any assistance.

Will Ezell

unread,
Jul 8, 2021, 9:34:13 AM7/8/21
to dot...@googlegroups.com
From that error, it looks like dotCMS successfully connected to your elasticsearch service.  It is just not finding the indexes.  You should run a reindex.

--
http://dotcms.com - Open Source Java Content Management
---
You received this message because you are subscribed to the Google Groups "dotCMS User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dotcms+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dotcms/09c0a30d-f421-47a1-baba-43b637d17cb9n%40googlegroups.com.


--



382 NE 191st St #92150
Miami, Florida 33179-3899
Main: 
305-900-2001 | Direct: 978.294.9429

Ben Horne

unread,
Jul 8, 2021, 4:42:05 PM7/8/21
to dotCMS User Group
Thank you for the response. I am still trying to get a default install working. So I have not been able to get into the UI at all to configure anything.

Will Ezell

unread,
Jul 8, 2021, 4:46:00 PM7/8/21
to dot...@googlegroups.com
Is there any other information in your logs?   What health probe are you using and is the node being marked as unavailable and being killed by the orchestrator?

Ben Horne

unread,
Jul 8, 2021, 5:22:38 PM7/8/21
to dotCMS User Group
Healthcheck endpoint: /api/v1/system-status/

full log attached.

dotcms.log.zip

Nollymar Longa

unread,
Jul 12, 2021, 8:00:49 PM7/12/21
to dotCMS User Group
Hi Ben, 

I have a few questions: 

1. Is there anything relevant in the Elasticsearch logs? 

2. What is the health status of the index cluster_ebdf7909e4.working_20210706224230 ? 

3. What is the cluster id? You can find this information in the Configuration feature.
Reply all
Reply to author
Forward
0 new messages