Matched version for Elasticsearch and Kibana but Kibana UI says "Kibana server is not ready yet"

[banthita limwilai]

Hi team,

I have two Elassandra running with version 6.8.4.10 and 6.8.4.9 which provided the same Elasticsearch 6.8.4.

Then I've installed Kibana-oss 6.8.4 (oss is the Kibana package without x-pack) on one of the node.

(Previously, I've installed Kibana default package with x-pack included) also gives the same result.

Kibana service is running fine. However, Kibana UI on port 5601 always says "kibana server is not ready yet".

Here are the message from Kibana log

============================================================

{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["plugins","debug"],"pid":5506,"plugin":{"name":"region_map","version":"kibana"},"message":"Initializing plugin region_map@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["plugins","debug"],"pid":5506,"plugin":{"name":"state_session_storage_redirect","version":"kibana","description":"When using the state:storeInSessionStorage setting with the short-urls, we need some way to get the full URL's hashed states into sessionStorage, this app will grab the URL from the injected state and and put the URL hashed states into sessionStorage before redirecting the user."},"message":"Initializing plugin state_session_storage_redirect@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["plugins","debug"],"pid":5506,"plugin":{"name":"status_page","version":"kibana"},"message":"Initializing plugin status_page@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["plugins","debug"],"pid":5506,"plugin":{"name":"table_vis","version":"kibana"},"message":"Initializing plugin table_vis@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["plugins","debug"],"pid":5506,"plugin":{"name":"tagcloud","version":"kibana"},"message":"Initializing plugin tagcloud@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["plugins","debug"],"pid":5506,"plugin":{"name":"tile_map","version":"kibana"},"message":"Initializing plugin tile_map@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:45Z","tags":["status","plugin:tile...@6.8.4","info"],"pid":5506,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["plugins","debug"],"pid":5506,"plugin":{"author":"Rashid Khan <ras...@elastic.co>","name":"timelion","version":"kibana"},"message":"Initializing plugin timelion@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["status","plugin:time...@6.8.4","info"],"pid":5506,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["plugins","debug"],"pid":5506,"plugin":{"author":"Yuri Astrakhan<yu...@elastic.co>","name":"vega","version":"kibana"},"message":"Initializing plugin vega@kibana"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["server","uuid","uuid"],"pid":5506,"message":"Resuming persistent Kibana instance UUID: fddba3c6-802e-4088-99d0-a45c8b5ee678"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["plugin","debug"],"pid":5506,"message":"Checking Elasticsearch version"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["status","plugin:elasti...@6.8.4","info"],"pid":5506,"state":"green","message":"Status changed from yellow to green - Ready","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
{"type":"log","@timestamp":"2020-08-28T03:07:46Z","tags":["info","migrations"],"pid":5506,"message":"Creating index .kibana_1."}
{"type":"log","@timestamp":"2020-08-28T03:07:48Z","tags":["plugin","debug"],"pid":5506,"message":"Checking Elasticsearch version"}
{"type":"log","@timestamp":"2020-08-28T03:07:49Z","tags":["debug","legacy-proxy"],"pid":5506,"message":"\"getConnections\" has been called."}
{"type":"log","@timestamp":"2020-08-28T03:07:51Z","tags":["plugin","debug"],"pid":5506,"message":"Checking Elasticsearch version"}
{"type":"log","@timestamp":"2020-08-28T03:07:53Z","tags":["plugin","debug"],"pid":5506,"message":"Checking Elasticsearch version"}

Apart from this, I'm getting this message too

=======================================================

{"type":"log","@timestamp":"2020-08-28T03:08:59Z","tags":["warning","migrations"],"pid":7040,"message":"Another Kibana instance appears to be migrating the index. Waiting for that migration to complete. If no other Kibana instance is attempting migrations, you can get past this message by deleting index .kibana_1 and restarting Kibana."}

From my perspective, this warning might occur from previous installed kibana.

What I did was delete the .kibana_1 and restarting like the suggestion, Unfortunately, it didn't help.

the system information

============================================================

Linux os: Ubuntu 18.04 LTS, Kernel 4.15.0-112-generic 86_64 x86_64 x86_64

              total        used        free      shared  buff/cache   available
Mem:    125G         27G         76G        1.3G         22G         96G
Swap:   1.0G          0B        1.0G

============================================================

and Kibana.yml

============================================================

#server.host: "host ip"
server.host: "0.0.0.0"

(tried both value, same result)

elasticsearch.hosts: ["http://host ip:9200"]

and Elasticseach.yml stored in /etc/cassandra/

============================================================

network.host: 137.74.200.56
#network.host: 0.0.0.0

http.port: 9200

I've searched over the internet and followed those suggestions. I still got the same Kibana UI error. I've tried install Kibana in the other node, no difference.

Thanks.