hazelcast manage center can not list all members

30 views
Skip to first unread message

wang...@gmail.com

unread,
Sep 18, 2020, 1:40:28 AM9/18/20
to Hazelcast

I have a three-member cluster. but from the management center, it only lists two members.. I turn on the log in the mc, here is the debug information. 


2020-09-17 17:52:46 [main] INFO  com.hazelcast.core.LifecycleService - MC-Client-dev [dev] [4.0.1] HazelcastClient 4.0.1 (20200409 - eb984ad, e086b9c) is STARTED2020-09-17 17:52:46 [main] INFO  c.h.internal.diagnostics.Diagnostics - MC-Client-dev [dev] [4.0.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
2020-09-17 17:52:46 [MC-Client-dev.internal-1] INFO  c.h.c.i.c.ClientConnectionManager - MC-Client-dev [dev] [4.0.1] Trying to connect to cluster: dev
2020-09-17 17:52:46 [MC-Client-dev.internal-1] INFO  c.h.c.i.c.ClientConnectionManager - MC-Client-dev [dev] [4.0.1] Trying to connect to [10.0.0.36]:5701
2020-09-17 17:52:46 [MC-Client-dev.internal-1] INFO  com.hazelcast.core.LifecycleService - MC-Client-dev [dev] [4.0.1] HazelcastClient 4.0.1 (20200409 - eb984ad, e086b9c) is CLIENT_CONNECTED
2020-09-17 17:52:46 [MC-Client-dev.internal-1] INFO  c.h.c.i.c.ClientConnectionManager - MC-Client-dev [dev] [4.0.1] Authenticated with server [10.0.0.36]:5701:d327eb67-36ea-4226-bca3-3efb69818f1b, server version: 4.0.1, local address: /10.0.0.40:53257
2020-09-17 17:52:46 [MC-Client-dev.lifecycle-1] INFO  c.h.w.service.ClusterManager - MC Client connected to cluster dev.
2020-09-17 17:52:46 [MC-Client-dev.event-3] INFO  c.h.c.impl.spi.ClientClusterService - MC-Client-dev [dev] [4.0.1]

Members [3] {
        Member [10.0.0.36]:5701 - d327eb67-36ea-4226-bca3-3efb69818f1b
        Member [10.0.0.37]:5702 - 015c31b1-e7b2-45ac-b6ba-83d968290aa3
        Member [10.0.0.37]:5701 - 28f3a414-5a16-4dcc-b862-ec37897f907e
}

2020-09-17 17:52:46 [MC-Client-dev.event-3] INFO  c.h.w.service.ClusterManager - Started communication with member: Member [10.0.0.37]:5702 - 015c31b1-e7b2-45ac-b6ba-83d968290aa3
2020-09-17 17:52:46 [MC-Client-dev.event-3] INFO  c.h.w.service.ClusterManager - Started communication with member: Member [10.0.0.36]:5701 - d327eb67-36ea-4226-bca3-3efb69818f1b
2020-09-17 17:52:46 [MC-Client-dev.event-3] INFO  c.h.w.service.ClusterManager - Started communication with member: Member [10.0.0.37]:5701 - 28f3a414-5a16-4dcc-b862-ec37897f907e
2020-09-17 17:52:47 [main] INFO  com.hazelcast.webmonitor.Launcher -

Hazelcast Management Center successfully started at http://localhost:8080/

2020-09-17 17:52:47 [MC-Client-dev.internal-3] INFO  c.h.c.i.c.ClientConnectionManager - MC-Client-dev [dev] [4.0.1] Authenticated with server [10.0.0.37]:5701:28f3a414-5a16-4dcc-b862-ec37897f907e, server version: 4.0.1, local address: /10.0.0.40:45515
2020-09-17 17:52:47 [MC-Client-dev.internal-1] INFO  c.h.c.i.c.ClientConnectionManager - MC-Client-dev [dev] [4.0.1] Authenticated with server [10.0.0.37]:5702:015c31b1-e7b2-45ac-b6ba-83d968290aa3, server version: 4.0.1, local address: /10.0.0.40:59033

in the GUI it only list [10.0.0.37]:5702 and [10.0.0.37]:5701. What may cause it is not talking to [10.0.0.36]:5701 even it is in the member list? 
I try to restart the MC and it does not help.

Bence Eros

unread,
Sep 18, 2020, 3:50:59 AM9/18/20
to haze...@googlegroups.com
Hello,

What is in the "Member Addresses" field of your Cluster Configuration?

Also, can you please confirm that you use MC 4.2020.8 and IMDG 4.0.1 ?

Thank you,

--
You received this message because you are subscribed to the Google Groups "Hazelcast" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hazelcast+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast/a47f4fe7-a514-4a8f-939a-254bc2720fcdo%40googlegroups.com.

This message contains confidential information and is intended only for the individuals named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required, please request a hard-copy version. -Hazelcast

Helena Wang

unread,
Sep 18, 2020, 1:54:33 PM9/18/20
to haze...@googlegroups.com
My Hazelcast server is 4.0.1. my Hazelcast manage center is 4.0.3

Disabled
No
4.0.1
90
495.44 GB
586.59 GB
364.65 GB
0%
4096
83
No
Disabled
No
4.0.1
91
495.43 GB
587.03 GB
363.48 GB
0%
4096
82
No
Disabled
No
4.0.1
90
495.43 GB
588.03 GB
363.48 GB
0%
4096
82




Bence Eros <er...@hazelcast.com> 于2020年9月18日周五 上午12:51写道:
You received this message because you are subscribed to a topic in the Google Groups "Hazelcast" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/hazelcast/6nMM43OdgPk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to hazelcast+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast/CAN%2Bc%3DYViJFT33%2BYut_%2BEmKNXvB3XyVU7Eqj_shsifeJAJkSYhg%40mail.gmail.com.

Bence Eros

unread,
Sep 18, 2020, 2:20:24 PM9/18/20
to haze...@googlegroups.com
Hello,

 is the 10.0.0.36 IP address listed in the Member Addresses in the cluster config? 

Helena Wang

unread,
Sep 19, 2020, 1:01:32 AM9/19/20
to haze...@googlegroups.com
Yes, this is one of the members of my cluster
I use this way to add the cluster to the MC

./mc-conf.sh  cluster add -cn memverge -ma 10.0.0.36:5701,10.0.0.37:570


By the way, is that MC has a Database to keeps going track the master information? 

Will that possible that the master that in MC DB is different from the master in the cluster side? if this happened, how can I refresh it?


Regards

Helen




Bence Eros <er...@hazelcast.com> 于2020年9月18日周五 上午11:20写道:

Bence Eros

unread,
Sep 22, 2020, 4:44:30 AM9/22/20
to haze...@googlegroups.com
Hello Helena,

can you please share the member configuration files? Is there any difference between them that can cause the problem?
You can also try deleting the local database of MC if you think that would help, but in that case you will have to re-create user and cluster configs (it is the $HOME/hazelcast-mc directory). I suggest creating a backup before deleting it.

em...@hazelcast.com

unread,
Sep 22, 2020, 4:55:59 AM9/22/20
to Hazelcast
Hi Helena,

> What may cause it is not talking to [10.0.0.36]:5701 even it is in the member list? 

There might be a network problem between the host where MC is running and the member in question. Please make sure the host 10.0.0.36 is reachable by Management Center's host machine and the port 5701 is open for communication from MC's host. There might be a firewall rule that is blocking the communication.

Regards,
Emre
Reply all
Reply to author
Forward
0 new messages