What ports must be open and available for cluster communication?

42 views
Skip to first unread message

Lorenzini, Joseph

unread,
Feb 26, 2013, 7:58:08 PM2/26/13
to idh-...@googlegroups.com

In an Apache Hadoop cluster, several services may run on many different nodes. To function, these services must be able to listen on one or more ports.

Services

Port

resourcemonitor

7070

Note: only required on the manager node

intel-manager

9443

Note: only required on the manager node

gmond

8649

gmetad

8561
8562

Note: only required on the manager node

httpd

80
443

nagios

80
443

puppetmasterd

§  18140

§  18141

§  18142

§  18143

Note: only required on the manager node

nginx

8140

Note: only required on the manager node

DNS

Default port number is 53. However, this could be a different port number depending on how the network administrator sets up DNS.

vsftpd

21 
Need to open an unprivileged port range to handle passive ports. This port range must be specified in /etc/vsftpd/vsftpd.conf

hadoop-namenode

50070
8020

hadoop-datanode

50075

hadoop-secondarynamenode

50090

hadoop-jobtracker

50030
44436

hadoop-tasktracker

50010

zookeeper-server

3888
39123

hbase-master

60010
60000

hbase-regionserver

60030

hbase-thrift

8080

mysqld

3306

hive-metastore

9083

 

Reply all
Reply to author
Forward
0 new messages