how to change resource manager port that spark trying to connect

[srinivasarao daruna]

Hi,

I have created required things for Spark to run on Yarn. But, Resource manager runs at 8050 but not at default port 8032 port in our cluster. how can i make spark to look at 8050 port instead of 8050.?

If I run the program it shows the below error.

Exception in thread "main" java.lang.reflect.UndeclaredThrowableException
        at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
        at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getClusterMetrics(ClientRMProtocolPBClientImpl.java:149)
        at org.apache.hadoop.yarn.client.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:173)
        at org.apache.spark.deploy.yarn.Client.logClusterResourceDetails(Client.scala:76)
        at org.apache.spark.deploy.yarn.Client.run(Client.scala:53)
        at org.apache.spark.deploy.yarn.Client$.main(Client.scala:328)
        at org.apache.spark.deploy.yarn.Client.main(Client.scala)
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From hortonhdp/192.168.121.121  to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
        at $Proxy7.getClusterMetrics(Unknown Source)
        at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getClusterMetrics(ClientRMProtocolPBClientImpl.java:146)
        ... 5 more
Caused by: java.net.ConnectException: Call From hortonhdp/192.168.121.121 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:780)
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:727)
        at org.apache.hadoop.ipc.Client.call(Client.java:1239)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
        ... 7 more
Caused by: java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:526)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:490)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:508)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:603)
        at org.apache.hadoop.ipc.Client$Connection.access$2100(Client.java:253)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1288)
        at org.apache.hadoop.ipc.Client.call(Client.java:1206)
        ... 8 more