No worries, I had it set up with hdp2 ga both in single-node and distributed clusters already. Just recollecting my thoughts to file a few issue reports to fix.
Andrew
--
You received this message because you are subscribed to a topic in the Google Groups "storm-yarn" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/storm-yarn/OLcvP6ITbdE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to storm-yarn+...@googlegroups.com.
--
--
You received this message because you are subscribed to the Google Groups "storm-yarn" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-yarn+...@googlegroups.com.
Hi,
Done delays due to Strata conference.
Basically, you have to update your storm config to point to a zookeeper quorum (list out all zookeeper instances after checking where they are deployed via Ambari. Hosts - Components - ZK Servers.
Storm-yarn getStormConfig, update the resulting yaml file. Restart with storm-yarn myconfig.yaml launch.
The reason is your Yarn-based storm cluster is running on nodes which don't have zookeeper (which is fine).
HTH,
Andrew
storm jar lib/storm-starter-0.0.1-SNAPSHOT.jar storm.starter.WordCountTopology WordCountTopology
I get an exception with regard to Thrift. My hunch is that there is another parameter I am missing in the storm.yaml config or some permission is set wrong, but I can't tell what that is. I can't even tell where this exception is logged, if at all. Any pointers in the right direction are appreciated.
Exception in thread "main" java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException: java.net.ConnectException: Connection refused
at backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:21)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:41)
at storm.starter.WordCountTopology.main(WordCountTopology.java:78)
Caused by: org.apache.thrift7.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.thrift7.transport.TSocket.open(TSocket.java:183)
at org.apache.thrift7.transport.TFramedTransport.open(TFramedTransport.java:81)
at backtype.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:66)
at backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:46)
at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:30)
at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:26)
at backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:19)
... 3 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at org.apache.thrift7.transport.TSocket.open(TSocket.java:178)
... 9 more
Identify the IP of the host where storm ui is running. Edit the client config file and point the nimbus host value to that IP. Again, this is the config used by storm when submitting topologies.
Andrew
Phone:
914 439 55 45
Email:
and...@hortonworks.com
Website:
http://www.hortonworks.com/
|
|