I could not submit com.opensoc.topology.Pcap to storm

[Murakami Keiko]

Hi

I'm beginner about storm and opensoc-streaming.

I already installed hadoop+storm+kafka+hbase+hive+elasticsearch on 2 nodes cluster + management node,

and I got error when storm jar command.

Would you please tell me to fix this issue or workaround? 

/opt/storm/bin/storm jar ./OpenSOC-Topologies/target/OpenSOC-Topologies-0.6BETA.jar com.opensoc.topology.Pcap -local_mode true -config_path ./OpenSOC-Topologies/target/classes/OpenSOC_Configs/ -generator_spout true

Running: /usr/java/default/bin/java -client -Dstorm.options= -Dstorm.home=/opensoc/oss/apache-storm-0.9.4 -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/opt/hadoop/lib/native:/usr/lib64 -Dstorm.conf.file= -cp /opensoc/oss/apache-storm-0.9.4/lib/commons-logging-1.1.3.jar:/opensoc/oss/apache-storm-0.9.4/lib/disruptor-2.10.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/jgrapht-core-0.9.0.jar:/opensoc/oss/apache-storm-0.9.4/lib/logback-classic-1.0.13.jar:/opensoc/oss/apache-storm-0.9.4/lib/logback-core-1.0.13.jar:/opensoc/oss/apache-storm-0.9.4/lib/slf4j-api-1.7.5.jar:/opensoc/oss/apache-storm-0.9.4/lib/log4j-over-slf4j-1.6.6.jar:/opensoc/oss/apache-storm-0.9.4/lib/jline-2.11.jar:/opensoc/oss/apache-storm-0.9.4/lib/storm-core-0.9.4.jar:/opensoc/oss/apache-storm-0.9.4/lib/clojure-1.5.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/clj-time-0.4.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/joda-time-2.0.jar:/opensoc/oss/apache-storm-0.9.4/lib/compojure-1.1.3.jar:/opensoc/oss/apache-storm-0.9.4/lib/core.incubator-0.1.0.jar:/opensoc/oss/apache-storm-0.9.4/lib/tools.macro-0.1.0.jar:/opensoc/oss/apache-storm-0.9.4/lib/clout-1.0.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/ring-core-1.1.5.jar:/opensoc/oss/apache-storm-0.9.4/lib/commons-codec-1.6.jar:/opensoc/oss/apache-storm-0.9.4/lib/commons-io-2.4.jar:/opensoc/oss/apache-storm-0.9.4/lib/commons-fileupload-1.2.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/servlet-api-2.5.jar:/opensoc/oss/apache-storm-0.9.4/lib/hiccup-0.3.6.jar:/opensoc/oss/apache-storm-0.9.4/lib/ring-devel-0.3.11.jar:/opensoc/oss/apache-storm-0.9.4/lib/clj-stacktrace-0.2.2.jar:/opensoc/oss/apache-storm-0.9.4/lib/ring-jetty-adapter-0.3.11.jar:/opensoc/oss/apache-storm-0.9.4/lib/ring-servlet-0.3.11.jar:/opensoc/oss/apache-storm-0.9.4/lib/jetty-6.1.26.jar:/opensoc/oss/apache-storm-0.9.4/lib/jetty-util-6.1.26.jar:/opensoc/oss/apache-storm-0.9.4/lib/tools.logging-0.2.3.jar:/opensoc/oss/apache-storm-0.9.4/lib/math.numeric-tower-0.0.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/tools.cli-0.2.4.jar:/opensoc/oss/apache-storm-0.9.4/lib/commons-exec-1.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/commons-lang-2.5.jar:/opensoc/oss/apache-storm-0.9.4/lib/json-simple-1.1.jar:/opensoc/oss/apache-storm-0.9.4/lib/carbonite-1.4.0.jar:/opensoc/oss/apache-storm-0.9.4/lib/kryo-2.21.jar:/opensoc/oss/apache-storm-0.9.4/lib/reflectasm-1.07-shaded.jar:/opensoc/oss/apache-storm-0.9.4/lib/asm-4.0.jar:/opensoc/oss/apache-storm-0.9.4/lib/minlog-1.2.jar:/opensoc/oss/apache-storm-0.9.4/lib/objenesis-1.2.jar:/opensoc/oss/apache-storm-0.9.4/lib/chill-java-0.3.5.jar:/opensoc/oss/apache-storm-0.9.4/lib/snakeyaml-1.11.jar:./OpenSOC-Topologies/target/OpenSOC-Topologies-0.6BETA.jar:/opensoc/oss/apache-storm-0.9.4/conf:/opensoc/oss/apache-storm-0.9.4/bin -Dstorm.jar=./OpenSOC-Topologies/target/OpenSOC-Topologies-0.6BETA.jar com.opensoc.topology.Pcap -local_mode true -config_path ./OpenSOC-Topologies/target/classes/OpenSOC_Configs/ -generator_spout true

[OpenSOC] Starting topology deployment...

[OpenSOC] Debug mode set to: true

[OpenSOC] Local mode set to: true

[OpenSOC] Setting config path to external config path: ./OpenSOC-Topologies/target/classes/OpenSOC_Configs/

[OpenSOC] Looking for environment identifier: ./OpenSOC-Topologies/target/classes/OpenSOC_Configs//topologies/environment_identifier.conf

[OpenSOC] Looking for topology identifier: ./OpenSOC-Topologies/target/classes/OpenSOC_Configs//topologies/pcap/topology_identifier.conf

[OpenSOC] Looking for topology config: ./OpenSOC-Topologies/target/classes/OpenSOC_Configs//topologies/pcap/topology.conf

[OpenSOC] Initializing Topology: nqsc_quick_start_pcap_P001

[OpenSOC] Initializing Spout: nqsc_quick_start_pcap_P001

[OpenSOC] Initializing Test Spout

java.util.NoSuchElementException: 'spout.test.parallelism.hint' doesn't map to an existing object

        at org.apache.commons.configuration.AbstractConfiguration.getInt(AbstractConfiguration.java:816)

        at com.opensoc.topology.runner.PcapRunner.initializeTestingSpout(PcapRunner.java:40)

        at com.opensoc.topology.runner.TopologyRunner.initTopology(TopologyRunner.java:164)

        at com.opensoc.topology.Pcap.main(Pcap.java:38)