using StormSubmitter without submitting the jar from command line

[Debojyoti Dutta]

Hi

Say I want to write a simple java program which will accept some user params interactively, build a topology and then submit it to the cluster. Has anyone done this?

thoughts?

--
-Debo~

[Richards Peter]

Hi,

Please check this post:
https://groups.google.com/forum/?fromgroups#!searchin/storm-user/Can$20we$20submit$20the$20topology$20jar$20without$20using$20storm$20command?/storm-user/5JjZQyviRqk/B_r1Ybew4aYJ

Thanks,
Richards Peter.

[Debojyoti Dutta]

Hi Richard 

Thanks for the pointer. I was planning to ask how to create submit objects directly instead of the jar file....

Did you get that to work? I am guessing I have to serialize the object and pass it on to nimbus? An example would clear my mind a bit .... 

debo

--
-Debo~

[Richards Peter]

Hi,

Can you elaborate more on submit objects? I don't really know what you meant.

Thanks,
Richards Peter.

[Debojyoti Dutta]

Say we want to just create a dynamic topology using the same spouts and bolts of the exclaim topology in storm starter with one difference (I want to interactively ask the user for the number of stages of the exclaim spout). Based on user input I want to generate a topology and submit it ....

Whats teh best way to do it and do I need to submit the jar with deps apriori ? Can I just instantiate a nimbus client as in the thread and get my work done? I guess I will still have to upload the jar file beforehand and just refer to it while submitting the topology?

debo

--
-Debo~

[Richards Peter]

Hi Debojyoti Dutta,

I think you will be able to do this:

Read the user input(no. of levels), build the topology(as per your requirement), submit the jar and get back the uploaded location and then submit the topology.

I am not sure whether there are any other options like placing the file directly on all nodes in the cluster at a particular location and then referring to it. Please check whether you will get other comments from community.

Thanks,
Richards Peter.