Shell Spout\Bolt starting up on multiple supervisors when numTasks is set to 1

33 views
Skip to first unread message

Chris Wj

unread,
May 1, 2013, 4:12:30 PM5/1/13
to storm...@googlegroups.com
I defined a topology with a Shell Spout to run on a small test cluster with 2 machines (2 supervisors). All Spouts/Bolts are instantiated and executed on both machines according to the parallelism specified instead of having only a single instance specified. For example, I set the spout's executors and numTasks to 1, but it still shows up as spawned process on each machine. It seems like the cluster is not working as one but as 2 separate clusters. Is there any reasoning behind this? Are there potential configuration parameters I may have missed?

I am using Storm 0.8.2.

-Chris

Chris Wj

unread,
May 1, 2013, 4:34:47 PM5/1/13
to storm...@googlegroups.com
Ok, problem solved. I removed the storm-local running directories and restarted the processes and it cleared it up.

This page led me to try it: https://github.com/nathanmarz/storm/wiki/Troubleshooting
Reply all
Reply to author
Forward
0 new messages