Shell Spout\Bolt starting up on multiple supervisors when numTasks is set to 1
33 views
Skip to first unread message
Chris Wj
unread,
May 1, 2013, 4:12:30 PM5/1/13
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to storm...@googlegroups.com
I defined a topology with a Shell Spout to run on a small test cluster with 2 machines (2 supervisors). All Spouts/Bolts are instantiated and executed on both machines according to the parallelism specified instead of having only a single instance specified. For example, I set the spout's executors and numTasks to 1, but it still shows up as spawned process on each machine. It seems like the cluster is not working as one but as 2 separate clusters. Is there any reasoning behind this? Are there potential configuration parameters I may have missed?
I am using Storm 0.8.2.
-Chris
Chris Wj
unread,
May 1, 2013, 4:34:47 PM5/1/13
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to storm...@googlegroups.com
Ok, problem solved. I removed the storm-local running directories and restarted the processes and it cleared it up.