Bolts don't receive data from spout

105 views
Skip to first unread message

Matt Stump

unread,
Apr 20, 2012, 3:01:23 AM4/20/12
to storm...@googlegroups.com
I'm trying to use the redis pub-sub spout but am running into some issues. Right now the data is traversing the spout and is being emitted, but it never makes it to the first bolt. The emitted and transfered count for the spout is 680, but the ack and fail count is 0. All counts for the bolts are also 0. From what I can tell the first bolt never gets called. 

I'm using storm 0.7.1 with storm-redis-pubsub 0.0.2-SNAPSHOT.

I was wondering if someone could take a quick look at my topology and my first bolt. I'm hoping it's something stupid on my part.  

Nathan Marz

unread,
Apr 20, 2012, 3:13:10 AM4/20/12
to storm...@googlegroups.com
The topology looks ok. I'm wondering it there's a problem with inter-node communication. Are you able to run the storm-starter topologies ok (WordCountTopology and ExclamationTopology)?
--
Twitter: @nathanmarz
http://nathanmarz.com

Matt Stump

unread,
Apr 20, 2012, 3:22:55 AM4/20/12
to storm...@googlegroups.com
Exclamation topology ran fine.  I'm running storm on my laptop, which is performing all three roles.  Also, I have the bolts under test where I mock the spout input and everything works as expected.

Matt Stump

unread,
Apr 20, 2012, 11:53:33 AM4/20/12
to storm...@googlegroups.com
Looks like I just needed to restart all of the various storm processes.  

Matt Stump

unread,
Apr 20, 2012, 2:14:32 PM4/20/12
to storm...@googlegroups.com
I think I spoke to soon, I'm still getting data lost between bolts with nary an exception or error message found in the logs.  I rerun the same test with the same data and I get a different result every time I restart storm.  Each time a different number of tuples get to different bolts before eventually most if not all tuples being lost on their way to the DB.

Nathan Marz

unread,
Apr 20, 2012, 2:19:23 PM4/20/12
to storm...@googlegroups.com
What version of ZeroMQ do you have installed?

Matt Stump

unread,
Apr 20, 2012, 2:24:12 PM4/20/12
to storm...@googlegroups.com
2.1.11  I skipped 2.1.10 as advised, but thought I'de give 2.1.11 a try due to a bevy of bug fixes.  I guess it's time to try downgrading to .9

Nathan Marz

unread,
Apr 20, 2012, 2:24:50 PM4/20/12
to storm...@googlegroups.com
I would downgrade to 2.1.7. 

Matt Stump

unread,
Apr 20, 2012, 5:12:00 PM4/20/12
to storm...@googlegroups.com
Alright, after downgrading to 2.1.7 and fixing some bugs on my part all tuples are being processed.  Thanks for your assistance!
Reply all
Reply to author
Forward
0 new messages