Re: [storm-user] dynamic topologies

146 views

Skip to first unread message

Nathan Marz

unread,

Nov 5, 2012, 6:07:33 PM11/5/12

to storm-user

The structure of a topology is fixed. Though using the ability in 0.8.2 to submit topologies in an inactive state and a small script you can update a topology with essentially no downtime:

1. Submit new version in inactive state

2. Deactivate old topology / activate new one

3. Kill old topology

On Mon, Nov 5, 2012 at 8:45 AM, Bobby Richards <bobby.r...@gmail.com> wrote:

I am evaluating storm and would like to know if the following is possible.

I have a trading dsl to model all aspect of the trade life cycle. I have users (traders) model scenarios via and would like them to be able to deploy in an ad hoc fashion.

So quotes, news, trade messages are all coming in and are each assigned a spout.

The dsl generates small scala applications.

Can I deploy these possibly as dynamic topologies? Can bolts come and go? Or does everything need to be known at startup?

Perhaps create a spout that will listen for deploy/undeploy messages and a bolt could handle the work (ie add another bolt)?

Hope that made sense.

Thanks,

Bobby