Mass Transit with High Availability Queues in a RabbitMQ Cluster

[Chris Howe]

I am fairly new to both RabbitMQ and Mass Transit, so I apologize if
this question has been answered somewhere already.

I am running Mass Transit on top of RabbitMQ, and I would like to
avoid a single point of failure in my system. I can create a cluster
of RabbitMQ servers, but from what I can tell, in the default
configuration, even though the exchange and routing information is
replicated among the rabbit nodes, queues live on a single node unless
told otherwise at the time they were created ( by adding an "x-ha-
policy" setting to the extra arguments when the queue was declared. )
If the node holding a queue goes down for some reason, there is the
potential for some loss of messages sent to the queue while the node
is down.

RabbitMQ has a way to allow you to declare High Availability queues
that work in an active/active configuration (http://www.rabbitmq.com/
ha.html).

Does anyone have any experience with running Mass Transit on top of a
RabbitMQ cluster in general or with High Availability Queues in
particular?

Thanks

-Chris H.

[Chris Patterson]

The HA queues were added in 2.6 I think, which came out after we created RabbitMQ support.

It's likely we will add support for the HA queues at some point, but would still encourage writing to a local node of a broker cluster for HA.

> --
> You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
> To post to this group, send email to masstrans...@googlegroups.com.
> To unsubscribe from this group, send email to masstransit-dis...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/masstransit-discuss?hl=en.
>

[Chris Patterson]

You will need to delete the queues and let MT recreate them, or just change them to HA using the management tools for RabbitMQ.

On Wed, Jun 5, 2013 at 10:19 AM, Matthew Osborn <mat...@osbornm.com> wrote:

Hey Chris, 

So if I understand RabbitMQ correctly and your comment correctly then; I would get HA by just clustering nodes and writing to the broker and letting RabbitMQ fail over to another node when the broke dies. However, according to the documentation Message Queues are not replicated so all messages in the queue on the broker would be lost, but the Cluster would still accept messages? 

Have you added support for the High Availability Queues to MassTransit yet? (this post is a couple years old now ;) ). 

Thanks, 

Matthew M. Osborn

> To unsubscribe from this group, send email to masstransit-discuss+unsub...@googlegroups.com.

> For more options, visit this group at http://groups.google.com/group/masstransit-discuss?hl=en.
>

--

You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-dis...@googlegroups.com.

To post to this group, send email to masstrans...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/e90c8e58-cba8-4691-a68e-f47f8da5ecb0%40googlegroups.com?hl=en-US.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Matthew Osborn]

Okay sorry for the ignorance, but if I understand you correctly your saying that MassTransit now supports the "mirrored" queues? So if I set up RabbitMQ to have mirrored HA queues then everything works? 

> To unsubscribe from this group, send email to masstransit-discuss+unsubscribe...@googlegroups.com.

> For more options, visit this group at http://groups.google.com/group/masstransit-discuss?hl=en.
>

--

You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsub...@googlegroups.com.

[Chris Patterson]

Yes, that is correct. It's been the case for some time now, for instance:

Check out http://coding-insomnia.com/2013/02/23/clustering-rabbitmq-on-windows/ for more details.

To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-dis...@googlegroups.com.

To post to this group, send email to masstrans...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/5a74a29a-cf26-440b-be34-181981e29976%40googlegroups.com?hl=en-US.

[Matthew Osborn]

Okay my Google Foo failed me and show me som out of date stuff! thanks for the quick reply! 

Cheers,

Matthew M. Osborn

--
You received this message because you are subscribed to a topic in the Google Groups "masstransit-discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/masstransit-discuss/ugm_hgh8Ako/unsubscribe?hl=en-US.
To unsubscribe from this group and all its topics, send an email to masstransit-dis...@googlegroups.com.

To post to this group, send email to masstrans...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/CAHX4WYeAVAywVZ%2BBx5uTVpzr8h3pCuwCO0GrhdrVDO575XH7sw%40mail.gmail.com?hl=en-US.