Is there a geo-redundant rmq brokers solution ?

[gili ada]

Hi

I'm new in this forum, so it would be appreciated if there are previous discussions on the topic.

We would like to replicate messages between brokers that are inter-connected over WAN (Geo-redundant).  A message published on one site should be replicated to all other nodes.

My understanding is: 

1. RabbitMQ cluster solution is not advised over WAN. (It is due to expected network partitioning issues)
2. We need to use shovel / federation plugin to replicate over WAN

A possible solution is to:

Develop a tool to configure the shovel plugin dynamically on each broker. The tool will be installed on each site where rmq broker is installed. Our preferred topology of connections is a mesh. A specific instance of the tool will be configured as the "topology configuration master" to provide the shovel configuration.

It feels we are doing something that was already done...

Are they any standard tool to configure shovel / federation between different brokers based on a common configuration?

Appreciate your comments and idea's 

Thanks Gil

[Michael Klishin]

Shovels can be created programmatically [1][2].

1. http://www.rabbitmq.com/shovel-dynamic.html

2. https://github.com/rabbitmq/rabbitmq-shovel-management

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

MK

Staff Software Engineer, Pivotal/RabbitMQ

[gili ada]

Hi Michael 

Thanks for the response

We are planning to create shovels programmatic using this API. BTW, we plan a mesh connectivity

I was wondering if there are plugins / tools already automating the dynamic shovel API , based on central configuration and expected topology?

Thanks Gil

On Thursday, August 30, 2018 at 10:36:18 AM UTC+3, Michael Klishin wrote:

Shovels can be created programmatically [1][2].

1. http://www.rabbitmq.com/shovel-dynamic.html

2. https://github.com/rabbitmq/rabbitmq-shovel-management

On Thu, Aug 30, 2018 at 9:38 AM, gili ada <gili...@gmail.com> wrote:

Hi

I'm new in this forum, so it would be appreciated if there are previous discussions on the topic.

We would like to replicate messages between brokers that are inter-connected over WAN (Geo-redundant).  A message published on one site should be replicated to all other nodes.

My understanding is: 

1. RabbitMQ cluster solution is not advised over WAN. (It is due to expected network partitioning issues)
2. We need to use shovel / federation plugin to replicate over WAN

A possible solution is to:

Develop a tool to configure the shovel plugin dynamically on each broker. The tool will be installed on each site where rmq broker is installed. Our preferred topology of connections is a mesh. A specific instance of the tool will be configured as the "topology configuration master" to provide the shovel configuration.

It feels we are doing something that was already done...

Are they any standard tool to configure shovel / federation between different brokers based on a common configuration?

Appreciate your comments and idea's 

Thanks Gil

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Michael Klishin]

Not that I know of.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[gili ada]

thanks..