rabbitmq federation plugin issue with multiple upstreams

273 views
Skip to first unread message

rakar...@gmail.com

unread,
Nov 5, 2016, 1:13:07 PM11/5/16
to rabbitmq-users
i have a setup as below,

Rabbitmq central cluster servers with federation:

Canada location cluster servers which used to connect all canada location servers(sub collective name as canada_mcollective):

Texas location cluster servers which used to connect all canada location servers(sub collective name as texas_mcollective):

configured federation upstream on centram cluster as below:
virtual host : /mcollective
ack mode : on-confirm
expirt : 36000000ms

federation upstream policy:
virtual host : /mcollective
Pattern : ^.*
apply to : all
definition : federation-upstream-set: all
Priority : 0

so when i do mcollective mco ping sometimes it returns only one location servers details and sometimes nothing. But if I do upstream to only one location cluster servers it works perfectly. 
not sure what am missing here to work with multiple locations with federation. any help pls. 

Michael Klishin

unread,
Nov 5, 2016, 2:43:30 PM11/5/16
to rabbitm...@googlegroups.com
Without knowing how exactly mcollective works and server logs it is not possible to suggest anything.

Federating every queue and exchange in a vhost sounds
like a complete overkill. What makes you believe it is necessary? What's the goal with this?

Federation is not a replacement for clustering. It is very important to understand how it works if you plan to build a geographically distributed system with it.
--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Ravi Kumar

unread,
Nov 6, 2016, 1:20:24 AM11/6/16
to rabbitm...@googlegroups.com
Am not replacing cluster with federation. I know both are different. What am trying is cluster with federation. mcollective it just broadcasts the message to the queue as exchange mcollective_reply. 

Basically I want the broadcasted message to be forwarded from central rabbitmq to each location of clustered rabbitmq servers and get the response from each location of rabbitmq. 

On Sun, Nov 6, 2016 at 12:13 AM, Michael Klishin <mkli...@pivotal.io> wrote:
Without knowing how exactly mcollective works and server logs it is not possible to suggest anything.

Federating every queue and exchange in a vhost sounds
like a complete overkill. What makes you believe it is necessary? What's the goal with this?

Federation is not a replacement for clustering. It is very important to understand how it works if you plan to build a geographically distributed system with it.

On 5 Nov 2016, at 20:13, rakar...@gmail.com wrote:

i have a setup as below,

Rabbitmq central cluster servers with federation:

Canada location cluster servers which used to connect all canada location servers(sub collective name as canada_mcollective):

Texas location cluster servers which used to connect all canada location servers(sub collective name as texas_mcollective):

configured federation upstream on centram cluster as below:
virtual host : /mcollective
ack mode : on-confirm
expirt : 36000000ms

federation upstream policy:
virtual host : /mcollective
Pattern : ^.*
apply to : all
definition : federation-upstream-set: all
Priority : 0

so when i do mcollective mco ping sometimes it returns only one location servers details and sometimes nothing. But if I do upstream to only one location cluster servers it works perfectly. 
not sure what am missing here to work with multiple locations with federation. any help pls. 

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "rabbitmq-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/rabbitmq-users/V_LG8dKPH6A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

Michael Klishin

unread,
Nov 6, 2016, 7:54:49 AM11/6/16
to rabbitm...@googlegroups.com
If you want replication then only federate exchanges. Queue federation moves a single set of messages around,
which likely is not expected in this case and causes the confusion.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages