Question about Citus Docker-compose and swarm+machine+compose

[Mario Sanz Rodrigo]

Hi,

I'm trying citus with docker. I created a cluster with Docker Swarm in which there are several Docker Machine. 

When i run "docker-p compose citus up" executed properly, but when you run "docker-scale worker citus compose -p" creates workers on the master node. 

Is there any way to make the workers created in the nodes of the swarm?

Scheme:

Swarm-master (with citus_master & citus_config)     -> swarm_node_01 (with citus_worker_01)

                                                                                   -> swarm_node_02 (with citus_worker_02)

                                                                                   -> swarm_node_03 (with citus_worker_03)
                                                                                   -> swarm_node_04 (with citus_worker_04)

                                                                                   -> swarm_node_05 (with citus_worker_05)
                                                                                   -> swarm_node_06 (with citus_worker_06)

All swarm nodes are Docker Machines.

Regads,

Mario.

[Sai Srirampur]

Hi Mario,

Currently Citus documentation scopes setting up a citus cluster on a development docker-machine.

I researched over whether docker-compose could be used over a production swarm cluster. The following are the insights:

a. For a version 2 docker-compose file (Citus docker-compose file is version 2), docker-compose would work with swarm, as long as the swarm cluster is configured to use the overlay driver, or a custom driver which supports multi-host networking.

b. Swarm offers manual scheduling, in which in the docker-compose file you could specify the node on which each container should reside on. In this way, you could specify the node on which the master and the config containers should reside and the nodes on which the worker containers should reside. 

This link would be helpful.

Sorry for the late reply. If you already setup Citus in the swarm cluster, it would be helpful if you share the exact steps with us.

Thanks,

Sai

--
You received this message because you are subscribed to the Google Groups "citus-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to citus-users...@googlegroups.com.
To post to this group, send email to citus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/citus-users/5f2a272f-1a66-44b8-b997-afd798742120%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.