Installing CEPH on coreos

[Akshay Rao]

Hi 

I know I cant build CEPH on coreos due to the lack of tools.  But is it possible for me to build ceph on another dev machine using centos and then to copy the built binaries over to the individual ceph nodes?  If so, general things to keep in mind when I am doing this?

Thanks

AR

[Rob Szumski]

You should be able to build Ceph inside of a CentOS container as you regularly would. Mount a volume into the container to expose the built binaries back to the host for use within another container.

In the future, if you require tools to do debugging against the host, you can use a toolbox container, as detailed here: http://coreos.com/docs/cluster-management/debugging/install-debugging-tools/

 - Rob

[Seán C. McCord]

You can also run ceph within containers on the host.  Different components need different accesses.  monitors are the most pain; osd's are actually pretty easy.  Bootstrapping is always the hard part... and forget using ceph-deploy.

I'm working on getting all the pieces in nice, easy-to-use docker images, but I do have ceph monitors and osds running locally on CoreOS in Docker containers.

--
Seán C. McCord

ule...@gmail.com

CyCore Systems

[Akshay Rao]

Thanks... that makes sense.  Will a toolbox container (in addition to debugging the host) also allow me to actually build ceph as well?

[Rob Szumski]

Yeah, it should work just fine. By default the toolbox is Fedora but you can use any docker container you’d like as well.

[Christopher Armstrong]

I have been working on Dockerifying Ceph to run on CoreOS so we can support a new component in Deis: https://github.com/deis/deis/pull/1754

And Seán's work is great too: https://github.com/ulexus/docker-ceph

Basically, it's quite possible, although I haven't yet successfully mounted the RDB volumes inside a container.