Cassandra retain store for MQTT

[Laing, Michael]

My POC is passing all tests on my mac and includes TLS and websocket support :)

I am preparing a presentation for Datastax "Cassandra Day" in NYC in early Feb, so I will be refactoring and generalizing the Cassandra "retain" server over the next week or so. Currently it can handle any number of brokers as clients, but I will refactor and enhance it to be fully async as well as multiprocess. 

So n brokers will be serviced by 1 retain server with m subprocesses each talking to a pool of x Cassandra nodes. Of course you can have many retain servers talking to the same Cassandra cluster.

After that I plan to add support for authentication and ACLs using Cassandra, as well as enterprise bridging using a message broker (we use RabbitMQ).

I plan to share this via github as an experimental project based upon 1.4 if there is interest.

We've recently been asked to think about expanding our fabrik infrastructure to our entire user base - some 10's of millions of clients, billions of messages, many retained - so this will be an interesting year :)

ml

[Paul Fremantle]

Michael

There is definitely interest. WSO2 have also built a MQTT server backed by Cassandra, but taken a very different approach. It would be interesting to compare notes.

Paul

--
To learn more about MQTT please visit http://mqtt.org
---
You received this message because you are subscribed to the Google Groups "MQTT" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mqtt+uns...@googlegroups.com.
To post to this group, send email to mq...@googlegroups.com.
Visit this group at http://groups.google.com/group/mqtt.
For more options, visit https://groups.google.com/d/optout.

--

Paul Fremantle

Part-time PhD student - School of Computing

email: paul.fr...@port.ac.uk, pa...@fremantle.org

twitter: pzfreo / skype: paulfremantle / blog: http://pzf.fremantle.org

CTO and Co-Founder, WSO2
OASIS WS-RX TC Co-chair, Apache Member
07740 199 729

[Laing, Michael]

Nice - it will be interesting to compare.

I couldn't actually find any MQTT / Cassandra stuff on the WSO2 web site tho...

Michael

[Paul Fremantle]

Michael

We implemented a Cassandra store for AMQP for our existing broker a while ago. I'm attaching an academic paper we published about this and the design of the model.

We have recently added MQTT support to this and that will be shipping later this quarter.

As you can imagine, the model will likely be very different to yours as we started with AMQP and then layered on MQTT support.

Paul

[Laing, Michael]

Thanks Paul, that's interesting. It is a different model.

Michael