send MQTT messages to RabbitMQ with activated RabbitMQ_Mqtt_plugin

[Admir Berbiu]

Hi,

Could sb help me with any tutorial using RabbitMQ as a broker for MQTT? I'm new here and want to learn sth.

I could use c# or java. What I want to do is to take some data from a textfile and send them through MQTT to the RabbitMQ broker.

A "hello world" example would be more than enough.  I checked the general c# tutorials in RabbitMQ, but I am wondering how to use it if I am sending through MQTT.

Thank you

[Michael Klishin]

Just pick any MQTT tutorial you like on the Web. There aren't many RabbitMQ-specific aspects,

besides the default user limited to localhost by default and the documented limitations on http://rabbitmq.com/mqtt.html.

All the fundamentals are still the same with any client library.

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

MK

Staff Software Engineer, Pivotal/RabbitMQ

[Admir Berbiu]

I wrote this code bymyself and tried to run it. I am able to see the MQTT Queue in the RabbitMQ dashboard, but there is no message.

There is no message received, only the queue is being shown in Rabbit :/ Any advices please? 

Thank you

and this 

On Sun, Feb 5, 2017 at 7:17 AM, Michael Klishin <mkli...@pivotal.io> wrote:

Just pick any MQTT tutorial you like on the Web. There aren't many RabbitMQ-specific aspects,

besides the default user limited to localhost by default and the documented limitations on http://rabbitmq.com/mqtt.html.

All the fundamentals are still the same with any client library.

On Sun, Feb 5, 2017 at 12:57 AM, Admir Berbiu <admir...@gmail.com> wrote:

Hi,

Could sb help me with any tutorial using RabbitMQ as a broker for MQTT? I'm new here and want to learn sth.

I could use c# or java. What I want to do is to take some data from a textfile and send them through MQTT to the RabbitMQ broker.

A "hello world" example would be more than enough.  I checked the general c# tutorials in RabbitMQ, but I am wondering how to use it if I am sending through MQTT.

Thank you

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.

To post to this group, send email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

MK

Staff Software Engineer, Pivotal/RabbitMQ

--
You received this message because you are subscribed to a topic in the Google Groups "rabbitmq-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/rabbitmq-users/V8njClbU7GM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to rabbitmq-users+unsubscribe@googlegroups.com.

[Admir Berbiu]

And here is the code, which is not working yet:

using System;

using System.Text;

using System.Net;

using uPLibrary.Networking.M2Mqtt;

using uPLibrary.Networking.M2Mqtt.Messages;

namespace MQTTcl

{

    class Program

    {

        public static void Main()

        {

            // create client instance 

            MqttClient client = new MqttClient(IPAddress.Parse("127.0.0.1"));

            // register to message received 

            client.MqttMsgPublishReceived += client_MqttMsgPublishReceived;

            string clientId = Guid.NewGuid().ToString();

            client.Connect(clientId);

            // subscribe to the topic "/home/temperature" with QoS 1 

            client.Subscribe(new string[] { "Xhindi" }, new byte[] { MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE });

            string strValue = Convert.ToString("This is a test message by Xhino!!!");

            // publish a message on "/home/temperature" topic with QoS 1 

            client.Publish("Xhindi", Encoding.UTF8.GetBytes(strValue), MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE, false);

        }

        static void client_MqttMsgPublishReceived(object sender, MqttMsgPublishEventArgs e)

        {

            // handle message received 

[Admir Berbiu]

Any idea why my code is not working please? Thx

using System;

using System.Text;

using System.Net;

using uPLibrary.Networking.M2Mqtt;

using uPLibrary.Networking.M2Mqtt.Messages;

namespace MQTTcl

{

    class Program

    {

        public static void Main()

        {

            // create client instance 

            MqttClient client = new MqttClient(IPAddress.Parse("127.0.0.1"));

            // register to message received 

            client.MqttMsgPublishReceived += client_MqttMsgPublishReceived;

            string clientId = Guid.NewGuid().ToString();

            client.Connect(clientId);

            // subscribe to the topic "/home/temperature" with QoS 1 

            client.Subscribe(new string[] { "Xhindi" }, new byte[] { MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE });

            string strValue = Convert.ToString("This is a test message by Xhino!!!");

            // publish a message on "/home/temperature" topic with QoS 1 

            client.Publish("Xhindi", Encoding.UTF8.GetBytes(strValue), MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE, false);

        }

        static void client_MqttMsgPublishReceived(object sender, MqttMsgPublishEventArgs e)

        {

            // handle message received 

On Sunday, February 5, 2017 at 7:17:31 AM UTC+1, Michael Klishin wrote:

Just pick any MQTT tutorial you like on the Web. There aren't many RabbitMQ-specific aspects,

besides the default user limited to localhost by default and the documented limitations on http://rabbitmq.com/mqtt.html.

All the fundamentals are still the same with any client library.

On Sun, Feb 5, 2017 at 12:57 AM, Admir Berbiu <admir...@gmail.com> wrote:

Hi,

Could sb help me with any tutorial using RabbitMQ as a broker for MQTT? I'm new here and want to learn sth.

I could use c# or java. What I want to do is to take some data from a textfile and send them through MQTT to the RabbitMQ broker.

A "hello world" example would be more than enough.  I checked the general c# tutorials in RabbitMQ, but I am wondering how to use it if I am sending through MQTT.

Thank you

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Michael Klishin]

Your program naturally finishes running after a call to Publish. It's easy

to assume at first that whenever Publish or similar methods return, your message

has reached RabbitMQ — or even consumer! — but that's not the case.

See http://www.rabbitmq.com/confirms.html. This is generally applicable to messaging

protocols, and most protocol have some kind of confirmation mechanism for publishers.

Add a 5 second sleep after publishing and better yet, move the consumer into a separate

program (that's how all of our tutorials are structured: http://www.rabbitmq.com/getstarted.html).

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Admir Berbiu]

Sorry again. I did it but there is the same issue, I have the queue but no message shown in the dashboard.

public static void Main()
{
// create client instance
MqttClient client = new MqttClient(IPAddress.Parse("127.0.0.1"));

// register to message received
client.MqttMsgPublishReceived += client_MqttMsgPublishReceived;

string clientId = Guid.NewGuid().ToString();
client.Connect(clientId);

// subscribe to the topic "/home/temperature" with QoS 1
client.Subscribe(new string[] { "Xhindi" }, new byte[] { MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE });

string strValue = Convert.ToString("This is a test message by Xhino!!!");

string strValue1 = Convert.ToString("This is a test message by Sandri!!!");
string strValue2 = Convert.ToString("KNP!!!");
string strValue3 = Convert.ToString("KONTH!!!");

System.Threading.Timer timer = null;
timer = new System.Threading.Timer((obj) =>
{

// publish a message on "/home/temperature" topic with QoS 1
client.Publish("Xhindi", Encoding.UTF8.GetBytes(strValue), MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE, false);

// client.Publish("Xhindi", Encoding.UTF8.GetBytes(strValue1), MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE, false);
// client.Publish("Xhindi", Encoding.UTF8.GetBytes(strValue2), MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE, false);
// client.Publish("Xhindi", Encoding.UTF8.GetBytes(strValue3), MqttMsgBase.QOS_LEVEL_AT_LEAST_ONCE, false);
// timer.Dispose();
},
null, 15000, System.Threading.Timeout.Infinite);

int milliseconds = 5000;
Thread.Sleep(milliseconds);
//LoadJson();
//writeJson();

}

<<<

[Michael Klishin]

There are command line tools in Mosquitto that let you publish and consume from the command line.

Try them for comparison.

Sorry but we are not experts in every client library there is for every protocol we support.

        }

<<<

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.

To post to this group, send an email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Admir Berbiu]

Thank you Michael , as you are the only active here. I appreciate a lot your help.

I have tried Mosquitto, but I need to do it by not using mosquitto. I want to use only rabbitmq since it says that it is a broker who supports even MQTT.

Normally from the code, I've written it should work. In which libraries you are experts so I could try to fit my solution related to that library?

Any advice on my issue, since I still want to stick to c# and m2mqtt library is welcomed also. Thank you very much.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send an email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Michael Klishin]

I was suggesting Mosquitto CLI tools and only to see that the plugin is functional.

Every client library has a maintainer and some kind of a venue for questions. This list is about RabbitMQ.

To post to this group, send email to rabbitm...@googlegroups.com.

[Admir Berbiu]

Actually everywhere I've been writing had explanations that the problem is not in the code but in rabbit configuration like:

[16:44] <karlp> you may want to check the manual for rabbit if that's a feature you can turn on.

[16:56] <karlp> I think you've got a rabbit config problem, not a code problem at least.

[16:56] <karlp> the messages are being posted from your little graph,

etc.

It works okay with mosquitto, but in rabbitmq I am not able to enter the message in the queue :/

[Michael Klishin]

When in doubt, inspect server logs. To get started you don't need to configure anything for MQTT or otherwise,
beyond creating a separate user that is allowed remote connections (http://www.rabbitmq.com/access-control.html). 

There is an easy way to verify your hypothesis: try a couple more different clients/existing examples
and mosquitto_pub, mosquitto_sub [1][2].

We routinely see people having Mosquitto or another MQTT broker running locally so RabbitMQ MQTT plugin
cannot even start (two process cannot bind to the same port at the same time). This is easy to see in server logs
(MQTT listeners will fail to start).

1. https://mosquitto.org/man/mosquitto_pub-1.html
2. https://mosquitto.org/man/mosquitto_sub-1.html

On 7 February 2017 at 19:09:16, Admir Berbiu (admir...@gmail.com) wrote:
> Actually everywhere I've been writing had explanations that the problem is
> not in the code but in rabbit configuration like:

> [16:44] you may want to check the manual for rabbit if that's a

> feature you can turn on.

> [16:56] I think you've got a rabbit config problem, not a code
> problem at least.
> [16:56] the messages are being posted from your little graph,

> etc.
>
> It works okay with mosquitto, but in rabbitmq I am not able to enter the
> message in the queue :/
>
> On Tuesday, February 7, 2017 at 12:25:27 PM UTC+1, Michael Klishin wrote:
> >
> > I was suggesting Mosquitto CLI tools and only to see that the plugin is
> > functional.
> >
> > Every client library has a maintainer and some kind of a venue for
> > questions. This list is about RabbitMQ.
> >
> > On 7 Feb 2017, at 13:57, Admir Berbiu >

[Michael Klishin]

I decided to test the hypothesis with `mosquitto_sub` and `mosquitto_pub`.

I started a RabbitMQ 3.6.6 node that has some configuration but nothing related to MQTT.

I enabled the mqtt plugin and then ran an example consumer and producer (in this order).

Here's how I run the consumer:

mosquitto_sub -h 127.0.0.1 -i "example_consumer" -t "example_topic" -u guest -P guest

Here's how I publish:

mosquitto_pub -h 127.0.0.1 -i "example_publisher" -t "example_topic" -m "example payload"

and the consumer consumes and outputs "example payload"s.

> To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.

> To post to this group, send an email to rabbitmq-users@googlegroups.com.

> For more options, visit https://groups.google.com/d/optout.
>

--
MK

Staff Software Engineer, Pivotal/RabbitMQ

[Admir Berbiu]

Dear Sir, 

I know that we cannot run both Mosquitto and RabbitMQ simultaneously at the same port and I haven't done this. I have stopped one of the services when I wanted to run the other one.
As I told you before, I have done different tests with Mosquitto previously and it perfectly works. It is super OKAY. 

The problem is that I HAVE TO use RabbitMQ, but I am not receiveing into RabbitMQ those messages :) I see the queue but the messages dont get in.

There should be something with the configuration of the plugin or RabbitMQ or maybe with the versions of AMQP and MQTT. Hmmm I'm still wondering.

I love RabbitMQ as a tool and hope I will succeed to use it with MQTT as I did in previous applications of it. Hopefuly, sb else had similar issue to mine :)

On Saturday, February 4, 2017 at 10:57:15 PM UTC+1, Admir Berbiu wrote:

[Admir Berbiu]

Just curious, Michael, did you have the chance to compile the code? I tried to change a lot of settings in Rabbit (ttl, size of clientID etc.) and tested in different PCs but still the same. I cannot get the message published.
On mosquitto broker works everything, but not on rabbitmq. :/ 

On Saturday, February 4, 2017 at 10:57:15 PM UTC+1, Admir Berbiu wrote:

[Michael Klishin]

Hi Admir,

I'm sorry to be so blunt but you are not going to get very far by asking me for
help every other day.

Please do your own research, contact the maintainer of the library you're using, ask your colleagues
for help, google for more examples.

And PLEASE, PLEASE, PLEASE inspect server logs and consider posting them here.
The easier you make it for others to help you, the higher are the chances for you of actually
getting help.

I've demonstrated that the plugin is functional, you seem to have reached the same conclusion.

Sorry, it's unrealistic for our small team to hand hold every beginner every step of the way.

[Karl Nilsson]

Hi Admir,

I tested your code against rabbitmq with the mqtt plugin enabled and that worked ok. The only thing I can think of is that the mqtt plugin isn't enabled correctly in RabbitMQ. Can you check the 'Ports and contexts' section on the overview page - there should be an mqtt listener listed there.

Cheers

Karl

> To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
> To post to this group, send an email to rabbitmq-users@googlegroups.com.

> For more options, visit https://groups.google.com/d/optout.
>

--
MK

Staff Software Engineer, Pivotal/RabbitMQ

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send an email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Karl Nilsson

Staff Software Engineer, Pivotal/RabbitMQ

[Michael Klishin]

I'd like to be particularly annoying to the OP and point out that we would easily find out
if the plugin was enabled from server logs but when we asked to inspect them,
none were provided.

If you are seeking help with a messaging broker or data store, always inspect and post
logs.

On 8 February 2017 at 19:29:52, Karl Nilsson (knil...@pivotal.io) wrote:
> Hi Admir,
>
> I tested your code against rabbitmq with the mqtt plugin enabled and that
> worked ok. The only thing I can think of is that the mqtt plugin isn't
> enabled correctly in RabbitMQ. Can you check the 'Ports and contexts'
> section on the overview page - there should be an mqtt listener listed
> there.
>
> Cheers
> Karl
>

> > an email to rabbitmq-user...@googlegroups.com.
> > > To post to this group, send an email to rabbitm...@googlegroups.com.

> > > For more options, visit https://groups.google.com/d/optout.
> > >
> >
> > --
> > MK
> >
> > Staff Software Engineer, Pivotal/RabbitMQ
> >
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "rabbitmq-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send an

> > email to rabbitmq-user...@googlegroups.com.
> > To post to this group, send an email to rabbitm...@googlegroups.com.

> > For more options, visit https://groups.google.com/d/optout.
> >
>
>
>
> --
> Karl Nilsson
>
> Staff Software Engineer, Pivotal/RabbitMQ
>

> --
> You received this message because you are subscribed to the Google Groups "rabbitmq-users"
> group.

> To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
> To post to this group, send an email to rabbitm...@googlegroups.com.

[Admir Berbiu]

Dear Gentlemen, 

All I have in log file is this:

=INFO REPORT==== 9-Feb-2017::21:43:14 ===

accepting MQTT connection <0.986.0> (127.0.0.1:55233 -> 127.0.0.1:1883)

=INFO REPORT==== 9-Feb-2017::21:43:28 ===

MQTT detected network error for "127.0.0.1:55233 -> 127.0.0.1:1883": peer closed TCP connection

Which I believe it is normal to show it when I close the client window, so when I close the window of my program, my code. Does this say anything to you?

I do not have anything in the other log file. No messages published so far in the queue, only the queue remains visible in the dashboard and the message rate :/

Thank you.

> To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
> To post to this group, send an email to rabbitm...@googlegroups.com.

> For more options, visit https://groups.google.com/d/optout.
>

--
MK

Staff Software Engineer, Pivotal/RabbitMQ

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send an email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Admir Berbiu]

Furthermore, I tried 5 other clients, 2 in c#, java and 2 python....all have the same issue on different PCs 

[Michael Klishin]

All it says that RabbitMQ accepted an MQTT connection and then that connection

was closed abruptly (as in, TCP connection was closed without closing the MQTT one).

Nothing else.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Admir Berbiu]

I followed the instructions on the RabbitMQ web to install the plugin etc. Please find my error logs posted before and let me know if something else is needed to understand better the issue. Is there any guide how I could verify that everything is working okay with the plugin? Is there any other way how to test and install the plugin?

[Michael Klishin]

We've posted how you can run a basic example with `mosquitto_sub` and `mosquitto_pub`,

Karl has tried your C# code and reported a success.

We also provided a list of more productive ways to get to the bottom of this:

> please do your own research, contact the maintainer of the library you're using, ask your colleagues

> for help, google for more examples

Asking over and over in this thread is unlikely to be efficient. There is no shortage

of beginner level information about MQTT, client libraries and even MQTT with RabbitMQ

specifically on the Web.

Good luck.

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Amithpn]

Hi Admir. May be im late to reply here. I thought i will make some points here. 

If at all you want to publish to mqtt from rabbitmq, you have to chose queue name and you have to use exchange "amq.topic" only. Routing what you choose will become the mqtt topic and all the mqtt subscribers or rabbit subscribers listening on this topic or queue will get the message.

If you choose to use rabbit worker queues, delivery will be in round robin fashion.

Hope this helps you. If you want i can help you with examples. Let me know

Thanks,

Amith

[Admir Berbiu]

Hi Amith & Michael,

maybe I wrongly presented my issue, that's why @Michael came up with such general and repeated tips (I've done them all for a couple of times). Let me know if I should open a new topic after reading below:

All I want and tried to do is send MQTT messages (for ex. temperature or humidity) to RabbitMQ and then use the possibility to save those messages in RabbitMQ QUEUE in case my Receiver.cs (server) goes in sleep for a couple of seconds (simulating a server downtime). The receiver will be a AMQP consumer/subscriber. So I will send with MQTT and on the reciever and routing side I will have AMQP. 

I started to do this with the code posted above (an many other clients in java, python etc), which creates the queue but there are no messages in the queue. If I comment the Subscriber in the code then the queue is not being created. How could I send messages with mqtt and then receive from the queue with amqp? I am not just trying to use RabbitMQ as an MQTT broker.

I want to show that sending with mqtt and then using rabbitmq and amqp is better than just use mosquitto and mqtt where we loose data beacause of the lack of the queue.

Also I am studying to do it by using SPRING INTEGRATION in java. so I could use mosquitto with mqtt, then adapt to amqp through spring and then send normally to Rabbitmq with amqp.

I would appreciate a lot having any advice or example. 

Thank you

[Michael Klishin]

MQTT clients publish messages to a pre-defined exchange (amq.topic by default).
From there it works just as if it was an AMQP 0-9-1 publisher.
The How It Works section on http://www.rabbitmq.com/mqtt.html says just that.

AMQP 0-9-1 concepts:
http://www.rabbitmq.com/tutorials/amqp-concepts.html

Tutorial 4:
http://www.rabbitmq.com/getstarted.html

[Amithpn]

I think i got your problem. I can give you working examples if you tell me the programming language of your choice.

[Admir Berbiu]

C# & java I could deal with no problem.
Thank you a lot.
I have already tried like 5_6 of examples but I had the same issue with the queue :)
What do you think the problem is?

You received this message because you are subscribed to a topic in the Google Groups "rabbitmq-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/rabbitmq-users/V8njClbU7GM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

[Admir Berbiu]

Done & solved.  I'll update you later or tomorrow how :)

Thank you!

[Amith Patil N]

Great. Let us also know how you did. 

To post to this group, send email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--