IOT architecture with prometheus; mqtt, aws, pushgateway

25 views
Skip to first unread message

A R

unread,
Mar 30, 2020, 10:14:59 PM3/30/20
to Prometheus Users
Hello,

I have a Prometheus instance up and am trying to figure out the best route to get my IOT sensor data into it.
My devices publish a JSON to a MQTT topic every minute and I'm uncertain about the best practices on how to ingest or scrape these metrics. After reading the documentation, using the push-gateway and subscribing to a topic via a service seem frowned upon. I had an idea of pointing my MQTT messages at AWS Kineses or DynamoDB and then writing a exporter to hit those resources, am I on the right track?

Can someone with some more experience recommend another way? Or is it okay to use the push-gateway in this case?

Appreciate any help I can get!

Cheers. Stay healthy out there.

Jakub Jakubik

unread,
Mar 31, 2020, 4:09:06 AM3/31/20
to A R, Prometheus Users
hi A R,

I haven't set it up myself yet, but was thinking about the same use case.
What I've found is that there are mqtt/prome gateways - that work kind of like pushgateway:


the general idea is that the exporter subscribes to the mqtt topic and exposes it as a metric for prome (keeping the last published value from mqtt in memory)

hth,



--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/393b1b0d-1c68-4f5c-8870-e9b13ba51e5b%40googlegroups.com.


--

Kuba Jakubik

SRE Tech Lead

Netguru - Building software for world changers

jakub....@netguru.com
netguru.com
facebooktwitterlinkedin
Reply all
Reply to author
Forward
0 new messages