Druid - Any road-map for generating Continuous Alerts and Better Visualization?

[Jagadeesh M]

Today we have an event collection system that collects data in great detail across all our applications and systems across all products (we have quite a few products). 

And we have an old system which allows for aggregation and charting the metrics from these events. As you can imagine due to very heavy volumes, our retention on this MySQL based system is very low. And we have very basic alerting system also based on these logs. Hence the need to built a new scalable system, which will allow us to keep metrics for several months and allow flexible alerting based on them.

Apart from aggregation and query capabilities, does Druid have any road-map outlined for continuous querying so we can generate alerts on them? Also, we were exploring Pivot for visualization but it doesn't support some of the basic features like - auth, dashboards etc. Are there any plans to integrate with more mature visualization tools like Grafana?

Thanks!

[Fangjin Yang]

Druid already integrates with Grafana

See https://github.com/gianm/druid-monitorama-2015

For Pivot specific questions, you may want to try https://groups.google.com/forum/#!forum/imply-user-group

Suggestions for new features are welcome.

[Jagadeesh M]

Fangjin,

I tried integrating Druid with Grafana based on the experimental plugin and it doesn't work. 

I tried with latest version fo Grafana though.

Thanks!

[Gian Merlino]

Hey Jagadeesh,

I believe that Grafana plugin only works with older versions of Grafana.

You could try having Grafana talk to Druid through PlyQL (http://imply.io/post/2016/05/04/programmatic-plyql.html) and see how far that will take you. Feedback is welcome if you try this and run into any issues.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/cbb901bb-57cb-44b9-a794-a5f7a08bc4da%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Jagadeesh M]

Hi Gian,

I thought Grafana doesn't have a mysql datasource. It only uses mysql for storing metadata - users, dashboard settings etc.Am I missing something else ?

Thanks,

Jagadeesh

[Gian Merlino]

Ah in that case, never mind. I'm not too familiar with Grafana and didn't know which datasources it supported.

Gian

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/1e7a12ab-39ea-4a6f-b920-458589058d2a%40googlegroups.com.