Best way to scrape metrics from a JSON log files

21 views
Skip to first unread message

Yashar Nesabian

unread,
Jul 12, 2020, 10:00:32 AM7/12/20
to Prometheus Users
Hi,
some of our applications are generating JSON style logs, for now, we are using elastic search to store the logs and show them in the Grafana but this is not a good choice to use elastic search.
I tried to use mtail but as their developers mentioned, "mtail is really designed for getting metrics out of unstructured logs"
So are there any other ways to send JSON style logs to the Prometheus?

Stuart Clark

unread,
Jul 12, 2020, 12:39:03 PM7/12/20
to Yashar Nesabian, Prometheus Users

Prometheus is a metrics system. You would normally use it in parallel with an events system such as Elasticsearch or Loki.

As you say tools like mtail can be used to create metrics from log files which can be very useful.

sayf eddine Hammemi

unread,
Jul 13, 2020, 3:58:52 AM7/13/20
to Stuart Clark, Prometheus Users
As said Prometheus is just a fancy wrapper around a TSDB (time-series database). Loki, being developed by Grafana has a sleek integration. You can jump from metric to log file and vice versa inside grafana. Advice you to check it out

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/03f1d087-3905-9123-7037-9b452e235d59%40Jahingo.com.
Reply all
Reply to author
Forward
0 new messages