Promethues scraper for ELK

[narsin...@gmail.com]

Hi Team ,

How to scrap efk/ELK metrics by using Prometheus which are running on kubernetes

Configeration file: https://github.com/prometheus/prometheus/blob/master/documentation/examples/prometheus-kubernetes.yml

Thanks

Narsing

[Marcus Franke]

On Mon, Jun 19, 2017 at 01:48:48AM -0700, narsin...@gmail.com wrote:
> Hi Team ,
>
> How to scrap efk/ELK metrics by using Prometheus which are running on
> kubernetes

You need an exporter on the elasticsearch side like this one:
https://github.com/vvanholl/elasticsearch-prometheus-exporter

Then you have an api endpoint for prometheus to scrape.


Regards,
Marcus

[David Karlsen]

Have quite happily been using it.

A bit of a PITA that a release is needed per ES version - but works very well elsewise

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsub...@googlegroups.com.
To post to this group, send email to prometheus-developers@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/20170619164913.GC22112%40googlemail.com.
For more options, visit https://groups.google.com/d/optout.

--

--
David J. M. Karlsen - http://www.linkedin.com/in/davidkarlsen

[Carl Pettersson (BN)]

There is the logstash_exporter as well: https://github.com/BonnierNews/logstash_exporter

 

Best regards,

Carl

 

Från: prometheus...@googlegroups.com [mailto:prometheus...@googlegroups.com] För David Karlsen
Skickat: den 19 juni 2017 19:35
Till: Prometheus Developers <prometheus...@googlegroups.com>
Kopia: narsin...@gmail.com
Ämne: Re: Promethues scraper for ELK

 

Have quite happily been using it.

A bit of a PITA that a release is needed per ES version - but works very well elsewise

2017-06-19 18:49 GMT+02:00 Marcus Franke <marcus...@gmail.com>:

On Mon, Jun 19, 2017 at 01:48:48AM -0700, narsin...@gmail.com wrote:
> Hi Team ,
>
> How to scrap efk/ELK metrics by using Prometheus which are running on
> kubernetes

You need an exporter on the elasticsearch side like this one:
https://github.com/vvanholl/elasticsearch-prometheus-exporter

Then you have an api endpoint for prometheus to scrape.


Regards,
Marcus

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To post to this group, send email to prometheus...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/20170619164913.GC22112%40googlemail.com.
For more options, visit https://groups.google.com/d/optout.

 

--

--
David J. M. Karlsen - http://www.linkedin.com/in/davidkarlsen

--

You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To post to this group, send email to prometheus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/CAGO7Ob3Nwj5C5hZpfhu7uAJse8JUvfk6aCb4L44-r3w_Ub8Rqg%40mail.gmail.com.

[Florian Koch]

Here is another exporter,
https://github.com/justwatchcom/elasticsearch_exporter

> --
> You received this message because you are subscribed to the Google Groups
> "Prometheus Developers" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to prometheus-devel...@googlegroups.com.
> To post to this group, send email to prometheus...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/prometheus-developers/29e9092b-6b86-4148-a4b1-b80eb58e7f6d%40googlegroups.com.

[Marcus Franke]

A bit of PITA is the missing grafana dashboard, one has to craft its own. The sheer amount of exposed metrics can be quite overwhelming. 

David Karlsen <davidk...@gmail.com> schrieb am Mo., 19. Juni 2017, 19:35:

Have quite happily been using it.

A bit of a PITA that a release is needed per ES version - but works very well elsewise

2017-06-19 18:49 GMT+02:00 Marcus Franke <marcus...@gmail.com>:

On Mon, Jun 19, 2017 at 01:48:48AM -0700, narsin...@gmail.com wrote:
> Hi Team ,
>
> How to scrap efk/ELK metrics by using Prometheus which are running on
> kubernetes

You need an exporter on the elasticsearch side like this one:
https://github.com/vvanholl/elasticsearch-prometheus-exporter

Then you have an api endpoint for prometheus to scrape.


Regards,
Marcus

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To post to this group, send email to prometheus...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/20170619164913.GC22112%40googlemail.com.

For more options, visit https://groups.google.com/d/optout.

--

--
David J. M. Karlsen - http://www.linkedin.com/in/davidkarlsen

--

You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To post to this group, send email to prometheus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/CAGO7Ob3Nwj5C5hZpfhu7uAJse8JUvfk6aCb4L44-r3w_Ub8Rqg%40mail.gmail.com.

[David Karlsen]

There is a board no grafana.net

Den mandag 19. juni 2017 skrev Marcus Franke <marcus...@gmail.com> følgende:

A bit of PITA is the missing grafana dashboard, one has to craft its own. The sheer amount of exposed metrics can be quite overwhelming. 

David Karlsen <davidk...@gmail.com> schrieb am Mo., 19. Juni 2017, 19:35:

Have quite happily been using it.

A bit of a PITA that a release is needed per ES version - but works very well elsewise

2017-06-19 18:49 GMT+02:00 Marcus Franke <marcus...@gmail.com>:

On Mon, Jun 19, 2017 at 01:48:48AM -0700, narsin...@gmail.com wrote:
> Hi Team ,
>
> How to scrap efk/ELK metrics by using Prometheus which are running on
> kubernetes

You need an exporter on the elasticsearch side like this one:
https://github.com/vvanholl/elasticsearch-prometheus-exporter

Then you have an api endpoint for prometheus to scrape.


Regards,
Marcus

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsub...@googlegroups.com.
To post to this group, send email to prometheus-developers@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/20170619164913.GC22112%40googlemail.com.

For more options, visit https://groups.google.com/d/optout.

--

--
David J. M. Karlsen - http://www.linkedin.com/in/davidkarlsen

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsub...@googlegroups.com.
To post to this group, send email to prometheus-developers@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/CAGO7Ob3Nwj5C5hZpfhu7uAJse8JUvfk6aCb4L44-r3w_Ub8Rqg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Marcus Franke]

Oh,
You're right. How did I oversee this one.

Thanks for the hint
Marcus

David Karlsen <davidk...@gmail.com> schrieb am Di., 20. Juni 2017, 00:39:

There is a board no grafana.net

Den mandag 19. juni 2017 skrev Marcus Franke <marcus...@gmail.com> følgende:

A bit of PITA is the missing grafana dashboard, one has to craft its own. The sheer amount of exposed metrics can be quite overwhelming. 

David Karlsen <davidk...@gmail.com> schrieb am Mo., 19. Juni 2017, 19:35:

Have quite happily been using it.

A bit of a PITA that a release is needed per ES version - but works very well elsewise

2017-06-19 18:49 GMT+02:00 Marcus Franke <marcus...@gmail.com>:

On Mon, Jun 19, 2017 at 01:48:48AM -0700, narsin...@gmail.com wrote:
> Hi Team ,
>
> How to scrap efk/ELK metrics by using Prometheus which are running on
> kubernetes

You need an exporter on the elasticsearch side like this one:
https://github.com/vvanholl/elasticsearch-prometheus-exporter

Then you have an api endpoint for prometheus to scrape.


Regards,
Marcus

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To post to this group, send email to prometheus...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/20170619164913.GC22112%40googlemail.com.

For more options, visit https://groups.google.com/d/optout.

--

--
David J. M. Karlsen - http://www.linkedin.com/in/davidkarlsen

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To post to this group, send email to prometheus...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/CAGO7Ob3Nwj5C5hZpfhu7uAJse8JUvfk6aCb4L44-r3w_Ub8Rqg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.