Remote file service discovery

[Matthew Mueller]

Is it possible to configure remote discovery to look for a remote static text file, like a text file or directory on S3?

[Matthew Mueller]

Sorry this was a bit unclear, I'm wondering if it's possible to pull scrapers from a directory like  an S3 bucket?

[Nicholas Capo]

As far as I know this is not supported. But you could always run a sidecar script to download the file. If you configure Prometheus using file_sd_configs it will automatically detect changes to the file and start scraping the new targets.

Nicholas

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To post to this group, send email to promethe...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/ff8a6556-0e05-4fb5-bd18-63be2121b3d1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Julius Volz]

Correct, we only have one way of doing generic SD (intentionally don't want to introduce multiple), and it is local-file-based only at the moment.

On Thu, Jul 6, 2017 at 8:45 PM, Nicholas Capo <nichol...@gmail.com> wrote:

As far as I know this is not supported. But you could always run a sidecar script to download the file. If you configure Prometheus using file_sd_configs it will automatically detect changes to the file and start scraping the new targets.

Nicholas

On Thu, Jul 6, 2017, 13:42 Matthew Mueller <mattm...@gmail.com> wrote:

Sorry this was a bit unclear, I'm wondering if it's possible to pull scrapers from a directory like  an S3 bucket?

On Friday, July 7, 2017 at 1:32:02 AM UTC+7, Matthew Mueller wrote:

Is it possible to configure remote discovery to look for a remote static text file, like a text file or directory on S3?

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/ff8a6556-0e05-4fb5-bd18-63be2121b3d1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAKA4%2B6roZsoDEB7LG7GKbTpYAiKUrCgq8j4sJrEeGu88eL2VbA%40mail.gmail.com.

[Matthew Mueller]

Got it, would it be possible to take a plugin approach with SD? I'd be happy to write this piece of functionality if it's possible to do outside of core.

The reason this would be cool is you could treat S3 as your push gateway and anytime you push to that bucket with some key (text file name), prometheus will pick up that new script / function / short-running task.

On Friday, July 7, 2017 at 4:29:35 AM UTC+7, Julius Volz wrote:

Correct, we only have one way of doing generic SD (intentionally don't want to introduce multiple), and it is local-file-based only at the moment.

On Thu, Jul 6, 2017 at 8:45 PM, Nicholas Capo <nichol...@gmail.com> wrote:

As far as I know this is not supported. But you could always run a sidecar script to download the file. If you configure Prometheus using file_sd_configs it will automatically detect changes to the file and start scraping the new targets.

Nicholas

On Thu, Jul 6, 2017, 13:42 Matthew Mueller <mattm...@gmail.com> wrote:

Sorry this was a bit unclear, I'm wondering if it's possible to pull scrapers from a directory like  an S3 bucket?

On Friday, July 7, 2017 at 1:32:02 AM UTC+7, Matthew Mueller wrote:

Is it possible to configure remote discovery to look for a remote static text file, like a text file or directory on S3?

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To post to this group, send email to promethe...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/ff8a6556-0e05-4fb5-bd18-63be2121b3d1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To post to this group, send email to promethe...@googlegroups.com.

[Matthew Mueller]

This is effectively what a sitemap.xml would do for google crawling, but you could do it for metrics and service discovery too!

[Ben Kochie]

I've suggested we add support for URLs in the file_sd_configs, as just another way to access those files.  This would provide for a simple way to add remote discovery.

Longer-term, we're starting a project within the CNCF to create a common/standard service discovery API. 

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/3236063e-d33b-4bc4-8b7d-e92ac496727c%40googlegroups.com.

[Matthew Mueller]

Awesome! Both would be very welcome improvements I think. 

The URLs would definitely help, but the only downside there is you need to restart the service every time a new one comes online or you'd need to coordinate S3 updates to merge all metrics across the network before pushing that file. 

I think for now, I'll probably stick with either a sidecar thing or DNS service discovery since that doesn't require restarts and is pretty quick to add (assuming it's just SRV records).

[Ben Kochie]

I think we may be confusing some symantics.  

The idea I'm proposing is one file for all targets.  Prometheus would refresh this URL every N seconds.

If you are talking about a file per target, I think this is the wrong approach and you should use a more standard service register like Consul.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/85868b43-d6e4-448f-867a-38e7e5defa24%40googlegroups.com.

[Matthias Rampke]

…or a side car. Think of file_sd as the plugin mechanism. There is no need to restart or (I think) even reload.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/85868b43-d6e4-448f-867a-38e7e5defa24%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To post to this group, send email to promethe...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CABbyFmqnR%2BcyjdqwwKH2h4KmD5d8dzjq%3D-y5Ri_uUs4iBY6Hxw%40mail.gmail.com.

[Julius Volz]

Btw., the general idea of implementing a generic SD over HTTP was discussed before: https://github.com/prometheus/prometheus/issues/2514

So far, the answer to it seems to be no, but I don't have strong feelings about it.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/85868b43-d6e4-448f-867a-38e7e5defa24%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CABbyFmqnR%2BcyjdqwwKH2h4KmD5d8dzjq%3D-y5Ri_uUs4iBY6Hxw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAFU3N5WgEgPGZ%3DosEF_tzbmCUzLhXoWwTv6m%3D%3DUfPKACMd6qGQ%40mail.gmail.com.