Suggested new TargetProvider -> Azure Service Fabric

[Javier Zunzunegui]

Hi,

I will be moving some microservices to Azure Service Fabric https://azure.microsoft.com/en-gb/services/service-fabric/ and will likely need a TargetProvider that can scrape application/services directly from it. Until now I was using the zookeeper one: https://prometheus.io/docs/operating/configuration/#%3Cserverset_sd_config%3E

Has anyone already looked at doing so? If I build it myself, is it welcome to be committed back to the Prometheus project?

Thanks,
Javier

Disclaimer: I am a Microsoft employee.

[Ben Kochie]

I don't think anyone has worked on an Azure-specific discovery plugin.  I think we would be ok adding it, as long as there is a commitment to supporting and maintaining it.

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsub...@googlegroups.com.
To post to this group, send email to prometheus-developers@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/0492002e-58ac-493f-87e4-4a2986bcc7f9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Björn Rabenstein]

On 7 April 2017 at 12:23, Ben Kochie <sup...@gmail.com> wrote:

I don't think anyone has worked on an Azure-specific discovery plugin.

Isn't https://prometheus.io/docs/operating/configuration/#<azure_sd_config> Azure-specific discovery?

--

Björn Rabenstein, Engineer
http://soundcloud.com/brabenstein

SoundCloud Ltd. | Rheinsberger Str. 76/77, 10115 Berlin, Germany
Managing Director: Alexander Ljung | Incorporated in England & Wales with Company No. 6343600 | Local Branch Office | AG Charlottenburg  | HRB 110657B

[Brian Brazil]

On 7 April 2017 at 11:54, Björn Rabenstein <bjo...@soundcloud.com> wrote:

On 7 April 2017 at 12:23, Ben Kochie <sup...@gmail.com> wrote:

I don't think anyone has worked on an Azure-specific discovery plugin.

Isn't https://prometheus.io/docs/operating/configuration/#<azure_sd_config> Azure-specific discovery?

It is. One of the issues with Azure compared to other service discovery mechanisms is the very low rate limits combined with the need to send an RPC per target to get the IP address. If either or both of those could be improved, that'd greatly assist those on Azure who wish to use Prometheus.

Brian

 

--

Björn Rabenstein, Engineer
http://soundcloud.com/brabenstein

SoundCloud Ltd. | Rheinsberger Str. 76/77, 10115 Berlin, Germany
Managing Director: Alexander Ljung | Incorporated in England & Wales with Company No. 6343600 | Local Branch Office | AG Charlottenburg  | HRB 110657B

--

You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsub...@googlegroups.com.
To post to this group, send email to prometheus-developers@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/CALSNGh%3DgFEsyaNwou6TVoXCa-%3DN_jwXLn0Y1Sg786ekB%3DjCmVg%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Brian Brazil

www.robustperception.io

[Tom Wilkie]

> One of the issues with Azure compared to other service discovery mechanisms is the very low rate limits

AWS ECS has the same problem, which I believe was one of the blockers
on https://github.com/prometheus/prometheus/pull/2309

On Fri, Apr 7, 2017 at 12:01 PM, Brian Brazil
<brian....@robustperception.io> wrote:
> On 7 April 2017 at 11:54, Björn Rabenstein <bjo...@soundcloud.com> wrote:
>>
>>
>> On 7 April 2017 at 12:23, Ben Kochie <sup...@gmail.com> wrote:
>>>
>>> I don't think anyone has worked on an Azure-specific discovery plugin.
>>
>>
>> Isn't
>> https://prometheus.io/docs/operating/configuration/#<azure_sd_config>
>> Azure-specific discovery?
>
>
>
> It is. One of the issues with Azure compared to other service discovery
> mechanisms is the very low rate limits combined with the need to send an RPC
> per target to get the IP address. If either or both of those could be
> improved, that'd greatly assist those on Azure who wish to use Prometheus.
>
> Brian
>
>>
>>
>> --
>> Björn Rabenstein, Engineer
>> http://soundcloud.com/brabenstein
>>
>> SoundCloud Ltd. | Rheinsberger Str. 76/77, 10115 Berlin, Germany
>> Managing Director: Alexander Ljung | Incorporated in England & Wales with
>> Company No. 6343600 | Local Branch Office | AG Charlottenburg | HRB 110657B
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Prometheus Developers" group.
>> To unsubscribe from this group and stop receiving emails from it, send an

>> email to prometheus-devel...@googlegroups.com.

>> To post to this group, send email to

>> prometheus...@googlegroups.com.

>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/prometheus-developers/CALSNGh%3DgFEsyaNwou6TVoXCa-%3DN_jwXLn0Y1Sg786ekB%3DjCmVg%40mail.gmail.com.
>>
>> For more options, visit https://groups.google.com/d/optout.
>
>
>
>
> --
> Brian Brazil
> www.robustperception.io
>

> --
> You received this message because you are subscribed to the Google Groups
> "Prometheus Developers" group.
> To unsubscribe from this group and stop receiving emails from it, send an

> email to prometheus-devel...@googlegroups.com.
> To post to this group, send email to prometheus...@googlegroups.com.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/prometheus-developers/CAHJKeLrY%2ByPG%2BrdyFj8fRv2tEu6zuNG21Crp%2BAER_aK0MqObkw%40mail.gmail.com.

[Javier Zunzunegui]

The <azure_sd_config> is for Azure Virtual Machines, while Service Fabric uses Virtual Machine Scale Sets.

Also Service Fabric provides a RESP API to access the cluster which I don't think has limits (it is served directly by your cluster). I already have a minimal implementation which I think will work - https://github.com/JavierZunzunegui/prometheus/tree/service-fabric/discovery/azuresf , but I am still in the process of testing it.

>> email to prometheus-developers+unsub...@googlegroups.com.

>> To post to this group, send email to
>> prometheus...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/prometheus-developers/CALSNGh%3DgFEsyaNwou6TVoXCa-%3DN_jwXLn0Y1Sg786ekB%3DjCmVg%40mail.gmail.com.
>>
>> For more options, visit https://groups.google.com/d/optout.
>
>
>
>
> --
> Brian Brazil
> www.robustperception.io
>
> --
> You received this message because you are subscribed to the Google Groups
> "Prometheus Developers" group.
> To unsubscribe from this group and stop receiving emails from it, send an

> email to prometheus-developers+unsub...@googlegroups.com.