Re: Prometheus Alert-Generator Compliance testing for M3

[Rob Skillington]

Hey Ganesh,

I have replied on behalf of Chronosphere for the corresponding alert generator compliance test.

For M3 and M3DB the project by itself doesn’t offer any alert generation capabilities and thus itself cannot produce a positive or negative result. It would needed to be combined with a rule manager from a one of the other independent Prometheus remote storage open source projects to produce such capabilities.

Result for alert generation capability as such is N/A.

Thanks for reaching out and the contributors behind the alert generation compliance program.

Rob 

On Wed, Mar 2, 2022 at 3:37 AM Ganesh Vernekar <ganes...@gmail.com> wrote:

Hello M3DB team,

I hope this email finds you well.

As a part of Prometheus conformance program, we had floated a doc on "Prometheus Alert-Generator Compliance" many months ago and had finalized the specification for that (see here).

The test suite to test the specification is now ready and instructions on how to run the test suite are present here.

If you wish M3 to be compliant with Prometheus Alert-Generator, please test your software with the above test suite and report back the results by replying to this thread (results being the entire log output of the test run).

If you do need any additional help from the test suite (for example setting custom headers to some requests), please let me know and I will add those abilities to the test suite.

Going forward, we would like to automate this process. We ask you to add your test-suite config template by opening a PR against prometheus/compliance and create test-m3.yaml in the alert_generator directory. See test-.*.yaml files here for example. Please also add instructions on how to set up as comments in the same file.

If you face issues in running the test suite or understanding any error messages, I am happy to answer your queries.

We plan to publish the results during the third week of May 2022 (during KubeCon EU).

Thanks,
Ganesh (codesome)
Prometheus team