Launch: Prombench Custom Benchmarks from Prometheus PRs.
47 views
Skip to first unread message
Bartłomiej Płotka
Dec 20, 2024, 9:29:16 AM12/20/24
to Prometheus Developers
Hi Prometheus Devs!
From today you can now prepare and run custom prombench benchmarks from any Prometheus PR (docs, design). The goal is to increase the community productivity by giving more efficiency data on the various Prometheus features we work on.
It's enabled by the two new /prombench command flags allowing alternative branch/commit (--bench.version) or directory (--bench.directory) with the manifests and nodepool configurations to use for the benchmark deployments.
Example flow (2 steps):
1. Create a custom benchmark scenario on a new test-infra branch. Only maintainers can push those, but we welcome contributors to propose those via PRs. For example bench/nhcbconvert
2. From a Prometheus PR run /prombench <version to cmp with> --bench.version=bench/nhcbconvert . Only maintainers can do that, so if you're not in maintainer, feel free to ask for it on your PR, if you want to trigger one. Prombench should confirm the benchmark as usual, but this time with more links:
A. Shows you exact configuration that will be deployed
It's enabled by the two new /prombench command flags allowing alternative branch/commit (--bench.version) or directory (--bench.directory) with the manifests and nodepool configurations to use for the benchmark deployments.
Example flow (2 steps):
1. Create a custom benchmark scenario on a new test-infra branch. Only maintainers can push those, but we welcome contributors to propose those via PRs. For example bench/nhcbconvert
2. From a Prometheus PR run /prombench <version to cmp with> --bench.version=bench/nhcbconvert . Only maintainers can do that, so if you're not in maintainer, feel free to ask for it on your PR, if you want to trigger one. Prombench should confirm the benchmark as usual, but this time with more links:
A. Shows you exact configuration that will be deployed
B. Status links to job list. Jobs will now print exact configuration files that will be used too:
C. Exact cmdline is repeated so you can restart if needed.
Bartek Plotka @bwplotka
Jesús Vázquez
Dec 20, 2024, 6:36:53 PM12/20/24
to Bartłomiej Płotka, Prometheus Developers
Awesome work!
--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/prometheus-developers/c718518d-a7b2-4130-a7ab-3551a1a4618cn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages