Bazel CI infrastructure

141 views
Skip to first unread message

Adam Porich

unread,
May 15, 2018, 6:02:14 AM5/15/18
to bazel-discuss
Hi,

We are working through evaluating bazel usage in our CI systems and I was wondering if there are any plans to opensource the code behind the web frontend displaying test results at https://source.cloud.google.com/results/invocations/dc0510c0-afc6-42b3-8d2e-6d879dec526a/targets

And has there been any progress on getting the buildkite to support public logins for the build results?

Thanks,
Adam


Jingwen Chen

unread,
May 15, 2018, 11:22:17 AM5/15/18
to Adam Porich, bazel-discuss
On public logins, from https://github.com/buildkite/feedback/issues/137:

> The good news is, we're actively working on this and having to have beta out soon. You're right in that it's a little tricky because we want to ensure we've got a good store to tell around security and abuse, and we're hoping to have all the rough edges ironed out for a beta soon.

> We'll drop everyone a line here when were' looking for testers!


This email is confidential. If you are not the intended recipient, destroy all copies and do not disclose or use the information within. No warranties are given that this email does not contain viruses or harmful code.

--
You received this message because you are subscribed to the Google Groups "bazel-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bazel-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bazel-discuss/489785f4-0f25-466b-8d4f-53ce59038b66%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

James Judd

unread,
May 15, 2018, 7:57:39 PM5/15/18
to bazel-discuss
That UI looks awesome! If there are plans to open source it, we would be interested in using it.

Best,
James

László Csomor

unread,
May 16, 2018, 3:28:24 AM5/16/18
to ja...@lucidchart.com, bazel-discuss, bazel-engprod
/cc CI maintainer folks


--
László Csomor | Software Engineer | laszlo...@google.com

Google Germany GmbH | Erika-Mann-Str. 33 | 80636 München | Germany
Registergericht und -nummer: Hamburg, HRB 86891
Sitz der Gesellschaft: Hamburg
Geschäftsführer: Paul Manicle, Halimah DeLaine Prado


sbag...@grailbio.com

unread,
Jul 17, 2018, 9:10:26 PM7/17/18
to bazel-discuss
+1. We will also really benefit from any code that can be open sourced for the test results UI.

Right now, when using bazel as a CI, there are no good tools around parsing the build results and displaying it in a manner easily navigable by people.

What the bazel team uses is excellent. I understand that there were issues around open-sourcing the code search website because of the way the work was contracted out. Even if it's the same case here, we will really appreciate any code that can be open sourced, and maybe somebody can build an open source website around it.

James Judd

unread,
Jul 18, 2018, 1:00:08 AM7/18/18
to sbag...@grailbio.com, bazel-discuss
I'll echo that sentiment and provide a friendly ping. We are still interested in seeing something like this open sourced. It would make it much easier for the team to understand build results in CI. 

I'm curious to get the CI team's opinion on this - is it something that could be open sourced?

Best,
James

--
You received this message because you are subscribed to a topic in the Google Groups "bazel-discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bazel-discuss/xzRK3-zjarY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bazel-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bazel-discuss/65e75108-9579-4a66-89a0-9a533c713468%40googlegroups.com.

sbag...@grailbio.com

unread,
Jul 18, 2018, 1:06:00 AM7/18/18
to bazel-discuss
If we can not get the website code, then even if we can get an example design that explains how to take the results and uploads of https://github.com/bazelbuild/continuous-integration/blob/master/buildkite/bazelci.py and make them suitable for display in a UI.

Jakob Buchgraber

unread,
Jul 18, 2018, 4:04:44 AM7/18/18
to sbag...@grailbio.com, ka...@google.com, bazel-discuss
+Sergio Campamá who I believe has also been thinking about building an open source BES backend.

Wed, Jul 18, 2018 at 7:06 AM <sbag...@grailbio.com> wrote:
If we can not get the website code, then even if we can get an example design that explains how to take the results and uploads of https://github.com/bazelbuild/continuous-integration/blob/master/buildkite/bazelci.py and make them suitable for display in a UI.

There is some documentation on how this works on our website: https://docs.bazel.build/versions/master/build-event-protocol.html

In a nutshell:
  • The information about build / test results is available in the build event protocol, which is a stream of protobufs.
    You can play around with that in a protobuf text format by adding --build_event_text_file=/path/to/file.json to your bazel build/test.
  • What we do on CI is send these BEP events over the network to a Build Event Service. That's a gRPC service that Bazel can
    connect to via the --bes_backend flag.
I am happy to talk more and provide guidance/support whenever possible.

Best,
Jakob
 

On Tuesday, July 17, 2018 at 10:00:08 PM UTC-7, James Judd wrote:
> I'll echo that sentiment and provide a friendly ping. We are still interested in seeing something like this open sourced. It would make it much easier for the team to understand build results in CI. 
>
>
> I'm curious to get the CI team's opinion on this - is it something that could be open sourced?
>
>
> Best,
> James
>
>
> On Tue, Jul 17, 2018 at 7:10 PM <sbag...@grailbio.com> wrote:
> +1. We will also really benefit from any code that can be open sourced for the test results UI.
>
>
>
> Right now, when using bazel as a CI, there are no good tools around parsing the build results and displaying it in a manner easily navigable by people.
>
>
>
> What the bazel team uses is excellent. I understand that there were issues around open-sourcing the code search website because of the way the work was contracted out. Even if it's the same case here, we will really appreciate any code that can be open sourced, and maybe somebody can build an open source website around it.
>
>
>
> --
>
> You received this message because you are subscribed to a topic in the Google Groups "bazel-discuss" group.
>
> To unsubscribe from this topic, visit https://groups.google.com/d/topic/bazel-discuss/xzRK3-zjarY/unsubscribe.
>
> To unsubscribe from this group and all its topics, send an email to bazel-discus...@googlegroups.com.
>
> To view this discussion on the web visit https://groups.google.com/d/msgid/bazel-discuss/65e75108-9579-4a66-89a0-9a533c713468%40googlegroups.com.
>
> For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "bazel-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bazel-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bazel-discuss/5f157f89-d3de-49bd-938b-3d2ce286f86e%40googlegroups.com.

sta...@gmail.com

unread,
Jul 18, 2018, 4:08:18 AM7/18/18
to bazel-discuss
Oh hi Sergio. Did not expect to find you here. Small world! :-)
Reply all
Reply to author
Forward
0 new messages