Notification of migration SONiC build from Jenkins Server to Azure Pipelines

[Xuhui Miao]

Hi folks,

 

You may have known that we are in the transition period to move SONiC build from Jenkins to Azure Pipelines. We have migrated almost all jobs from Jenkins server (https://sonic-jenkins.westus2.cloudapp.azure.com/) to Azure Pipelines (Pipelines - All (azure.com)). we plan to deprecate the server on June 30, 2021. We will not onboard any new jobs on Jenkins server, only maintain the server for some time.

The motivation is to improve the scalability of the agents, reduce the pending PR/official build jobs in the queue. And we do not need to manage the Jenkins Server and the agents.

 

Thanks,

Xuhui Miao

[Andriy Kokhan]

Hi Xuhui Miao,

Thank you for the heads up.

What's the right way to download SONiC artifacts from Azure Pipelines by permanent link that points to a specific build ID?

I'm looking specifically for the approach that can be scripted but not downloading manually.

Thank you in advance,

Andriy

ср, 12 трав. 2021 о 12:34 'Xuhui Miao' via sonicproject <sonicp...@googlegroups.com> пише:

--
You received this message because you are subscribed to the Google Groups "sonicproject" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sonicproject...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sonicproject/TYZP153MB0527BC0B618C81EF061C999FA9529%40TYZP153MB0527.APCP153.PROD.OUTLOOK.COM.

[Xuhui Miao]

We got some feedbacks about how to access the artifacts in Azure Pipelines. Some of you may have trouble to browse the files of the artifacts, and not know how to download the artifacts of the latest successful build.

We have created web site SONiC Build Artifacts for you to browse the azure pipelines builds, build history, artifacts, and the files of the artifacts. Add support to download the files from a specified build or latest build.

Hope you can change to use Azure Pipelines smoothly.

 

 

 

 

 

 

 

You can copy the download link of the target target/debs/buster/bfn-modules_1.0_amd64.deb for build 16564.

https://sonic-build.azurewebsites.net/api/sonic/artifacts?branchName=master&platform=barefoot&buildId=16563&target=target/debs/buster/bfn-modules_1.0_amd64.deb

 

You can click “Copy Latest Static Link” to copy the link to the latest successful build. And you can change the highlight part below to download the other files.

https://sonic-build.azurewebsites.net/api/sonic/artifacts?branchName=master&platform=barefoot&target=target/debs/buster/bfn-modules_1.0_amd64.deb

 

If you can use Azure pipelines Rest API to meet your requirement, the rest API is the best choice for you.

Currently, we only use the http redirect to download the latest artifacts, the web site itself does not save any content. If Azure Pipelines supports relative APIs, then some of functions or the whole web site will be deprecated.

 

You can refer to sonic-build-web/sonic-build at main · Azure/sonic-build-web (github.com) for the web app.

[Yuliia Bashko]

Hi Xuhui Miao,

Sorry to bother you.

I tried to download SONiC image by specific buildId from suggested web app (sonic-build.azurewebsites.net). 

I did same steps as you gave above (copied link was like https://sonic-build.azurewebsites.net/api/sonic/artifacts?branchName=master&platform=barefoot&buildId=16955&target=target/sonic-barefoot.bin).

After deploy SONiC image on DUT I get not the version I expected. Installed version was latest. 

Have you ever notice same problem?

Sincerely,

Yuliia

[miao...@gmail.com]

Hi Bashko, thanks for catching the issue.

The download latest version of the artifact even buildId specified issue has fixed. 

It is caused by the code bug, the buildId is not used correctly.

[Heidi net]

Hello, I'm currently on leave with limited access to my email. I will reply to your email as soon as possible. Thank you.

[zhenghui cai]

Hi, Xuhui, 

As for our PR, we need to modify pipeline yaml files. Before creating PR for those files, is there an easy way for us to test the change?(i.e. running the pipeline within our private repository?). 

Thanks

Zhenghui

--

You received this message because you are subscribed to the Google Groups "sonicproject" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sonicproject...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/sonicproject/a7964d0d-2345-47bf-b4a0-5301aa8f8a3dn%40googlegroups.com.

[Xuhui Miao]

Notify again. The Jenkins Server (https://sonic-jenkins.westus2.cloudapp.azure.com/) will be deprecated on June 30 2021. please change to use the Azure Pipelines ASAP.

All the jobs on the Server will be disabled, no job will be run on the server by then. You can only download old images from the server, and the Jenkins server will only keep running several months, and then destroy the sever.

[Shilong Liu]

Hi folks,

 

The Jenkins Server (https://sonic-jenkins.westus2.cloudapp.azure.com/) has been deprecated at 2021/06/30.

And we will formally shutdown the jenkins’ server by the 2021/08/15.

If you have any questions, please contact sonicbu...@microsoft.com.

[Xuhui Miao]

The Jenkins server was deprecated, you will be not able to download artifacts from the Jenkins. Please use Azure Pipelines instead, thanks.

[MS Reddy]

Hi Team,

Can someone help to get these builds, it requires read permission.  How to get the old builds from June? 

Note: I don't find these builds in azure pipelines - https://dev.azure.com/mssonic/build/_build?view=folders

https://sonic-jenkins.westus2.cloudapp.azure.com/job/mellanox/job/buildimage-mlnx-202012/104/artifact/target/sonic-mellanox.bin

Thanks,

-Madhu

To view this discussion on the web visit https://groups.google.com/d/msgid/sonicproject/CADCbaQmwiG1CFttrPxGOxJcQp%3DVtjZX0U%3DLqWaEFNYriUnM7uA%40mail.gmail.com.