[CI-NOTIFY]: TCWG Bisect tcwg_kernel/llvm-master-aarch64-lts-allmodconfig - Build # 6 - Successful!

7 views
Skip to first unread message

ci_n...@linaro.org

unread,
Aug 18, 2021, 1:22:10 AM8/18/21
to tcwg-va...@linaro.org, Greg Kroah-Hartman, linaro-t...@lists.linaro.org, clang-bu...@googlegroups.com, ar...@linaro.org
Successfully identified regression in *linux* in CI configuration tcwg_kernel/llvm-master-aarch64-lts-allmodconfig. So far, this commit has regressed CI configurations:
- tcwg_kernel/llvm-master-aarch64-lts-allmodconfig

Culprit:
<cut>
commit 132a8267adabd645476b542b3b132c1b91988fe8
Author: Greg Kroah-Hartman <gre...@linuxfoundation.org>
Date: Thu Aug 12 13:22:21 2021 +0200

Linux 5.10.58

Link: https://lore.kernel.org/r/202108101729...@linuxfoundation.org
Tested-by: Fox Chen <foxh...@gmail.com>
Tested-by: Hulk Robot <hulk...@huawei.com>
Tested-by: Sudip Mukherjee <sudip.m...@codethink.co.uk>
Tested-by: Linux Kernel Functional Testing <lk...@linaro.org>
Tested-by: Guenter Roeck <li...@roeck-us.net>
Tested-by: Shuah Khan <sk...@linuxfoundation.org>
Tested-by: Aakash Hemadri <aakashhe...@gmail.com>
Signed-off-by: Greg Kroah-Hartman <gre...@linuxfoundation.org>
</cut>

Results regressed to (for first_bad == 132a8267adabd645476b542b3b132c1b91988fe8)
# reset_artifacts:
-10
# build_abe binutils:
-9
# build_llvm:
-5
# build_abe qemu:
-2
# linux_n_obj:
28702
# linux build successful:
all
# First few build errors in logs:

from (for last_good == 3d7d1b0f5f41d66a2d177f9fdcdb32e23a4b2513)
# reset_artifacts:
-10
# build_abe binutils:
-9
# build_llvm:
-5
# build_abe qemu:
-2
# linux_n_obj:
28702
# linux build successful:
all
# linux boot successful:
boot

Artifacts of last_good build: https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/artifact/artifacts/build-3d7d1b0f5f41d66a2d177f9fdcdb32e23a4b2513/
Artifacts of first_bad build: https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/artifact/artifacts/build-132a8267adabd645476b542b3b132c1b91988fe8/
Build top page/logs: https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/

Configuration details:


Reproduce builds:
<cut>
mkdir investigate-linux-132a8267adabd645476b542b3b132c1b91988fe8
cd investigate-linux-132a8267adabd645476b542b3b132c1b91988fe8

git clone https://git.linaro.org/toolchain/jenkins-scripts

mkdir -p artifacts/manifests
curl -o artifacts/manifests/build-baseline.sh https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/artifact/artifacts/manifests/build-baseline.sh --fail
curl -o artifacts/manifests/build-parameters.sh https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/artifact/artifacts/manifests/build-parameters.sh --fail
curl -o artifacts/test.sh https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/artifact/artifacts/test.sh --fail
chmod +x artifacts/test.sh

# Reproduce the baseline build (build all pre-requisites)
./jenkins-scripts/tcwg_kernel-build.sh @@ artifacts/manifests/build-baseline.sh

# Save baseline build state (which is then restored in artifacts/test.sh)
mkdir -p ./bisect
rsync -a --del --delete-excluded --exclude /bisect/ --exclude /artifacts/ --exclude /linux/ ./ ./bisect/baseline/

cd linux

# Reproduce first_bad build
git checkout --detach 132a8267adabd645476b542b3b132c1b91988fe8
../artifacts/test.sh

# Reproduce last_good build
git checkout --detach 3d7d1b0f5f41d66a2d177f9fdcdb32e23a4b2513
../artifacts/test.sh

cd ..
</cut>

History of pending regressions and results: https://git.linaro.org/toolchain/ci/base-artifacts.git/log/?h=linaro-local/ci/tcwg_kernel/llvm-master-aarch64-lts-allmodconfig

Artifacts: https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/artifact/artifacts/
Build log: https://ci.linaro.org/job/tcwg_kernel-llvm-bisect-llvm-master-aarch64-lts-allmodconfig/6/consoleText

Full commit (up to 1000 lines):
<cut>
commit 132a8267adabd645476b542b3b132c1b91988fe8
Author: Greg Kroah-Hartman <gre...@linuxfoundation.org>
Date: Thu Aug 12 13:22:21 2021 +0200

Linux 5.10.58

Link: https://lore.kernel.org/r/202108101729...@linuxfoundation.org
Tested-by: Fox Chen <foxh...@gmail.com>
Tested-by: Hulk Robot <hulk...@huawei.com>
Tested-by: Sudip Mukherjee <sudip.m...@codethink.co.uk>
Tested-by: Linux Kernel Functional Testing <lk...@linaro.org>
Tested-by: Guenter Roeck <li...@roeck-us.net>
Tested-by: Shuah Khan <sk...@linuxfoundation.org>
Tested-by: Aakash Hemadri <aakashhe...@gmail.com>
Signed-off-by: Greg Kroah-Hartman <gre...@linuxfoundation.org>
---
Makefile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/Makefile b/Makefile
index e9621a90e752..232dee1140c1 100644
--- a/Makefile
+++ b/Makefile
@@ -1,7 +1,7 @@
# SPDX-License-Identifier: GPL-2.0
VERSION = 5
PATCHLEVEL = 10
-SUBLEVEL = 57
+SUBLEVEL = 58
EXTRAVERSION =
NAME = Dare mighty things

</cut>

Greg Kroah-Hartman

unread,
Aug 18, 2021, 1:38:27 AM8/18/21
to ci_n...@linaro.org, tcwg-va...@linaro.org, linaro-t...@lists.linaro.org, clang-bu...@googlegroups.com, ar...@linaro.org
On Wed, Aug 18, 2021 at 05:22:07AM +0000, ci_n...@linaro.org wrote:
> Successfully identified regression in *linux* in CI configuration tcwg_kernel/llvm-master-aarch64-lts-allmodconfig. So far, this commit has regressed CI configurations:
> - tcwg_kernel/llvm-master-aarch64-lts-allmodconfig
>
> Culprit:
> <cut>
> commit 132a8267adabd645476b542b3b132c1b91988fe8
> Author: Greg Kroah-Hartman <gre...@linuxfoundation.org>
> Date: Thu Aug 12 13:22:21 2021 +0200
>
> Linux 5.10.58

<snip>

And what am I supposed to do with this information?

Maxim Kuvyrkov

unread,
Sep 29, 2021, 7:29:12 AM9/29/21
to Greg Kroah-Hartman, linaro-toolchain, clang-built-linux, Arnd Bergmann
Hi Greg,

This appears to have been a fluke. Boot-testing succeeded before the merge and failed after. Boot-testing on allmodconfig doesn’t seem to be stable, so we are going to disable it.

Regards,

--
Maxim Kuvyrkov
https://www.linaro.org
> --
> You received this message because you are subscribed to the Google Groups "Clang Built Linux" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to clang-built-li...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/clang-built-linux/YRyczv2OCq51edQh%40kroah.com.

Reply all
Reply to author
Forward
0 new messages