Issue 1746 in webm: Google VP9 failed to run test on debug and release configurations with MSVC on windows

[qd133… via monorail]

Status: Unconfirmed
Owner: ----

New issue 1746 by qd133...@gmail.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746

Hello,

I tried to build Google VP9 with VS2019 on Windows. It failed due to run test on debug and release configurations with MSVC on windows. Could you please help take a look at this issue? Thanks.

What steps will reproduce the problem?
1. git clone https://github.com/webmproject/libvpx F:\gitP\webmproject\libvpx
git -C "F:\gitP\webmproject\libvpx" rev-parse --git-dir
git -C "F:\gitP\webmproject\libvpx" clean -xdf
git -C "F:\gitP\webmproject\libvpx" fetch --recurse-submodules=no --force
git -C "F:\gitP\webmproject\libvpx" reset --hard c56ab7d
git -C "F:\gitP\webmproject\libvpx" remote prune origin
2. set VSCMD_SKIP_SENDTELEMETRY=1 & "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\Common7\Tools\VsDevCmd.bat" -host_arch=amd64 -arch=amd64
3. cd F:\gitP\webmproject\libvpx\..
4. set PATH=F:\gitP\webmproject\libvpx\..\tools;%PATH%
set PATH=F:\gitP\webmproject\libvpx\..\tools\msys32\usr\bin;%PATH%
set VP9_SRC_PATH=F:\gitP\webmproject\libvpx
set MSYS2_PATH_TYPE=inherit
set VP9_TARGET=x86_64-win64-vs16
set VP9_BUILD_DIR=build_x64
5. .\tools\msys32\usr\bin\sh.exe --login -i -c "/F/gitP/webmproject/libvpx/../tools/build.sh"

6. set VSCMD_SKIP_SENDTELEMETRY=1 & "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\Common7\Tools\VsDevCmd.bat" -host_arch=amd64 -arch=amd64
7. cd F:\gitP\webmproject\libvpx
8. xcopy ..\test_data build_x64 /k/r/e/i/s/c/h/f/y
9. set PATH=F:\gitP\webmproject\libvpx\..\tools;%PATH%
set PATH=F:\gitP\webmproject\libvpx\..\tools\msys32\usr\bin;%PATH%
set VP9_SRC_PATH=F:\gitP\webmproject\libvpx
set MSYS2_PATH_TYPE=inherit
set VP9_TARGET=x86_64-win64-vs16
set VP9_BUILD_DIR=build_x64
10. cd F:\gitP\webmproject\libvpx\..
11. .\tools\msys32\usr\bin\sh.exe --login -i -c "/F/gitP/webmproject/libvpx/../tools/test.sh"

What is the expected output?
Run test pass

What do you see instead?
sh: cannot set terminal process group (-1): Inappropriate ioctl for device
sh: no job control in this shell
Starting testing in F:\gitP\webmproject\libvpx for target x86_64-win64-vs16 in build_x64
Run tests
[DOWNLOAD] bus_352x288_420_f20_b8.yuv
[DOWNLOAD] crbug-1539.rawfile
[DOWNLOAD] desktop_credits.y4m
[DOWNLOAD] desktop_office1.1280_720-020.yuv
[DOWNLOAD] hantro_collage_w352h288.yuv
[DOWNLOAD] hantro_collage_w352h288_nv12.yuv
[DOWNLOAD] hantro_odd.yuv
[DOWNLOAD] invalid-bug-1443.ivf
[DOWNLOAD] invalid-bug-1443.ivf.res
[DOWNLOAD] invalid-bug-148271109.ivf
[DOWNLOAD] invalid-bug-148271109.ivf.res
[DOWNLOAD] invalid-crbug-1558.ivf
[DOWNLOAD] invalid-crbug-1558.ivf.res
[DOWNLOAD] invalid-crbug-1562.ivf
[DOWNLOAD] invalid-crbug-1562.ivf.res
[DOWNLOAD] invalid-crbug-629481.webm
[DOWNLOAD] invalid-crbug-629481.webm.res
[DOWNLOAD] invalid-crbug-667044.webm
[DOWNLOAD] invalid-crbug-667044.webm.res
[DOWNLOAD] invalid-token-partition.ivf
[DOWNLOAD] invalid-token-partition.ivf.res
[DOWNLOAD] invalid-vp80-00-comprehensive-018.ivf.2kf_0x6.ivf
[DOWNLOAD] invalid-vp80-00-comprehensive-018.ivf.2kf_0x6.ivf.res
[DOWNLOAD] invalid-vp80-00-comprehensive-s17661_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp80-00-comprehensive-s17661_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-01-v3.webm
[DOWNLOAD] invalid-vp90-01-v3.webm.res
[DOWNLOAD] invalid-vp90-02-v2.webm
[DOWNLOAD] invalid-vp90-02-v2.webm.res
[DOWNLOAD] invalid-vp90-03-v3.webm
[DOWNLOAD] invalid-vp90-03-v3.webm.res
[DOWNLOAD] invalid-vp90-2-00-quantizer-00.webm.ivf.s5861_r01-05_b6-.v2.ivf
[DOWNLOAD] invalid-vp90-2-00-quantizer-00.webm.ivf.s5861_r01-05_b6-.v2.ivf.res
[DOWNLOAD] invalid-vp90-2-00-quantizer-11.webm.ivf.s52984_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp90-2-00-quantizer-11.webm.ivf.s52984_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-2-00-quantizer-11.webm.ivf.s52984_r01-05_b6-z.ivf
[DOWNLOAD] invalid-vp90-2-00-quantizer-11.webm.ivf.s52984_r01-05_b6-z.ivf.res
[DOWNLOAD] invalid-vp90-2-00-quantizer-63.ivf.kf_65527x61446.ivf
[DOWNLOAD] invalid-vp90-2-00-quantizer-63.ivf.kf_65527x61446.ivf.res
[DOWNLOAD] invalid-vp90-2-03-size-202x210.webm.ivf.s113306_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp90-2-03-size-202x210.webm.ivf.s113306_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-2-03-size-224x196.webm.ivf.s44156_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp90-2-03-size-224x196.webm.ivf.s44156_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-2-05-resize.ivf.s59293_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp90-2-05-resize.ivf.s59293_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-2-07-frame_parallel-1.webm
[DOWNLOAD] invalid-vp90-2-07-frame_parallel-2.webm
[DOWNLOAD] invalid-vp90-2-07-frame_parallel-3.webm
[DOWNLOAD] invalid-vp90-2-08-tile_1x2_frame_parallel.webm.ivf.s47039_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp90-2-08-tile_1x2_frame_parallel.webm.ivf.s47039_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-2-08-tile_1x4_frame_parallel_all_key.webm
[DOWNLOAD] invalid-vp90-2-08-tile_1x4_frame_parallel_all_key.webm.res
[DOWNLOAD] invalid-vp90-2-08-tile_1x8_frame_parallel.webm.ivf.s288_r01-05_b6-.ivf
[DOWNLOAD] invalid-vp90-2-08-tile_1x8_frame_parallel.webm.ivf.s288_r01-05_b6-.ivf.res
[DOWNLOAD] invalid-vp90-2-09-aq2.webm.ivf.s3984_r01-05_b6-.v2.ivf
[DOWNLOAD] invalid-vp90-2-09-aq2.webm.ivf.s3984_r01-05_b6-.v2.ivf.res
[DOWNLOAD] invalid-vp90-2-09-subpixel-00.ivf.s19552_r01-05_b6-.v2.ivf
curl: (35) Unknown SSL protocol error in connection to storage.googleapis.com:443
make[1]: *** [../libs.mk:517: invalid-vp90-2-09-subpixel-00.ivf.s19552_r01-05_b6-.v2.ivf] Error 35
make: *** [Makefile:17: .DEFAULT] Error 2
Failed test suite!


Please use labels and text to provide additional information.
See attached Log for test_output.log.

Attachments:
test_output.log 3.7 KB

--
You received this message because:
1. The project was configured to send all issue notifications to this address

You may adjust your notification preferences at:
https://bugs.chromium.org/hosting/settings

[jz… via monorail]

Comment #1 on issue 1746 by jz...@google.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c1

Thanks for the report. This looks like a transient error. I'd suggest running make testdata or make test again.

[qd133… via monorail]

Comment #2 on issue 1746 by qd133...@gmail.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c2

Yes, but this issue occurs more frequently,

[jz… via monorail]

Comment #3 on issue 1746 by jz...@google.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c3

This may come down to the storage site or curl itself. Did you update that tool recently? Are you running make with any jobs set (-j)? If you you might try to run it serially.

We have --retry set, but I don't know if this will count for a transient error to curl. If you can reliably reproduce this you could try increasing that count [1] and adding --retry-all-errors to see if it helps.

[1] https://chromium.googlesource.com/webm/libvpx/+/refs/tags/v1.11.0/libs.mk#519

[qd133… via monorail]

Comment #4 on issue 1746 by qd133...@gmail.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c4

I haven't updated the tool recently. I tried to modify the libs.mk file yesterday, and the parameter retry-all-errors is invalid. Therefore, I only modified the count. This is the result of my modification (curl="curl -S -s --retry 2 -L -o $@ $(call libvpx_test_data_url,$(@F))"; \).Is there any problem with this？

[jz… via monorail]

Comment #5 on issue 1746 by jz...@google.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c5

> I haven't updated the tool recently. I tried to modify the libs.mk file
> yesterday, and the parameter retry-all-errors is invalid.

It looks like --retry-all-errors was added in 7.74.

> Therefore, I only
> modified the count. This is the result of my modification (curl="curl -S -s
> --retry 2 -L -o $@ $(call libvpx_test_data_url,$(@F))"; \).Is there any
> problem with this？

That change looks fine.

[jz… via monorail]

Updates:
Labels: Needs-Feedback

Comment #6 on issue 1746 by jz...@google.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c6

Did --retry 2 help in this case?

[qd133… via monorail]

Comment #7 on issue 1746 by qd133...@gmail.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c7

I did not try to use -retry. I replaced curl.exe in msys2, using the latest version, the issue seems to be solved. So far, it's ok. If it still doesn't work, I will try your suggestion.

[jz… via monorail]

Comment #8 on issue 1746 by jz...@google.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c8

Thanks for the update. If the newer version is >= 7.74 you can also try --retry-all-errors if it surfaces again. I'll leave this issue open for now, but if things remain stable I'll close it as invalid.

[qd133… via monorail]

Comment #9 on issue 1746 by qd133...@gmail.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c9

Ok, thank you very much for your help

[jz… via monorail]

Updates:
Status: WontFix

Comment #10 on issue 1746 by jz...@google.com: Google VP9 failed to run test on debug and release configurations with MSVC on windows
https://bugs.chromium.org/p/webm/issues/detail?id=1746#c10

(No comment was entered for this change.)