'illegal Instruction' in release builds when compiling with 'Visual Studio 17 2022'

[Haseeb Abdul Qadir]

Hi,

I'm encountering an issue while compiling libaom using the official cmake files on Windows. Specifically, when I compile with the Visual Studio 2022 compiler for a release build on x86_64, and enable realtime mode, it results in an 'Illegal instruction' error. This occurs with aomenc.exe as demonstrated below:

aomenc.exe -p 1 --webm -o test.webm -w 352 -h 288 --limit=30 --fps=24000/1000 --cpu-used=10 --rt --end-usage=cbr --lag-in-frames=0 --aq-mode=1 --kf-min-dist=20 --kf-max-dist=20 --target-bitrate=200 akiyo_cif.y4m Pass 1/1 frame 2/1 31681B 10899 us 183.50 fps [ETA 0:00:00] Illegal instruction

Interestingly, when I switch to 'Visual Studio 16 2019', the error does not occur. 

Is this a known compatibility issue with Visual Studio 17 2022?

Thanks.

[James Zern]

Hi,

Yes, I believe you're running into an issue I saw recently, but haven't had time to file a bug. This issue came up in at least 17.8.0. The last version of 17.7.x I had installed worked correctly. What version are you using?

The failure looks to be due to the compiler emitting AVX-512 instructions in AVX2 code (compiled with /arch:AVX2). highbd_quantize_intrin_avx2.c was one module showing this behavior.

[Haseeb Abdul Qadir]

> The last version of 17.7.x I had installed worked correctly. What version are you using?

I tried on 17.8.0 and 17.8.3 - both hit the same issue.

Thanks.

--
You received this message because you are subscribed to a topic in the Google Groups "AV1 Discussion" group.
To unsubscribe from this topic, visit https://groups.google.com/a/aomedia.org/d/topic/av1-discuss/1dFej-YOZFM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to av1-discuss...@aomedia.org.
To view this discussion on the web visit https://groups.google.com/a/aomedia.org/d/msgid/av1-discuss/CABWgkX%2BpUfCZmOFX%2BW673a%3DgOH_91iSHC558uWJvAeM_%3DTvJwQ%40mail.gmail.com.

[James Zern]

On Wed, Dec 20, 2023 at 10:41 AM Haseeb Abdul Qadir <has...@jumpdesktop.com> wrote:

> The last version of 17.7.x I had installed worked correctly. What version are you using?

I tried on 17.8.0 and 17.8.3 - both hit the same issue.

Thanks for confirming. I filed https://developercommunity.visualstudio.com/t/VS2022-AVX-512-emitted-with-arch:AVX2/10545704.

 

You received this message because you are subscribed to the Google Groups "AV1 Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to av1-discuss...@aomedia.org.
To view this discussion on the web visit https://groups.google.com/a/aomedia.org/d/msgid/av1-discuss/CADTa4GAgThup561D%2B4w1mMbc2nPHZPWRhVOzD2PWyL9ru_r3JQ%40mail.gmail.com.