`new VideoFrame(video)` unimplemented/unsupported for high bit depth video?

[161089]

Recently, I am doing some image filtering on decoded video frames and I especially want it to work with high bit depth videos. However, I find that `new VideoFrame(video)` may be unimplemented/unsupported or somewhat broken for high bit-depth videos. So far I have tested three different setups, namely Linux x64 (with hardware-accelerated video decode disabled), Windows x64 (with and without hardware-accelerated video decode). The Linux x64 setup seems to give me the correct result - I get video frames of "I420P10" format (though I didn't test it with hardware-accelerated video decode enabled). On the other hand, neither of the two Windows setups gives me correct result - I get video frames of "null" format when hardware accelerated video decode is enabled and "NV12" format when hardware accelerated video decode is disabled. Here is the video track information of the test video from "chrome://media-internal" (but I think any 10-bit depth video should reproduce this problem).

[{"alpha mode":"is_opaque","codec":"hevc","coded size":"3840x2160","color space":{"matrix":"BT2020_NCL","primaries":"BT2020","range":"LIMITED","transfer":"SMPTEST2084"},"encryption scheme":"Unencrypted","has extra data":true,"hdr metadata":"unset","natural size":"3840x2160","orientation":"0°","profile":"hevc main 10","visible rect":"0,0 3840x2160"}]

[Dale Curtis]

+media-dev

Currently HDR canvas support isn't launched. You can enable experimental web platform features and try to use it:

https://github.com/w3c/ColorWeb-CG/blob/main/hdr_html_canvas_element.md

Though it seems the params mentioned there have drifted a bit from what's implemented:

https://source.chromium.org/chromium/chromium/src/+/main:third_party/blink/renderer/core/html/canvas/image_data_settings.idl

We don't have support for high-bit-depth read-back either unfortunately so copyTo() won't work from hardware decoded HBD/HDR frames. You can kind of workaround this by using VideoDecoder with hardwareAcceleration: prefer-software, which should generate I420P10 software mappable frames on all platforms.

- dale

On Wed, Mar 12, 2025 at 8:34 AM 161089 <realra...@gmail.com> wrote:

Recently, I am doing some image filtering on decoded video frames and I especially want it to work with high bit depth videos. However, I find that `new VideoFrame(video)` may be unimplemented/unsupported or somewhat broken for high bit-depth videos. So far I have tested three different setups, namely Linux x64 (with hardware-accelerated video decode disabled), Windows x64 (with and without hardware-accelerated video decode). The Linux x64 setup seems to give me the correct result - I get video frames of "I420P10" format (though I didn't test it with hardware-accelerated video decode enabled). On the other hand, neither of the two Windows setups gives me correct result - I get video frames of "null" format when hardware accelerated video decode is enabled and "NV12" format when hardware accelerated video decode is disabled. Here is the video track information of the test video from "chrome://media-internal" (but I think any 10-bit depth video should reproduce this problem).

[{"alpha mode":"is_opaque","codec":"hevc","coded size":"3840x2160","color space":{"matrix":"BT2020_NCL","primaries":"BT2020","range":"LIMITED","transfer":"SMPTEST2084"},"encryption scheme":"Unencrypted","has extra data":true,"hdr metadata":"unset","natural size":"3840x2160","orientation":"0°","profile":"hevc main 10","visible rect":"0,0 3840x2160"}]

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.
To view this discussion visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/dc7ab7af-6786-4024-b0cb-b29d1b2a1949n%40chromium.org.