Intent to Implement and Ship: VideoEncoderConfig.contentHint

389 views
Skip to first unread message

Eugene Zemtsov

unread,
Nov 1, 2023, 6:32:18 PM11/1/23
to blink-dev, Dale Curtis, Eugene Zemtsov

Contact emails

ezem...@google.com

Specification

https://www.w3.org/TR/webcodecs/#dom-videoencoderconfig-contenthint

Explainer

https://gist.github.com/Djuffin/c3742404b7c53ada227849c8b2b76b4c

Summary

Adding a contentHint field to VideoEncoderConfig Content hint takes values that are already used for MediaStreamTrack: "motion", "text", "detail". This gives web developers a way to communicate to VideoEncoder the expected type video frames they intend to encode.


Blink component

Blink>Media>WebCodecs

TAG review

N/A



Interoperability and Compatibility



Gecko: No signal (https://github.com/mozilla/standards-positions/issues/919)

WebKit: Positive (https://github.com/WebKit/standards-positions/issues/274)

Web developers: Positive RTC software vendors (including Google Meet) are interested in using it for screen sharing vs live cam scenarios.


Will this feature be supported on all six Blink platforms (Windows, Mac, Linux, Chrome OS, Android, and Android WebView)?

Yes

Is this feature fully tested by web-platform-tests?

Yes

https://source.chromium.org/chromium/chromium/src/+/main:third_party/blink/web_tests/external/wpt/webcodecs/video-encoder-content-hint.https.any.js



Finch feature name

WebCodecsContentHint

Requires code in //chrome?

False

Tracking bug

https://crbug.com/1493588

Estimated milestones

Shipping on desktop121
Shipping on Android121

Link to entry on the Chrome Platform Status

https://chromestatus.com/feature/5103493249761280

--
Thanks,
Eugene Zemtsov.

Mike Taylor

unread,
Nov 6, 2023, 10:19:53 AM11/6/23
to Eugene Zemtsov, blink-dev, Dale Curtis, Eugene Zemtsov

Hi Eugene,

Could you please request reviews for all the other review gates in your chromestatus entry?

thanks,
Mike

--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAK8JDrGKnc0Jc_doyR9ZsGVfcnk8aNfNS_t%2BTNQ-KLL%3DW%3DiZdA%40mail.gmail.com.

Eugene Zemtsov

unread,
Nov 7, 2023, 11:04:54 PM11/7/23
to Mike Taylor, blink-dev, Dale Curtis, Eugene Zemtsov
Done for Privacy, Security, Enterprise, Debuggability and Testing.

--
Thanks,
Eugene Zemtsov.

Daniel Bratell

unread,
Nov 8, 2023, 10:34:26 AM11/8/23
to Eugene Zemtsov, Mike Taylor, Jason Robbins, blink-dev, Dale Curtis, Eugene Zemtsov

They seem to be in state "preparing" which is the stage before they are actually requested. The system is a bit new so maybe there is some confusing UI or bug, but they are not yet requested. jrobbins, do you know what might have gone awry?

/Daniel

Rick Byers

unread,
Nov 28, 2023, 1:50:25 AM11/28/23
to Daniel Bratell, Eugene Zemtsov, Mike Taylor, Jason Robbins, blink-dev, Dale Curtis, Eugene Zemtsov
All the other gates are now approved. I see there's a larger TAG review open which includes this feature, but it sounds like this generic (not codec-specific) feature is the direction TAG is encouraging. I don't think we need to block this little feature on the larger discussion of AV1-specific options.

LGTM1



Yoav Weiss

unread,
Nov 28, 2023, 1:51:30 AM11/28/23
to Rick Byers, Daniel Bratell, Eugene Zemtsov, Mike Taylor, Jason Robbins, blink-dev, Dale Curtis, Eugene Zemtsov

Mike Taylor

unread,
Nov 28, 2023, 7:38:47 PM11/28/23
to Yoav Weiss, Rick Byers, Daniel Bratell, Eugene Zemtsov, Jason Robbins, blink-dev, Dale Curtis, Eugene Zemtsov

LGTM3

Reply all
Reply to author
Forward
0 new messages