Intent to Prototype: Eye Gaze Correction API.

243 views
Skip to first unread message

Bhaumik, Rijubrata

unread,
Dec 1, 2023, 8:10:15 AM12/1/23
to blin...@chromium.org, Harald Alvestrand, Guido Urdaneta, Youenn Fablet, Bernard Aboba, Jan-Ivar Bruaroey, Jon Napper, CJ Huang, elad...@google.com

Contact emails

rijubrat...@intel.com,  eero.h...@intel.com,  fbea...@google.com

Explainer

https://github.com/riju/eyeGazeCorrection/blob/main/explainer.md

Specification

https://w3c.github.io/mediacapture-extensions/#exposing-mediastreamtrack-source-eye-gaze-correction-support

Summary

Some platforms or User Agents may provide built-in support for automatic Eye Gaze Correction, in particular for camera video streams.

Web applications may either want to control the levers which can be a simple ON/OFF or an enhanced version like STARE/ TELEPROMPTER mode or at least be aware that .

This may allow the web application to update its UI or to not apply Eye Gaze Correction on its own.

 

Blink component

Blink>ImageCapture

Motivation

Eye Contact / Gaze Redirection is a technique designed to help ensure that your eyes are looking at the camera when presenting in a video call.

Camera placement can determine how we are looking in the video but now novel techniques can shift our eyes and create a sense that we are always making eye contact,

which is a powerful social stimulus. That helps to create a sense of connection and engagement with the viewer.

This Eye Gaze Correction API gives developers a choice to use the native platform's API.

 

Initial public proposal

https://github.com/w3c/mediacapture-extensions/pull/56

Search tags

webrtcAIcamerastudio/ visual effects

TAG review

None

TAG review status

Pending

Risks

 

Interoperability and Compatibility

None


Gecko: No signal
https://github.com/mozilla/standards-positions/issues/934

Jan-Ivar (Mozilla) is involved in the discussions.

WebKit: No signal
https://github.com/WebKit/standards-positions/issues/287
Youenn Fablet (Apple) is supportive of this change.

Web developers: No signals

Other signals:

WebView application risks

Does this intent deprecate or change behavior of existing APIs, such that it has potentially high risk for Android WebView-based applications?

None

 

Debuggability

No specific DevTools changes are required. This feature is treated like any other JS method.

 

Is this feature fully tested by web-platform-tests?

Yes.

Flag name on chrome://flags

--enable-blink-features=MediaCaptureCameraControl

Finch feature name

None

Non-finch justification

None

Requires code in //chrome?

False

Tracking bug

https://bugs.chromium.org/p/chromium/issues/detail?id=1506956

Estimated milestones

No milestones specified

 

Link to entry on the Chrome Platform Status

https://chromestatus.com/feature/5140905475964928

This intent message was generated by Chrome Platform Status.

 

Reply all
Reply to author
Forward
0 new messages