Intent to Ship: Capture handle

[Elad Alon]

Contact emails

elad...@chromium.org

Explainer

https://github.com/w3c/mediacapture-handle/blob/main/identity/README.md

Specification

https://w3c.github.io/mediacapture-handle/identity/

Summary

We introduce a mechanism that allows an application to opt-in to exposing certain information to other applications which are video-capturing it. This allows collaboration between capturing and captured applications. For example, a VC application that's video-capturing a tab where a presentation application lives, could expose user-facing controls in the VC tab for navigating the presentation in the captured tab.

TAG review

https://github.com/w3ctag/design-reviews/issues/645

TAG review status

Pending

Risks

Interoperability and Compatibility

Gecko:

No signal (https://github.com/mozilla/standards-positions/issues/615)

Engaged in discussions in the W3C and approved the adoption of this document.

There is currently a disagreement with Mozilla over issue #11. Mozilla suggests setCaptureHandleConfig() should only be callable once, to reduce the risk of it becoming an alternative communication channel. We see relevant use cases that calling it multiple times can enable (e.g. the captured application changing its state and wants to notify the capturer). We believe setCaptureHandleConfig() should be callable multiple times.
Note that there could be other mitigations for Mozilla's concerns (e.g. rate-limiting) that will keep the use cases intact.
We'd like to ship the API as callable multiple times, while continuing to discuss this point. This could unfold in several ways:

• We might be able to convince Mozilla of the correctness of our viewpoint.
• We might find out that legitimate websites often call setCaptureHandleConfig() multiple times (but not excessively), making it easier for us to convince Mozilla.
• We might find out that websites rarely call setCaptureHandleConfig() multiple times, allowing us to rather painlessly change the function to being callable only once.
• We might find out that some websites call setCaptureHandleConfig() multiple times in suspicious ways, in which case we'd change the function to being callable only once.

As part of the launch, we'll add usage metrics and keep close watch for the possibility of suspicious usage of the type Mozilla is worried about.

In either case, we have a reasonable way forward regardless of how things turn out.

WebKit:

No signal (https://lists.webkit.org/pipermail/webkit-dev/2022-February/032140.html)

Engaged in discussions in the W3C and approved the adoption of this document.

Web developers:

Strongly positive (https://docs.google.com/document/d/12LcwOy6AruoORAP7woswhBgG3cjoxVzQfPUuB6U-Vdo/edit?usp=sharing) 

Strong positive signals from:

• Google (link)
  
• Microsoft (link1, link2)
  
• Citrix (link1, link2)
  
• Zoom (link)
  
• RingCentral (link)
• Jitsi (link)

Other signals:

N/A

Debuggability

No DevTools support is needed.

Is this feature fully tested by web-platform-tests?

No

Tracking bug

https://bugs.chromium.org/p/chromium/issues/detail?id=1200910

Launch bug

https://bugs.chromium.org/p/chromium/issues/detail?id=1200907

Sample links

https://w3c.github.io/mediacapture-handle/identity/demos/remote_control/capturer.html
https://w3c.github.io/mediacapture-handle//identity/demos/self_capture_detection/index.html

Estimated milestones

OriginTrial desktop last	102
OriginTrial desktop first	92

Link to entry on the Chrome Platform Status

https://chromestatus.com/feature/4854125411958784

Links to previous Intent discussions

Intent to prototype: https://groups.google.com/a/chromium.org/g/blink-dev/c/yLTykllpNmI
Intent to Experiment: https://groups.google.com/a/chromium.org/g/blink-dev/c/RKONugfoGwM/m/mpFizHPxAwAJ

Intent to Extend Experiment: https://groups.google.com/a/chromium.org/g/blink-dev/c/eJPOkBGriZc

Intent to Extend Experiment Again: https://groups.google.com/a/chromium.org/g/blink-dev/c/fB3IZDgcoco

This intent message was generated by Chrome Platform Status.

[Yoav Weiss]

On Wed, Mar 9, 2022 at 11:26 AM 'Elad Alon' via blink-dev <blin...@chromium.org> wrote:

Contact emails

elad...@chromium.org

Explainer

https://github.com/w3c/mediacapture-handle/blob/main/identity/README.md

Specification

https://w3c.github.io/mediacapture-handle/identity/

Summary

We introduce a mechanism that allows an application to opt-in to exposing certain information to other applications which are video-capturing it. This allows collaboration between capturing and captured applications. For example, a VC application that's video-capturing a tab where a presentation application lives, could expose user-facing controls in the VC tab for navigating the presentation in the captured tab.

TAG review

https://github.com/w3ctag/design-reviews/issues/645

It seems worthwhile to give the TAG a few more weeks to get back to this, as they may be able to weigh in on some of the open issues.

 

--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAMO6jDNrRWJfFKmB4__6WcL_un1F%2BF0L0bnN9k2zRzjT05DdWA%40mail.gmail.com.

[Elad Alon]

TAG has just closed this issue as "satisfied" and posted "we are happy to see this move forward."

[chrishtr via Chromestatus]

LGTM1

[Yoav Weiss]

LGTM2

On Wednesday, March 23, 2022 at 4:27:06 PM UTC+1 chrishtr via Chromestatus wrote:

LGTM1

[mkwst via Chromestatus]

LGTM3.

[Elad Alon]

Thank you all!

Sorry for not asking originally, but - may we ship gaplessly?

On Wednesday, March 23, 2022 at 4:34:24 PM UTC+1 mkwst via Chromestatus wrote:

LGTM3.

[Yoav Weiss]

LGTM for a gapless OT

--

You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/a1c9b5e3-a199-4c88-bfbc-b249a49dd126n%40chromium.org.