Intent to Experiment: Document picture-in-picture

339 views
Skip to first unread message

Tommy Steimel

unread,
Jan 9, 2023, 2:15:30 PM1/9/23
to blin...@chromium.org

Contact emails

ste...@chromium.orglibe...@chromium.orgy...@chromium.org

Explainer

https://github.com/WICG/document-picture-in-picture/blob/main/README.md

Specification

https://wicg.github.io/document-picture-in-picture

Summary

Document PiP adds a new API to open an always-on-top window that can be populated with arbitrary HTMLElements. This is an expansion upon the existing HTMLVideoElement API that only allows for an HTMLVideoElement to be put into a PiP window. This allows web developers to provide a better PiP experience to users.



Blink component

Blink>Media>PictureInPicture

TAG review

https://github.com/w3ctag/design-reviews/issues/798

TAG review status

Pending

Risks



Interoperability and Compatibility



Gecko: No signal (https://github.com/mozilla/standards-positions/issues/670)

WebKit: No signal (https://github.com/WebKit/standards-positions/issues/41)

Web developers: Positive (https://discourse.wicg.io/t/proposal-document-picture-in-picture/5736/2?u=steimel) In addition to the linked comment, we have some signals from partners that this would be valuable, and are checking to see if they are OK making that public

Other signals:

WebView application risks

Does this intent deprecate or change behavior of existing APIs, such that it has potentially high risk for Android WebView-based applications?

N/A since we are not enabling this API on Android



Goals for experimentation

We want to make sure the API is ergonomic/powerful enough to enable websites to provide the improved picture-in-picture experiences they've wanted to create (improved vs the existing video picture-in-picture API). We'll look at developer feedback for issues/limitations that we hadn't considered. We'll look at the usage of the CSS copying feature to see if it's actually useful and worth pursuing.



Reason this experiment is being extended

N/A



Ongoing technical constraints

None



Debuggability

The new methods and properties proposed in this spec will show up in autocomplete functionality (e.g. window.documentPictureInPicture). The enter event will support event listener breakpoints in the "Picture-in-Picture" category.



Will this feature be supported on all six Blink platforms (Windows, Mac, Linux, Chrome OS, Android, and Android WebView)?

No

At least initially, we're not supporting Android since the Android APIs don't easily support always-on-top windows with arbitrary interaction



Is this feature fully tested by web-platform-tests?

Yes

Flag name

Document Picture-in-Picture API

Requires code in //chrome?

True

Tracking bug

https://crbug.com/1269059

Launch bug

https://crbug.com/1269059

Estimated milestones

OriginTrial desktop last115
OriginTrial desktop first111


Link to entry on the Chrome Platform Status

https://chromestatus.com/feature/5755179560337408

Links to previous Intent discussions

Intent to prototype: https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGyVZ8L-SmBFbBMvvbm0x3TwZ66JQ1Fm7_zb3nSiBvYhXavAuA%40mail.gmail.com


This intent message was generated by Chrome Platform Status.

Tommy Steimel

unread,
Jan 9, 2023, 6:02:03 PM1/9/23
to blink-dev, Tommy Steimel

Note on the WebKit signal: They do have some concerns listed on the GitHub issue but no official position
On Monday, January 9, 2023 at 11:15:30 AM UTC-8 Tommy Steimel wrote:

Yoav Weiss

unread,
Jan 10, 2023, 8:08:15 AM1/10/23
to Tommy Steimel, blink-dev
LGTM to experiment M111-M115 (inclusive)

On Tue, Jan 10, 2023 at 12:02 AM Tommy Steimel <ste...@chromium.org> wrote:

Note on the WebKit signal: They do have some concerns listed on the GitHub issue but no official position
On Monday, January 9, 2023 at 11:15:30 AM UTC-8 Tommy Steimel wrote:


Explainer

https://github.com/WICG/document-picture-in-picture/blob/main/README.md

Specification

https://wicg.github.io/document-picture-in-picture

Summary

Document PiP adds a new API to open an always-on-top window that can be populated with arbitrary HTMLElements. This is an expansion upon the existing HTMLVideoElement API that only allows for an HTMLVideoElement to be put into a PiP window. This allows web developers to provide a better PiP experience to users.



Blink component

Blink>Media>PictureInPicture

TAG review

https://github.com/w3ctag/design-reviews/issues/798

Would be great to address Alex's great questions on that thread, but I don't think this is a blocker for the OT. 



TAG review status

Pending

Risks



Interoperability and Compatibility



Gecko: No signal (https://github.com/mozilla/standards-positions/issues/670)

Some concerns around abuse & user annoyance seem valid. Have you considered adding mitigations on that front to the spec?
Thanks for addressing WebKit folks' voiced concerns! 
 
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/03e97552-6e27-4c24-8a79-7b2f7f43e28en%40chromium.org.

Arnaud Budkiewicz

unread,
Feb 2, 2023, 12:53:09 PM2/2/23
to blink-dev, yoav...@chromium.org, blink-dev, ste...@chromium.org
Hi!

Dialpad would benefit if this feature would become available in the browser. 
Is there a demo available?

Thank you,

Arnaud Budkiewicz

Tommy Steimel

unread,
Feb 2, 2023, 2:46:13 PM2/2/23
to blink-dev, Arnaud Budkiewicz, yoav...@chromium.org, blink-dev, ste...@chromium.org
Hi Arnaud,

There will be an origin trial starting in Chrome 111, and when that's available you can go to https://document-picture-in-picture-api.glitch.me/ to view a demo. You can also make that page work sooner by enabling experimental web platform features in chrome://flags

Thanks,
Tommy

Arnaud Budkiewicz

unread,
Feb 3, 2023, 11:45:22 AM2/3/23
to Tommy Steimel, blink-dev, yoav...@chromium.org, ste...@chromium.org
Awesome, thank you so much!

Arnaud
Reply all
Reply to author
Forward
0 new messages