Intent to implement: HTMLMediaElement::seekToNextFrame()

[Tzu-Hao Kuo]

*Summary*: HTMLMediaElement::seekToNextFrame() is an experimental feature
which enables JS developers to access video frames one-by-one without going
through the real-time playback. Internally, this feature could could be
used to writ media tests.

*Bug*: https://bugzilla.mozilla.org/show_bug.cgi?id=1235301

*Link to standard*: No standard. This API was first discussed at Mozlando
and has been discussed online here(
https://github.com/w3c/mediacapture-worker/issues/33). The discussion has
been led to a stream-based design which will probably take a long time so
we would like to implement the proposed HTMLMediaElement::seekToNextFrame()
first for testing.

*Platform coverage*: all platforms.

*Estimated or target release*: 49

*Preference behind which this will be implemented*: media.seekToNextFrame

*DevTools bug*: no needed, I think.

*Tzuhao Kuo (Kuku)* | OS Media | *Mozilla Taipei* | M: +886-939-816-840

[Xidorn Quan]

On Fri, May 27, 2016 at 12:49 PM, Tzu-Hao Kuo <tk...@mozilla.com> wrote:

>
> *Preference behind which this will be implemented*: media.seekToNextFrame
>

I guess it'd be better to call it "media.seekToNextFrame.enabled".

- Xidorn

[Tzu-Hao Kuo]

Yes, Xidorn, thanks. I have modified it accordingly.

*Tzuhao Kuo (Kuku)* | OS Media | *Mozilla Taipei* | M: +886-939-816-840

[Eric Shepherd]

This will be great for writing JavaScript code that applies filters or
effects to video, too. Sweet.

> *Summary*: HTMLMediaElement::seekToNextFrame() is an experimental feature
> which enables JS developers to access video frames one-by-one without going
> through the real-time playback. Internally, this feature could could be
> used to writ media tests.

--

Eric Shepherd
Senior Technical Writer
Mozilla Developer Network <https://developer.mozilla.org/>
Blog: https://www.bitstampede.com/
Twitter: http://twitter.com/sheppy
Doodle: http://doodle.com/the.sheppy

[Jet Villegas]

On Thu, May 26, 2016 at 7:49 PM, Tzu-Hao Kuo <tk...@mozilla.com> wrote:


> *Link to standard*: No standard. This API was first discussed at Mozlando
> and has been discussed online here(
> https://github.com/w3c/mediacapture-worker/issues/33). The discussion has
> been led to a stream-based design which will probably take a long time so
> we would like to implement the proposed HTMLMediaElement::seekToNextFrame()
> first for testing.
>

What's the plan for resolving Streams/MediaStream integration raised on
the github issue? I read "probably take a long time" to mean we're working
on it, but is that actually the case? This is a feature we definitely want
interop on.

--Jet

[Ehsan Akhgari]

FWIW I r+ed the patch on the bug based on the assumption that we will
not be shipping the API in its current form...

[Chris Pearce]

The plan is to use feedback garnered from people experimenting with the experimental API in pre-release builds to help guide the design of the larger streams-based API.

We're not going to ship the API enabled in the current form in Release Firefox.

There are guys in Taipei interested in working on a streams-based API I believe. So they'll likely be leading the effort. We'll discuss this at Mozlondon.

[Eric Shepherd]

Do: do you want this method documented or not? I presume not, since
exposure will be limited.

------------------------------------------------------------------------
*From:* Chris Pearce
*Sent:* Thursday, Jun 2, 2016 4:40:59 PM EDT
*To:* dev-pl...@lists.mozilla.org
*Subject:* Intent to implement: HTMLMediaElement::seekToNextFrame()

> We're not going to ship the API enabled in the current form in Release Firefox.

[Chris Pearce]

I think minimal documentation, saying that this feature is experimental and that the user must enable the pref before it'll work is useful.