Primary eng (and PM) emails
rt...@chromium.org, hong...@chromium.org
Summary
The WebAudio MediaElementAudioSourceNode, MediaStreamAudioSourceNode, and MediaStreamAudioDestinationNode will only be allowed to be created on an AudioContext, not OfflineAudioContext.
Motivation
The nodes listed above are inherently real-time audio nodes that assume things progress in a real-time manner. But an OfflineAudioContext is specifically designed not to be constrained by real-time processing and is intended to run faster than real-time when possible. These two constraints are incompatible so these nodes will no longer be allowed to work for an OfflineAudioContext. They will, however, continue to be created for an AudioContext, which produces real-time audio.
In recognition of this fact the WebAudio specification removed these nodes from an OfflineAudioContext in 2015.
Interoperability and Compatibility Risk
It’s not clear how much we will break in removing this since there are no use counters for this case. The usage of these nodes in general is relatively low. We take it as a good sign that Firefox has already removed these and there have been no bugs filed on this that we know of. However, see also the WebAudio spec issue 1605.
Edge: Currently allows offline audio context
Firefox: Already removed
Safari: Currently allows offline audio context.
Alternative implementation suggestion for web developers
There is no drop-in alternative, but it can be approximated by using an AudioContext and a ScriptProcessorNode or AudioWorkletNode to capture the data from the Media node.
Usage information from UseCounter
There are use counters for these nodes, but they don’t distinguish between whether an OfflineAudioContext or AudioContext is used. We will add use counters for this to measure how often these are used with an OfflineAudioContext.
Current counters are:
MediaElementAudioSourceNode
https://www.chromestatus.com/metrics/feature/timeline/popularity/640
https://www.chromestatus.com/metrics/feature/timeline/popularity/1716
MediaStreamAudioSourceNode
https://www.chromestatus.com/metrics/feature/timeline/popularity/642
https://www.chromestatus.com/metrics/feature/timeline/popularity/1717
MediaStreamAudioDestinationNode
Entry on the feature dashboard
https://www.chromestatus.com/features/5258622686724096
Requesting approval to remove too?
Yes. We will tentatively remove this no earlier than M70, depending on the use counter data. If the usage is high, we may postpone removal until a later date to allow developers to update their code.
Interoperability and Compatibility Risk
It’s not clear how much we will break in removing this since there are no use counters for this case.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
Hey Raymond,I'm fairly sure that MediaStreamAudioSourceNode is used for the "mike check" of WebRTC web apps like Hangouts and Meet, although perhaps not together with OfflineAudioContext. Nevertheless, do you have a more fleshed out example using AudioWorkletNode that would replace existing use of OfflineAudioContext?
On Fri, Jun 8, 2018 at 1:27 AM TAMURA, Kent <tk...@chromium.org> wrote:
LGTM2
On Fri, Jun 8, 2018 at 3:34 AM Chris Harrelson <chri...@chromium.org> wrote:
LGTM1 to deprecate and try to remove in M70. Please come back with stable channel use counter data on M69 to confirm.
On Thu, Jun 7, 2018 at 11:22 AM Raymond Toy <rt...@chromium.org> wrote:
Quick clarification:--On Thu, Jun 7, 2018 at 11:15 AM Raymond Toy <rt...@chromium.org> wrote:
Interoperability and Compatibility Risk
It’s not clear how much we will break in removing this since there are no use counters for this case.
By "this case", I meant no counters to show if these nodes are used with an OfflineAudioContext.
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+unsubscribe@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
--TAMURA Kent--
Software Engineer, Google
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+unsubscribe@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAARdPYf%3DU2tZ8Yxh5dRtWgpz1GhAWfxnC9XiVH%2BXQDj%3DpnH7TA%40mail.gmail.com.
Hey Raymond,I'm fairly sure that MediaStreamAudioSourceNode is used for the "mike check" of WebRTC web apps like Hangouts and Meet, although perhaps not together with OfflineAudioContext. Nevertheless, do you have a more fleshed out example using AudioWorkletNode that would replace existing use of OfflineAudioContext?
One of the attempts to work around the autoplay issue for the "mike check" of WebRTC applications while we had the autoplay imbroglio used OfflineAudioNode.We should install an use counter to verify that none of the production services picked up on this workaround and deployed it.
M70 is the same version as the target date for reintroducing the autoplay denial for WebAudio.
On Mon, Jun 11, 2018 at 12:18 PM, 'Philip Jägenstedt' via blink-dev <blin...@chromium.org> wrote:
Hey Raymond,I'm fairly sure that MediaStreamAudioSourceNode is used for the "mike check" of WebRTC web apps like Hangouts and Meet, although perhaps not together with OfflineAudioContext. Nevertheless, do you have a more fleshed out example using AudioWorkletNode that would replace existing use of OfflineAudioContext?
On Fri, Jun 8, 2018 at 1:27 AM TAMURA, Kent <tk...@chromium.org> wrote:
LGTM2
On Fri, Jun 8, 2018 at 3:34 AM Chris Harrelson <chri...@chromium.org> wrote:
LGTM1 to deprecate and try to remove in M70. Please come back with stable channel use counter data on M69 to confirm.
On Thu, Jun 7, 2018 at 11:22 AM Raymond Toy <rt...@chromium.org> wrote:
Quick clarification:--On Thu, Jun 7, 2018 at 11:15 AM Raymond Toy <rt...@chromium.org> wrote:
Interoperability and Compatibility Risk
It’s not clear how much we will break in removing this since there are no use counters for this case.
By "this case", I meant no counters to show if these nodes are used with an OfflineAudioContext.
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
--TAMURA Kent--
Software Engineer, Google
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
On Mon, Jun 11, 2018 at 4:23 AM Harald Alvestrand <h...@google.com> wrote:One of the attempts to work around the autoplay issue for the "mike check" of WebRTC applications while we had the autoplay imbroglio used OfflineAudioNode.We should install an use counter to verify that none of the production services picked up on this workaround and deployed it.I'm adding usecounters now. It won't tell you if it's for WebRTC, but we'll at least know how common this is.M70 is the same version as the target date for reintroducing the autoplay denial for WebAudio.I randomly picked M70 since 67 just recently landed. We can postpone it, but since the autoplay restrictions are coming back in M70, this seemed like a good time.
On Mon, Jun 11, 2018 at 12:18 PM, 'Philip Jägenstedt' via blink-dev <blin...@chromium.org> wrote:
Hey Raymond,I'm fairly sure that MediaStreamAudioSourceNode is used for the "mike check" of WebRTC web apps like Hangouts and Meet, although perhaps not together with OfflineAudioContext. Nevertheless, do you have a more fleshed out example using AudioWorkletNode that would replace existing use of OfflineAudioContext?
On Fri, Jun 8, 2018 at 1:27 AM TAMURA, Kent <tk...@chromium.org> wrote:
LGTM2
On Fri, Jun 8, 2018 at 3:34 AM Chris Harrelson <chri...@chromium.org> wrote:
LGTM1 to deprecate and try to remove in M70. Please come back with stable channel use counter data on M69 to confirm.
On Thu, Jun 7, 2018 at 11:22 AM Raymond Toy <rt...@chromium.org> wrote:
Quick clarification:--On Thu, Jun 7, 2018 at 11:15 AM Raymond Toy <rt...@chromium.org> wrote:
Interoperability and Compatibility Risk
It’s not clear how much we will break in removing this since there are no use counters for this case.
By "this case", I meant no counters to show if these nodes are used with an OfflineAudioContext.
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+unsubscribe@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
--TAMURA Kent--
Software Engineer, Google
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+unsubscribe@chromium.org.
LGTM2
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
--TAMURA Kent--
Software Engineer, Google
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
Hi Harald,
> Nevertheless, do you have a more fleshed out example using AudioWorkletNode that would replace existing use of OfflineAudioContext?
What do you mean by this? How do you replace OAC with the AudioWorkletNode? If that helps Meet or Hangout somehow I would love to look into it.
LGTM2
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
--TAMURA Kent--
Software Engineer, Google
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAARdPYf%3DU2tZ8Yxh5dRtWgpz1GhAWfxnC9XiVH%2BXQDj%3DpnH7TA%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOqqYVGtiOUDeg7Q5GjovVh5_8i9YmC6rbM4Kcg1_ZG_%3DOBrLw%40mail.gmail.com.
LGTM2
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXFfTai65K0WPUR6%3DNpuZ%3D3h-%3DS8%2BF8WsP%3DYVY0s6CJj%2Bw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAOMQ%2Bw-i8J6k72f04LAy38VUjM-X%2Bkjr2z6vYOHv_hA%3DOrhjbg%40mail.gmail.com.
--TAMURA Kent--
Software Engineer, Google
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAGH7WqHByM1qyBc0%2B1iAeBQsMTp1_h9C_G1K%2BVwMJbjAYyispg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CAE3TgXF8OF%2BOdW_bVcvTMWvm7vjtWcZ%3DcikVU_yPMV8O99yoSw%40mail.gmail.com.
Hi,I do not know top of my head why the feature is not being recorded. But there are a few things we could try:1. This is the logic for deprecation use counter. We want to verify the caller will have a valid: frame, document, document loader, and a page in order for the use to be counted.2. We can write a layout test (see example) that triggers the web audio usage and then use internals.isUseCounted(document, ...) to test if usages are being recorded.3. The chromestatus.com is sometimes delayed (it uses most dominant version tag and stable) and has some issues with it. So I'd recommend checking the internal usage with UMA dashboard.
On Tue, Oct 2, 2018 at 9:32 AM Luna Lu <lun...@chromium.org> wrote:Hi,I do not know top of my head why the feature is not being recorded. But there are a few things we could try:1. This is the logic for deprecation use counter. We want to verify the caller will have a valid: frame, document, document loader, and a page in order for the use to be counted.2. We can write a layout test (see example) that triggers the web audio usage and then use internals.isUseCounted(document, ...) to test if usages are being recorded.3. The chromestatus.com is sometimes delayed (it uses most dominant version tag and stable) and has some issues with it. So I'd recommend checking the internal usage with UMA dashboard.This link shows that there is very, very little usage. I think it's ok to move the methods to the AudioContext.Thanks for your help!