Insertable Streams - Question

69 views
Skip to first unread message

Afonso Vilalonga

unread,
Oct 17, 2024, 5:46:34 AMOct 17
to discuss-webrtc
Hi, 

I was looking through the Insertable Streams example here and had a few questions to ask:  

1) I can encrypt the whole frame if I'm not using a middlebox, right? In other words, I only need to leave the first few bytes unencrypted if I want a middlebox to process them in some way.

2) Is the Insertable Streams API negotiated between the two peers when used, or is each peer unaware of the other's use of the API? In other words, can I determine if one, both, or neither of the peers are using it just by observing the exchanged traffic or the SDP offers and answers? 

3) In the pion-to-web example using Insertable Streams, how does the RTP depacketizer in the browser know when a frame is fully received? It seems that if I am encrypting the entire frame in the pion example and using the result as the data of the media sample, the depacketizer wouldn't be able to use the VP8 payload descriptor to regroup the whole frame from all RTP packets, since the VP8 payload descriptor would be encrypted.  

Thank you so much for taking the time to read these questions!
Afonso Vilalonga

Afonso Vilalonga

unread,
Oct 17, 2024, 11:29:33 AMOct 17
to discuss-webrtc

I just wanted to make a correction regarding question 3. After reviewing the source code of Pion, I realized that the question doesn't make much sense. The VP8 payload descriptor is not encrypted—only the VP8 header and the content of the frame are.

However, I still don’t know the answers to the other two questions :)  

Philipp Hancke

unread,
Oct 17, 2024, 11:34:18 AMOct 17
to discuss...@googlegroups.com
1/ yes. Middleboxes may want to know this is a keyframe though.

2/ they are not aware, see the Middlebox in the webrtc sample

3/ note that this applies to VP8

--
This list falls under the WebRTC Code of Conduct - https://webrtc.org/support/code-of-conduct.
---
You received this message because you are subscribed to the Google Groups "discuss-webrtc" group.
To unsubscribe from this group and stop receiving emails from it, send an email to discuss-webrt...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/discuss-webrtc/b02c36a1-5c5f-4348-acd9-d0ec44decc82n%40googlegroups.com.

Afonso Vilalonga

unread,
Oct 21, 2024, 9:37:49 AMOct 21
to discuss-webrtc
Thank you!
Reply all
Reply to author
Forward
0 new messages