how to combine YouTube live video with audio from a WebRTC client to make a new YouTube live stream?

[Hutch]

Hi, I've been puzzling over how to do this in Kurento for months now but am stuck. Is it possible to use Kurento to ingest one YouTube live stream and one WebRTC stream simultaneously, extract only the video from the YouTube live stream, combine it with only the audio from the WebRTC stream, mux them together, and restream them to a new YouTube live stream?

In other words, how to replace the sound of a live YouTube stream with audio incoming from a WebRTC client connected to Kurento, and restream it to YouTube? All streams are under our control, so there are no copyright issues. Just technical ones. I'd be grateful for some good tips and examples of how to code this in Kurento. I think it would be an interesting application of Kurento's live mixed media processing.

                         +----------------------------+

+-----------+            |------------+  +----+ +-----|

|  webrtc   +----------->-|  extract  |  |    | |    ||

|  client   |            ||  audio    +->+ M  | | R  ||       +-----------+

+-----------+            |------------+  | U  +>+ T  |------->+  youtube  |

                         |------------+  | X  | | M  ||       |  live #2  |

+-----------+            ||  extract  +->+    | | P  ||       +-----------+

|  youtube  +----------->-|  video    |  |    | |    ||

|  live #1  |  HLS/      |------------+  +----+ +-----|

+-----------+  DASH      +----------------------------+

                                    Kurento

[Micael Gallego]

Hi Hutch, 

Kurento Media Server doesn't support sending RTMP to YouTube currently. I think there some people in the list is using ffmpeg (connected through RTP) to do that. The same to "inject" YouTube stream into Kurento. But I don't know if ffmpeg can be used to do this.

The "mixing" part is easy, you can connect the video track from one source and the audio track to another source the the same sink.

If you get managed to implement this use case, please share with us.

Best regards

Micael Gallego

Kurento / OpenVidu Project Lead

--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+unsubscribe@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/728e394c-d7aa-4062-9c4a-fffce7db7a8f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.