Access to raw Opus bytes for sending them to Deepgram speech-to-text service

[pmin...@digitalsamba.com]

Hi,

We are investigating a way to integrate Janus with Deepgram Speech to text service.
They support Opus streams, but the issue is Janus rtp_forward uses RTP packets.
So we cannot just send RTP packets to Deepgram.

Is there a way Janus to unwrap/depacketize the RTP packets and forward only the raw Opus bytes to a concrete port?

What do you suggest?

Thank you in advance!

[Lorenzo Miniero]

You'll need an RTP forward recipient that can unwrap the frame from the RTP packet, which is not hard. If you don't want to do it yourself, I guess you can use a GStreamer pipeline for the purpose, which just depacketizes RTP. How to access the payload to use with Deepgram is up to you.

L.

[sergey radionov]

Hi

I'm using RTP forwarders (Audiobridge and Videoroom plugins) with my own Node.js plugin https://github.com/RSATom/wcjs-gs receive and send audio frames to Google Speech-To-Text engine. In my case it works well enough...