Gladia Transcriptions not Showing in Web UI

[fv]

I have followed the instructions here: https://docs.bigbluebutton.org/administration/customize/#configuration-of-gladiaio

I can see the speech being transcribed in the log file (/var/log/bigbluebutton/bbb-transcription-controller.log) but no captions or transcription box shows in the web UI.

I am running BigBlueButton 3.0.23 installed with the official install script.

Any suggestions would be very much appreciated!

Thank you,

FV

[Günther Schwienbacher]

Hello FV,
- are you using Livekit or Mediasoup as Media (esp. Audio) Gateway? (root@bbb-host:~# yq eval --output-format=props /etc/bigbluebutton/bbb-webrtc-sfu/production.yml | grep
enabled and :~# grep audioBridge /etc/bigbluebutton/bbb-web.properties => if nothing special)
- As you mention: "no captions or transcription box shows in the web UI": did you also follow this documentation to enable/configure the audioCaptions in the bbb-html5 client? https://docs.bigbluebutton.org/administration/customize/#enable-live-captions
I'd stronly assume this part is missing, as nothing is displayed in the UI. Verify via: root@bbb-host:~# yq eval --output-format=props /etc/bigbluebutton/bbb-html5.yml | grep audioCaptions

Sample output:
public.app.audioCaptions.enabled = true
public.app.audioCaptions.alwaysVisible = true
public.app.audioCaptions.mobile = true
public.app.audioCaptions.provider = gladia
public.app.audioCaptions.language.available.0 = en-US

Best,
Guenther

[fv]

Hello Guenther!

It appears I am using mediasoup (IP obfuscated):

root@bbb3:/home/bbb# yq eval --output-format=props /etc/bigbluebutton/bbb-webrtc-sfu/production.yml

freeswitch.esl_password = abcdefgh

freeswitch.ip = 123.123.123.12.123

freeswitch.sip_ip = 123.123.123.12.123

mediasoup.webrtc.listenIps.0.ip = 0.0.0.0

mediasoup.webrtc.listenIps.0.announcedIp = 123.123.123.12.123

mediasoup.plainRtp.listenIp.ip = 0.0.0.0

mediasoup.plainRtp.listenIp.announcedIp = 123.123.123.12.123

I also have audioCaptions enabled (domain obfuscated):

root@bbb3:/home/bbb# yq eval --output-format=props /etc/bigbluebutton/bbb-html5.yml

public.kurento.wsUrl = wss://example.com/bbb-webrtc-sfu

public.pads.url = https://example.com/pad

public.media.sipjsHackViaWs = true

public.app.audioCaptions.enabled = true

public.app.audioCaptions.provider = gladia

I cannot find any difference between my setup and the official documentation but gladia captions do not show in the web UI.

Thank you for your help!

FV

[Günther Schwienbacher]

Hi FV,

Thanks, the configuration part looks good.
I think you might be missing the respective bbb plugin to have the config in the bbb-html5 client translated to actual functionality. Please have a look and install this plugin in your v3 BBB installation:
https://github.com/bigbluebutton/bbb-plugin-live-transcription

Sorry for not pointing out that earlier - maybe it should be made clearer in the documentation. Hope this helps.

Best,
Guenther

[fv]

Thank you! That was exactly what was missing.The transcription window now shows.

Is there a mechanism to download the final transcription by any chance?

[Günther Schwienbacher]

Hi FV,

glad to hear.
I know of this possibility (just download the transcription, see screen attached)

Best,
Guenther

 

[fv]

Thank you for your wonderful help!