[Scrum] - SUSI Interpretation Project - 20260713

2 views
Skip to first unread message

Eshaan Walia

unread,
Jul 13, 2026, 12:55:20 PM (8 days ago) Jul 13
to SUSI.AI
1. What did I do yesterday?
  • Unified the caption relay into a single SSE stream for both captions and TTS. Added support for forwarding late-arriving audio events through an event queue, included audio=true support, and made language selection mandatory when tts=1 is enabled.

  • Added support for selectable TTS voices in the relay. The selected voice is forwarded upstream as a query parameter, and the list of available voices is advertised to clients in the initial SSE connection event.

  • Added Text-to-Speech (TTS) support for spoken translations. When TTS is enabled, the original stage audio is muted, translated speech from SUSI is played, audio queue management was implemented, tts_url support was added, and interpretationTtsActive state was introduced.

  • Fixed stage audio restoration when TTS is toggled. The original mute/volume state is now preserved instead of forcing the stage volume to zero.
  • Fixed TTS resume behavior. Speech now continues from the current live captions when re-enabled, add stale caption/audio streams are discarded to prevent outdated playback. 
  • Added an independent TTS volume control, allowing users to adjust translated speech volume separately from the original stage audio.
  • Added selectable TTS voices. Available voices are fetched from the server, shown in a dropdown, and changing the voice automatically restarts TTS with the selected voice.

TTS feature fully implemented in eventyay videos, as part of the interpretation plugin. 
here is an image for it: 
tts.png

2. What do I plan to do today?

    • Update interpretation to work with websockets as primary connection and sse as fallback

    • Prepare pr 19 for review


    3. What is blocking me from making progress?

    No Blocker at the moment

    Reply all
    Reply to author
    Forward
    0 new messages