Transcribe video

[Rowdy Rabouw]

Hi,

I'm looking at https://chrome.dev/web-ai-demos/mediarecorder-audio-prompt/ 

I wonder if it's also possible to do this for video files?

I tried to use type: "video/mp4" for expectedInputs and content type in session.promptStreaming. The arrayBuffer is created, but nothing happens, no error nothing.

[Thomas Steiner]

Routing this one to @François Beaufort. 

Thomas Steiner, PhD—Developer Relations Engineer (blog.tomayac.com, toot.cafe/@tomayac)

Google Spain, S.L.U.

Torre Picasso, Pl. Pablo Ruiz Picasso, 1, Tetuán, 28020 Madrid, Spain

CIF: B63272603

Inscrita en el Registro Mercantil de Madrid, sección 8, Hoja M­-435397 Tomo 24227 Folio 25

----- BEGIN PGP SIGNATURE -----

Version: GnuPG v2.4.8 (GNU/Linux)

iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck

0fjumBl3DCharaCTersAttH3b0ttom.xKcd.cOm/1181.

----- END PGP SIGNATURE -----

--
You received this message because you are subscribed to the Google Groups "Chrome Built-in AI Early Preview Program Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chrome-ai-dev-previe...@chromium.org.
To view this discussion visit https://groups.google.com/a/chromium.org/d/msgid/chrome-ai-dev-preview-discuss/644a3afb-d48f-4587-b50e-912139dea43dn%40chromium.org.

[François Beaufort]

LanguageModelMessageType can only be "text", "image", or "audio" for now. See https://source.chromium.org/chromium/chromium/src/+/main:third_party/blink/renderer/modules/ai/language_model_create_options.idl;drc=370c461e310dcbed15a80f9707c604db60981ea9
We'll see if we can add "video" in the future. FWIW I've had this discussion at https://github.com/webmachinelearning/prompt-api/pull/71#discussion_r1952223042 already ;)

[Rowdy Rabouw]

Thanks for the info François!