I've enjoyed following your ongoing audio experiments on planet
mozilla education. It sounds as though what you're doing could have
utility beyond just audio.
The Mozilla marketing folks have done a nifty video promoting Personas
for the FF 3.6 release. After this week's design lunch, Brian
Warner, Aleksandr Milewski, and I were discussing how to build a
Jetpack that could dynamically swap personas in the browser as the
video plays, synching them to the images in the video.
We came to the conclusion that simply timing the video was the
simplest approach, but if there was real-time meta-data available from
the video tag, a much more robust general solution would be available.
As you work through the issues involved in defining a "proper API" for
kicking data across the content boundry, know that you're blazing a
trail others hope to follow.
Eagerly awaiting the next installment....
-- Richard
An interesting approach could be encode timed personas theme-id
in srt format and change personas with a callback on "subtitle" change
events, so you can use any subtitle-editor to create the srt file :-D
Paul Rouget prototyped an srt parser in his video-tag-and-subtitles
demo some times ago:
http://blog.mozbox.org/post/2009/03/10/video-tag-and-subtitles
Just my 2 cents ;-)
-- Luca Greco @ Alca Società Cooperativa
Follow me on http://twitter.com/lucagreco