I've been toying with this idea too for a while.
Last year I started using Moe's Notes on iPhone for recording music
ideas / videos / images / text (TWEdit hadn't come out yet for iOS).
Moe's Notes (& Notepad for iPad) works great to quickly capture ideas,
but I wish my TiddlyWiki could do that stuff when I'm on the PC or
Android device.
I think that the YouTube sounds OK, but I would really like to be able
to record offline as well.
PS the <<newSynth>> idea is awesome. If the right framework/tools/
standard can be created for TW, it could make it possible for people
to invent their own instruments (and even embed songs in them) and
share them as tiddlers... If only the iPad was this open, with that
interface, oh man :-)
Has anyone explored MIDI capability in TW / JavaScript? I know there
are plenty of HTML 5 sequencers out, but have been too busy to really
look into how it's done. Any good tutorials or simple examples out
there?
Also it would be awesome to do actual ADSR or analog-style synthesis.
I've seen VB examples of WAV editors on PlanetSourceCode, has anyone
seen anything like this done from JavaScript? TW can write to files
(at least text, can it do binary?) so a start might be to have it
write a generated sample to a binary file (WAV/FLAC/etc.) and then be
able to play the sample...
(I guess either you would have to generate a "patch set" of the sound
in different pitches for the 88 piano keys, or perhaps the one sound
file could be "pitch-shifted" in realtime? Pardon my cluelessness, I'm
way over my head here, just thinking out loud.)
I would say an easy-to-use general purpose AV library with record/play
audio/video (mono, stereo, multitrack?), MIDI & sound synthesis would
be a worthy cause for TW.