synchronized pdf and midi playback

[Federico Bruni]

I have a feature request.
It has been asked also in lilypond-user mailing list recently:
http://lists.gnu.org/archive/html/lilypond-user/2011-01/msg00366.html

When I play the MIDI file I'd like to see, in the PDF preview, the notes
being played in each moment.
I don't know if it's feasible...

I started dreaming about it when I tried the new built-in MIDI player.
Apparently, KMid knows which beat of which bar is being played.
I thought next step could be adding this highlight feature.

Wilbert, have you already thought about it?

Thanks,
Federico

[Brett McCoy]

You are probably better off using Rosegarden or Denemo if you want
note highlighting during MIDI playback. I can't see how you would be
able to synch MIDI events to the PDF, because the PDF document doesn't
retain the note data internally, AFAIK.

--
Brett W. McCoy -- http://www.electricminstrel.com
------------------------------------------------------------------------
"In the rhythm of music a secret is hidden; If I were to divulge it,
it would overturn the world."
    -- Jelaleddin Rumi

[Wilbert Berendsen]

Op woensdag 19 januari 2011 schreef Federico:

> When I play the MIDI file I'd like to see, in the PDF preview, the notes
> being played in each moment.
> I don't know if it's feasible...

Frescobaldi 2.0 can maybe have such a thing. Of course the PDF preview does
not know the notes, but it does have the positions (if point and click was
used) and Frescobaldi 2.0 has a tokenizer that works all the time and so it is
possible to see what object a point and click link points to. The built-in
MIDI player could also look at the document and so maybe it's possible to
implement highlighted notes (in text and/or PDF preview) while playing.

And other things like play from cursor, etc.

Currently the MIDI player just shows the bar number and beat.

best regards,
Wilbert Berendsen

--
Frescobaldi, LilyPond editor for KDE: http://www.frescobaldi.org/

[Federico Bruni]

Il giorno mer, 19/01/2011 alle 07.19 +0100, Wilbert Berendsen ha
scritto:

> Op woensdag 19 januari 2011 schreef Federico:
>
> > When I play the MIDI file I'd like to see, in the PDF preview, the
> notes
> > being played in each moment.
> > I don't know if it's feasible...
>
> Frescobaldi 2.0 can maybe have such a thing. Of course the PDF preview
> does
> not know the notes, but it does have the positions (if point and click
> was
> used) and Frescobaldi 2.0 has a tokenizer that works all the time and
> so it is
> possible to see what object a point and click link points to. The
> built-in
> MIDI player could also look at the document and so maybe it's possible
> to
> implement highlighted notes (in text and/or PDF preview) while
> playing.
>
> And other things like play from cursor, etc.

That would be great!

I've tried to add an enhancement request in the issue tracker, but I
could see no option to select... so the issue was added as "defect" (?).

This is the link:
http://code.google.com/p/lilykde/issues/detail?id=42

Thanks,
Federico

[Ryan Kavanagh]

Hi,

On Wed, Jan 19, 2011 at 07:19:52AM +0100, Wilbert Berendsen wrote:
> Op woensdag 19 januari 2011 schreef Federico:
>
> > When I play the MIDI file I'd like to see, in the PDF preview, the notes
> > being played in each moment.
> > I don't know if it's feasible...
>
> Frescobaldi 2.0 can maybe have such a thing. Of course the PDF preview does
> not know the notes, but it does have the positions (if point and click was
> used) and Frescobaldi 2.0 has a tokenizer that works all the time and so it is
> possible to see what object a point and click link points to. The built-in
> MIDI player could also look at the document and so maybe it's possible to
> implement highlighted notes (in text and/or PDF preview) while playing.

Would it be worthwhile to have Frescobaldi participade in GSoC and maybe
have some of the students on this list help tackle some of these things?

Kind regards,
Ryan

PS: I'd be interested in participating in GSoC through Frescobaldi ;)

--
|_)|_/ Ryan Kavanagh | GnuPG key
| \| \ http://ryanak.ca/ | 4A11C97A (Transitioning from E95EDDC9)
() ascii ribbon campaign - against html e-mail
/\ www.asciiribbon.org - against proprietary attachments

[Bernard Hurley]

Can I get clear what is proposed here? Presumably this involves adding markers in both midi and pdf files. If so, would it be possible to develop a cut-down frescobaldi (frescobaldi player, say) that could "play" such pairs of files. This would be very useful for educational purposes and I'm sure many people, who don't particularly want to use lilypond, would like to "play" such files.

/Bernard

--
Frescobaldi homepage: http://www.frescobaldi.org/
Mailing list: http://groups.google.com/group/frescobaldi

[Wilbert Berendsen]

Op vrijdag 21 januari 2011 schreef Bernard:

> Can I get clear what is proposed here? Presumably this involves adding
> markers in both midi and pdf files. If so, would it be possible to develop
> a cut-down frescobaldi (frescobaldi player, say) that could "play" such
> pairs of files. This would be very useful for educational purposes and I'm
> sure many people, who don't particularly want to use lilypond, would like
> to "play" such files.

to make "play" files other tools are more suitable, I think, although
Frescobaldi could contain options to generate such files in some way.

[Doug Laidlaw]

On Sun, 23 Jan 2011 06:59:03 pm Wilbert Berendsen wrote:
> Op vrijdag 21 januari 2011 schreef Bernard:
> > Can I get clear what is proposed here? Presumably this involves adding
> > markers in both midi and pdf files. If so, would it be possible to
> > develop a cut-down frescobaldi (frescobaldi player, say) that could
> > "play" such pairs of files. This would be very useful for educational
> > purposes and I'm sure many people, who don't particularly want to use
> > lilypond, would like to "play" such files.
>
> to make "play" files other tools are more suitable, I think, although
> Frescobaldi could contain options to generate such files in some way.
>
> best regards,
> Wilbert Berendsen

To put it another way, I can't see what Bernard would want to process.
Lilypond is an essential component of Frescobaldi. A program that could
import midi files and turn them into PDF, or the reverse, is something
fundamentally different, and perhaps better written from scratch?

Doug.

[Bernard Hurley]

I didn't want to process midi files to turn them into pdf's. My point is that Frescobaldi could eventually if one could sync a midi file with a pdf, would the process be such that the lilypond file still have to be available? If not then this functionality could be split out from Frescobaldi to produce an app that could "play" such a pair of files, which presumably would have to be produced by Frescobaldi.

cheers

/Bernard