Piano Genie iOS prototype

64 views
Skip to first unread message

Virgile Boulanger

unread,
Jul 26, 2022, 12:24:20 PM7/26/22
to magenta...@tensorflow.org
Dear all, 

I wanted to share with you a cool project we’ve been working on lately:  porting the Piano Genie model from Magenta to iOS !

The result is a prototype accessible on the App Store (sorry for all Android users, we do not have dev ressources for it yet !)


We basically took huge inspiration from the existing web demos, and added MIDI out + an experimental playing mode with hand tracking.
Feel free to download the app and play with it ! We welcome any feedbacks ;) 

Thanks a lot to the Piano Genie contributors for the inspiring work !

Have a good day, 

Virgile Boulanger
Lead Machine Learning at MWM

Simon Russell

unread,
Jul 27, 2022, 4:35:24 AM7/27/22
to Magenta Discuss, boulange...@gmail.com
It's great! I've been having a play and my 6 year old and 3 year old love it, although the 3 year old favors auto mode. 
The hand motion detector does go the opposite way to the keyboard though, not sure if that's the intention. 
But it's really nice 

Jesse Engel

unread,
Aug 2, 2022, 2:05:34 PM8/2/22
to Simon Russell, Magenta Discuss, boulange...@gmail.com
This is great! I love the sound design, really makes it more enjoyable, pushes people towards a reasonable way to play it. Definitely let us know when the Android app is available!

--
Magenta project: magenta.tensorflow.org
To post to this group, send email to magenta...@tensorflow.org
To unsubscribe from this group, send email to magenta-discu...@tensorflow.org
---
To unsubscribe from this group and stop receiving emails from it, send an email to magenta-discu...@tensorflow.org.

Virgile Boulanger

unread,
Aug 17, 2022, 4:51:56 AM8/17/22
to Magenta Discuss, jesse...@google.com, Magenta Discuss, Virgile Boulanger, simonfa...@gmail.com
Hi,  thanks your feedbacks ! 

@Simon 
We didn't think about it but this kind of experience for kids totally makes sense ;) 
Concerning the camera, I guess it flipped orientation when the phone turned and the directions are not in sync anymore ... this is an experimental feature ;) 

@Jesse
Yes we will try to do an Android version !

Best, 
Virgile
Reply all
Reply to author
Forward
0 new messages