Lip-syncing with Rhubarb and OpenToonz

[Jane Eyre]

In exciting news, Rhubarb Lip Sync can now output the .dat files that OpenToonz uses for lip syncing! This results in extremely fast lip syncing. While it would be amazing to see this directly integrated with OpenToonz at some point, for now we can use command line to run Rhubarb and then use the generated .dat file in OpenToonz.

I use macOS, so these directions are mac specific:

1. Download the release of rhubarb for your OS from https://github.com/DanielSWolf/rhubarb-lip-sync/releases 

2. Unzip the rhubarb directory - I moved mine onto the Desktop

3. Place your audio file in the same parent directory (ie. Desktop)

4. Open Terminal

5. Open the parent directory (ie. Desktop) directory by typing:

cd ~/Desktop (then press enter)

6. Type the following, customizing as needed:

rhubarb-lip-sync-1.10.0-osx/rhubarb -o outputname.dat -f dat --datUsePrestonBlair youraudiofile.wav (then press enter)

Step 6 is specifying the:

rhubarb path: rhubarb-lip-sync-1.10.0-osx/rhubarb

output name: -o outputname.dat (the exact name can be customized)

output format: -f dat

mouth type: --datUsePrestonBlair

audio file: youraudiofile.wav (the exact name can be customized, should be listed last)

7. In OpenToonz, load your audio file into a scene and use the "Apply Lip Sync Data to Column" command on a level of Preston blair mouths (this works best when only the first frame is exposed in the Xsheet) - select the generated .dat file

Personally I'm really excited to have a compatible lip-sync option on macOS. The last release of Papagayo only partially works and Papagayo-NG is only an option if you build yourself.

[jp parks]

Thanks Jane Eyre anyone know how to use this with Windows? It would be very Helpful for me because I cant seem to get Papagayo to work correctly.

[DarrenT]

Windows instructions:

Full Rhubarb instructions at: https://github.com/DanielSWolf/rhubarb-lip-sync

Download from: https://github.com/DanielSWolf/rhubarb-lip-sync/releases

To run the command line to create a data file to use with OpenToonz:

1. Download the latest version (rhubarb-lip-sync-1.10.0-win32.zip)

2. Unzip it and copied it to a local folder (I copied it to: C:\Program Files (Local)\Rhubarb).

3. Open a command line window and type the following line (assuming that you've got your audio file in C:\Temp):

  "C:\Program Files (Local)\Rhubarb\rhubarb.exe" "C:\Temp\test.wav" -f dat --datUsePrestonBlair -o "C:\Temp\output.dat"

This creates the data file in your C:\Temp folder.

Or you can download a GUI for this, from my GumRoad site: https://gumroad.com/DarrenTAnims

[Explosion Implosion]

So how exactly do I mport a .dat into opentoonz? Also I though the .dat file is only the latters and for how long…

[Jane Eyre]

You should create a level with the different drawings for the mouth. Leave only the first drawing exposed in the Xsheet. In the Xsheet menu there's an option to apply lip-sync data to a column - select that, line up the drawings & connect the .dat file.

[Explosion Implosion]

Okay, thanks! :)