HOW TO SET UP LIP SYNC?

[BORICUA CHRONICLES]

HELLO GUYS, again thanks so much for making OPEN TOONZ available to us.
I have a project and need to do lip sync with PAPAGAYO. I have no clue how to go about it correctly.  I have imported the .dat file correctly but do not know where to go on after that. Please help I need to get this done before new years eve.

[BORICUA CHRONICLES]

I am using OT 1.2 btw

[BORICUA CHRONICLES]

[BORICUA CHRONICLES]

Thats as far as I get. I tried getting info from YUTUBE but it dosent apply to OT1.2

[joshua shute]

1.draw your mouth shapes

2 right click on the level containing your mouth drawings in the xsheet and select "apply lip sync data to column".

3 in the popup menu, choose mouth shapes for appropriate phonemes and select your data file and hit apply.

[joshua shute]

in the image you attached, you've selected level F which only has one blank drawing. select a different level with your mouth images first then open the pop up.

[Rodney]

Joshua,

Thank you for your description.

I've been meaning to give the Lip Sync feature a test and your post inspired me to finally give it a shot.

It works great!  

I did have an initial difficulty getting anything working but that was primarily because I didn't have a papagayo file and associated wav file handy.

Once I had those in place everything worked quite well.

[joshua shute]

heya Rodney,

I played around with it back when it was added to OTX. The devs(Jeremy) did an awesome job fixing little stupid things that happens in papagayo (removing excessive "etc"s for instance).

 I found in most cases it was actually faster for me to do "straight forward lip syncing" in opentoonz then it was to mess about with papagayo but it's always good to have options.

*puppy dog eyes*

The auto lip sync feature in toonboom harmony is actually the only feature I genuinely miss. Lightning fast lip syncing. The thing analyzes audio files and breaks apart the phonemes. It's the same popup window as opentoonz but no need for papagayo.

*puppy dog eyes*

[Rodney]

Yes, like you I don't have much use for auto lipsync... well I have use for it but find that straight forward lipsync works best for my needs especially since in more extended animation every drawing is different and unique.

I was impressed with the first results coming out of the lipsync application (it was an Arnold type character saying 'Hasta La Vista Baby') but my second attempt was a mess.

Ouch.  Painful.  gah.

This likely had more to do with the images that I fed into the setup but... not good at all.

My primary interest in Jeremy's lipsync tool was actually automation... but not necessarily lipsync.

The heavy reliance on Papagayo to drive that automation would make that approach unwieldy.

BUT it's great to know this works if and when I need it.  

And it's important for me to firstly and foremostly think of the intended usage.

Often before I've learned that intended usage I'm already distracted by a tools other possibilities.

Working with the Q and W keys to quickly move through lip poses works very well and I'd love to perfect a workflow that uses the Lipsync tool to get the initial sync laid in.

The issue with lipsync (and Papagayo as far as I can tell) is that it doesn't have a good grasp on emphasis, inflection and such that can often be leveraged by an animator that takes the time to study the dialogue and the performance and find just the right mouth shape to fit that moment.  This is relatively straightforward for flat 2D characters but when dealing with characters with depth the orientation of the body must also be taken into consideration.

I have a lot of thoughts and theories but I've still got a long way to go before I master lipsync.  ;)

[joshua shute]

always thinking outside the box, ay?

There has been a plan on my part to make a video or two running through how I approach the lip-sync process in opentoonz as the subject has come up a few times here and there. the method is easy and it looks more polished than drawings of mouths flipping back and forth. perhaps this thread will be that extra push I need to whip those puppies up.

start your mouth shapes in vector. so much flexibility. Are you primarily vector or raster?  I feel like I've seen you use both.

The issue with lipsync (and Papagayo as far as I can tell) is that it doesn't have a good grasp on emphasis, inflection

most will hit apply on this feature and consider it done which is not bad necessarily but it's not great either. However, if papagayo is only used as a jumping off point, some very diverse and organic results can be achieved. folks just need to take those extra few steps.

[Rodney]

Are you primarily vector or raster?

I use them both as they each have their strengths and weaknesses.

My affection for both raster and vector began back in the CorelDraw 3 days where I began to use workflows that utilized both.

The question largely becomes one of benefits and constraints... and you mention an important one with lipsync.

Creating mouths (on a separate Level) in vector can allow for easy changes... and great automatic inbetweening as vectors allow for such while raster (and Toonz raster) will not.

Vector is resolution independent.

Raster is not.

Raster has MyPaint brushes.

Vector does not.

Toonz raster is a great mid point between those two with some of the strengths (and weaknesses) of both vector and raster.

But I find Toonz raster to be the go to level type for quickly laying down lines and filling them with color.

The list of strengths and weaknesses could go on and on... (I'd love to create a cheat sheet but it's better to just learn through experience especially as things will change and make that cheat sheet obsolete .)

Which one I prefer often depends on which one I am using.  ;)

Currently, my favorite level Type is Toonz Raster and I find that a very happy medium and starting point... I love the overly generic line I can get with that.

But it's a rare drawing or animation from me that doesn't also have elements of vector and raster.

I'm closing in on a workflow where I convert between all three level types rapidly but I'm not quite there yet.

The goal (in this case at least ) is to be very fast.  ;)