Is it possible to improve granularity of the teeth region for an AR lipstick effect?

[Dennis Lysenko]

Hey all.

I'm working on an AR makeup application, using the legacy MediaPipe face mesh solution, with attention.

For most things it works really well.

However, I'm finding that the texture coordinates are really cramped together around the lips and teeth. This makes it very hard to create a lipstick effect, as the lip area seems to spill onto the teeth in many practical examples.

If you stay within the visible "lip" bounds, it basically looks like you painted the lipstick onto half of the lip; if you go into the teeth, it paints over the teeth, since the texture map is very few pixels of height for the teeth area, and that area gets stretched over the polygons drawing the teeth (themselves not 100% exact, so it's quite unforgiving).

Has anyone been able to successfully achieve an AR makeup lipstick effect with the attention mesh? I'm probably missing something.