How to fit 3DMM using Scalismo-faces

[Hao Zhou]

Hi,
I am trying to use Scalismo-faces to fitting 3DMM on a face and get all the parameters (e.g. parameters of shape, albedo and spherical harmonics). I have gone through the tutorial of model fitting part, but still don't know how to do it ( I am not familiar with Jave nor Scala). Is there a sample code which I could use to do that without the interface (I have tried the code in the tutorial, but it won't work in the Scalismo-faces project, it seems there are a lot of packages that are not appear in this project https://github.com/unibas-gravis/scalismo-faces).

Thanks in advance

[Andreas Forster]

Dear Hao,

To help you we need a lot more information.

What do you mean by "... tried the code in the tutorial... won't work in the Scalismo-faces project.... ".? What have you done exactly? Can you give us more information about your project setup (build.sbt), what is a minimal code example that did not work and what error did you get?

Were you able to run the example as described in the README to ensure that you have successfully configured a project with scalismo-faces as a dependency?

Best regards

Andreas

--
You received this message because you are subscribed to the Google Groups "scalismo-faces" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scalismo-faces+unsubscribe@googlegroups.com.
To post to this group, send email to scalism...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scalismo-faces/971f2c13-f777-42e6-9099-03acde3fb1c5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

*****************************************

Dr. Andreas Morel-Forster
Departement Mathematik und Informatik
Spiegelgasse 1
CH-4051 Basel
PHONE: +41 61 207 05 52

MAIL: Andreas.Forster@unibas.ch
*****************************************

[Hao Zhou]

Hi Andreas,

I am now able to run the image fitting code in tutorial under the project of Scalismo-faces. However, the results on our own image are very bad. We believe this is because the sample code in tutorial does not include landmark information. I am wondering whether you could provide a complete sample code how to fit a 3DMM model with landmark under Scalismo-faces project. We tried to implement it based on the tutorial, but it does not work. We now have no idea whether it is our implementation is wrong or our landmark preparation is wrong (we use the CLandmark to detect the landmark of the face, but we don't know how you cold get the heat map for each of the landmark, so we simply filter the landmark with a Gaussian filter. As a result, our heat map looks quite different from those provided in the data folder).

Also have you published your code for the paper: Occlusion-aware 3D Morphable Models and an Illumination Prior for Face Image Analysis?

Best Regards.
Hao

Andreas Forster於 2018年1月19日星期五 UTC-5下午5時10分07秒寫道：

Dear Hao,

To help you we need a lot more information.

What do you mean by "... tried the code in the tutorial... won't work in the Scalismo-faces project.... ".? What have you done exactly? Can you give us more information about your project setup (build.sbt), what is a minimal code example that did not work and what error did you get?

Were you able to run the example as described in the README to ensure that you have successfully configured a project with scalismo-faces as a dependency?

Best regards

Andreas

On Fri, Jan 19, 2018 at 5:19 PM, Hao Zhou <zhh...@gmail.com> wrote:

Hi,
I am trying to use Scalismo-faces to fitting 3DMM on a face and get all the parameters (e.g. parameters of shape, albedo and spherical harmonics). I have gone through the tutorial of model fitting part, but still don't know how to do it ( I am not familiar with Jave nor Scala). Is there a sample code which I could use to do that without the interface (I have tried the code in the tutorial, but it won't work in the Scalismo-faces project, it seems there are a lot of packages that are not appear in this project https://github.com/unibas-gravis/scalismo-faces).

Thanks in advance

--
You received this message because you are subscribed to the Google Groups "scalismo-faces" group.

To unsubscribe from this group and stop receiving emails from it, send an email to scalismo-face...@googlegroups.com.

To post to this group, send email to scalism...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scalismo-faces/971f2c13-f777-42e6-9099-03acde3fb1c5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

*****************************************

Dr. Andreas Morel-Forster
Departement Mathematik und Informatik
Spiegelgasse 1
CH-4051 Basel
PHONE: +41 61 207 05 52

MAIL: Andreas...@unibas.ch
*****************************************

[Bernhard Egger]

Hi Hao,

what you need is actually the last step of the Basel Face Pipeline:

https://github.com/unibas-gravis/basel-face-pipeline

Our defaultFitscript follows our publications:

https://github.com/unibas-gravis/basel-face-pipeline/blob/master/src/main/scala/fitting/StandardFitScript.scala

To run it on images this code can be helpful:

https://github.com/unibas-gravis/basel-face-pipeline/blob/master/src/main/scala/fitting/experiments/QualitativeLFW.scala

The code of our publication "Occlusion-aware 3D Morphable Models and an Illumination Prior for Face Image Analysis" is already part of scalismo-faces. A fitscript will be released till end of January in form of a new tutorial.

The Illumination prior of this paper is already available here: http://gravis.dmi.unibas.ch/PMM/data/bip/

Best

Bernhard

[Hao Zhou]

Hi Bernhard,

Thanks for your quick reply, I will try the code you mentioned.

Best
Hao

Bernhard Egger於 2018年1月23日星期二 UTC-5上午1時00分46秒寫道：