using raw face data to build shape and color models

72 views
Skip to first unread message

ATUHAIRE FELIX

unread,
Mar 28, 2019, 5:30:57 AM3/28/19
to scalismo-faces
Dear all,

I have acquired 3D face scans using a 3D scanner. The scans are in TOM file extension format. The scans are in a RAW form.
I cloned the Basel face pipeline master and then opened it in intellij IDE. The pipeline contains packages with methods such as fitting, model building, preprocessing, and registration.

Questions:
Is the TOM file extension from my data supported or I need to convert the scans into a different format?
How do I move from raw data to preprocessing, registration and then building the models using the pipeline master.? I am quite unsure. I would love a detailed description.
Do I need to landmark the raw data?

Regards,
Felix

Andreas Forster

unread,
Mar 28, 2019, 5:59:32 AM3/28/19
to ATUHAIRE FELIX, scalismo-faces
Hi Felix,

Welcome to the community. Unfortunately we do not support the .TOM file format. I also do not know the format. What type of scanner do you use? We currently support .vtk, .stl, .ply and .h5 format. We recommend to use the .ply format if you have more than just the 3d surface geometry.

The Idea of the pipeline is:
- Preprocessing: Code to take arbitrary data and convert it to the expected folder structure and data format.
- Registration: Use the preprocessed data and establish correspondence, i.e. replace all target surfaces with a deformed version of the reference.
- Model building: Use the registered meshes and the texture / color extraction to build a face model with shape and color.

Yes, the pipeline needs landmarks at least for the initial alignment. You can manually landmark your data by using e.g. scalismo-ui. But you can also replace the calculation of the alignment
val alignmentTransform = LandmarkRegistration.similarity3DLandmarkRegistration(correspondingLandmarkPoints, center = Point(0.0, 0.0, 0.0))
in the function registration.Registration.run() with something else. The registration afterward can use landmarks but does not rely on landmarks being present. However, we have seen that good landmarks improve the results usually.


Best regards,
Andreas


--
You received this message because you are subscribed to the Google Groups "scalismo-faces" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scalismo-face...@googlegroups.com.
To post to this group, send email to scalism...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scalismo-faces/2e16a25c-2d27-4f9b-83e1-1e58422495b9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


--
*****************************************
Dr. Andreas Morel-Forster
Departement Mathematik und Informatik
Spiegelgasse 1
CH-4051 Basel
PHONE: +41 61 207 05 52
MAIL: Andreas.Forster@unibas.ch
*****************************************

ATUHAIRE FELIX

unread,
Mar 29, 2019, 3:49:50 AM3/29/19
to Andreas Forster, scalismo-faces
Thank you Andreas. TOM file format is commonly known as triangulated oriented manifold. We do have a Vectra h1 imaging system manufactured by Canifield  Scientific. Let me try to convert the data in the required file format. I will be update you on the progress. Thank you again.

Regards,
Felix
--
Felix Atuhaire Mulumba
MSc candidate in Biomedical Engineering
University of Cape Town, South Africa.
Skype: felix.atuhaire | linkedin: www.linkedin.com/in/felix-atuhaire-a9a14361

Reply all
Reply to author
Forward
0 new messages