Generate a real time 3D (mesh) model in Unity using Kinect

[nuno.ma...@gmail.com]

Greetings,

I'm currently developing an application with the initial goal of obtaining, in real time, a 3D model of the environment "seen" by a Kinect device. This information would be later on used for projection mapping but that's not an issue, for the moment.

There are a couple of challenges to overcome, namely the fact that the Kinect will be mounted on a mobile platform (robot) and the model generation has to be in real-time (or close to it).

After a long research on this topic, I came up with several possible (?) architectures:

1) Use the depth data obtained from Kinect, convert it into a point cloud (using PCL for this step), then a Mesh and then export it into Unity for further work.

2) Use the depth data obtained from Kinect, convert it into a point cloud (using PCL for this step), export it into Unity and then convert it into a Mesh.

3) Use KinectFusion that already the option of creating a Mesh model, and (somehow) automatically load the Mesh model created into Unity.

4) Use OpenNI+ZDK (+ wrapper) to obtain the depth map and generate the Mesh using Unity.

Quite honestly, I'm kinda lost here, my main issue is the real-time requirement along with being forced to integrate several software components makes this it tricky problem. I don't know which if any of these solutions are viable and the information/tutorials on these issues isn't exactly abundant like the one, for example, for Skeleton tracking .


Any sort of help would be greatly appreciated.

Regards,
Nuno

[Pulkit Budhiraja]

Hi Nuno

I am starting a project that requires me to do the exact same things that you have described in this post. Did you find any relevant help to do this? Did you manage to complete it? So far, I've found this post https://groups.google.com/forum/#!topic/unitykinect/cLREp_BAnEs that seems to contain some helpful information. However, this post is 3 years old and I don't know if it will work. People have mentioned a couple of bugs when they were trying to run it. I am going to give it a try since this seems like the only relevant starting point for me right now. 

Thanks

Pulkit

[Nuno Costa]

Hello Pulkit,

I'm still developing the (Unity) application and so far I've achieved projection mapping with some success however I ended up taking another approach that doesn't envolve generating a point cloud/mesh in real-time so I'm afraid I won't be much of a help. That change was due to some factors: projects software requirements (namely OS) to possible performance issues of the application's performance while doing such an computacional intensive task that would affect the projection itself.

Regards,

Nuno

--
You received this message because you are subscribed to a topic in the Google Groups "unitykinect" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/unitykinect/fsBUVRLHKdQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to unitykinect...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Chop Labalagun]

Can you share, how to get the Point Cloud with Kinect in Unity?

[Kevin Roy]

hello!

Did you manage to do that using depthmaps and projection maps ?
Did you make use of Height maps in unity ?