RGB image?

[wagedu]

Hi,

first of all: tryplex's been a present so thank you very much!

I'm actually rebuilding with Synapse + tryplex a project of mine, which mixes gestures with live caption & chroma, and also controls two motors through serial port.

It was originally built in Flash (no kidding) then translated using Visual Studio and is fully functional but... it's all too patchy.

Now, I'm trying to rebuild it once more using Synapse + Tryplex but I can't find a way into the RGB video from the Kinect camera. The Kineme and Open Kinect patches deliver empty screens if Synapse is running.

So, please, is there a way I can mix the skeleton joints + RGB image + depth image?

I want to integrate the RGB image + the depth image (+ some smart blur) to get a really smooth distance-based mask like in http://kineme.net/forum/Discussion/Jobs/WanttouseKinecttocreateMattandreplacegreenscreen 

this way I could get rid of the blue wall that my project currently needs.

And then integrate it with Synapse's skeleton joints information to keep the interactivity level of skeleton tracking. This makes it a really inmersive experience.

If you could hint me to a solution, help me bring the RGB image into the project, I'd be almost done. I'm still in doubt if QC is a good idea for sending commands to the serial port.

Thanks,

[Sebastian Kox (gMail)]

Hi,

> Now, I'm trying to rebuild it once more using Synapse + Tryplex but I can't find a way into the RGB video from the Kinect camera. The Kineme and Open Kinect patches deliver empty screens if Synapse is running.

This is because the kinect is in use by synapse, I think only one app/driver can access the kinect at a time.

> So, please, is there a way I can mix the skeleton joints + RGB image + depth image?

It's possible, but then you should dive into the synapse source code, and figure out how to send the RGB image.
http://synapsekinect.tumblr.com/post/6305020721/download

> I want to integrate the RGB image + the depth image (+ some smart blur) to get a really smooth distance-based mask like in http://kineme.net/forum/Discussion/Jobs/WanttouseKinecttocreateMattandreplacegreenscreen
> this way I could get rid of the blue wall that my project currently needs.
> And then integrate it with Synapse's skeleton joints information to keep the interactivity level of skeleton tracking. This makes it a really inmersive experience.

For prototyping purposes you could also consider using a PSEYE camera, I found that the lens angle is quite comparable to the kinects' when you place in on top.

> If you could hint me to a solution, help me bring the RGB image into the project, I'd be almost done. I'm still in doubt if QC is a good idea for sending commands to the serial port.

I had mixed results with QC on controlling serial. It has problems with opening and closing a port, meaning a restart of QC to use it again, and some protocols don't seem to work.
I found it better and more stable to have a dedicated processing serial app that's controlled trough OSC with QC.

>
> Thanks,

[wagedu]

Hi Sebastian, thanks for the comments.

It was already clear to me that only one driver/access to the Kinect, but messing with Synapse's code is waaaay above my head.

So either I wait for "someone" who can access (and send) skeleton + RGB + Depth, or I'll have to go the PSEYE way... But having to attach a 2nd camera when I have a Kinect...

And also thanks for the opinion of someone who's already walked the QC->Serial path. I'll stick to OSC then.

Just in case... any idea where's a discussion group for Synapse? I'd prefer to try there first before emailing the author.

[Sebastian Kox (gMail)]

Hi,

There isn't, best to contact the developer!

Ciao,

Sebastian.

[Josue Abraham]

Hi Sebastian , maybe this can help  

Kinect RGBDemo v0.6.1

http://nicolas.burrus.name/index.php/Research/KinectRgbDemoV6#tocLink1

i found this libraries for kinect,  it have some gut options like rgb, 3d capturing, and multiple kinect cameras.   It says works whit Open Ni.

it would be great to bring this capabilities to  QC

is some body woking on that??  

[stu shapiro]

How about using OSCeleton to free up the RGB image that synapse is utilizing? 

Did you ever work this out?