Image projection to touch

[Sharie Ingente]

Hi! we have a problem with the kinect bundle. I would like to ask what is your advisable min and max distance for an image projection to touch instead using LCD screen. This our project so i am looking forward that you can help me on this. thanks. can you also please explain  the other functions of the software.

[Nicolas Zalaquett]

Hi Sharie,

The distance depends on the size of the intended touch surface and the desired resolution. To use with "finger" resolution some 1 to1.8 mt should do it. If what you want lower resolution (couple of fingers or a hand) you can maybe go up to 3 mts. If you need "feet" resolution (touch floor for example) you can go up to 4-4.5 mts (with lots of difficulties). Each calibration is just trial and error. 

The main functions of LKB are : 

- Multitouch Surfaces : You already know about this one

- Skeleton tracking : Track skeleton Joints using NITE and send their positions through TUIO to other apps.

- Hand tracking : Tracking of hand with "Push method" that means recongition of hand with a threshold for "visible surface". This function is usable when you want to hoover a screen using your hands and after make a "click"

- 3d Viewer : Small example so you can see what kinect sees. You can also calibrate 2 cameras to get extra "3d" field of view. 

- TUIO multiplexer, gestures and screen calibrator : With this you can : 

                Resend the TUIO data you receive "probably from a very different source than kinect, even though you can send from kinect to this) 

                Calibrate the screen of a different computer from the one doing the detection. You can use one pc to detect, send the data through TUIO and then receive and calibrate on another. 

                This is useful if your visual application is CPU intensive 

                Make simple gestures (to be sent as TUIO objects to any software listening)

Hope this answer helps

Cheers!

 

On Sat, Nov 24, 2012 at 11:40 AM, Sharie Ingente <sharie...@gmail.com> wrote:

Hi! we have a problem with the kinect bundle. I would like to ask what is your advisable min and max distance for an image projection to touch instead using LCD screen. This our project so i am looking forward that you can help me on this. thanks. can you also please explain  the other functions of the software.

--
 
 

[Sharie Ingente]

Hi! Thank you very muh for your response. Our thesis is about your work because it is really interesting. Hmm by the way, do you have an idea how to send the TUIO message from the kinect to a device? We are planning to send the message so we can control an android device which is similar with the one you hve explained on the TUIOmultiplexer. We tried TUIOService application and intalled it on a mobile phone but it didnt work. Hoping you could help us on this. By the way, i am an electronics engineering student from Philippines

--
 
 

[Sharie Ingente]

Hi! I hope you would reply on this. I will just ask what are the applications that can be controlled by the lkb just like the mt4j. 

On Saturday, November 24, 2012, Sharie Ingente wrote:

Hi! we have a problem with the kinect bundle. I would like to ask what is your advisable min and max distance for an image projection to touch instead using LCD screen. This our project so i am looking forward that you can help me on this. thanks. can you also please explain  the other functions of the software.

--
 
 

[Nicolas Zalaquett]

Hi Sharie, there are many processing examples with tuio support.
If you want to use it in  android you can:
1:use mt4j for android
2:create an android app that receives tuio data (using the java tuio reference that you can find in tuio.org)
3:a harder option, inject the tuio events in the systems as a touch event. If you search skt and android in google you will find that a guy did this but had to use a rooted phone and a modded firmware.

Kivy also has a lot of nice examples using tuio.
OpenFrameworks too.

Hope this helps,
cheers!
Nico

--
 
 

[Sharie Ingente]

Hi Nico,

I am very thankful for your replies. One more thing, how can I send the tuio events from the LKB to the android phone having MT4j for android installed? I tried to manipulate the TUIO multiplexer but I was not able to do well. Any ideas? I am sorry for lots of questions. I am jut newbie here and just researching for thesis.

--
 
 

[Nicolas Zalaquett]

Hi Sharie,
I'm not completely sure that mt4j accepts tuio in android, but, if it does, you can change the ip to your cell's ip and the port to 3333 in the tuio sender and data extractor window. Just be sure to have both devices (pc and cell phone) in the same WiFi network. The next problem will probably be calibration, I'm almost sure that mt4j accepted only 0-1 values in x-y coordinates from tuio. Just calibrate aprox with the point calibration.
Good luck!

--
 
 

[Sharie Ingente]

Hi Nico,

I have solved my problems. I am very thankful for your replies. I used the BSQsimulator instead and works fine. By the way I have noticed that LKB doesn't work on windows 8.

--
 
 

[Sharie Ingente]

By the way, I can't find the link on QT SDK 4.8 with qt creator. I look up on their site and there's only qt creator 2.6.1 available. Any idea where I can download the installer? Thanks!

[Sharie Ingente]

[Sharie Ingente]

Hi Nico,

I found out that the LKB has lot of features. I just need the 2D camera part because all I need is to make surface a touch screen. I have no idea how to modify this. can you give me some tips?

--
 
 

[Sharie Ingente]

I tried opening the .pro file in my qt creator. When I build the project, it tells that openvcv_core233 is not found and need to install it again. On your instruction, it was not stated that I should install opencv right? Any ideas? The instruction you have given is very concise so I was not able to fully understand it.

--
 
 

[nzrock]

Hi Sharie, no, you probably will not need to compile or install opencv, we have included a version in the libs dir. Just be sure that the LD path in the .pro file that points at the locations of the libraries is correct and then, after building, copy all the dlls in the libs folder inside the release folder where you have your new recently compiled lkb.exe file.
Good luck!