WISH LIST: Any volunteers?
56 views
Skip to first unread message
AMB
Mar 25, 2011, 10:12:34 AM3/25/11
to AS3OpenNI
The following is a list of developer challenges that I could use
anyone's help with in achieving.
If you look here you can easily get inspired: http://www.kinect-hacks.com/
1. Get the AS3OpenNI binary to work with Node.js and come up with some
examples that works in the browser.
2. A sweet 3D skeleton avatar example would be cool.
3. Getting multiple player detection working.
4. Hand/Finger detection would be sweet too!
5. Getting the code ported over to just compile as a SWC, that way
AS3OpenNI, could run completely native in Flash/Flex and Air apps.
Adobe Alchemy is where to start: http://labs.adobe.com/technologies/alchemy/.
6. Spread the word and post up as many video examples as you can on
YouTube, and let the http://www.kinect-hacks.com people know too.
7. And more and more examples would be great, the creative
possibilities are endless.
I'm sure there's a lot more, but start with this and thanks in
advance!
AMB
anyone's help with in achieving.
If you look here you can easily get inspired: http://www.kinect-hacks.com/
1. Get the AS3OpenNI binary to work with Node.js and come up with some
examples that works in the browser.
2. A sweet 3D skeleton avatar example would be cool.
3. Getting multiple player detection working.
4. Hand/Finger detection would be sweet too!
5. Getting the code ported over to just compile as a SWC, that way
AS3OpenNI, could run completely native in Flash/Flex and Air apps.
Adobe Alchemy is where to start: http://labs.adobe.com/technologies/alchemy/.
6. Spread the word and post up as many video examples as you can on
YouTube, and let the http://www.kinect-hacks.com people know too.
7. And more and more examples would be great, the creative
possibilities are endless.
I'm sure there's a lot more, but start with this and thanks in
advance!
AMB
Homer
Mar 28, 2011, 5:59:26 AM3/28/11
to AS3OpenNI
Hi,
First of all, nice job !
I have some questions about the C++ socket part.
When transmitting gestures like swipe, circle, etc, do you pass other
arguments like velocity, angle, etc. ?
Is there a velocity property for trackpad2D, too ?
Then, in your AS3 classes, I noticed a method for depthMap management.
Is this code working ?
I would appreciate if you provide a sample with a depth map generation
with flash.
Thanx for your help.
Regards,
Homer.
On 25 mar, 16:12, AMB <mosaic...@gmail.com> wrote:
> The following is a list of developer challenges that I could use
> anyone's help with in achieving.
> If you look here you can easily get inspired:http://www.kinect-hacks.com/
>
> 1. Get the AS3OpenNI binary to work with Node.js and come up with some
> examples that works in the browser.
>
> 2. A sweet 3D skeleton avatar example would be cool.
>
> 3. Getting multiple player detection working.
>
> 4. Hand/Finger detection would be sweet too!
>
> 5. Getting the code ported over to just compile as a SWC, that way
> AS3OpenNI, could run completely native in Flash/Flex and Air apps.
> Adobe Alchemy is where to start:http://labs.adobe.com/technologies/alchemy/.
>
> 6. Spread the word and post up as many video examples as you can on
> YouTube, and let thehttp://www.kinect-hacks.compeople know too.
First of all, nice job !
I have some questions about the C++ socket part.
When transmitting gestures like swipe, circle, etc, do you pass other
arguments like velocity, angle, etc. ?
Is there a velocity property for trackpad2D, too ?
Then, in your AS3 classes, I noticed a method for depthMap management.
Is this code working ?
I would appreciate if you provide a sample with a depth map generation
with flash.
Thanx for your help.
Regards,
Homer.
On 25 mar, 16:12, AMB <mosaic...@gmail.com> wrote:
> The following is a list of developer challenges that I could use
> anyone's help with in achieving.
> If you look here you can easily get inspired:http://www.kinect-hacks.com/
>
> 1. Get the AS3OpenNI binary to work with Node.js and come up with some
> examples that works in the browser.
>
> 2. A sweet 3D skeleton avatar example would be cool.
>
> 3. Getting multiple player detection working.
>
> 4. Hand/Finger detection would be sweet too!
>
> 5. Getting the code ported over to just compile as a SWC, that way
> AS3OpenNI, could run completely native in Flash/Flex and Air apps.
> Adobe Alchemy is where to start:http://labs.adobe.com/technologies/alchemy/.
>
> 6. Spread the word and post up as many video examples as you can on
AMB
Mar 28, 2011, 3:05:42 PM3/28/11
to AS3OpenNI
Hey Homer-
Thanks for the remarks, much appreciated. You helped me notice
something that was missing, thanks for that. For the gestures, push,
swipe left, swipe right, swipe up, and swipe down both the velocity
and angle data is available. And for the steady hand only the velocity
value is available. As for the track pad it does give you the left to
right value and up and down values, similar to the slider data. As for
the depth map, yeah that code was a work in progress on version 1.0.5.
So here's what is projected to be available out on the next release:
* DepthMap Capture socket added, plus image quality control
* RGB Capture socket added, plus image quality control
* More Command Line Parameters added
# -dmq 1 || DepthMapCapture quality, 0 = Low, 1 = Average, 2 =
High, 3 = Super High, default is 1
# -rgbq 1 || RGBCapture quality, 0 = Low, 1 = Average, 2 = High, 3
= Super High, default is 1
# -grey || RGBCapture render in grayscale, default is false
# -snap || Snap the RGBCapture pixels with the DepthMapCapture
pixels, default is false
* Per Homer's request, Velocity and Angle data available for the
Gestures, Push Detector, Swipe Left, Swipe Right, Swipe Up, and Swipe
Down.
* For the Steady Hand Detector the Velocity data will be available
to.
* The TrackPad feature will also provide Left and Right values and
Up and Down values.
I'll have it available soon, just finishing up a few things!
AMB
------
> > YouTube, and let thehttp://www.kinect-hacks.compeopleknow too.
Thanks for the remarks, much appreciated. You helped me notice
something that was missing, thanks for that. For the gestures, push,
swipe left, swipe right, swipe up, and swipe down both the velocity
and angle data is available. And for the steady hand only the velocity
value is available. As for the track pad it does give you the left to
right value and up and down values, similar to the slider data. As for
the depth map, yeah that code was a work in progress on version 1.0.5.
So here's what is projected to be available out on the next release:
* DepthMap Capture socket added, plus image quality control
* RGB Capture socket added, plus image quality control
* More Command Line Parameters added
# -dmq 1 || DepthMapCapture quality, 0 = Low, 1 = Average, 2 =
High, 3 = Super High, default is 1
# -rgbq 1 || RGBCapture quality, 0 = Low, 1 = Average, 2 = High, 3
= Super High, default is 1
# -grey || RGBCapture render in grayscale, default is false
# -snap || Snap the RGBCapture pixels with the DepthMapCapture
pixels, default is false
* Per Homer's request, Velocity and Angle data available for the
Gestures, Push Detector, Swipe Left, Swipe Right, Swipe Up, and Swipe
Down.
* For the Steady Hand Detector the Velocity data will be available
to.
* The TrackPad feature will also provide Left and Right values and
Up and Down values.
I'll have it available soon, just finishing up a few things!
AMB
------
AMB
Mar 28, 2011, 6:57:26 PM3/28/11
to AS3OpenNI
Hey Homer-
I noticed something else too, when using the TrackPad example you
could also just setup the listeners for the Slider events that go left
and right and up and down those are already available in the NISlider
example.
Let me know if that helps,
AMB
----
I noticed something else too, when using the TrackPad example you
could also just setup the listeners for the Slider events that go left
and right and up and down those are already available in the NISlider
example.
Let me know if that helps,
AMB
----
Homer
Mar 29, 2011, 6:36:54 AM3/29/11
to AS3OpenNI
Hey
Thanks again for your answers.
I found yesterday the slider listener solution, i'ts ok.
By the way, I didn't see your c++ code in detail but what about using
UDP sockets, with non-connected mode ?
Before I found your As3 wrapper, I was working on a Flex / Kinect
exchange project which included both TCP & UDP communication
protocols.
And I saw that UDP was a better way to transmit real-time data like
coords.
UDP is nicely implemented in ActionScript and the API isn't really
difficult to use.
In addition to that, the c++ code part is pretty simple, too.
But like I said before, maybe you've already used this ! ;)
I look forward to your next release !
Thanks again for your answers.
I found yesterday the slider listener solution, i'ts ok.
By the way, I didn't see your c++ code in detail but what about using
UDP sockets, with non-connected mode ?
Before I found your As3 wrapper, I was working on a Flex / Kinect
exchange project which included both TCP & UDP communication
protocols.
And I saw that UDP was a better way to transmit real-time data like
coords.
UDP is nicely implemented in ActionScript and the API isn't really
difficult to use.
In addition to that, the c++ code part is pretty simple, too.
But like I said before, maybe you've already used this ! ;)
I look forward to your next release !
AMB
Mar 29, 2011, 10:56:05 AM3/29/11
to AS3OpenNI
Hey Homer-
I did try UDP with the DepthMap and RGB data and found that it was too
large of data to send through UDP.
So I'm going to stick with TCP for that, as for the other real time
data I haven't tried it yet with UDP.
But thanks for your suggestion I'll look into it further and see what
I come up with. We could just set it up where you can have it work
with both protocols it really wouldn't hurt anything!
AMB
----
I did try UDP with the DepthMap and RGB data and found that it was too
large of data to send through UDP.
So I'm going to stick with TCP for that, as for the other real time
data I haven't tried it yet with UDP.
But thanks for your suggestion I'll look into it further and see what
I come up with. We could just set it up where you can have it work
with both protocols it really wouldn't hurt anything!
AMB
----
Homer
Mar 29, 2011, 11:02:17 AM3/29/11
to AS3OpenNI
Sure !
I will run more tests with UDP if I have the time... ;)
Bye
I will run more tests with UDP if I have the time... ;)
Bye
Homer
Apr 5, 2011, 4:58:13 AM4/5/11
to AS3OpenNI
My new suggestion / wish list ;)
- You probably heard about FAAST library : http://projects.ict.usc.edu/mxr/faast/
It seems that this library is managing a lot of new body gestures like
lean left, turn left, etc.
The skeleton part would be much improved with this.
- (more a question) Which way would you use to manage fingers
detection ? This part is, I think the most attractive part of the
project ;)
Homer.
- You probably heard about FAAST library : http://projects.ict.usc.edu/mxr/faast/
It seems that this library is managing a lot of new body gestures like
lean left, turn left, etc.
The skeleton part would be much improved with this.
- (more a question) Which way would you use to manage fingers
detection ? This part is, I think the most attractive part of the
project ;)
Homer.
AMB
Apr 5, 2011, 9:19:51 AM4/5/11
to AS3OpenNI
Hey Homer-
Yeah it looks cool, it looks like they don't have the code anywhere to
download and it only works on PC.
I'll look into it further, but adding more of these gestures in like
they did is definitely a possibility.
AMB
----
Yeah it looks cool, it looks like they don't have the code anywhere to
download and it only works on PC.
I'll look into it further, but adding more of these gestures in like
they did is definitely a possibility.
AMB
----
Homer
Apr 5, 2011, 12:17:35 PM4/5/11
to AS3OpenNI
Ok I didn't see there was only a release for PC.
Sorry for MAC users but I'm using a PC ;)
Sorry for MAC users but I'm using a PC ;)
AMB
Apr 7, 2011, 11:00:04 AM4/7/11
to AS3OpenNI
Hey Homer-
There is now AS code setup to work similar to the FAAST action list,
it has gesture detection for the following:
LEFT_ARM_FORWARD:String = "event:left_arm_forward";
LEFT_ARM_DOWN:String = "event:left_arm_down";
LEFT_ARM_UP:String = "event:left_arm_up";
LEFT_ARM_OUT:String = "event:left_arm_out";
LEFT_ARM_ACCROSS:String = "event:left_arm_across";
RIGHT_ARM_FORWARD:String = "event:right_arm_forward";
RIGHT_ARM_DOWN:String = "event:right_arm_down";
RIGHT_ARM_UP:String = "event:right_arm_up";
RIGHT_ARM_OUT:String = "event:right_arm_out";
RIGHT_ARM_ACCROSS:String = "event:right_arm_across";
LEFT_FOOT_FORWARD:String = "event:left_foot_forward";
LEFT_FOOT_SIDEWAYS:String = "event:left_foot_sideways";
LEFT_FOOT_BACKWARD:String = "event:left_foot_backward";
LEFT_FOOT_UP:String = "event:left_foot_up";
RIGHT_FOOT_FORWARD:String = "event:right_foot_forward";
RIGHT_FOOT_SIDEWAYS:String = "event:right_foot_sideways";
RIGHT_FOOT_BACKWARD:String = "event:right_foot_backward";
RIGHT_FOOT_UP:String = "event:right_foot_up";
You can check it out in the unstable trunk here:
http://as3openni.googlecode.com/svn/trunk/as3openni_common
And there's a file called 'FAASTExample.mxml' in the examples folder,
that shows how to set it up:
http://as3openni.googlecode.com/svn/trunk/examples
I'll be adding more gestures to it soon,
There is now AS code setup to work similar to the FAAST action list,
it has gesture detection for the following:
LEFT_ARM_FORWARD:String = "event:left_arm_forward";
LEFT_ARM_DOWN:String = "event:left_arm_down";
LEFT_ARM_UP:String = "event:left_arm_up";
LEFT_ARM_OUT:String = "event:left_arm_out";
LEFT_ARM_ACCROSS:String = "event:left_arm_across";
RIGHT_ARM_FORWARD:String = "event:right_arm_forward";
RIGHT_ARM_DOWN:String = "event:right_arm_down";
RIGHT_ARM_UP:String = "event:right_arm_up";
RIGHT_ARM_OUT:String = "event:right_arm_out";
RIGHT_ARM_ACCROSS:String = "event:right_arm_across";
LEFT_FOOT_FORWARD:String = "event:left_foot_forward";
LEFT_FOOT_SIDEWAYS:String = "event:left_foot_sideways";
LEFT_FOOT_BACKWARD:String = "event:left_foot_backward";
LEFT_FOOT_UP:String = "event:left_foot_up";
RIGHT_FOOT_FORWARD:String = "event:right_foot_forward";
RIGHT_FOOT_SIDEWAYS:String = "event:right_foot_sideways";
RIGHT_FOOT_BACKWARD:String = "event:right_foot_backward";
RIGHT_FOOT_UP:String = "event:right_foot_up";
You can check it out in the unstable trunk here:
http://as3openni.googlecode.com/svn/trunk/as3openni_common
And there's a file called 'FAASTExample.mxml' in the examples folder,
that shows how to set it up:
http://as3openni.googlecode.com/svn/trunk/examples
I'll be adding more gestures to it soon,
Homer
Apr 8, 2011, 7:07:45 AM4/8/11
to AS3OpenNI
Hi, this is a great news !
By the way, when you say "to work similar to the FAAST action list",
does it mean that you didn't use FAAST ?
Do you simulate these custom gestures by computing the skeleton joins
positions ?
I will check on it later, but thank you.
Homer.
By the way, when you say "to work similar to the FAAST action list",
does it mean that you didn't use FAAST ?
Do you simulate these custom gestures by computing the skeleton joins
positions ?
I will check on it later, but thank you.
Homer.
Tony Birleffi
Apr 8, 2011, 9:44:34 AM4/8/11
to as3o...@googlegroups.com
Yes, I'm simulating it with AS code. For now, until they release their C++ code.
But it seems to work either way,
AMB
On Apr 8, 2011 6:07 AM, "Homer" <homer...@gmail.com> wrote:
Hi, this is a great news !
By the way, when you say "to work similar to the FAAST action list",
does it mean that you didn't use FAAST ?
Do you simulate these custom gestures by computing the skeleton joins
positions ?
I will check on it later, but thank you.
Homer.
On Apr 7, 5:00 pm, AMB <mosaic...@gmail.com> wrote:
> Hey Homer-
>
> There is now AS code setup to ...
maurice
Apr 12, 2011, 2:19:38 AM4/12/11
to AS3OpenNI
Hi,
Just wanted to say I am also using your framework for my project. It
works like a charm! So thanks a million for the work work you put into
this!
Although I do know a bit of actionscript I am unable to contribute on
the C++ level. Therefor, I also feel a bit bad to make requests but I
also agree that Fingertracking would be an extremly cool feature
(there are some examples on YT and there is some opencv code
available). Esspecially for the UI designers among us: the full
posture gestures are cool but finger tracking allows scenarios beyond
our wildest dreams!
I'll be happy to post my examples when I finish them. I could also
make a donation to the project. I just hope you keep up the really
excellent work!!!!
-Maurice
On Apr 8, 3:44 pm, Tony Birleffi <mosaic...@gmail.com> wrote:
> Yes, I'm simulating it with AS code. For now, until they release their C++
> code.
>
> But it seems to work either way,
> AMB
>
Just wanted to say I am also using your framework for my project. It
works like a charm! So thanks a million for the work work you put into
this!
Although I do know a bit of actionscript I am unable to contribute on
the C++ level. Therefor, I also feel a bit bad to make requests but I
also agree that Fingertracking would be an extremly cool feature
(there are some examples on YT and there is some opencv code
available). Esspecially for the UI designers among us: the full
posture gestures are cool but finger tracking allows scenarios beyond
our wildest dreams!
I'll be happy to post my examples when I finish them. I could also
make a donation to the project. I just hope you keep up the really
excellent work!!!!
-Maurice
On Apr 8, 3:44 pm, Tony Birleffi <mosaic...@gmail.com> wrote:
> Yes, I'm simulating it with AS code. For now, until they release their C++
> code.
>
> But it seems to work either way,
> AMB
>
AMB
Apr 12, 2011, 12:55:53 PM4/12/11
to AS3OpenNI
Hey Maurice-
Yeah finger tracking is definitely next on the radar. One alternate
option might be to do it in Flash with blob detection. Maybe it might
work that way, but not sure yet. The OpenNI framework doesn't support
it native, however I'm looking at some other examples on how to get it
into Flash.
I'll keep you posted, and thanks again for the compliments!
AMB
---
Yeah finger tracking is definitely next on the radar. One alternate
option might be to do it in Flash with blob detection. Maybe it might
work that way, but not sure yet. The OpenNI framework doesn't support
it native, however I'm looking at some other examples on how to get it
into Flash.
I'll keep you posted, and thanks again for the compliments!
AMB
---
Reply all
Reply to author
Forward
0 new messages