I need a better image than Kinect RGB can give. So I'm thinking Unity
3.5 (native webcam support), and my app currently can read the Kinect
depth, and webcam at the same time (turn Kinect RGB off). I mount the
webcam on the Kinect near the internal camera.
Now I need to align the depth and rgb.
Can I somehow 'feed' the webcam image through OpenNI (or something) to
fake it being Kinect's RGB camera? And can I somehow recalibrate that
code to use the external camera's parameters? (I'm still trying,
without luck, to build RGBDemo from
http://nicolas.burrus.name/index.php/Research/KinectRgbDemoV6?from=Research.KinectRgbDemoV2#tocLink10)
What I'm thinking is a) get the external camera intrinsic data to b)
give to Kinect/OpenNI, so that it can c) use good ole
OpenNIContext.Instance.Depth.AlternativeViewpointCapability.SetViewpoint
(Image);