OpenNI + SensorKinect + NITE not working on Ubuntu 10.10 (32bit)

59 views
Skip to first unread message

Tom

unread,
Jan 20, 2011, 6:10:37 AM1/20/11
to OpenNI
Hi all,

I'm trying to run Kinect on top of Ubuntu 10.10 (32bit).
My environment:
Mac OS X (host) running VMWare Fusion, and Ubuntu 10.10 (32bit) is
the guest OS.

I installed OpenNI (unstable), SensorKinect (0.4), and run NiViewer.
But all I get is a timeout from XnSensorServer. I tried to trace the
code, but it seems like a huge task. I lost track after
nRetVal = pStream->Open()
in XnStatus XnDeviceBase::OpenStream(const XnChar* StreamName)

The timeout is caused by the Open() function.


Below is my log of NiViewer:
1179 [INFO] OpenNI version is 1.0.0 (Build 25)-Linux-x86
(Jan 20 2011 16:47:22)
1654 [VERBOSE] Checking /usr/lib/
libnimMockNodes.so...
3192 [VERBOSE] Found exported production node.
Device: OpenNI/Mock/1.0.0.25
3232 [VERBOSE] Found exported production node. Depth:
OpenNI/Mock/1.0.0.25
3261 [VERBOSE] Found exported production node. IR:
OpenNI/Mock/1.0.0.25
3292 [VERBOSE] Found exported production node. Image:
OpenNI/Mock/1.0.0.25
3315 [VERBOSE] Found exported production node. Audio:
OpenNI/Mock/1.0.0.25
3328 [VERBOSE] Checking /usr/lib/libnimCodecs.so...
5084 [VERBOSE] Found exported production node. Codec:
OpenNI/16zP/1.0.0.25
5104 [VERBOSE] Found exported production node. Codec:
OpenNI/16zT/1.0.0.25
5114 [VERBOSE] Found exported production node. Codec:
OpenNI/Im8z/1.0.0.25
5123 [VERBOSE] Found exported production node. Codec:
OpenNI/JPEG/1.0.0.25
5132 [VERBOSE] Found exported production node. Codec:
OpenNI/NONE/1.0.0.25
5153 [VERBOSE] Checking /usr/lib/libnimRecorder.so...
6303 [VERBOSE] Found exported production node.
Recorder: OpenNI/Recorder/1.0.0.25
6325 [VERBOSE] Found exported production node.
Player: OpenNI/Player/1.0.0.25
6335 [VERBOSE] Checking /usr/lib/
libXnDeviceSensorV2.so...
13960 [VERBOSE] Found exported production node.
Device: PrimeSense/SensorV2/5.0.0.25
13997 [VERBOSE] Found exported production node. Depth:
PrimeSense/SensorV2/5.0.0.25
14011 [VERBOSE] Found exported production node. Image:
PrimeSense/SensorV2/5.0.0.25
14022 [VERBOSE] Found exported production node. IR:
PrimeSense/SensorV2/5.0.0.25
14045 [VERBOSE] Found exported production node. Audio:
PrimeSense/SensorV2/5.0.0.25
14060 [VERBOSE] Checking /usr/lib/
libXnDeviceFile.so...
15826 [VERBOSE] Found exported production node.
Player: PrimeSense/File/1.0.0.25
16334 [VERBOSE] Requested to create a node of type
Image...
16691 [VERBOSE] Initializing USB...
16863 [INFO] USB is initialized.
21451 [INFO] Creating node 'Device1' of type Device...
2206368 [INFO] Property Device.ShareMode was changed to 1.
2206398 [INFO] Property Device.InstancePointer was changed.
2206503 [INFO] Property Device.ShareMode was changed to 0.
2206801 [INFO] Creating node 'Image1' of type Image...
2206867 [VERBOSE] Creating stream Image1 (of type Image)
2223840 [INFO] Property Device.ReadData was changed to 1.
2223994 [INFO] Creating stream 'Image1' of type 'Image'...
2224098 [VERBOSE] Initializing stream 'Image1'...
2224192 [INFO] Property Image1.RequiredDataSize was changed
to 230400.
2225442 [INFO] Property Image1.OutputFormat was changed to 5.
2225573 [INFO] Stream 'Image1' was initialized.
2225583 [INFO] 'Image1' stream was created.
2225943 [VERBOSE] Batch configuring server...
2226235 [INFO] Property Image1.RequiredDataSize was changed
to 460800.
2228410 [INFO] Property Image1.XRes was changed to 640.
2228429 [INFO] Property Image1.RequiredDataSize was changed
to 921600.
2232987 [INFO] Property Image1.YRes was changed to 480.
2233008 [INFO] Property Image1.Resolution was changed to 1.
2233074 [VERBOSE] Setting Image1.Mirror to 1...
2233219 [INFO] Property Image1.Mirror was changed to 1.
2233275 [VERBOSE] Opening stream Image1...
2244787 [INFO] Property Image1.ActualReadData was changed to
1.
32233604 [WARNING] Timeout when waiting for reply from
sensor server!
32233701 [INFO] Destroying node 'Image1'
32233756 [VERBOSE] Destroying stream Image1
62234211 [WARNING] Timeout when waiting for reply from
sensor server!
62234266 [INFO] Destroying node 'Device1'
62234314 [VERBOSE] Sending Bye



And this is the log from XnSensorServer

4046 [INFO] XnLog.cpp 165 OpenNI version is 1.0.0 (Build 25)-
Linux-x86 (Jan 20 2011 16:47:22)
4099 [INFO] XnLog.cpp 173 Log system initialized. Console:
0, File: 1, Severity: VERBOSE, Masks: ALL
6591 [VERBOSE] XnSensorServer.cpp 142 Server is now
listening
11321 [INFO] XnSensorServer.cpp 168 New client trying to
connect...
16758 [VERBOSE] XnServerSession.cpp 198 Client 1 requested to
open sensor 045e/02ae@1/3
16821 [INFO] XnSensorsManager.cpp 94 Opening sensor '045e/
02ae@1/3'...
17762 [VERBOSE] XnSensor.cpp 154 Initializing device
sensor...
17890 [VERBOSE] XnDeviceModule.cpp 417 Configuring module
'Device' from section 'Device' in file '/usr/etc/primesense/
GlobalDefaults.ini'...
18171 [INFO] XnDeviceModule.cpp 431 Module 'Device'
configuration was loaded from file.
18188 [INFO] XnProperty.cpp 151 Property Device.ShareMode was
changed to 1.
18251 [VERBOSE] XnUSBLinux-x86.cpp 87 Initializing USB...
18401 [INFO] XnUSBLinux-x86.cpp 98 USB is initialized.
18409 [VERBOSE] XnDeviceSensorIO.cpp 86 Connecting to USB
device...
18414 [VERBOSE] XnDeviceSensorIO.cpp 104 Trying to open
sensor '045e/02ae@1/3'...
19132 [VERBOSE] XnDeviceSensorIO.cpp 117 Trying to open
endpoint 0x4 for control out (for old firmwares)...
19210 [INFO] XnDeviceSensorIO.cpp 135 Connected to USB
device
19231 [INFO] XnProperty.cpp 151 Property Device.USBPath was
changed to 045e/02ae@1/3.
57925 [VERBOSE] XnHostProtocol.cpp 675 Getting hardware
versions...
641363 [INFO] XnHostProtocol.cpp 825 Hardware versions:
FW=5.1.4 (7) HW=4 Chip=2 Sensor=4 SYS=7
655814 [VERBOSE] XnHostProtocol.cpp 835 Requesting
KeepAlive...
670577 [VERBOSE] XnHostProtocol.cpp 846 Got KeepAlive Reply.
670618 [VERBOSE] XnHostProtocol.cpp 1122 Setting mode to
3...
1485367 [VERBOSE] XnHostProtocol.cpp 835 Requesting
KeepAlive...
1500403 [VERBOSE] XnHostProtocol.cpp 846 Got KeepAlive Reply.
1515720 [VERBOSE] XnProperty.cpp 151 Property
Firmware.ReferenceResolution was changed to 2.
1515754 [VERBOSE] XnSensorFirmwareParams.cpp 215 Reading all
params from firmware...
1600892 [VERBOSE] XnProperty.cpp 151 Property
Firmware.ImageFlicker (17) was changed to 1.
1645351 [VERBOSE] XnProperty.cpp 151 Property Firmware.GMCMode
(36) was changed to 1.
1673547 [VERBOSE] XnProperty.cpp 151 Property
Firmware.DepthWhiteBalance (45) was changed to 1.
2075828 [VERBOSE] XnProperty.cpp 151 Property
Firmware.DepthHoleFilter (22) was changed to 1.
2091282 [VERBOSE] XnProperty.cpp 151 Property
Firmware.DepthGain (21) was changed to 30.
2105777 [VERBOSE] XnProperty.cpp 151 Property Firmware.DepthFPS
(20) was changed to 30.
2119255 [VERBOSE] XnProperty.cpp 151 Property
Firmware.DepthResolution (19) was changed to 1.
2133856 [VERBOSE] XnProperty.cpp 151 Property
Firmware.DepthFormat (18) was changed to 1.
2133896 [VERBOSE] XnSensorFirmwareParams.cpp 224 Firmware
params were updated.
2133942 [VERBOSE] XnHostProtocol.cpp 955 Getting the fixed
params...
2148863 [VERBOSE] XnSensorFixedParams.cpp 54 Sensor serial
number: 0
2148908 [INFO] XnProperty.cpp 151 Property Device.ID was changed
to 0.
2148934 [INFO] XnSensor.cpp 182 Device sensor initialized
2148955 [VERBOSE] XnDeviceModule.cpp 417 Configuring module
'Device' from section 'Server' in file '/usr/etc/primesense/
GlobalDefaults.ini'...
2149386 [INFO] XnDeviceModule.cpp 431 Module 'Device'
configuration was loaded from file.
2149889 [VERBOSE] XnSensorsManager.cpp 114 Sensor '045e/
02ae@1/3' now has 1 sessions
2151127 [VERBOSE] XnServerSession.cpp 668 Client 1 requested to
create stream 'Image1' (Image)
2151152 [INFO] XnDeviceBase.cpp 1391 Creating stream
'Image' of type 'Image'...
2151163 [INFO] XnProperty.cpp 74 Setting Device.ReadData to
1...
2151170 [VERBOSE] XnDeviceSensorIO.cpp 167 Opening
endpoints...
2151175 [VERBOSE] XnDeviceSensorIO.cpp 177 Opening endpoint
0x81 for depth...
2151352 [VERBOSE] XnDeviceSensorIO.cpp 201 Depth endpoint is
isochronous.
2151362 [VERBOSE] XnDeviceSensorIO.cpp 227 Opening endpoint
0x82 for image...
2151468 [VERBOSE] XnDeviceSensorIO.cpp 240 Image endpoint is
isochronous.
2151526 [VERBOSE] XnDeviceSensorIO.cpp 257 Opening endpoint
0x83 for misc...
2151587 [VERBOSE] XnDeviceSensorIO.cpp 271 Misc endpoint is
not supported...
2151594 [INFO] XnDeviceSensorIO.cpp 298 Endpoints open
2151599 [VERBOSE] XnHostProtocol.cpp 1169 Getting algorithm
params 0x80 for resolution 0 and fps 0....
2166249 [INFO] XnProperty.cpp 151 Property Device.ReadData was
changed to 1.
2166355 [INFO] XnProperty.cpp 101 Device.ReadData was
successfully set.
2166631 [VERBOSE] XnDeviceBase.cpp 1427 Initializing
stream 'Image'...
2166808 [INFO] XnProperty.cpp 151 Property Image.Resolution was
changed to 0.
2166819 [INFO] XnProperty.cpp 151 Property Image.XRes was
changed to 320.
2166828 [INFO] XnProperty.cpp 151 Property Image.YRes was
changed to 240.
2166836 [INFO] XnProperty.cpp 151 Property Image.FPS was changed
to 30.
2166843 [INFO] XnProperty.cpp 151 Property Image.OutputFormat
was changed to 5.
2166850 [INFO] XnProperty.cpp 151 Property Image.BytesPerPixel
was changed to 3.
2166857 [INFO] XnProperty.cpp 151 Property
Image.RequiredDataSize was changed to 230400.
2166897 [INFO] XnDeviceBase.cpp 1466 Stream 'Image' was
initialized.
2167119 [INFO] XnDeviceBase.cpp 1471 'Image' stream was
created.
2167129 [VERBOSE] XnDeviceModule.cpp 417 Configuring module
'Image' from section 'Image' in file '/usr/etc/primesense/
GlobalDefaults.ini'...
2167186 [INFO] XnProperty.cpp 74 Setting Image.InputFormat to
6...
2167195 [INFO] XnProperty.cpp 151 Property Image.InputFormat was
changed to 6.
2167202 [INFO] XnProperty.cpp 101 Image.InputFormat was
successfully set.
2167498 [INFO] XnDeviceModule.cpp 431 Module 'Image'
configuration was loaded from file.
2167507 [VERBOSE] XnServerSensorInvoker.cpp 271 Stream Image
now has 1 clients.
2170164 [VERBOSE] XnServerSession.cpp 619 Client 1 requested a
batch config
2170211 [INFO] XnProperty.cpp 74 Setting Image.FPS to 30...
2170219 [INFO] XnProperty.cpp 86 Image.FPS value did not
change.
2170225 [INFO] XnProperty.cpp 74 Setting Image.YRes to 480...
2170234 [INFO] XnProperty.cpp 151 Property Image.Resolution was
changed to 1.
2170242 [INFO] XnProperty.cpp 151 Property Image.XRes was
changed to 640.
2170250 [INFO] XnProperty.cpp 151 Property
Image.RequiredDataSize was changed to 460800.
2170282 [INFO] XnProperty.cpp 151 Property Image.YRes was
changed to 480.
2170290 [INFO] XnProperty.cpp 151 Property
Image.RequiredDataSize was changed to 921600.
2170314 [INFO] XnProperty.cpp 101 Image.YRes was successfully
set.
2170322 [INFO] XnProperty.cpp 74 Setting Image.XRes to 640...
2170328 [INFO] XnProperty.cpp 86 Image.XRes value did not
change.
2177258 [VERBOSE] XnServerSession.cpp 296 Client 1 requested to
set Image1.Mirror
2177289 [INFO] XnProperty.cpp 74 Setting Image.Mirror to 1...
2177299 [INFO] XnProperty.cpp 151 Property Image.FirmwareMirror
was changed to 1.
2177307 [INFO] XnProperty.cpp 151 Property Image.Mirror was
changed to 1.
2177327 [INFO] XnProperty.cpp 101 Image.Mirror was successfully
set.
2177450 [VERBOSE] XnServerSession.cpp 800 Client 1 requested to
open stream Image1
2177465 [VERBOSE] XnDeviceBase.cpp 359 Opening stream
Image...
2177483 [VERBOSE] XnFirmwareStreams.cpp 202 FW Stream Image
was claimed by Image
2177491 [VERBOSE] XnSensorImageStream.cpp 252 Creating USB image
read thread...
2177498 [VERBOSE] XnUSBLinux-x86.cpp 108 Starting libusb asynch
thread...
2177612 [VERBOSE] XnUSBLinux-x86.cpp 1130 Starting a USB
read thread...
2184955 [INFO] XnUSBLinux-x86.cpp 1222 USB read thread was
started.
2184995 [INFO] XnProperty.cpp 151 Property Image.ActualReadData
was changed to 1.
2185069 [VERBOSE] XnProperty.cpp 74 Setting
Firmware.ImageFormat (12) to 6...



Does anyone have any ideas?

Thanks!!

Tom

Rhys Lewis

unread,
Jan 20, 2011, 3:29:27 PM1/20/11
to OpenNI
Have you installed the Nite middleware? I'm not sure that the OpenNI
samples work without the Nite install. Open NI is the framework, and
Nite is an implementation of the framework.

If you go to this page:

http://www.openni.org/downloadfiles/openni-compliant-middleware-binaries/33-latest-unstable

and download the Ubuntu 10.10 32 bit version it should help.

Do you have a Kinect sensor? I'm not sure that VMWare will be able to
pass the USB signal from the controller through to the guest OS
without problems with latency and bandwidth. If you are working with
the recordings it should be OK though.

Regards,
Rhys

Tom

unread,
Jan 20, 2011, 9:29:00 PM1/20/11
to OpenNI
I have tried it both (with NITE installed and without NITE installed).
Neither works.

I have a Kinect sensor. The OpenKinect drivers work well under Ubuntu
inside VMWare. It looks like the SensorKinect Client/Server had
trouble connecting to each other.

Regards,
Tom

On 1月21日, 上午4時29分, Rhys Lewis <r...@rhyslewis.info> wrote:
> Have you installed the Nite middleware? I'm not sure that the OpenNI
> samples work without the Nite install. Open NI is the framework, and
> Nite is an implementation of the framework.
>
> If you go to this page:
>
> http://www.openni.org/downloadfiles/openni-compliant-middleware-binar...
> ...
>
> 閱讀更多 >>

Rymixxx

unread,
Jan 30, 2011, 3:21:58 PM1/30/11
to OpenNI
Tom, did you ever get OpenNI and NITE working via VMWare?
I'm trying to do the same and are getting the same symptoms: USB
devices seem to be hooked up ok but none of the samples can
communicate with the camera.
Steve

On Jan 21, 2:29 am, Tom <ctc...@gmail.com> wrote:
> I have tried it both (with NITE installed and without NITE installed).
> Neither works.
>
> I have a Kinect sensor. The OpenKinect drivers work well under Ubuntu
> insideVMWare. It looks like the SensorKinect Client/Server had
> trouble connecting to each other.
>
> Regards,
> Tom
>
> On 1月21日, 上午4時29分, Rhys Lewis <r...@rhyslewis.info> wrote:
>
>
>
>
>
>
>
> > Have you installed the Nite middleware? I'm not sure that the OpenNI
> > samples work without the Nite install. Open NI is the framework, and
> > Nite is an implementation of the framework.
>
> > If you go to this page:
>
> >http://www.openni.org/downloadfiles/openni-compliant-middleware-binar...
>
> > and download the Ubuntu 10.10 32 bit version it should help.
>
> > Do you have a Kinect sensor? I'm not sure thatVMWarewill be able to
> > pass the USB signal from the controller through to the guest OS
> > without problems with latency and bandwidth. If you are working with
> > the recordings it should be OK though.
>
> > Regards,
> > Rhys
>
> > On Jan 21, 12:10 am, Tom <ctc...@gmail.com> wrote:
>
> > > Hi all,
>
> > > I'm trying to run Kinect on top of Ubuntu 10.10 (32bit).
> > > My environment:
> > > Mac OS X (host) runningVMWareFusion, and Ubuntu 10.10 (32bit) is
> ...
>
> read more >>

viant

unread,
Apr 27, 2011, 5:33:19 PM4/27/11
to openn...@googlegroups.com
Reply all
Reply to author
Forward
0 new messages