issue with DLC-LIVE

[Riccardo Schina]

Hi,

I get the error message you can see in the attachment when I try to run my workflow.

I'm trying to analyze with a pre-trained Deeplabcut network a video stream from an IDS camera (which I configured through the IDS camera manager, and of which I can see the video through Bonsai, so no issues there).

From what I understand there is some OpenCV mismatch but I have no idea what should I change. 

Does someone have an idea?

Thanks

[ania...@gmail.com]

Hi!

I had a similar problem, try to insert a ConvertColor node with the conversion Gray2Bgr. From what I've been told by Goncalo, the issue is that for now the DetectPose requires color images as input (I guess it should be addressed in the future). 

I hope it will work for you.

Best,

Ania

[Romain Ligneul]

Yes, it is indeed a color issue and the ConvertColor should work.

The DetectPose node requires color channels because Deeplabcut DNNs do (it is not something which depends on Bonsai)

--
You received this message because you are subscribed to the Google Groups "Bonsai Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bonsai-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bonsai-users/0a8feb7c-43cd-4f95-8fd2-977cfae9d5a3n%40googlegroups.com.

[Riccardo Schina]

Thanks everyone, this solved the issue! 

Attaching a snapshot of how my workflow looks now, hope it can help someone else!

[João Frazão]

I may have pointed you wrong I think you just need the convert color: you can remove the grayscale node.

To view this discussion on the web visit https://groups.google.com/d/msgid/bonsai-users/fa174d24-3f3e-4268-a2ff-edd3c8b4cfecn%40googlegroups.com.

[Riccardo Schina]

Actually that does not work. I guess it is because the original camera stream is in color (see attachments) so I cannot use Gray2BGR if I don't use the grayscale node before the convertcolor..but I do not know which other conversion should I do. 

I tried without converting at all of course, but that does not work either. Even if I just try to record a video using ueye--image--videowriter  the resulting video is not playable.

I guess I should use a different streaming format from the camera, do you have a suggestion? 

[João Frazão]

You may Try to get grayscale directly from camera them convert to RGB in bonsai, but it is the same thing,  just maybe less overhead on  usb and processor.

To view this discussion on the web visit https://groups.google.com/d/msgid/bonsai-users/ac8190b1-5c17-4c2e-b49e-456f93558518n%40googlegroups.com.