AV sync after video processing using OpenCV

[Surya Dwivedi]

Hi,

I have set up a gstreamer-opencv server which receives rtp video packets, constructs frames, does some opencv processing and forwards them to a streaming mount point video port. I also have a rtp audio stream that I am directly forwarding to the same streaming mount-point audio port. Since there is some processing delay for video, audio and video are not in sync. Given this processing delay for video rtp packets, how do I sync video and audio ? 

Thanks,

Surya

[Flavia Sparacino]

Hi Surya,

we are looking to setup a similar OpenCV server, so possibly we can help each other out. Do you have any pointers on how you went about it? My goal is to use OpenCV.js and Tensorflow.js served by node.js. It seems you have a different setup. Want to compare notes?