AR Remote Assistance

[anonimo ananimo]

Hello!

I would like to make a open source AR Remote Assistance with Unity and WebRTC.

Does anyone know how can I build this ? Is for my final University project..

Any help would be much appreciated!

[marin....@gmail.com]

Hi,

You didn't give out much information about what you plan to do, so I can't really give a full answer here. I also don't know what is your timeline for the project and how complex it will be.

In case you are working with HoloLens, you should check out microsoft examples for the webrtc project. If you are using MagicLeap, they added webrtc support in their latest SDK and they have an example on how to use it (in the SDK examples).  If you are using Nreal, Android's Camera2Enumerator cannot pick up their video camera, so you will need to do a workaround for it to make video work.

For the receiving end (I assume you have "AR device" streaming to another device that is the receiving end),  I would make web app so I can use JavaScript API for WebRTC instead of building that client from Unity. (again it all depends on complexity of your project and how much time you have).

I didn't use webrtc with ARKit or ARCore so I can't give suggestions on that.

If you plan to build iOS/Android/Windows apps from Unity that will use webrtc, you can take a look at the examples folder (src/examples/unityplugin).

For signaling server, I found that nodejs websocket/socketio/signalR is the simplest thing to do (but it again depends on what you actually want to do with your project).
If you need to make demo of the project while being connected to University wifi, you might have issues with UDP traffic, so you should also set up a TURN server (https://github.com/coturn/coturn). You might also be able to connect to your mobile hotspot and connect all devices on it if you don't want to bother with TURN.

I hope some of this might help you.

Good luck!

-Marin