Hi Pupil Community!
I made a Capture plugin so that you can run real-time object recognition on the world view and identify which object is closest to your gaze in real-time. I also overlaid visualizations on the world view to show these things in real-time. Here's a short video demonstration:
https://youtu.be/MqqQnCbzryA
Also, I'd love to hear suggestions on how you think I can make this plugin better or what applications you think can stem from this.
-Jesse
**Note: I'm using Tensorflow with only CPU here, so it slows my capture down to about 10-15 FPS. If you have a GPU it should work much faster.