HBRC General Meeting Tonight! - July 29, 7:00 PM Pacific

[camp .]

Teaching a Robot to Check the Doors: The AI Behavior Layer of LENS

Speaker: Suresh Muthumal

Presentation:

LENS is a differential-drive robot built from the ground up with a custom 3D-printed chassis, an ESP32 handling motors, encoders, IMU, and I²S audio over micro-ROS, and an NVIDIA Jetson running ROS 2 Jazzy with Nav2, slam_toolbox, and an EKF.

This presentation focuses on the layer above that hardware and software stack: how a collection of machine learning models turns a spoken sentence into an autonomous mission.

Suresh will walk through the complete door-patrol workflow, including:

* A custom-trained wake word running as ONNX on the robot's microphone stream

* Speech recognition using faster-whisper on the Jetson GPU

* Intent parsing and mission execution

* Nav2 autonomous navigation

* Camera capture

* Claude's Vision API determining whether a door latch is locked

* Edge-versus-cloud design tradeoffs

* Real-world engineering challenges, including I²S bus contention and micro-ROS QoS mismatches

Whether you're interested in robotics, ROS 2, embedded systems, AI, or autonomous navigation, this promises to be an informative look at building an end-to-end intelligent robot.

HomeBrew Robotics Club

https://www.hbrobotics.org/

Hybrid Meeting:

In-Person: Maker Nexus, 1330 Orleans Drive, Sunnyvale, CA 94089

Online (Zoom): https://us06web.zoom.us/j/88326925900

Meeting Agenda:

Our general meetings follow the same format each month:

Industry News, Club News, I Need Help, Show-and-Tell, Featured Presentation, Random Access

Hope to see you there!

Thanks!

Camp

[camp .]

Tonight! - cp