Next week at our General Meeting, Suresh Kumar Muthumal will present his robot, LENS.
LENS is a differential-drive robot built end-to-end with a custom 3D-designed and printed chassis. An ESP32 handles the motors, encoders, IMU, and I²S audio over micro-ROS, while a Jetson runs ROS 2 Jazzy with Nav2, slam_toolbox, and an EKF.
This presentation focuses on the intelligence layer above the robot's navigation stack: how a collection of machine learning models turns a spoken sentence into an autonomous mission. Suresh will walk through the door patrol behavior from start to finish—from a custom-trained wake word running as ONNX on the robot's microphone stream, through faster-whisper transcription and intent parsing on the Jetson GPU, to Nav2 navigation, camera capture, and Claude's vision API determining whether a door latch is locked. He'll also discuss practical engineering tradeoffs between edge and cloud computing, along with some of the less glamorous challenges, including I²S bus contention and micro-ROS QoS mismatches.
Our meetings are hybrid.
In Person: Maker Nexus, 1330 Orleans Drive, Sunnyvale, CA 94089
Online (Zoom):
https://us06web.zoom.us/j/88326925900
Meeting Agenda
HomeBrew Robotics Club
https://www.hbrobotics.org/
Thanks,