ROSie, the Roving AI (Smart!) Snack Table is ALIVE!

[Thomas Messerschmidt]

The Video:    https://youtu.be/VBA8qHs0bPw

Part 2: Autonomous ROS 2 Smart Table Demonstration. LLM AI Chatbot, Vision, Voice I/O. Second demonstration of navigation. More to come. This is a roving smart table based on Camp Peavy's MockBot. My use case is that it wanders around your kitchen/living room at parties offering your guests food and drink. New features: 1. Startup verbal chime 2. Verbal snack announcement 3. Added a shelf for the laptop 4. Added battery level display to GUI 5. Added motor speed control to GUI 6. Added "Park" mode 7. Added "Rove" mode to GUI 8. Added "low battery" display and verbal announcement Still to do: 1. Integrate onboard LLM AI chatbot (it's on the computer and working, but not integrated.) 2. Integrate onboard VLM AI (vision) AI to locate people (it's on the computer and working, but not integrated.)   3. Add "seek" behavior that will look for people and bring the table to them. 4. "Ping" sensor that will keep it from running under tables. (The lidar sees the table legs but not the table top.) 5. Physical buttons so I don't need to open the laptop. 6. Indicator lights to show modes when laptop is closed 7. Change rove mode behavior so robot covers more of a room. 8. Add "wait" behavior based on touch sensor so user can grab his snack from the tray. Final update: - Replace ordinary laptop with a gaming laptop with NVidia GPU for better AI speed. Software Technology ROS 2 "Jazzy" Ubuntu Linux Python 3.x Tkinter Arduino_bridge code (Arduino C and Python) GPT4All (API) Gazebo RViz SLAM Toolbox Custom drivers Navigation 2 MoonDream vision AI VLM Onboard LLM for conversation and to work with MoonDream Hardware Technology: Dell computer (formerly a Windows machine) Neato Botvac D4 LIDAR Ultrasonic Sensor Arduino (USB serial interface)

[camp .]

This is great Thomas!  :-]  

- Camp

Yahoo Mail: Search, Organize, Conquer

--
You received this message because you are subscribed to the Google Groups "HomeBrew Robotics Club" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hbrobotics+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/hbrobotics/CADyjTyaMQEKWqdfj1DVUfh0mo%2BRUQ7PhM1EDoPhM6kWgeP3osw%40mail.gmail.com.