![]() | |
To view this discussion visit https://groups.google.com/d/msgid/hbrobotics/828292411.1932519.1785214532375%40mail.yahoo.com.
In an Echo, and probably in your watch, only the wake word processing happens locally. Everything else is a simple audio codec in each direction to the cloud. All of the voice / TTS processing happens on the server where they have lots of memory and real horsepower.
That's why there are so many little, cheap "AI" devices: You just need an ESP32 with a microphone, speaker, and network connection.
We just had a presentation noting the open source wake-word detector library that runs locally.
If you need to run disconnected, or try to cut latency if you have fast enough compute, local processing is required.
Stephen
To view this discussion visit https://groups.google.com/d/msgid/hbrobotics/F11F7D6F-575B-4FD1-AA1E-3D7881A29DF1%40gmail.com.
|
Stephen D.
Williams
Founder: VolksDroid, Blue Scholar Foundation |
On Jul 31, 2026, at 11:30 PM, Stephen Williams <s...@lig.net> wrote:
In an Echo, and probably in your watch, only the wake word processing happens locally. Everything else is a simple audio codec in each direction to the cloud. All of the voice / TTS processing happens on the server where they have lots of memory and real horsepower.
That's why there are so many little, cheap "AI" devices: You just need an ESP32 with a microphone, speaker, and network connection.
We just had a presentation noting the open source wake-word detector library that runs locally.
If you need to run disconnected, or try to cut latency if you have fast enough compute, local processing is required.
Stephen
On 7/28/26 9:50 AM, Chris Albertson wrote:
No. You absolutely do not want to go back to even 4 or 5 years of voice technology. The technology has moved so much of late and is not expensive. Apple has decent voice built into my watch. How much computer power and RAM could be in a wristwatch? The Echo Dot does voice as a side feature while it plays music and acts as a Thread router all on one tiny $2 chip.
I think the best Open Source and easy voice assistant project is built around “Wyoming Protocol”. This is a bit of “glue” that binds together other voice projects. So the system is modular. You can run parts of it on different computers or even parts on the cloud.
There is more to it than you might think. For example, you need to run a “Wake Word” detector on “hopefully” some very low-power device that listens for “Hey Robot” and then opens a connection to a more sophisticated voice processor and then sends the recognized text to so AI (cloud or local) and then the reply needs to be sent to a text-to-speech and the audio gets routed to the same location as the microphone. Wyoming does all this but lets you pick the parts.
So for example, you could run a mon LLM on a small PC but put the microphone on a mobile robot.
This project is well supported and even has some paid staff maintaining it. So it stays working and will be maintained.
On Jul 31, 2026, at 11:30 PM, Stephen Williams <s...@lig.net> wrote:
Thanks, good information!
I wonder how much you can develop for those hardware units, like the NPU? I will try to find out at some point.
Stephen