Google Nest Mini gutted and rebuilt to run custom agents

The Google Nest Mini is a popular smart speaker, but it's actually a Big Tech cloud-based solution. For those who want to roll their own voice assistant, or just avoid corporate oversight of it all, [Justin Alvey]'s work may appeal. (Nitter)

[Justin] took apart a Nest Mini, ripped out the original circuit board, and fitted it with his own internals. It uses ESP32 as the basis of its design, as it offers great processing power and WiFi connectivity. Its replacement PCB also interfaces with the Nest Mini's LEDs, mute switch and capacitive touch features for easy interaction.

As a demonstration, he configured the system to work with a custom "Maubot" wizard using the Matrix framework. He connected it to Beeper, an email client that brings all your other email platforms together in one easily accessible place. The assistant uses GPT3.5, prompted with a list of his family, friends, and other details, to allow him to make calls, send messages, and handle natural language queries. The demo itself is very impressive and we would like to try setting up a similar wizard ourselves. Seeing two of [Justin]'s builds talking to each other is also fun.

If you're more comfortable with Google Assistant rather than abandoning it entirely, we've looked at that sort of thing as well. Video after the break.

I "jailbroken" a Google Nest Mini so you can run your own LLMs, agents, and voice models.

Here's a demo using it to manage all my messages (with help from @onbeeper)

Google Nest Mini gutted and rebuilt to run custom agents

The Google Nest Mini is a popular smart speaker, but it's actually a Big Tech cloud-based solution. For those who want to roll their own voice assistant, or just avoid corporate oversight of it all, [Justin Alvey]'s work may appeal. (Nitter)

[Justin] took apart a Nest Mini, ripped out the original circuit board, and fitted it with his own internals. It uses ESP32 as the basis of its design, as it offers great processing power and WiFi connectivity. Its replacement PCB also interfaces with the Nest Mini's LEDs, mute switch and capacitive touch features for easy interaction.

As a demonstration, he configured the system to work with a custom "Maubot" wizard using the Matrix framework. He connected it to Beeper, an email client that brings all your other email platforms together in one easily accessible place. The assistant uses GPT3.5, prompted with a list of his family, friends, and other details, to allow him to make calls, send messages, and handle natural language queries. The demo itself is very impressive and we would like to try setting up a similar wizard ourselves. Seeing two of [Justin]'s builds talking to each other is also fun.

If you're more comfortable with Google Assistant rather than abandoning it entirely, we've looked at that sort of thing as well. Video after the break.

I "jailbroken" a Google Nest Mini so you can run your own LLMs, agents, and voice models.

Here's a demo using it to manage all my messages (with help from @onbeeper)

What's Your Reaction?

like

dislike

love

funny

angry

sad

wow