[ad_1]
TL;DR
- A developer used a Google Nest Mini, changed its PCB and MCU, and hacked in combination an answer that employs AI for a formidable AI voice assistant.
- The mission offers us a glimpse into the way forward for how AI-powered good audio system may just turn into.
The Google Nest Mini is a great good speaker that may do a lot regardless of its tiny bundle. However at the present time of AI, a easy Google Assistant-powered good speaker might really feel relatively underwhelming. Whilst we move our arms for AI achieving good audio system quickly, you’ll be able to take issues into your individual arms and create your individual AI-powered Google Nest Mini.
Twitter consumer Justin Alvey changed their Google Nest Mini to run their very own LLM, agent, and voice style.
I “jailbroke” a Google Nest Mini to be able to run your individual LLM’s, brokers and voice fashions.
Right here’s a demo the usage of it to regulate all my messages (with assist from @onbeeper)🔊 on, and look ahead to marvel visitor!
The hacking procedure begins with a PCB substitute, which is already past what maximum strange customers can do by means of themselves. However in the event you do go for this procedure, you’ll be able to use an inexpensive and developer-friendly Wi-Fi chip that works smartly with quite a lot of audio frameworks. This, in flip, opens up the facility to make use of the speaker for audio and voice detection whilst offloading the AI processing to a extra robust native gadget.
Additional, the answer depends upon Beeper, a common chat app. That is the place the messages arrive and get parsed via an API. The developer then makes use of GPT 3.5 for summarizing the messages and different AI purposes. The result’s handed directly to ElevenLabs’ text-to-speech engine.
The results of this experimental mission is a a laugh creativeness of what good audio system may just sound like if AI powered them.
I’ve been experimenting with a couple of of those, saying essential messages as they arrive in, morning briefings, noting down concepts and memos, and skimming brokers.
I couldn’t face up to – right here’s a playful (unscripted!) video of 2 speaking to one another precipitated to be AI’s from “Her percent.twitter.com/f9lOUciO3Y
The developer mentioned they’re running on open-sourcing the PCB design, construct directions, firmware, bot, and server code. We must have a greater thought of what’s taking place beneath the hood when those are open-sourced.
Nevertheless, this used to be a thrilling mission to witness. It offers us a glimpse of what the AI-powered long term may just seem like in our on a regular basis lives. As a substitute of getting a wise speaker learn issues out, AI may just make it all of the extra precious by means of offering a abstract of our notifications.
Becoming all of that device magic throughout the footprint of a tiny Google Nest Mini would even be unbelievable. Granted, the processing on this mission used to be taking place on a distinct gadget, however that’s no longer too other from how the Nest Mini wishes a relentless web connection to paintings with Assistant.
[ad_2]
