[FEATURE REQUEST] Optimize a version to use with ESP32 and microphone for assist

[lubeda]

In my lab I made (hacked together with duck tape and hot glue) a version that works with microphone as an assist satelite.

The functionality was there but the display had some hiccups. I think because of timing issues. Voice is very depdendent on timing so the esp32_rmt_led_stripplattform.

My dream is to have some ehmtx devices in some rooms with a microphone for assist (Goodbye Alexa)

[trip5]

Woah. I thought I saw some things in the repo that looked like that...

Did you add a microphone or mic array? There's a speaker in there but I assumed that could only be used as a speaker?

Would you be able to share pictures, diagrams, anything?

[lubeda]

These are old videos with the press button to speak assist :https://www.youtube.com/shorts/wHDdW07svjc and https://www.youtube.com/watch?v=CsOir14DCbM

With wake word the source has to be adapted but the impression is more or less the same

[trip5]

Oh. I thought you had experimented with getting the Ulanzi to act as a voice assistant. I have my doubts that a bare ESP32 such as exists in the Ulanzi can handle wakeword...

All the other examples I've seen, voice assistant still struggles with wakewords even though the assistant is the only component of the ESPHome device.

I myself have just ordered a ESP32 Korvo https://www.aliexpress.com/item/1005002803964499.html to play with. It seems to have a lot of dedicated hardware to it to make a voice assistant...

I'd almost think that it would be better to simply stuff another ESP32 inside the Ulanzi case, replace the speaker and just have 2 different devices in the same box. The Korvo is way too big though... almost 8 cm diameter.

[lubeda]

the esp32 is capable to do voice activation. The case of the ulanzi is hard to open, I will buy a new one and try this: https://github.com/lubeda/EspHoMaTriXv2/wiki/ulanzi-hardware-mode and try also to add a mic.