55
Self hosting voice assistant (poptalk.scrubbles.tech)

Hi all, looking for my next major project/frustration. I've been forcing myself to learn the new AI tools and I think I'm ready for the next step. I'm familiar with image generation and I dabbled in a bit of chat bot stuff, but I think I'm ready.

I've read a few blogs but I want to find something that could work with my existing setup. My dream setup would be:

A voice assistant that runs locally, preferably dockerized, backup linux, and final option would be Windows, that can run a decent model and preferably let me train a custom voice for it.

I currently have:

  • Home Assistant set up already, I've seen the OpenAI integrations but would like to migrate off of those
  • Google Minis laying around, I'm willing to sacrifice one of them if it means I can use my own stuff
  • Spare 1650GTX GPU, I know not the best but hopefully enough to get it off the ground before deciding to go in on a larger GPU that would be dedicated to this

Needs/wants/nice to haves would be:

  • Basic chat functionality, what's the weather like
  • Play music from my plex or jellyfin server
  • HA integrations so I could say stuff like "Turn off the lights"

Sorry for dumping all of this, like I said I've seen blog posts around, some are doing parts of this, but I wonder if anyone has done something like this. I'm sure people have tried. Guides, jumping off points, even githubs/projects you know of would be helpful.

Thanks all!

all 12 comments
sorted by: hot top controversial new old
[-] logos@sh.itjust.works 17 points 1 year ago

There was Mycroft but it got killed by a patent troll although afaik you can still run it. OpenvoiceOS and Neon AI have picked up the ball.

[-] motsu@lemmy.world 12 points 1 year ago

Rhasspy. Idk if rhasspy3 is out fully, but I would wait for that and then set it up. (I have began to see the home assistant side being released - its supposed to tie in a lot better than rhasspy2, and even brought the dev on to the HA project)

[-] Yowasa@lemmy.world 6 points 1 year ago

Didn't home assistant hire the guy who made rhasppy so he could work on their voice assistant?

[-] Midnitte@kbin.social 8 points 1 year ago
[-] christiannils@sh.itjust.works 2 points 1 year ago

Did you check https://github.com/toverainc/willow-inference-server/ ? I tried it with an ESP-BOX (running https://github.com/toverainc/willow) and the first results are really promising.

this post was submitted on 15 Aug 2023
55 points (96.6% liked)

Selfhosted

39677 readers
325 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS