34

Are there any free/open-source TTS options out there that are on the same level as Google Cloud's? I tried a lot of free ones, but they are absolutely awful and still sound like my Amiga did 30 years ago. With LLMs being available as open source, I am hoping there's also a good TTS offering I just haven't found yet.

you are viewing a single comment's thread
view the rest of the comments
[-] tal@lemmy.today 11 points 1 year ago* (last edited 1 year ago)

Festival -- not cutting edge -- will definitely be better than your Amiga, and can handle long text. Last time I set it up, IIRC I wanted some voices generated by Tokyo University or something, which took some setting up. It'll probably be packaged in your Linux distro.

You can listen to a demo here.

https://www.cstr.ed.ac.uk/projects/festival/onlinedemo.html

It's not LLM-based.

For short snippets, offline, one can use Tortoise TTS -- which is LLM based. But it's slow and can only generate clips of a limited length. Whether it's reasonable for you will depend a lot on your application. It will let one clone -- or make a voice sounding more-or-less similar -- a voice using some sound samples from them speaking.

https://github.com/neonbjb/tortoise-tts

Examples at:

https://nonint.com/static/tortoise_v2_examples.html

I haven't used Google's, but I'd assume, given that Google is paying people to work on it full time, that whatever they've done probably sounds nicer. But, then not open source, so...shrugs

Ah, I looked at Tortoise, but I do not have an nVidia GPU, so I couldn't try it. Festival I tried and the results were bad. Not so much for the voice, but for intonation and pronunciation.

[-] tal@lemmy.today 3 points 1 year ago* (last edited 1 year ago)

Ah, I looked at Tortoise, but I do not have an nVidia GPU, so I couldn’t try it.

I use it on an AMD GPU.

EDIT: Wait, let me make sure. I was using an Nvidia GPU for a while and switched to AMD.

EDIT2: Oh, yeah, it uses transformers, and that doesn't work on rocm presently, IIRC.

this post was submitted on 13 Nov 2023
34 points (90.5% liked)

Selfhosted

40198 readers
382 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS