TTS still sucks

Syndicated from the fediverse. Read and engage on the original instance.

ai_·Artificial IntelligencebyPlanterTree

TTS still sucks

A couple of years ago I decided to turn this blog into a podcast. At the time, I decided to make up a stupid rule: whatever model I use to clone my voice and generate article transcripts needs to be an open model.

https://duarteocarmo.com/blog/tts-still-sucksOpen link View original on discuss.tchncs.de

Comments4

4 replies

PlanterTree

discuss.tchncs.de

The guy has pretty big constraints on his setup: Voice Cloning AND open source …

At the top of the leaderboard is Kokoro. Kokoro is an amazing model! Especially for a modest 82 Million (!) parameters and a mere 360 MB (!). However, like many models in this leaderboard - I can’t use it - since it doesn’t support voice cloning.

BananaTrifleViolin reply

lemmy.world

To be fair there are quite a few open source TTS AI engines that support voice cloning. Coqui TTS springs to mind. They do take some configuring and training to get right, especially for voice cloning, but it's definitely doable opensource.

Kokoro is designed to turn epubs into audio books, and designed to be lightweight. I think he's looking at the wrong tools for his use case.

brucethemoose reply

lemmy.world

And also a leaderboard that doesn't even have all the TTS models? There are a TON of them.

Domi

lemmy.secnd.me

They left out VibeVoice, the leading model for voice cloning that is intended exactly for the described use case?