TTS bench - 91 open TTS models and 28 paid TTS APIs on the same prompts
Reported by r/LocalLLaMA1 source ↓
A community benchmark compares 91 locally run text-to-speech models and 28 hosted APIs using six prompts in English, Spanish and French, with audio samples and performance, quality and price measurements.
Key points
- AuroraTTS-100K had the fastest reported first audio among open models: 12 ms on an RTX 5090
- VUI Labs Luna had the highest hosted-API UTMOS score at 4.488, but took about 1.2 seconds to start speaking
- AssemblyAI had the fastest hosted-API first audio at 30 ms
- Hosted APIs were tested with warm calls from the Eastern US; local and hosted models were not ranked against each other
Details
The third round of the community-run tts-bench tested 91 open models on an RTX 5090, RTX 3090 and, in some cases, an Apple M4. Its separate hosted board covers 28 APIs, using the same six prompts across English, Spanish and French; reported results are medians from warm calls over several days.
The benchmark includes time to first audio, realtime factor, UTMOS naturalness scores, word error rate, voice-cloning similarity and API prices, alongside audio samples. Among open models, Maya1 had the highest UTMOS score at 4.487, while LongCat-AudioDiT 3.5B had the best cloning similarity at 0.875. The benchmark author notes that UTMOS predicts naturalness rather than human preference, and that time to first audio is not whole-clip latency; concurrency was not measured.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh