Silencio-2: an 18M TTS with emotion and sound tags, ~20x realtime on CPU (open weights)
Reported by r/LocalLLaMA1 source ↓
A developer has released Silencio-2, an open-weights, English text-to-speech model fine-tuned from Kyutai’s Pocket TTS to respond to emotion and sound tags. The developer reports 18.2 million speech-model parameters and about 20 times real-time speed in one Apple M4 CPU run.
Key points
- Silencio-2 responds to text tags for emotions and sounds such as laughter, sighs and coughs
- The speech model has 18.2M parameters; adding the voice-cloning encoder brings it to 27.9M
- The developer reports about 20x real-time speed in one Apple M4 run using four CPU threads, without a GPU
- Weights are available under CC-BY-4.0; inference code is MIT-licensed
- The model is English-only, and the developer says whispering is the least stable tag
Details
The developer describes Silencio-2 as a fine-tune of Kyutai’s Pocket TTS 18M. It generates 24 kHz streaming speech and supports voice cloning from a short clip. The weights and code are posted on Hugging Face, and a browser demo is available through Colab; there is no pip package, so users must clone the repository and install its requirements.
The developer reports 18.2 million parameters for speech generation, or 27.9 million with the encoder needed for voice cloning, and a 112 MB download. The reported speed—about 20 times real time—came from one long-text run on an Apple M4 using four CPU threads, not a benchmark. Training used about 50 hours of audio across 27,000 clips on two T4 GPUs.
Supported sound tags include laugh, sigh, gasp, cough and clear_throat; emotion tags include happy, sad, angry, fear, surprised and whisper. The developer says whispering is the least stable tag and that results vary by line, voice and random seed. A real whisper is about ten times quieter than speech, so the generation function raises its level by default.
The developer did not run a word-error-rate benchmark on this checkpoint. A later, unshipped training stage scored 1.9% WER versus 1.5% for base Pocket TTS on 300 LibriSpeech items. The developer says earlier filtering removed all examples for several sound tags, so the released model was trained without that filter.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh