Voice dictation with one model
Reported by r/LocalLLaMA1 source ↓
A developer says he trained a single model to turn speech into cleaned-up dictation and released it in the free, open-source Typd app for Windows with an NVIDIA GPU and Apple silicon Macs.
Key points
- The model takes audio directly to finished text, combining transcription and cleanup
- The developer reports about 0.5 seconds for short dictations and 1 second for long ones on his laptop
- The Qwen3-ASR 1.7B model is a 2.2 GB Q8 file and uses about 2.5 GB of VRAM, according to its developer
- Typd is available for Windows systems with an NVIDIA GPU and Apple silicon Macs
Details
The developer described training Qwen3-ASR 1.7B to convert audio directly into edited dictation, rather than transcribing speech first and then processing the text with a separate language model. He says he trained it using unscripted speech from openly licensed datasets, with a large language model producing target text from transcripts; clips that appeared to lose spoken content during cleanup were excluded.
On an RTX 3050 Ti laptop with 4 GB of VRAM, the developer reports the model handled short dictations in about 0.5 seconds and long ones in about 1 second. He compared that with 2.5 to 36 seconds for combinations of Whisper and Qwen3.5, depending on the models used. These are results from his own tests, not an independent evaluation.
The developer says the Q8 model file is 2.2 GB and uses about 2.5 GB of VRAM. He released it in Typd, a free, open-source dictation app for Windows computers with an NVIDIA GPU and Apple silicon Macs, and says it runs in llama.cpp.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh