My 0.8B fine-tune proofreads Spanish at 138 ms per sentence on a CPU
Reported by r/LocalLLaMA1 source ↓
A developer says a locally run Spanish proofreading app is available for Windows and Linux. Its 0.8B model scored an average F0.5 of 84.5 on the developer’s benchmark of 2,388 cases.
Key points
- The app works with selected text in other applications and offers corrections through a keyboard shortcut
- The developer reports an average F0.5 of 84.5 across three benchmark sections
- The quantized model is 529 MB and was fine-tuned on about 40,000 text pairs
Details
The developer says the app runs locally on Windows and Linux and works with text selected in other applications. Pressing Ctrl+Alt+Space opens a popup showing proposed edits and explanations; Enter replaces the selected text. The project is built in C++ on llama.cpp, and the model itself returns a corrected sentence while C++ code handles edit comparisons and explanations.
The developer’s benchmark contains 2,388 cases drawn from Wikipedia edits, Wikipedia discussion pages, and synthetic work emails and chats. The fine-tuned model recorded F0.5 scores of 81.5, 80.0 and 92.0 across those sections, for a mean of 84.5. The developer says the benchmark’s reference corrections were prepared by two language models, with disagreements resolved through a debate round, and that the benchmark was frozen before scoring.
The model is a full fine-tune of Qwen3.5-0.8B, trained for two epochs on about 40,000 pairs. The developer reports that the quantized Q4_K_M version with imatrix is 529 MB; training took 22 minutes on a rented RTX 5090, with the GPU rental and evaluations costing about $2.50. On an eight-thread CPU test, speculative decoding had a median time of 138 milliseconds per sentence versus 305 milliseconds with greedy decoding; outputs matched greedy decoding on 99.4% of a 500-sentence sample.
Written from coverage as of