[GUIDE] Qwen3.8 Flash-Next on a single RTX 5080 + 64GB RAM: >250 tok/s tg and 5700 tok/s prefill in real agent coding sessions (Basalt + new Unsloth UD-IQ3_XXS + Lamina drafter),+ how it compares to llama.cpp
Reported by r/LocalLLaMA1 source ↓
Key points
- The author reports 195.6 tokens per second on average and 263 at best during an agent coding session
- The setup used an RTX 5080 with 16GB of VRAM and 64GB of system RAM
- The author measured higher draft acceptance with Lamina than with Basalt’s stock drafter
- The guide requires an RTX card, CUDA 13, 64GB RAM and about 180GB of free disk space
Details
The r/LocalLLaMA guide reports results from 151 requests in an OpenCode agent coding session, with context reaching 202,000 tokens. The author measured average decoding at 195.6 tokens per second, with a best request at 263 and a worst at 156; prompt processing reached about 5,700 tokens per second.
On the same model file and computer, the author reports Basalt decoded about 3.5 times faster than llama.cpp without drafting and about five times faster with drafting. Prompt processing was about seven times faster, according to the guide. The hardware was an RTX 5080 at its stock 360W limit, an Intel Core Ultra 9 285K and 64GB of DDR5 memory.
The setup uses Unsloth’s UD-IQ3_XXS quantization and Lamina, a further-trained draft model. In a replay of a recorded session, the author measured draft acceptance increasing from 83.1% to 85.8%; they report that the quantization reduced decoding speed by 1% to 3.5% while improving the reported WikiText perplexity score from 3.382 to 3.247.
The guide provides a setup script that downloads about 90GB of files and builds the model and configuration. It says users need an RTX card, CUDA 13, 64GB of RAM and about 180GB of free disk space. The performance figures are the guide author’s measurements; the article does not provide an independent benchmark.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh