Betelgeuse runs Qwen 3.8 Flash Next at 22 tokens per second on an RTX 3060
Reported by r/LocalLLaMA2 sources ↓
A community developer reports that Betelgeuse ran the 68GB Qwen 3.8 Flash Next build at 22.03 tokens per second on an RTX 3060 with 12GB VRAM and 16GB RAM, without pruning experts.
Key points
- The developer reports 16.80 tokens per second on a cold run and 22.03 on a warm run
- Generation reached bursts of up to 48 tokens per second, according to the developer
- The test used an RTX 3060 12GB, 16GB DDR4 RAM and a 12GB memory limit
- The developer says 576 generated tokens matched stock output byte-for-byte
Sources
- r/LocalLLaMARead ↗Betelgeuse: Running Qwen 3.8 Flash Next at 22 tok/s sustained (spiking to 48 tok/s) on an RTX 3060 12GB + 16GB DDR4 RAM 100% bit-exact!
- r/LocalLLaMARead ↗Betelgeuse running Qwen 3.8 Flash Next IQ4_XS at 24 tok/s on 2x8GB DDR4 (14 tok/s on a single 16GB stick) + RTX 3060 12GB — 0 dropped experts, 100% byte-exact
Details
The Betelgeuse developer says the engine ran a 68GB Qwen 3.8 Flash Next build on a PC with an RTX 3060 12GB, 16GB of DDR4 RAM and a consumer NVMe SSD. In reported tests, decode speed was 16.80 tokens per second on the first run and 22.03 on a warm run; bursts reached 48 tokens per second. The test ran under a 12GB memory limit.
The developer says Betelgeuse computes all 10 routed experts per layer across 48 layers without gate pruning. They report checking 28,080 router records and 576 generated tokens against stock output, with no byte differences. These are developer-reported results; the article provides no independent benchmark verification.
The post compares Betelgeuse with stock llama.cpp, which it reports ran at 1.47 tokens per second, and Strata in low-RAM mode, at 8.11 tokens per second on the same setup. The developer says Betelgeuse reduced physical SSD reads to 12.43 MiB per token, from 208–312 MiB for stock llama.cpp. The engine and a model bundle are linked in the post, and the developer says an upstream llama.cpp pull request is open.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh