Benchmarking: Qwen 27B, 35B, QFN180B; Nemotron Bolt 74B, Flint40B & Clover 35B (Q4 + KFlash) on MacBook M5 Max 2026 with Kapitsa (Apple Silicon Inference Engine)
Reported by r/LocalLLaMA1 source ↓
Key points
- Kapitsa reports decode speeds from 108 to 346 tokens per second across six models
- The 32K-context Qwen 35B run reached 175 tokens per second for decoding
- Kapitsa says Flash-Next 180B runs at 61 tokens per second on a 48 GB Mac using SSD offloading
- Version 0.2.26 is available for Apple Silicon Macs
Details
The community post reports tests on a 2026 16-inch MacBook Pro with an M5 Max and 128 GB of memory. Kapitsa’s reported decode and prompt-prefill speeds were 346 and 6,036 tokens per second for Qwen3.6 35B-A3B; 304 and 5,981 for Clover 35B-A3B; 265 and 5,770 for Flint 40B; 154 and 1,075 for Nemotron Bolt 74B; 143 and 904 for Qwen3.8 27B; and 108 and 1,701 for Qwen Flash-Next 180B. The post says the measurements used a 512-token coding answer and a 4K prompt, with the median of three runs.
Kapitsa says the latest update, version 0.2.26, adds DiffuSpace’s Clover 35B and improves Flash-Next 180B prompt processing by 46% and Qwen 27B decoding by 8% compared with the project’s previous M5 Max results. At 32K context, it reports Qwen 35B decoding at 175 tokens per second; Flash-Next’s rate fell from 90 to 78 tokens per second.
The post says Kapitsa can run Flash-Next 180B on a 48 GB MacBook Pro by streaming model data that does not fit in memory from an SSD, at 61 tokens per second.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh