Developer releases Saber inference engine for AMD R9700 GPUs
Reported by r/LocalLLaMA2 sources ↓
A community post says Saber, a Rust inference engine targeting AMD R9700 GPUs, is available on GitHub. Its developer reports benchmark results for Qwen3.8 27b and says Flash next is also supported.
Key points
- The developer reports Qwen3.8 27b results of 6,645 tokens per second for prefill and 316 for peak decode
- Saber supports tensor parallelism settings of 1, 2 or 4
- The reported benchmark used two R9700 GPUs, a Ryzen 9900X and 64 GB of RAM
Sources
Details
The developer says Saber supports Qwen3.8 27b and Flash next, and can run with tensor parallelism settings of 1, 2 or 4. The community post links to a GitHub release.
For Qwen3.8 27b, the developer reports BetterBench results of 6,645 tokens per second for prefill and 316 tokens per second for peak decode. The test setup listed two R9700 GPUs, an AMD Ryzen 9900X, a Taichi X870E motherboard and 64 GB of RAM; the developer also claims Saber outperforms other available engines on Qwen3.8 27b and Flash next.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh