Strata EXL3 AMD fork adds faster decoding and experimental MiMo V2.6 Flash support
Reported by r/LocalLLaMA1 source ↓
An independent AMD-focused Strata EXL3 fork update reports 10–20% faster decoding on average and experimental MiMo V2.6 Flash inference at 25–30 tokens per second on two GPUs.
Key points
- The update reports decoding gains of 10–20% on average, with some tested cases improving by nearly 24%
- MiMo V2.6 Flash runs at about 25–30 tokens per second with a 2.20 bpw quant on two GPUs
- Benchmarks used two Radeon RX 7900 XTX cards, a Ryzen 9 7950X and Linux with ROCm
- MiMo support is experimental and has been tested only with the specified quant
Details
The developer reports that faster HIP kernels and revised memory management raised decode speeds by roughly 10–20% over the prior fork version, depending on quantization and workload. In the posted benchmarks, two-GPU results for Qwen3.8-Flash-Next improved by 6.6% to 23.9%; a one-GPU setup with CPU assistance improved by 8.2% to 15.2%.
The update also adds experimental support for MiMo V2.6 Flash, which the developer says runs at about 25–30 tokens per second using a 2.20 bpw MOPD quant. The developer recommends CPU assistance for this model, including with two GPUs, and says support has only been tested with that quant.
The tests used a Ryzen 9 7950X, 96GB of RAM and one or two Radeon RX 7900 XTX 24GB cards, running Linux and ROCm. The fork also adds optional repacking of quantized expert weights for CPU access from system RAM; the developer says whether it helps depends on hardware and GPU configuration. The project was developed and tested on RDNA3, and other AMD architectures have not yet been tested.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh