Strata user asks about quantization options for running Qwen Flash Next
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user asked how GSQ-RCO IQ3_S, NVFP4 and Unsloth quantizations compare when running Qwen Flash Next on a Ryzen 7 9800X3D, RTX 4090 and 64 GB of RAM.
Key points
- The user says Unsloth UD-Q4_K_XL runs at about 20–30 tokens per second on their setup
- Strata indicates about 6 GB of UD-Q4_K_XL is loaded from NVMe
- The post asks whether GSQ-RCO IQ3_S offers better response quality than Unsloth UD-IQ4_XS
Sources
Details
The October 31, 2026 post on r/LocalLLaMA describes experiments with Qwen Flash Next on a system with a Ryzen 7 9800X3D, RTX 4090 and 64 GB of RAM. The user says the model is near the practical limits of the hardware and asks about the quality and performance of several quantization formats.
The user reports that UD-Q4_K_XL is technically usable according to Strata, with around 6 GB loaded from NVMe, but generation speed falls to about 20–30 tokens per second. The post asks for user experiences comparing GSQ-RCO IQ3_S, Unsloth UD-IQ4_XS and NVFP4; it does not report test results comparing their quality or speed.
Written from coverage as of