Another benchmark has hit the quant war
Reported by r/LocalLLaMA1 source ↓
A creator of the Basalt inference engine says he replaced ISTA-DASLab’s quants in his Qwen-Flash-Next setup with similar-sized Unsloth quants after testing them. The post includes performance screenshots but no benchmark methodology or figures in its text.
Key points
- The Basalt creator says his Qwen-Flash-Next setup now uses Unsloth quants instead of ISTA-DASLab quants
- The creator says the alternatives were similar in size
- Unsloth has criticized ISTA-DASLab’s benchmark results as difficult to reproduce
Details
A community post reports that the creator of the Basalt inference engine had used ISTA-DASLab’s quants as the base for specially packed Qwen-Flash-Next quants, then switched to similar-sized Unsloth equivalents after testing. The post includes screenshots of performance numbers, but its text does not give the figures or describe the test method.
The post says Unsloth had raised concerns that ISTA-DASLab’s reported benchmark numbers could not be reproduced, and that Unsloth’s own testing found its quants outperforming ISTA-DASLab’s. It does not provide enough detail to independently compare the results.
Written from coverage as of