Speedy is shockingly good for qwen3.8 FN
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user compared Speedy with Avalon and Strata on a 4090 system, reporting shorter whole-exchange times for Speedy at 60K, 120K and 198K context lengths.
Key points
- The user reported Speedy completed exchanges faster than Avalon at all three tested context lengths
- At 60K context, reported whole-exchange times were 23.9 seconds for Speedy and 32.1 for Avalon
- At 198K context, reported whole-exchange times were 56.1 seconds for Speedy and 81.5 for Avalon
- Tests used a 4090, 128GB DDR5-3600 memory and a Ryzen 9 7950X
Details
The LocalLLaMA post compares Speedy, Avalon and Strata using an ISTA IQ3_S quantization setup. The user lists results at 60K, 120K and 198K context lengths on a system with an RTX 4090, 128GB of DDR5-3600 memory and a Ryzen 9 7950X.
For whole-exchange time, the post reports Speedy at 23.9, 37.0 and 56.1 seconds across those context lengths, compared with Avalon at 32.1, 52.0 and 81.5 seconds. It also reports Speedy generation rates of 110.0, 105.8 and 104.3 tokens per second, versus Avalon's 102.5, 101.6 and 103.0.
These figures come from one community post; the article provides no independent verification or further testing details.
Written from coverage as of