A LocalLLaMA user asks for quality benchmarks comparing Basalt, Infernix and Strata
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA post asks whether Basalt and Infernix reduce output quality compared with Strata-nvfp4, rather than simply improving inference speed. The post provides no comparative quality benchmark results.
Key points
- The post asks whether faster inference comes with unacceptable quality loss
- The author says Basalt lacks dynamic RoPE scaling and instead applies static YaRN scaling for 524K context
- The post reports no quality scores or benchmark comparisons
Details
A user on r/LocalLLaMA is seeking benchmarks that compare the output quality of Basalt, Infernix and Strata-nvfp4. The post says speed comparisons alone do not show whether the faster options are worth using if they perform worse on quality.
The author says Basalt lacks dynamic RoPE scaling and uses static YaRN scaling set to 2 for 524K context from the start. They also say Basalt lacks a censorship switch, though the machinery to add one is present. The post does not provide comparative quality results.
Written from coverage as of