Infernix releases an inference engine update for Qwen models
Reported by r/LocalLLaMA1 source ↓
Infernix’s developer released an update focused on running recent Qwen models on RTX 5090 systems, with Windows and Linux support, new model formats, and a beta web interface.
Key points
- The update adds support for several Qwen3.8-Flash-Next model variants and DFlash2 speculative decoding
- A beta launcher can download and configure models and includes model switching, logging, statistics, and test chat
- The developer says Infernix beats Strata in many of its benchmark comparisons, with results varying by model and context length
- The developer says Windows builds are available for download; Linux is also supported
Details
The update adds NVIDIA QAD FP4, GSQ-RCO-IQ3_S, NVFP4, and full FP8 versions of Qwen3.8-Flash-Next, along with an Ornith 1.5 122B NVFP4 model. The developer also added automatic speculative-decoding configuration, a lossless mode for reproducible calculations, and a beta web launcher. The project is intended for RTX 5090 systems and supports Windows and Linux.
The developer reports benchmark comparisons against Strata, Basalt, and NInfer, with results depending on the model, context length, and precision settings. For example, in tests using Qwen3.8-Flash-Next NVFP4, the developer reports first-token times of 3.1 seconds for Infernix versus 12.3 seconds for Strata and 7.2 seconds for Basalt. These are the developer’s results; the post does not provide independent verification.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh