Qwen3.8-Flash-Next runs on a Valve Steam Machine with stock SteamOS
Reported by r/LocalLLaMA1 source ↓
A community post reports running Qwen3.8-Flash-Next on a Valve Steam Machine using stock SteamOS. The test found that a memory-budget setting improved decode speed, while enabling the model’s draft layer did not help.
Key points
- The test used a Valve Steam Machine with stock SteamOS and an 8 GB AMD GPU
- Setting a 64 GiB resident-memory budget was the only tested change that improved decode speed
- The draft layer used extra VRAM but did not improve decode speed in the reported tests
- Testing was limited to one machine and up to 61K-token prompts
Details
The r/LocalLLaMA post reports using the Gyro S TQ1_0 model through Strata on a Valve Steam Machine with 8 GB of AMD GPU memory and 32 GB of RAM. The setup used stock SteamOS 3.9.5, a 128K context, and a quantized KV cache. The machine served the model over the local network.
In the post’s tests, setting resident-budget-gib to 64 was the only configuration change that raised decode speed. With that setting, the author reports 17.3–19.8 tokens per second on shorter prompts and 17.6–17.9 tokens per second on prompts of 58K and 61K tokens; prefill was around 234–236 tokens per second on those longer prompts. Other tested changes, including a larger VRAM reserve, did not produce measurable improvements.
The author also tested a manually loaded draft layer, which used 820 MiB of VRAM and reduced the expert cache. Across three short-prompt runs, decode speed ranged from 15.6 to 18.4 tokens per second, with no reported gain over the configuration without the draft layer; prefill was about 10% lower. The author did not test prompts beyond 61K tokens and noted that available RAM fell to roughly 3.4 GB with the resident-memory setting.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh