AMD Loom Fun: Added Radeon 9700 support over the weekend. Benchmarked 48 models with an average 42% speedup over llama.cpp
Reported by r/LocalLLaMA1 source ↓
An AMD Loom contributor reports testing 48 language models on a Radeon 9700, with an average 42% speedup over llama.cpp. The comparison used models that fit in 32 GB of VRAM.
Key points
- The 48 tested models were selected from a set of 51 because they fit in 32 GB of VRAM
- The reported average speedup over llama.cpp was 42%
- Results vary by model and metric; some models showed little difference or did not fit in VRAM
Details
The contributor reports results for AMD Loom, described as an experimental inference stack with a runtime, kernel compiler and inference server. The benchmark covered prefill and short-decode performance on a Radeon 9700; the contributor says the average speedup across the 48 models was 42%.
The contributor says the test began with the same 51 trending Q4_K_M models used in earlier Strix Halo testing, then excluded three that did not fit in the Radeon 9700's 32 GB of VRAM. Reported results varied: for example, Qwen3.5-35B-A3B short decode measured 190 tokens per second with Loom versus 112 with llama.cpp, while gemma-4-E2B prefill measured 14,289 versus 14,519 tokens per second. The article does not provide independent verification of the benchmark or the average.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh