Intel Arc Pro B70 32GB ($1,299) vs NVIDIA RTX 5090 ($6,500+) on Qwen3.8-27B: about 1/2 speed gen (1/3 speed prefill) for 1/5 price, after best setup
Reported by r/LocalLLaMA1 source ↓
Key points
- The user reports about 52 tokens per second generation on the B70 after tuning
- The B70 cost $1,299; the user says RTX 5090 listings were $6,500 or more
- The user’s final setup used llama.cpp with Intel’s SYCL backend, quantized KV cache and MTP
- The 5090 comparison figures came from other users’ posts, not the author’s own test
Details
The LocalLLaMA poster says an Intel Arc Pro B70 with 32GB of memory reached roughly 52 tokens per second generating Qwen3.8-27B Q6, with prompt processing around 960 tokens per second. The poster paid $1,299 for the card and compared it with RTX 5090 figures found in other users’ posts; the poster did not test a 5090 personally.
The user says performance depended on software and configuration. Their final setup used a Linux kernel version 6.17 or newer, updated Intel compute software and Mesa, and llama.cpp’s SYCL backend. With SYCL, the user also enabled a quantized KV cache and speculative decoding using MTP; they report that quantized KV cache caused substantial generation slowdowns in their Vulkan tests.
In the user’s tests, the initial Ollama and Vulkan setup processed prompts at 137 tokens per second and generated at 6.8 tokens per second at 16k context. Their final SYCL setup with q8_0 KV cache and MTP reached 1,032 prompt tokens per second and 56.5 generation tokens per second at 16k context, and supported a reported maximum context of 223k tokens. The poster says a 215k-token prompt took 8.6 minutes to reach its first token on SYCL, compared with 1.9 hours on Ollama and Vulkan.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh