Update: tandem.cpp — DeepSeek-V4.1 on a 64 GB PC with a 16 GB card, and AMD (ROCm) support
Reported by r/LocalLLaMA2 sources ↓
A tandem.cpp developer reports DeepSeek-V4.1 and other model tests on consumer PCs, and says the llama.cpp patch now builds with AMD ROCm. The post compares performance across GPUs and inference engines.
Key points
- On a 64 GB PC with an RTX 5070 Ti, tandem.cpp decoded DeepSeek-V4.1 at 14.2 tokens per second, versus 7.4 for llama.cpp
- The patch builds with AMD ROCm and was tested on an RX 7900 XTX
- On that AMD card, tandem.cpp recorded 68.6 tokens per second on Qwen3.8 IQ3_S with MTP
- Vulkan support is not available yet
Sources
Details
The developer says tandem.cpp keeps frequently used model experts on the GPU and uses the CPU for the rest. In tests of DeepSeek-V4.1-Flash, the model had 139 GiB of experts and used the same quantization across engines, with no expert skipping. On a PC with an RTX 5070 Ti 16 GB, 64 GB of RAM and an i5-14600KF, tandem.cpp reached 14.2 tokens per second, compared with 7.4 for llama.cpp and 10.4 for Strata.
The post also reports results on systems with less memory than the model size. With an RTX 5070 Ti and 32 GB of RAM, tandem.cpp ran Qwen3.8-Flash-Next at 34.3 tokens per second, compared with 14.9 for llama.cpp and 30.3 for Strata. The developer says the DeepSeek-V4.1 model was about twice the available RAM on the 64 GB system and streamed from its SSD.
For AMD, the developer says the patch now builds with HIP and reports a test on an RX 7900 XTX with 64 GB of RAM. On Qwen3.8 IQ3_S with MTP, tandem.cpp reached 68.6 tokens per second; Strata 0.2.9 reached 69.7, Strata’s RDNA3 fork 80.1, and Avalon 83.6 using its own quantization. The post says shared CUDA/HIP kernel work improved results by 2.5% on the RX 7900 XTX and 1.3% on an RTX 5070 Ti; Vulkan is not supported yet.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh