Switching to EPYC: what I had to fix, and before/after numbers
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA community member replaced a Core Ultra 7 265KF system with an EPYC 7443 workstation and reported large gains on some memory-bound AI workloads after tuning. GPU-heavy Qwen3.8-27B performance was roughly unchanged.
Key points
- GLM-5.3-Flash decode rose from 9.7 to 41.0 tokens per second
- DeepSeek-V4.1-Flash decode rose from 9.3 to 35.2 tokens per second
- The new system has 256 GB of DDR4 ECC RAM across eight channels, up from 64 GB of DDR5
- Qwen3.8-27B decode was about the same after tuning
- One of four GPUs was unavailable for the reported large MoE runs
Details
The user replaced a Core Ultra 7 265KF and MSI Z890 system with a 24-core EPYC 7443 and Supermicro H12SSL-NT motherboard. The same four GPUs were used across the comparison, but one RTX 5060 Ti was waiting for a riser, so the large mixture-of-experts runs used three cards after the change rather than four before it.
The new system has 256 GB of DDR4 ECC memory running at 3200 MT/s across eight channels, compared with 64 GB of DDR5-6000 across two channels. Reported memory bandwidth rose from 58.8 to 102.0 GB/s. The user also reported roughly doubled host-to-GPU bandwidth for the RTX 3090 and RTX 5070 Ti, and a 2.2-fold increase for the RTX 5060 Ti.
After tuning, GLM-5.3-Flash decode increased from 9.7 to 41.0 tokens per second, while DeepSeek-V4.1-Flash increased from 9.3 to 35.2. The user said these large models had previously read 30–60% of their weights from NVMe on each token; the upgraded system kept them in VRAM and RAM. The user also noted that Maya and Strata software versions changed during testing.
Results varied by workload. Qwen3.8-27B decode was approximately unchanged, and its 64K-prompt prefill was 1,120 tokens per second after tuning versus 1,146 before. The user reported that BIOS and kernel settings, fan thresholds, and a larger llama.cpp micro-batch affected results; idle power was about 180 W after the changes, compared with 156 W initially.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh