My setup for 2x 5060TI
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user shares a dual-RTX 5060 Ti setup and benchmark results, reporting 1,530 tokens per second of prefill at 176K context and 72–85 tokens per second of decode. The reported Gen4 results are estimates, not measurements.
Key points
- The user reports 1,530 tokens per second of prefill at 176K context on PCIe Gen3 x8/x8
- Decode measured 72–85 tokens per second for one request
- Moving the second GPU from chipset lanes to CPU lanes cut reported time-to-first-token by about 2.5x
- The setup uses two 16GB RTX 5060 Ti cards and Qwen3.8-27B NVFP4
- Gen4 performance figures are estimates; the user has not tested them
Details
The user posted the setup and results on r/LocalLLaMA, describing a system with two 16GB RTX 5060 Ti GPUs, a Ryzen 7 5800X and a B550 motherboard configured for CPU-connected x8/x8 lanes. They run Qwen3.8-27B in NVFP4 with tensor parallelism, an int8 KV cache and speculative decoding, using capy-flash and OpenCode.
In the user's tests, prefill ranged from 3,860 tokens per second at a 2K-token prompt to 1,530 tokens per second at 176K context. Single-request decode ranged from 71 to 84 tokens per second across the listed prompt sizes. The user says moving the second GPU from the chipset to CPU lanes reduced time-to-first-token by about 2.5 times and doubled batching throughput.
The user estimates that changing from PCIe Gen3 to Gen4 x8/x8 would raise prefill to roughly 4,500–5,000 tokens per second at 35K context and 1,800–2,200 at 176K; those figures have not been measured. They report that enabling peer-to-peer transfers increased decode by about 5% but did not change prefill.
Written from coverage as of