Ai Rig finally done and stable, perfect winter heater
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user says they completed a home AI rig with eight RTX 3090 GPUs. They report generation speeds of about 60 tokens per second for one agent and 370 tokens per second across 10 agents.
Key points
- The rig uses eight Gigabyte Gaming OC RTX 3090 GPUs, bought for roughly £600–£700 each
- The user reports the system draws 300W at idle and limits each GPU to 270W
- The user measured GPU-to-GPU traffic at 22GB/s, except on two GPUs running at PCIe 4.0 x8
Details
The user says the system is built around a RomeD8-2T motherboard, with two power supplies and water cooling for the CPU. Six GPUs run at PCIe 4.0 x16; two share a slot and run at x8. The user says modified Nvidia drivers enable peer-to-peer traffic between GPUs.
In tests using a quantized Qwen model with vLLM and OpenCode, the user reports about 60 tokens per second with one agent and a peak aggregate rate of 370 tokens per second with 10 agents running in parallel. They say the rig idles at 300W and could be used to fine-tune small models; no independent measurements are provided.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh