Tiny's new AI workstation is anything but — packing in 16 TB SSD array and 128 GB GPU memory, but with an eye-watering price tag to boot
Reported by TechRadar1 source ↓
Tiny Corp's new tinybox uses an SSD array alongside GPU memory to run Moonshot's Kimi K3 locally. Its claimed speed has not been independently tested.
Key points
- TechRadar reports the tinybox Red Kimi costs $30,000
- It combines four GPUs with sixteen 1 TB SSDs
- Tiny Corp claims 40 tokens per second running Kimi K3; no outside test has confirmed the figure
- Tiny Corp has not disclosed the precision, context length, batch size or method behind its speed claim
Details
TechRadar reports that the tinybox Red Kimi pairs four AMD Radeon AI Pro R9700 GPUs, with 128 GB of GPU memory in total, with sixteen 1 TB NVMe SSDs. The system also has 32 GB of system memory and a 32-core AMD Epyc Genoa processor; TechRadar says the exact processor model is not specified. Tiny Corp lists the machine at $30,000.
Tiny Corp says its tinygrad software lets the GPUs access the SSDs directly, and claims the system can run Moonshot AI's 2.8-trillion-parameter Kimi K3 at 40 tokens per second. TechRadar says that speed has not been independently tested. The article notes that the model's published checkpoint is about 1.56 TB, far more than the GPUs can hold, and that the company has not disclosed key details of the speed test, including its precision and context length.
TechRadar's analysis says the claimed rate would require most of the weights used for each token to be served from GPU memory, rather than the SSD array. The article also notes that the system's SSD bandwidth is insufficient to supply all those weights at the claimed rate on its own.
Written from coverage as of
Images
- TechRadar
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh