1Cat-vLLM vs Strata
Reported by r/LocalLLaMA1 source ↓
A community member’s tests on four Tesla V100 GPUs found 1Cat-vLLM had higher decode speeds than Strata across the tested prompt lengths, while Strata had higher prefill speed at about 97,000 tokens.
Key points
- 1Cat-vLLM recorded higher decode speeds than Strata in the reported tests
- Strata prefilling was faster on the roughly 97,000-token prompt
- Tests used four 16 GB Tesla V100 GPUs and a Qwen3.8-Flash-Next quant
- The 97,000-token single-stream result was run once; most single-stream results were medians of three runs
Details
The comparison was posted on r/LocalLLaMA. For single requests, the poster reported 1Cat-vLLM decoding at about 125–143 tokens per second, compared with roughly 75–79 for Strata, across prompts from about 2,700 to 96,600 tokens. Strata had higher prefill speed on the longest prompt; 1Cat-vLLM was faster on the shorter prompts shown.
The tests used a Qwen3.8-Flash-Next UD-IQ3_XXS quant on four 16 GB Tesla V100 GPUs connected over PCIe 3, with an AMD Epyc 7543 CPU. The poster says most single-request results were medians of three runs, but the roughly 97,000-token result was run once; concurrent-request results were medians of two runs. The post also reports higher aggregate decode throughput for 1Cat-vLLM in the tested concurrent-request cases, but these are results from one user’s setup, not an independent evaluation.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh