Betelgeuse running DeepSeek V4.1 Flash Q8_XL (1017) at 19 tok/s decode & 62 tok/s prefill on an RTX 3060 12GB + 16GB RAM: How we finally fixed the prefill bottleneck on out-of-core MoEs
, updated First seen Updated Limited coverage, tapering
DeepSeek · Models
Reported by r/LocalLLaMA1 source ↓