How long are we gonna depend bunch of model creators (like Qwen, Gemma, NVIDIA, etc.,) for ~100B models?
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA community post asks how users could access models that fit on consumer hardware if model creators shift toward much larger releases. The author suggests self-made distillation and low-bit models as possible alternatives.
Key points
- The post says models above roughly 300B parameters may exceed the capacity of some 128GB systems
- The author identifies distillation and 1-bit, 2-bit or ternary models as possible alternatives
- The post asks for practical ways to create distills and for more ternary mixture-of-experts models
Details
A LocalLLaMA user argues that growing model sizes could leave people relying on a smaller set of creators for models around 100B parameters. The author expects releases around that size to remain available through 2027, but presents this as their own expectation, not a confirmed industry schedule.
The post lists possible alternatives including distillation and low-bit models, and points to several existing examples. It says the author knows of only a few distills and is waiting for more ternary mixture-of-experts models around 100B parameters; the post does not provide a tested recipe for making distills.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh