Rather Qwen4-27b at 1M ctx than a big MOE at 128k
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user argues that, on a system with 48GB of VRAM and 64GB of system RAM, a smaller model with a larger context window is more useful than a larger mixture-of-experts model with a shorter context.
Key points
- The user reports using Qwen3.8-27B with a 400,000-token context window
- They say larger context helps agentic sessions avoid rereading files
- The user proposes Qwen4-27B with a 1-million-token context window, but reports no such release or test
Details
The post is a user's account of local model use and preference, not a reported benchmark. The user says they currently use Qwen3.8-27B with a 400,000-token context window and web search to retrieve current documentation.
They argue that extra context can let an agent work with more material without rereading files, and say they prefer that setup to a faster model they tried. They suggest Qwen4-27B with a 1-million-token context window could suit their needs, but the post does not establish that the model or context configuration is available or tested.
The user says their system has 48GB of VRAM and 64GB of system RAM. They also say a large mixture-of-experts model with at least 12 billion active parameters and a 1-million-token context could be better, but consider a smaller model more efficient for their hardware.
Written from coverage as of