Hot take: frontier models haven’t actually become much smarter
Reported by r/LocalLLaMA1 source ↓
A software engineer’s Reddit post argues that frontier models’ practical gains may owe more to better tools and harnesses than to large increases in raw problem-solving ability. The author says this is an impression, not proof that progress has stalled.
Key points
- The author says newer frontier models rarely improved scores once a production harness was working well
- The post identifies context engineering and tool limitations as common causes of failures
- The author says newer models often help with software engineering, but results vary across harnesses
Details
The Reddit post’s author describes working with language models in software engineering, local-model experiments and product integrations. They define “raw intelligence” as using available information efficiently to solve problems, particularly under limits on time and tools.
The author says replacing a model with a newer frontier model rarely improved results on their production golden datasets once the surrounding harness was effective. They attribute many failures to context or tool limitations, and say some newer models’ workarounds were too slow or unreliable for production.
The post also notes that newer models have improved software-engineering results, while performance can vary across harnesses. The author acknowledges gains in tool use, hallucination reduction and context length, and says their observations do not establish that frontier progress has stalled or that efficient problem-solving requires few parameters.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh