A community post reports evaluating six models with 4 billion parameters or fewer on its own AI agent tasks. It provides no scores or detailed results in the post.
Key points
The evaluated models were Qwen3.5-4B, Spark-X2.6, LFM3-1.7B, LFM2.5-2.6B, Gemma 4 E2B and MiniCPM5-2B
The post says small models differ in their strengths and weaknesses
The post gives no scores or model-by-model comparisons
The r/LocalLLaMA post says the evaluation used the authors’ own AI agent tasks. It links to a Camthink.ai blog post and the NeoMind project, but the provided post does not include the evaluation method or detailed results.
The authors describe a rapid improvement in the “intelligent density” of small models, without giving measurements to support that assessment.