I'm going to try to turn a 4B model into a genuinely useful coding agent that can compete with much larger models
Reported by r/LocalLLaMA1 source ↓
A developer is seeking community input before training a specialized coding agent based on the pretrained Qwen 3.5 4B. The proposed pilot would use 100–200 mini SaaS applications to train and evaluate coding tasks.
Key points
- The planned pilot would train and evaluate the model on development, testing, debugging and maintenance tasks
- If the pilot looks promising, the developer may expand to about 100,000 validated multi-turn trajectories across 30–40 subdomains
- The developer is asking for suggestions on coding domains, agent harnesses and evaluation methods
- They intend to release the weights, datasets and results, including unsuccessful experiments
Details
In a post on r/LocalLLaMA, the developer proposes using pretrained Qwen 3.5 4B as the base for a coding model focused on related practical tasks. They say their initial tests show it can scaffold Vite projects, install dependencies, run commands and build simple applications, though its performance is inconsistent.
The proposed pilot would center on 100–200 functional mini SaaS applications. Training examples would cover complete tasks, including tool use, errors and corrections; the developer says they would use teacher models whose terms allow their outputs to be used for training.
Potential areas include web development, backend and SaaS applications, games and 3D, and research and automation. The developer is considering Codex, OpenCode, Pi or a custom harness, and wants to select one environment with a stable tool protocol. They say they prefer to avoid uncertainty about licensing and training-data use.
The developer says an expansion could reach about 100,000 validated multi-turn trajectories across 30–40 related subdomains if early results are promising. They are asking the community to suggest priorities and evaluation methods, and say they plan to release weights, datasets and results openly.
Written from coverage as of