After Qwenputer, I wondered if a smaller model could do it too. So I built a Forth interpreter into Nemotron 3.5 Lightning's weights
Reported by r/LocalLLaMA1 source ↓
A community researcher says they added an untrained Forth interpreter network alongside Nemotron 3.5 Lightning. LoRA fine-tuning raised its score on a 600-problem test from 79.1% to 92.1%.
Key points
- LoRA fine-tuning raised the model's score on a 600-problem test from 79.1% to 92.1%
- The interpreter's 765,734 machine tokens matched a Python reference in the researcher's tests
- Nemotron 3.5 Lightning has 30B parameters, with 3B active; the added network has 27 layers
- Results on Qwenputer arithmetic sets were mixed, and the machine is limited to 20-digit integers
- The researcher says each machine step costs a full forward pass, making it slower than a tool call
Details
The researcher says the setup leaves Nemotron 3.5 Lightning unchanged and places a separate, untrained 27-layer network alongside it. The machine uses Mamba-2 state for its stack and 982 reserved tokens for internal steps.
In the researcher's tests, all 765,734 machine tokens matched a Python reference. The model initially had trouble trusting and using the interpreter; LoRA fine-tuning raised its score from 79.1% to 92.1% on a held-out test of 600 problems. The post says results on Qwenputer's arithmetic sets were mixed: the model roughly tied stock Lightning on DeepMind sets and lost to Python on long integers because the machine is limited to 20 digits.
The researcher describes the work as a research project rather than a production system, noting that each machine step requires a full forward pass and that a normal tool call is much faster. The shared repository includes the kernel builder, parity tests, a vLLM plugin, training materials and model builds; the researcher says the project is MIT-licensed.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh