I tried MIT's "weight-space programming" on my own use case: Claude rewrote 8 neurons of Gemma 4 12B to change how it translates one Italian tense
Reported by r/LocalLLaMA1 source ↓
Key points
- The edit reduced use of the original tense from 26% to 5% and 32% to 16% in two tests
- The change touched about 92,000 of 11.9 billion parameters, the author reports
- Two of three runs succeeded; the third failed because of the author's test setup
- The experiment covered one construction in one model
Details
The LocalLLaMA poster used Claude Opus 5.5 and a Python kernel to modify Gemma 4 12B’s weights, with 50 forward passes and no gradients or training. The goal was to favor an Italian imperfect construction when an action was still ongoing in the past, while retaining the original tense when the action had ended.
The poster says a probe found that Gemma already represented the distinction, but did not reliably use it when selecting a verb form. Claude rewrote eight MLP neurons as a context-sensitive switch; the resulting difference was about 92,000 parameters, or roughly 100 KB, out of 11.9 billion.
On two test sets, the original tense appeared in 5% and 16% of the cases after the edit, compared with 26% and 32% for unmodified Gemma. The edit caused two control sentences to take a wrong reading, while 182 of 200 unrelated translations remained identical; the poster says the prompt and LoRA baselines changed more unrelated outputs.
The report describes a single model and construction, and says two of three runs succeeded; the third failed because of the author's harness. The poster shared the edits, code, agent logs and comparison baselines in a GitHub repository.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh