Can Opus weight-space-edit Qwen3.8-27B to refuse less? Yes
Reported by r/LocalLLaMA1 source ↓
A r/LocalLLaMA poster reports a reversible, low-rank edit that reduced Qwen3.8-27B’s refusals by about 50% overall, with no measurable loss on initial capability benchmarks. The effect varied by category and often involved hedged or partial answers.
Key points
- The edit targets one direction in each of layers 20–47, without additional training
- The poster reports MMLU-Pro at 73% and GSM8K at 93%, matching the base model
- Acceptance across nine prompt categories ranged from about 10% to 76%
- The edited model weights are available as a GGUF file on Hugging Face
Details
The r/LocalLLaMA poster says the edit reduced refusals by about 50% overall, but did not remove them consistently. Across a nine-category test battery, acceptance ranged from about 10% to 76%; the poster says most accepted responses were hedged or offered partial help.
The edit is a reversible, low-rank change to layers 20–47 of the model’s 64 layers, using one direction per layer and no training. The poster says it shifts about 12% of weight values along those directions, represented by 28 small vectors.
In initial Q8 benchmark tests, the poster reports the edited model matched the base model on MMLU-Pro (73%), GSM8K (93%) and a known-facts test (99%). Agentic-coding runs also showed no clear difference, but the poster describes those results as preliminary and based on few runs. The edited weights are available as a GGUF file on Hugging Face.
Written from coverage as of