What Qwen is thinking when it gets stuck saying "Wait"
Reported by r/LocalLLaMA1 source ↓
A community post reports using Anthropic’s Jacobian lens to inspect Qwen3.5-0.8B as it repeats “Wait,” and says a small weight edit changed the model’s apparent internal signals toward completion.
Key points
- The post says the lens read signals of doubt at the token where Qwen repeats “Wait”
- The author reports an edit to 0.016% of weights raised MATH-500 accuracy from 7.9% to 48.1%
- The edited model reportedly still worked at Q4_K_M quantization, with one loop in 40 samples
Details
The r/LocalLLaMA post says the author used Anthropic’s Jacobian lens to inspect Qwen3.5-0.8B. At the token where the model repeats “Wait,” the lens showed concepts the author described as “Wrong,” “Nope” and “Hmm,” despite the answer already being written; at stopping points, it showed “</think>,” “Answer” and “Output.”
The author says a weight edit attributed to MIT CSAIL and GPT-6 Astra changed 0.016% of the model’s weights and raised its MATH-500 score from 7.9% to 48.1%. With the edit applied, the lens showed “Verification,” “Completion” and “Result” at the repeated token. The post says the edit can be rebuilt from a released diff, converts to GGUF, and retained performance at Q4_K_M, with one loop in 40 samples; the author cautions that the samples are small.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh