Grok 4.20 spent ~700 turns stuck in Red's house in Pokemon Red, and its own reasoning kept noticing
Reported by r/LocalLLaMA1 source ↓
A PokeBench log posted to r/LocalLLaMA says Grok 4.20 non-reasoning took 755 turns to get a starter in Pokémon Red after leaving the house at turn 36, repeatedly recognizing it was looping without escaping.
Key points
- Grok 4.20 non-reasoning left Red's house at turn 36 but did not get a starter until turn 755
- The run cost about $30, according to the post
- Grok 4.6 beat Brock in 316 turns for about $10, according to the post
Details
The PokeBench benchmark creator, writing in r/LocalLLaMA, says turn logs show Grok 4.20 non-reasoning repeatedly walking into walls and triggering dialogue with Red's mother after leaving the house. Its notes reportedly recognized the loop, including describing it as continuing for hundreds of turns, but it did not change course effectively.
The post says Grok 4.20 spent about $30 and barely reached its starter, while Grok 4.6 beat Brock in 316 turns for about $10. These figures and results come from the benchmark creator's post; no independent confirmation or explanation for the behavior is included.
Written from coverage as of