When Can One Neuron Fix Repetition Loops in LLMs?

Aristotelis Lazaridis, Aman Sharma, Dylan Bates +3

The Gemma 4 instruction-tuned models share a reproducible failure: on long factual enumeration prompts, such as TV episodes, the 88 IAU constellations, or the 151 original Pokemon,…