Recurrent Self-Improvement: Dynamic Cross-Loop On-Policy Distillation for Looped Language Models

Yi Wang, Rui Qian, Yu Li +2

Looped Language Models (LoopLMs) offer a parameter efficient approach to scaling reasoning by reusing shared parameters across recurrent computation steps. Despite their promise, e…