Beyond Depth Truncation: Controlled Evaluation of Depth Utilization in Recursive Language Models

Ha Van Dau, Thanh Tung Khuat, Nguyen Thanh Dung

Depth-recurrent language models iteratively apply a small layer stack, decoupling per-token compute from distinct parameter count. To determine whether such a model genuinely utili…