Latent Chain-of-Thought? Decoding the Depth-Recurrent Transformer

Wenquan Lu, Yuechuan Yang, Kyle Lee +2

Chain-of-thought (CoT) reasoning has enabled transformer-based language models to excel at complex mathematics and multi-step planning. However, in standard decoder-only architectu…