Pretraining with Token-Level Adaptive Latent Chain-of-Thought

Boyi Zeng, Yiqin Hao, He Li +8

Scaling large language models by increasing parameters and training data is increasingly constrained by limited high-quality corpora and rising communication costs. This work explo…