Selective Latent Thinking: Adaptive Compression of LLM Reasoning Chains

Hui Xie, Jie Liu, Ziyue Qiao +1

Explicit chain-of-thought (CoT) reasoning substantially improves the reasoning ability of large language models (LLMs), but incurs high inference cost due to lengthy autoregressive…