Latent Reasoning with Supervised Thinking States

Ido Amos, Avi Caciularu, Mor Geva +4

Reasoning with a chain-of-thought (CoT) enables Large Language Models (LLMs) to solve complex tasks but incurs significant inference costs due to the generation of long rationales.…