Sparse RL Relaxation for LLM Reasoning

Jiabin Fan, Matthias Lindemann, Zita Marinho +2

Recent work has explored continuous representations in place of discrete tokens during Chain-of-Thought (CoT) reasoning, often referred to as soft CoT. This is motivated by the ide…