5 citations · 6 across the 27 of their papers we have counts for
4 papers · 2 filters
When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions
Wei Xia, Haoqing Wang, Zhi-Hong Deng +1
Chain-of-thought (CoT) reasoning has become the default strategy for enhancing LLM capabilities, yet its application raises a fundamental question: when is explicit reasoning actua…
Priming: Hybrid State Space Models From Pre-trained Transformers
Aditya Chattopadhyay, Elvis Nunez, Prannay Kaul +6
Hybrid State-Space models combine Attention with recurrent State-Space Model (SSM) layers, balancing eidetic memory from Attention with compressed fading memory from SSMs. This yie…
Experience Sharing in Mutual Reinforcement Learning for Heterogeneous Language Models
Xiaoze Liu, Dhananjay Ram, Yuting Zhang +3
We introduce Mutual Reinforcement Learning, a framework for concurrent RL post-training in which heterogeneous LLM policies exchange typed experience while keeping separate paramet…
Reinforcement-aware Knowledge Distillation for LLM Reasoning
Zhaoyang Zhang, Shuli Jiang, Yantao Shen +6
Reinforcement learning (RL) post-training has recently driven major gains in long chain-of-thought reasoning large language models (LLMs), but the high inference cost of such model…