From the 1 of 7 linked papers with an AI index.
7 papers
Penelope: Localized Latent Recurrence for Efficient Structured Reasoning
Yutong Chen, Shouqian Shi, Xinran Liu +5
Penelope introduces a method that adds a localized recurrent computation within a decoder-only Transformer to perform structured reasoning efficiently, using a latent space instead…
Collaborative Parameter Learning: Mitigating Forgetting via Parameter-Level Gradient Analysis
Mutian Yang, Zisen Zhan, Yutong Chen +7
Catastrophic forgetting during knowledge injection impairs the ability of large language models to acquire new knowledge without overwriting previously mastered knowledge. Recent s…
CoScale-RL: Efficient Post-Training by Co-Scaling Data and Computation
Yutong Chen, Jiandong Gao, Ji Wu
Training Large Reasoning Model (LRM) is usually unstable and unpredictable, especially on hard problems or weak foundation models. We found that the current post-training scaling s…
Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline
Jiawei Xu, Arief Koesdwiady, Sisong Bei +8
Recent advances in LLM-based multi-agent systems (MAS) show that workflows composed of multiple LLM agents with distinct roles, tools, and communication patterns can outperform sin…
ENTRA: Entropy-Based Redundancy Avoidance in Large Language Model Reasoning
Ruichu Cai, Haopeng Du, Qingwen Lin +3
Large Reasoning Models (LRMs) often suffer from overthinking, generating unnecessarily long reasoning chains even for simple tasks. This leads to substantial computational overhead…
Towards Effective Model Editing for LLM Personalization
Baixiang Huang, Limeng Cui, Jiapeng Liu +7
Personalization is becoming indispensable for LLMs to align with individual user preferences and needs. Yet current approaches are often computationally expensive, data-intensive,…