6 papers · 1 filter
From Outcomes to Steps: Reliable Success-Aware Critic Learning for Long-Horizon Language Agents
Jiaxi Liu, Shixiong Kai, Zhentao Tang +4
Reinforcement learning for long-horizon language agents requires identifying whether intermediate actions make eventual task success more or less likely when supervision is availab…
Test-time Calibration Learning for Large Language Model Reasoning
Zizhuo Zhang, Xiong Peng, Jingwei Sun +4
Reliable large language models (LLMs) must not only produce accurate answers but also express confidence that faithfully reflects their probability of being correct. Such calibrati…
ASymPO: Asymmetric-Scale Policy Optimization for Asynchronous LLM Post-Training Without Behavior Information
Zehua Liu, Yuxuan Yao, Xiaojin Fu +2
Asynchronous reinforcement learning can improve language-model post-training throughput by decoupling response generation from policy optimization, but stale responses introduce di…
RIFT: Repurposing Negative Samples via Reward-Informed Fine-Tuning
Zehua Liu, Shuqi Liu, Tao Zhong +1
While Supervised Fine-Tuning (SFT) and Rejection Sampling Fine-Tuning (RFT) are standard for LLM alignment, they either rely on costly expert data or discard valuable negative samp…
REG: A Regularization Optimizer for Robust Training Dynamics
Zehua Liu, Han Wu, Xiaojin Fu +4
Optimizers are crucial for the efficient training of Large Language Models (LLMs). While AdamW is the de facto standard, recent structure-aware optimizers like Muon have emerged, w…
MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
Zehua Liu, Han Wu, Ruifeng She +4
Mixture of Experts (MoE) has become a key architectural paradigm for efficiently scaling Large Language Models (LLMs) by selectively activating a subset of parameters for each inpu…