From the 1 of 17 linked papers with an AI index.
11 papers · 1 filter
Multi-Stakeholder LLM Alignment: Decomposing Estimation from Aggregation
Lulu Zheng, Wenjin Yang, Xiangwen Zhang +4
Multi-stakeholder tasks require one output to satisfy users with conflicting preferences. Holistic LLM judges conflate utility estimation and utility aggregation, yielding unstable…
TRACE: Distilling Where It Matters via Token-Routed Self On-Policy Alignment
Jiaxuan Wang, Xuan Ouyang, Zhiyu Chen +4
On-policy self-distillation (self-OPD) densifies reinforcement learning with verifiable rewards (RLVR) by letting a policy teach itself under privileged context. We find that when…
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling
Jiaxuan Wang, Yulan Hu, Wenjin Yang +3
In classical Reinforcement Learning from Human Feedback (RLHF), Reward Models (RMs) serve as the fundamental signal provider for model alignment. As Large Language Models evolve in…
Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
Xiang Cheng, Yulan Hu, Xiangwen Zhang +5
Travel planning is a natural real-world task to test large language models' (LLMs) planning and tool-use abilities. Although prior work has studied LLM performance on travel planni…
No More Stale Feedback: Co-Evolving Critics for Open-World Agent Learning
Zhicong Li, Lingjie Jiang, Yulan Hu +7
Critique-guided reinforcement learning (RL) has emerged as a powerful paradigm for training LLM agents by augmenting sparse outcome rewards with natural-language feedback. However,…
Learn More with Less: Uncertainty Consistency Guided Query Selection for RLVR
Hao Yi, Yulan Hu, Xin Li +3
Large Language Models (LLMs) have recently improved mathematical reasoning through Reinforcement Learning with Verifiable Reward (RLVR). However, existing RLVR algorithms require l…