7 papers
GroupTravelBench: Benchmarking LLM Agents on Multi-Person Travel Planning
Xiang Cheng, Yulan Hu, Lulu Zheng +3
Travel planning in the real world is overwhelmingly a \textit{group} activity, yet existing LLM travel-planning benchmarks reduce it to a single user, where the field is approachin…
Multi-Stakeholder LLM Alignment: Decomposing Estimation from Aggregation
Lulu Zheng, Wenjin Yang, Xiangwen Zhang +4
Multi-stakeholder tasks require one output to satisfy users with conflicting preferences. Holistic LLM judges conflate utility estimation and utility aggregation, yielding unstable…
TRACE: Distilling Where It Matters via Token-Routed Self On-Policy Alignment
Jiaxuan Wang, Xuan Ouyang, Zhiyu Chen +4
On-policy self-distillation (self-OPD) densifies reinforcement learning with verifiable rewards (RLVR) by letting a policy teach itself under privileged context. We find that when…
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling
Jiaxuan Wang, Yulan Hu, Wenjin Yang +3
In classical Reinforcement Learning from Human Feedback (RLHF), Reward Models (RMs) serve as the fundamental signal provider for model alignment. As Large Language Models evolve in…
Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
Xiang Cheng, Yulan Hu, Xiangwen Zhang +5
Travel planning is a natural real-world task to test large language models' (LLMs) planning and tool-use abilities. Although prior work has studied LLM performance on travel planni…
No More Stale Feedback: Co-Evolving Critics for Open-World Agent Learning
Zhicong Li, Lingjie Jiang, Yulan Hu +7
Critique-guided reinforcement learning (RL) has emerged as a powerful paradigm for training LLM agents by augmenting sparse outcome rewards with natural-language feedback. However,…