15 citations · 15 across the 10 of their papers we have counts for
7 papers · 1 filter
Optimal Design for Active Preference Learning with Biased LLM Judges
Zhongman Du, Huiming Zhang, Haodong Zhu +1
Learning from human preferences is central to large language model (LLM) alignment, but human preference annotation is costly. Active preference learning reduces this cost by selec…
GraphHCA: Closed-Form Hindsight Credit Assignment for Long-Horizon LLM Agents
Haodong Zhu, Yangyang Ren, Changbai Li +4
Group-based reinforcement learning (RL) has advanced large language models (LLMs) and is increasingly extending to agentic tasks, where sparse terminal rewards make step-level cred…
Cross-Rollout Bellman Closure for Long-Horizon Agentic Reinforcement Learning
Yangyang Ren, Haodong Zhu, Linlin Yang +3
Group-based reinforcement learning such as GRPO trains LLM agents by comparing rollouts sampled for each task, without a learned critic. In long-horizon settings, these rollouts re…
MaPP: A Unified Marginalized Posterior-Predictive Framework for Data-Efficient RLVR
Yangyang Ren, Haodong Zhu, Sheng Xu +4
Reinforcement learning with verifiable rewards (RLVR) improves the reasoning capabilities of large language models but incurs substantial costs from rollouts and policy updates. On…
Kalman Meets Curriculum: Efficient Dynamic Prompt Selection for Adaptive RL Finetuning
Haodong Zhu, Yangyang Ren, Yanjing Li +4
Reinforcement learning (RL) finetuning significantly enhances the reasoning capabilities of large language models (LLMs), yet its effectiveness critically depends on selecting prom…
Unbiased Dynamic Pruning for Efficient Group-Based Policy Optimization
Haodong Zhu, Yangyang Ren, Yanjing Li +6
Group Relative Policy Optimization (GRPO) effectively scales LLM reasoning but incurs prohibitive computational costs due to its extensive group-based sampling requirement. While r…
Squeeze10-LLM: Squeezing LLMs' Weights by 10 Times via a Staged Mixed-Precision Quantization Method
Qingcheng Zhu, Yangyang Ren, Linlin Yang +6
Deploying large language models (LLMs) is challenging due to their massive parameters and high computational costs. Ultra low-bit quantization can significantly reduce storage and…