2 citations · 3 across the 7 of their papers we have counts for
4 papers · 1 filter
Shared Actors Need Not Share Critics: Effects of Value Mismatch in Parallel Reinforcement Learning
Zhenya Liu, Yang Meng, Zhuokai Zhao +2
When a single policy is trained in parallel across multiple environments of the same task, such as procedurally generated levels, randomized dynamics, or curricula, implementations…
Rethinking Transfer in Continual Learning: A Replay-Based Realisation
Yang Meng, Zhenya Liu, Zhuokai Zhao +1
Continual learning studies how deployed language models can continually acquire new tasks without expensive retraining from scratch. Existing methods, whether rehearsal-based (repl…
Beyond Reward Hacking: Causal Rewards for Large Language Model Alignment
Chaoqi Wang, Zhuokai Zhao, Yibo Jiang +8
Recent advances in large language models (LLMs) have demonstrated significant progress in performing complex tasks. While Reinforcement Learning from Human Feedback (RLHF) has been…
Preference Optimization with Multi-Sample Comparisons
Chaoqi Wang, Zhuokai Zhao, Chen Zhu +8
Recent advancements in generative models, particularly large language models (LLMs) and diffusion models, have been driven by extensive pretraining on large datasets followed by po…