77 citations · 118 across the 11 of their papers we have counts for
4 papers · 2 filters
Understanding Negative Learning in Large Language Model Fine-tuning
Yue Wang, Qizhou Wang, Zizhuo Zhang +3
Negative learning has never been more important than it is today, particularly in large language model (LLM) fine-tuning, where it underpins machine unlearning, preference- and rew…
Towards Understanding Valuable Preference Data for Large Language Model Alignment
Zizhuo Zhang, Qizhou Wang, Shanshan Ye +4
Large language model (LLM) alignment is typically achieved through learning from human preference comparisons, making the quality of preference data critical to its success. Existi…
Co-rewarding: Stable Self-supervised RL for Eliciting Reasoning in Large Language Models
Zizhuo Zhang, Jianing Zhu, Xinmu Ge +6
While reinforcement learning with verifiable rewards (RLVR) is effective to improve the reasoning ability of large language models (LLMs), its reliance on human-annotated labels le…
Two Minds Better Than One: Collaborative Reward Modeling for LLM Alignment
Jiazheng Zhang, Wenqing Jing, Zizhuo Zhang +12
Reward models (RMs) are central to aligning large language models (LLMs) with human values, yet noisy preference feedback can induce reward misgeneralization through spurious corre…