3 papers
cs.AI2025
Self-Consistency of the Internal Reward Models Improves Self-Rewarding Language Models
Xin Zhou, Yiwen Guo, Ruotian Ma +3
Aligning Large Language Models (LLMs) with human preferences is crucial for their deployment in real-world applications. Recent advancements in Self-Rewarding Language Models sugge…
cs.CL2024
Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data
Han Xia, Songyang Gao, Qiming Ge +3
Reinforcement Learning from Human Feedback (RLHF) has proven effective in aligning large language models with human intentions, yet it often relies on complex methodologies like Pr…
cs.LG2024
MetaRM: Shifted Distributions Alignment via Meta-Learning
Shihan Dou, Yan Liu, Enyu Zhou +9
The success of Reinforcement Learning from Human Feedback (RLHF) in language model alignment is critically dependent on the capability of the reward model (RM). However, as the tra…