Adaptive Segment-level Reward: Bridging the Gap Between Action and Reward Space in Alignment

Yanshi Li, Shaopan Xiong, Gengru Chen +6

Reinforcement Learning (RL) has proven highly effective in aligning Large Language Models (LLMs) with human preferences. Typical RL methods optimize under an overall sequence rewar…