Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Clip Your Sequences Fairly: Enforcing Length Fairness for Sequence-Level RL
Hanyi Mao, Quanjia Xiao, Lei Pang +1
We propose FSPO (Fair Sequence Policy Optimization), a sequence-level reinforcement learning method for LLMs that enforces length-fair clipping on the importance-sampling (IS) weig…
cs.LG2025
TIC-GRPO: Provable and Efficient Optimization for Reinforcement Learning from Human Feedback
Lei Pang, Jun Luo, Ruinan Jin
Group Relative Policy Optimization (GRPO) trains language models without a value critic using rewards centered within sampled response groups. We study how importance weighting, cl…