ExTra: Exploratory Trajectory Optimization for Language Model Reinforcement Learning

Wenyang Hu, Junxiang Jia, Zhen Shu +3

Reinforcement Learning with Verifiable Rewards (RLVR) for language-model reasoning can fail at both extremes of task difficulty: easy prompts often produce all-correct, low-diversi…