OPPO: Bayesian Value Recursion for Token-Level Credit Assignment in LLM Reasoning

Yu Li, Rui Miao, Tian Lan +1

Reinforcement learning with verifiable rewards has become the standard recipe for improving LLM reasoning, but the dominant algorithm GRPO assigns a single trajectory-level advanta…