Efficient Process Reward Modeling via Contrastive Mutual Information

Nakyung Lee, Sangwoo Hong, Jungwoo Lee

Recent research has devoted considerable effort to verifying the intermediate reasoning steps of chain-of-thought (CoT) trajectories using process reward models (PRMs) and other ve…