Forward versus Backward: Comparing Reasoning Objectives in Direct Preference Optimization

Murtaza Nikzad, Raghuram Ramanujan

Large language models exhibit impressive reasoning capabilities yet frequently generate plausible but incorrect solutions, a phenomenon commonly termed hallucination. This paper in…