The Viscosity of Logic: Phase Transitions and Hysteresis in DPO Alignment

Marco Pollanen

Direct Preference Optimization (DPO) is often tuned as if increasing alignment pressure (controlled by $\beta$) yields progressively "better" behavior. We instead treat $\beta$ as a contro…