D-STEER: Two-Way Control of DPO-Induced Safety Behavior in Activation Space

Samarth Raina, Saksham Aggarwal, Aman Chadha +3

Preference-based post-training shapes language-model behavior, but safer outputs do not reveal how that change is represented internally or how firmly it persists under direct inte…