Looking in the Mirror: Introspecting Side-Effect Misalignments Induced by Fine-Tuning

Kotaro Yoshida, Laura Gomezjurado Gonzalez, Yukinori Yamamoto +3

Fine-tuning enables a source model to acquire desired capabilities and behaviors in a target domain while retaining much of its general-purpose competence. However, this adaptation…