Two to Tango: Coupled Task-Reference Selection for Safe LLM Fine-tuning

Xinrui Chen, Jianhao Zhang, Ou Wu +1

Fine-tuning safety aligned large language models (LLMs) on downstream data improves adaptation but may erode learned safety behavior. Existing methods use fixed safety examples, gl…