LookAhead Tuning: Safer Language Models via Partial Answer Previews

Kangwei Liu, Mengru Wang, Yujie Luo +7

Fine-tuning enables large language models (LLMs) to adapt to specific domains, but often compromises their previously established safety alignment. To mitigate the degradation of m…