Defending Against Malicious Finetuning by Scaling Train-time Adversarial Attacks

Haoming Wen, Shi Chen, Qingyu Shi +4

Malicious finetuning attacks pose a major safety threat against open-weight large language models (LLMs). However, existing alignment-stage defenses provide limited protection agai…