Distillation Defenses Easily Break After Reinforcement Learning

Shidan Javaheri, Alexander Panfilov, Oliver Britton +2

Distillation attacks copy the reasoning capabilities of closed-source large language models, allowing bad actors to replicate state-of-the-art performance at low cost. Attackers sy…