Distribution-Specific Curvature Control with Finite-Sample Guarantees for Open-Weight Safety

Domenic Rosati, Ali Dadsetan, Hong Huang +5

A short fine-tuning run can undo the safety guards of an open-weight model---retraining a refusal-trained assistant to aid weapons development or produce hate speech. Preventing su…