Can Native Safety Travel? Reusing Safety Pretraining Across Models via On-Policy Distillation

Bingqi Shang, Yang Zhang, Yiwei Chen +4

Safety pretraining has emerged as a promising paradigm for embedding safety deeply into a model during pretraining, yielding robustness to subsequent fine-tuning that conventional…