DP-OPD: Differentially Private On-Policy Distillation for Language Models

Fatemeh Khadem, Sajad Mousavi, Yi Fang +1

Large language models (LLMs) are increasingly adapted to proprietary and domain-specific corpora that contain sensitive information, creating a tension between formal privacy guara…