On Membership Inference Attacks in Knowledge Distillation

Ziyao Cui, Minxing Zhang, Jian Pei

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge dist…