CARD: Closing the Teacher-Student Loop for Adversarial Robustness Distillation

Zhi Li, Haowei Liu, Hongchen Yang +5

Adversarial robustness distillation typically treats a robust teacher as a fixed knowledge source and transfers robustness to a compact student in a one-way manner. This paradigm t…