ARDIR: Improving Robustness using Knowledge Distillation of Internal Representation

Tomokatsu Takahashi, Masanori Yamada, Yuuki Yamanaka +1

Adversarial training is the most promising method for learning robust models against adversarial examples. A recent study has shown that knowledge distillation between the same arc…