Improving the Robustness/Accuracy Tradeoff Against Adversarial Attacks Using Information Bottleneck Distillation Through Dual Teachers

Vincent Ryusuke Takahashi, Yoshinari Takeishi, Jun'ichi Takeuchi +1

The paper extends information bottleneck distillation by adding a clean‑trained teacher alongside a robust teacher, using cross‑layer attention to improve both clean accuracy and a…