adversarial robustness 1dual teacher 1image classification 1information bottleneck 1knowledge distillation 1
From the 1 of 7 linked papers with an AI index.
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Improving the Robustness/Accuracy Tradeoff Against Adversarial Attacks Using Information Bottleneck Distillation Through Dual Teachers
Vincent Ryusuke Takahashi, Yoshinari Takeishi, Jun'ichi Takeuchi +1
The paper extends information bottleneck distillation by adding a clean‑trained teacher alongside a robust teacher, using cross‑layer attention to improve both clean accuracy and a…
cs.LG2025
Neural Tangent Kernels and Fisher Information Matrices for Simple ReLU Networks with Random Hidden Weights
Jun'ichi Takeuchi, Yoshinari Takeishi, Noboru Murata +3
Fisher information matrices and neural tangent kernels (NTK) for 2-layer ReLU networks with random hidden weight are argued. We discuss the relation between both notions as a linea…