works on
adversarial robustness 1dual teacher 1image classification 1information bottleneck 1knowledge distillation 1

From the 1 of 7 linked papers with an AI index.

activity
20242026
collaborators
Showing stat.MLShow all

1 paper · 1 filter

stat.ML2026

Approximating Simple ReLU Networks based on Spectral Decomposition of Fisher Information

Ka Long Keith Ho, Yoshinari Takeishi, Junichi Takeuchi

Properties of Fisher information matrices of 2-layer neural ReLU networks with random hidden weights are studied. For these networks, it is known that the eigenvalue distribution h…