13 citations · 31 across the 7 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2020
Maximum Multiscale Entropy and Neural Network Regularization
Amir R. Asadi, Emmanuel Abbe
A well-known result across information theory, machine learning, and statistical physics shows that the maximum entropy distribution under a mean constraint has an exponential form…
cs.LG2019★ 1 cited
Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Nets
Amir R. Asadi, Emmanuel Abbe
We derive generalization and excess risk bounds for neural nets using a family of complexity measures based on a multilevel relative entropy. The bounds are obtained by introducing…
cs.LG2018★ 13 cited
Chaining Mutual Information and Tightening Generalization Bounds
Amir R. Asadi, Emmanuel Abbe, Sergio Verdú
Bounding the generalization error of learning algorithms has a long history, which yet falls short in explaining various generalization successes including those of deep learning.…