Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks

Xuanzhe Xiao, Zeng Li, Chuanlong Xie +1

Unraveling the reasons behind the remarkable success and exceptional generalization capabilities of deep neural networks presents a formidable challenge. Recent insights from rando…