Lipschitz Constant Meets Condition Number: Learning Robust and Compact Deep Neural Networks

Yangqi Feng, Shing-Ho J. Lin, Baoyuan Gao +1

Recent research has revealed that high compression of Deep Neural Networks (DNNs), e.g., massive pruning of the weight matrix of a DNN, leads to a severe drop in accuracy and susce…