Deep Learning Weight Pruning with RMT-SVD: Increasing Accuracy and Reducing Overfitting

Yitzchak Shmalo, Jonathan Jenkins, Oleksii Krupchytskyi

In this work, we present some applications of random matrix theory for the training of deep neural networks. Recently, random matrix theory (RMT) has been applied to the overfittin…