A Second-Order Perspective on Pruning at Initialization and Knowledge Transfer

Leonardo Iurada, Beatrice Occhiena, Tatiana Tommasi

The widespread availability of pre-trained vision models has enabled numerous deep learning applications through their transferable representations. However, their computational an…