To update or not to update? Neurons at equilibrium in deep models

Andrea Bragagnolo, Enzo Tartaglione, Marco Grangetto

Recent advances in deep learning optimization showed that, with some a-posteriori information on fully-trained models, it is possible to match the same performance by simply traini…