Rethinking the Potential of Layer Freezing for Efficient DNN Training

Chence Yang, Ci Zhang, Lei Lu +11

With the growing size of deep neural networks and datasets, the computational costs of training have significantly increased. The layer-freezing technique has recently attracted gr…