Layer-Specific Adaptive Learning Rates for Deep Networks

Bharat Singh, Soham De, Yangmuzi Zhang +2

The increasing complexity of deep learning architectures is resulting in training time requiring weeks or even months. This slow training is due in part to vanishing gradients, in…