Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures

Hafsa Mateen, Radu Timofte, Dmitry Ignatov

Choosing a learning rate scheduling strategy is critical to neural network training, but manual selection is costly and rarely exhaustive. While classical AutoML approaches often t…