An Empirical Study of $\hat{I}¼$P Learning Rate Transfer

Lucas Lingle

Deep learning models have become a cornerstone of modern AI research, yet their initializations and learning rates may at times be set in an opaque or ad-hoc fashion due to the hig…