Tuning Learning Rates with the Cumulative-Learning Constant

Nathan Faraj

This paper introduces a novel method for optimizing learning rates in machine learning. A previously unrecognized proportionality between learning rates and dataset sizes is discov…