2 papers
cs.LG2025
How far away are truly hyperparameter-free learning algorithms?
Priya Kasimbeg, Vincent Roulet, Naman Agarwal +4
Despite major advances in methodology, hyperparameter tuning remains a crucial (and expensive) part of the development of machine learning systems. Even ignoring architectural choi…
cs.LG2025
Training neural networks faster with minimal tuning using pre-computed lists of hyperparameters for NAdamW
Sourabh Medapati, Priya Kasimbeg, Shankar Krishnan +2
If we want to train a neural network using any of the most popular optimization algorithms, we are immediately faced with a dilemma: how to set the various optimization and regular…