55 citations · 61 across the 4 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023★ 4 cited
Tune As You Scale: Hyperparameter Optimization For Compute Efficient Training
Abraham J. Fetterman, Ellie Kitanidis, Joshua Albrecht +6
Hyperparameter tuning of deep learning models can lead to order-of-magnitude performance gains for the same amount of compute. Despite this, systematic tuning is uncommon, particul…
cs.LG2023
On the Stepwise Nature of Self-Supervised Learning
James B. Simon, Maksis Knutins, Liu Ziyin +3
We present a simple picture of the training process of joint embedding self-supervised learning methods. We find that these methods learn their high-dimensional embeddings one dime…