1 citations · 1 across the 1 of their papers we have counts for
2 papers
cs.LG2025
Training neural networks faster with minimal tuning using pre-computed lists of hyperparameters for NAdamW
Sourabh Medapati, Priya Kasimbeg, Shankar Krishnan +2
If we want to train a neural network using any of the most popular optimization algorithms, we are immediately faced with a dilemma: how to set the various optimization and regular…
cs.CL2024★ 1 cited
On the Inductive Bias of Stacking Towards Improving Reasoning
Nikunj Saunshi, Stefani Karp, Shankar Krishnan +3
Given the increasing scale of model sizes, novel training strategies like gradual stacking [Gong et al., 2019, Reddi et al., 2023] have garnered interest. Stacking enables efficien…