7 citations · 25 across the 10 of their papers we have counts for
1 paper · 1 filter
Charlie Blake, Constantin Eichenberg, Josef Dean +7
The Maximal Update Parametrization (μP) aims to make the optimal hyperparameters (HPs) of a model independent of its size, allowing them to be swept using a cheap proxy model rat…