93 citations · 155 across the 5 of their papers we have counts for
1 paper · 2 filters
Hiroaki Hayashi, Jayanth Koushik, Graham Neubig
Adaptive gradient methods for stochastic optimization adjust the learning rate for each parameter locally. However, there is also a global learning rate which must be tuned in orde…