33 citations · 46 across the 2 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2020★ 13 cited
Energy-based models for atomic-resolution protein conformations
Yilun Du, Joshua Meier, Jerry Ma +2
We propose an energy-based model (EBM) of protein conformations that operates at atomic scale. The model is trained solely on crystallized protein data. By contrast, existing appro…
cs.LG2019
On the adequacy of untuned warmup for adaptive optimization
Jerry Ma, Denis Yarats
Adaptive optimization algorithms such as Adam are widely used in deep learning. The stability of such algorithms is often improved with a warmup schedule for the learning rate. Mot…
cs.LG2018
Quasi-hyperbolic momentum and Adam for deep learning
Jerry Ma, Denis Yarats
Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning. We propose the quasi-hyperbolic momentum algorithm (QHM) as an extremely simple al…