33 citations · 46 across the 2 of their papers we have counts for
4 papers
Energy-based models for atomic-resolution protein conformations
Yilun Du, Joshua Meier, Jerry Ma +2
We propose an energy-based model (EBM) of protein conformations that operates at atomic scale. The model is trained solely on crystallized protein data. By contrast, existing appro…
On the adequacy of untuned warmup for adaptive optimization
Jerry Ma, Denis Yarats
Adaptive optimization algorithms such as Adam are widely used in deep learning. The stability of such algorithms is often improved with a warmup schedule for the learning rate. Mot…
Snakes on a Spaceship - An Overview of Python in Heliophysics
A. G. Burrell, A. Halford, J. Klenzing +7
Computational analysis has become ubiquitous within the heliophysics community. However, community standards for peer-review of codes and analysis have lagged behind these developm…
Quasi-hyperbolic momentum and Adam for deep learning
Jerry Ma, Denis Yarats
Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning. We propose the quasi-hyperbolic momentum algorithm (QHM) as an extremely simple al…