87 citations · 197 across the 6 of their papers we have counts for
6 papers
Recent Developments in AI and USPTO Open Data
Scott Beliveau, Jerry Ma
The USPTO disseminates one of the largest publicly accessible repositories of scientific, technical, and commercial data worldwide. USPTO data has historically seen frequent use in…
Energy-based models for atomic-resolution protein conformations
Yilun Du, Joshua Meier, Jerry Ma +2
We propose an energy-based model (EBM) of protein conformations that operates at atomic scale. The model is trained solely on crystallized protein data. By contrast, existing appro…
On the adequacy of untuned warmup for adaptive optimization
Jerry Ma, Denis Yarats
Adaptive optimization algorithms such as Adam are widely used in deep learning. The stability of such algorithms is often improved with a warmup schedule for the learning rate. Mot…
ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero
Yuandong Tian, Jerry Ma, Qucheng Gong +4
The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the c…
Snakes on a Spaceship - An Overview of Python in Heliophysics
A. G. Burrell, A. Halford, J. Klenzing +7
Computational analysis has become ubiquitous within the heliophysics community. However, community standards for peer-review of codes and analysis have lagged behind these developm…
Quasi-hyperbolic momentum and Adam for deep learning
Jerry Ma, Denis Yarats
Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning. We propose the quasi-hyperbolic momentum algorithm (QHM) as an extremely simple al…