5.2k citations · 7.8k across the 38 of their papers we have counts for
Showing 2019 · cs.LGShow all
3 papers · 2 filters
cs.LG2019★ 68 cited
Symplectic Recurrent Neural Networks
Zhengdao Chen, Jianyu Zhang, Martin Arjovsky +1
We propose Symplectic Recurrent Neural Networks (SRNNs) as learning algorithms that capture the dynamics of physical systems from observed trajectories. An SRNN models the Hamilton…
cs.LG2019★ 1 cited
Beyond Folklore: A Scaling Calculus for the Design and Initialization of ReLU Networks
Aaron Defazio, Léon Bottou
We propose a system for calculating a "scaling constant" for layers and weights of neural networks. We relate this scaling constant to two important quantities that relate to the o…
cs.LG2019★ 63 cited
Cold Case: The Lost MNIST Digits
Chhavi Yadav, Léon Bottou
Although the popular MNIST dataset [LeCun et al., 1994] is derived from the NIST database [Grother and Hanaoka, 1995], the precise processing steps for this derivation have been lo…