54 citations · 102 across the 3 of their papers we have counts for
3 papers
cs.NE2019★ 54 cited
A Mean Field Theory of Batch Normalization
Greg Yang, Jeffrey Pennington, Vinay Rao +2
We develop a mean field theory for batch normalization in fully-connected feedforward neural networks. In so doing, we provide a precise characterization of signal propagation and…
cs.LG2019★ 24 cited
Dynamical Isometry and a Mean Field Theory of LSTMs and GRUs
Dar Gilboa, Bo Chang, Minmin Chen +4
Training recurrent neural networks (RNNs) on long sequence tasks is plagued with difficulties arising from the exponential explosion or vanishing of signals as they propagate forwa…
hep-th2014★ 24 cited
Bootstrapping six-gluon scattering in planar super-Yang-Mills theory
Lance J. Dixon, James M. Drummond, Claude Duhr +2
We describe the hexagon function bootstrap for solving for six-gluon scattering amplitudes in the large limit of super-Yang-Mills theory. In this method, an ansa…