Understanding the Covariance Structure of Convolutional Filters

Asher Trockman, Devin Willmott, J. Zico Kolter

Neural network weights are typically initialized at random from univariate distributions, controlling just the variance of individual weights even in highly-structured operations l…