11 citations · 11 across the 3 of their papers we have counts for
3 papers
cs.CV2022
Understanding the Covariance Structure of Convolutional Filters
Asher Trockman, Devin Willmott, J. Zico Kolter
Neural network weights are typically initialized at random from univariate distributions, controlling just the variance of individual weights even in highly-structured operations l…
cs.CV2022
Patches Are All You Need?
Asher Trockman, J. Zico Kolter
Although convolutional networks have been the dominant architecture for vision tasks for many years, recent experiments have shown that Transformer-based models, most notably the V…
cs.LG2021★ 11 cited
Orthogonalizing Convolutional Layers with the Cayley Transform
Asher Trockman, J. Zico Kolter
Recent work has highlighted several advantages of enforcing orthogonality in the weight layers of deep networks, such as maintaining the stability of activations, preserving gradie…