226 citations · 316 across the 5 of their papers we have counts for
3 papers · 1 filter
Insights on representational similarity in neural networks with canonical correlation
Ari S. Morcos, Maithra Raghu, Samy Bengio
Comparing different neural network representations and determining how representations evolve over time remain challenging open questions in our understanding of the function of ne…
SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability
Maithra Raghu, Justin Gilmer, Jason Yosinski +1
We propose a new technique, Singular Vector Canonical Correlation Analysis (SVCCA), a tool for quickly comparing two representations in a way that is both invariant to affine trans…
Exponential expressivity in deep neural networks through transient chaos
Ben Poole, Subhaneil Lahiri, Maithra Raghu +2
We combine Riemannian geometry with the mean field theory of high dimensional chaos to study the nature of signal propagation in generic, deep neural networks with random weights.…