290 citations · 682 across the 9 of their papers we have counts for
3 papers · 1 filter
Random projections of random manifolds
Subhaneil Lahiri, Peiran Gao, Surya Ganguli
Interesting data often concentrate on low dimensional smooth manifolds inside a high dimensional ambient space. Random projections are a simple, powerful tool for dimensionality re…
Exponential expressivity in deep neural networks through transient chaos
Ben Poole, Subhaneil Lahiri, Maithra Raghu +2
We combine Riemannian geometry with the mean field theory of high dimensional chaos to study the nature of signal propagation in generic, deep neural networks with random weights.…
A universal tradeoff between power, precision and speed in physical communication
Subhaneil Lahiri, Jascha Sohl-Dickstein, Surya Ganguli
Maximizing the speed and precision of communication while minimizing power dissipation is a fundamental engineering design goal. Also, biological systems achieve remarkable speed,…