96 citations · 100 across the 2 of their papers we have counts for
2 papers
cs.LG2019★ 4 cited
The HSIC Bottleneck: Deep Learning without Back-Propagation
Wan-Duo Kurt Ma, J. P. Lewis, W. Bastiaan Kleijn
We introduce the HSIC (Hilbert-Schmidt independence criterion) bottleneck for training deep neural networks. The HSIC bottleneck is an alternative to the conventional cross-entropy…
cs.NE2017★ 96 cited
The Shattered Gradients Problem: If resnets are the answer, then what is the question?
David Balduzzi, Marcus Frean, Lennox Leary +3
A long-standing obstacle to progress in deep learning is the problem of vanishing and exploding gradients. Although, the problem has largely been overcome via carefully constructed…