37 citations · 42 across the 5 of their papers we have counts for
3 papers · 1 filter
SHADE: Information Based Regularization for Deep Learning
Michael Blot, Thomas Robert, Nicolas Thome +1
Regularization is a big issue for training deep neural networks. In this paper, we propose a new information-theory-based regularization scheme named SHADE for SHAnnon DEcay. The o…
SHADE: Information-Based Regularization for Deep Learning
Michael Blot, Thomas Robert, Nicolas Thome +1
Regularization is a big issue for training deep neural networks. In this paper, we propose a new information-theory-based regularization scheme named SHADE for SHAnnon DEcay. The o…
GoSGD: Distributed Optimization for Deep Learning with Gossip Exchange
Michael Blot, David Picard, Matthieu Cord
We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization…