24 citations · 40 across the 11 of their papers we have counts for
4 papers · 1 filter
Adversarial Attacks on the Interpretation of Neuron Activation Maximization
Geraldin Nanfack, Alexander Fulleringer, Jonathan Marty +2
The internal functional behavior of trained Deep Neural Networks is notoriously difficult to interpret. Activation-maximization approaches are one set of techniques used to interpr…
Can Forward Gradient Match Backpropagation?
Louis Fournier, Stéphane Rivaud, Eugene Belilovsky +2
Forward Gradients - the idea of using directional derivatives in forward differentiation mode - have recently been shown to be utilizable for neural network training while avoiding…
MoMo: Momentum Models for Adaptive Learning Rates
Fabian Schaipp, Ruben Ohana, Michael Eickenberg +2
Training a modern machine learning architecture on a new task requires extensive learning-rate tuning, which comes at a high computational cost. Here we develop new Polyak-type ada…
Local Learning with Neuron Groups
Adeetya Patel, Michael Eickenberg, Eugene Belilovsky
Traditional deep network training methods optimize a monolithic objective function jointly for all the components. This can lead to various inefficiencies in terms of potential par…