50 citations · 50 across the 6 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
stat.ML2020
Task Agnostic Continual Learning Using Online Variational Bayes with Fixed-Point Updates
Chen Zeno, Itay Golan, Elad Hoffer +1
Background: Catastrophic forgetting is the notorious vulnerability of neural networks to the changes in the data distribution during learning. This phenomenon has long been conside…
cs.CV2020
Neural gradients are near-lognormal: improved quantized and sparse training
Brian Chmiel, Liad Ben-Uri, Moran Shkolnik +3
While training can mostly be accelerated by reducing the time needed to propagate neural gradients back throughout the model, most previous works focus on the quantization/pruning…