61 citations · 200 across the 9 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.LG2017★ 61 cited
Sobolev Training for Neural Networks
Wojciech Marian Czarnecki, Simon Osindero, Max Jaderberg +2
At the heart of deep learning we aim to use neural networks as function approximators - training them to produce outputs from inputs in emulation of a ground truth function or data…
cs.LG2017★ 28 cited
Understanding Synthetic Gradients and Decoupled Neural Interfaces
Wojciech Marian Czarnecki, Grzegorz Świrszcz, Max Jaderberg +3
When training neural networks, the use of Synthetic Gradients (SG) allows layers or modules to be trained without update locking - without waiting for a true error gradient to be b…