TinyProp -- Adaptive Sparse Backpropagation for Efficient TinyML On-device Learning

Marcus Rüb, Daniel Maier, Daniel Mueller-Gritschneder +1

Training deep neural networks using backpropagation is very memory and computationally intensive. This makes it difficult to run on-device learning or fine-tune neural networks on…