Sideways: Depth-Parallel Training of Video Models

Mateusz Malinowski, Grzegorz Swirszcz, Joao Carreira +1

We propose Sideways, an approximate backpropagation scheme for training video models. In standard backpropagation, the gradients and activations at every computation step through t…