XConv: Low-memory stochastic backpropagation for convolutional layers

Anirudh Thatipelli, Jeffrey Sam, Mathias Louboutin +3

Training convolutional neural networks at scale demands substantial memory, largely because intermediate activations must be stored for backpropagation. Existing remedies (checkpoi…