XEngine: Optimal Tensor Rematerialization for Neural Networks in Heterogeneous Environments

Manuela Schuler, Richard Membarth, Philipp Slusallek

Memory efficiency is crucial in training deep learning networks on resource-restricted devices. During backpropagation, forward tensors are used to calculate gradients. Despite the…