most citedOptimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory

13 citations · 13 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2019★ 13 cited

Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory

Julien Herrmann, Olivier Beaumont, Lionel Eyraud-Dubois +3

This paper introduces a new activation checkpointing method which allows to significantly decrease memory usage when training Deep Neural Networks with the back-propagation algorit…