Mimose: An Input-Aware Checkpointing Planner for Efficient Training on GPU

Jianjin Liao, Mingzhen Li, Qingxiao Sun +8

Larger deep learning models usually lead to higher model quality with an ever-increasing GPU memory footprint. Although tensor checkpointing techniques have been proposed to enable…