Pinpointing the Memory Behaviors of DNN Training

Jiansong Li, Xiao Dong, Guangli Li +9

The training of deep neural networks (DNNs) is usually memory-hungry due to the limited device memory capacity of DNN accelerators. Characterizing the memory behaviors of DNN train…