AccUDNN: A GPU Memory Efficient Accelerator for Training Ultra-deep Neural Networks

Jinrong Guo, Wantao Liu, Wang Wang +4

Typically, Ultra-deep neural network(UDNN) tends to yield high-quality model, but its training process is usually resource intensive and time-consuming. Modern GPU's scarce DRAM ca…