Scheduling Optimization Techniques for Neural Network Training

Hyungjun Oh, HyeongJu Kim, Jiwon Seo

Neural network training requires a large amount of computation and thus GPUs are often used for the acceleration. While they improve the performance, GPUs are underutilized during…