Profiling based Out-of-core Hybrid Method for Large Neural Networks

Yuki Ito, Haruki Imai, Tung Le Duc +4

GPUs are widely used to accelerate deep learning with NNs (NNs). On the other hand, since GPU memory capacity is limited, it is difficult to implement efficient programs that compu…