A Study on the Intersection of GPU Utilization and CNN Inference

Jack Kosaian, Amar Phanishayee

There has been significant progress in developing neural network architectures that both achieve high predictive performance and that also achieve high application-level inference…