Improving Strong-Scaling of CNN Training by Exploiting Finer-Grained Parallelism

Nikoli Dryden, Naoya Maruyama, Tom Benson +3

Scaling CNN training is necessary to keep up with growing datasets and reduce training time. We also see an emerging need to handle datasets with very large samples, where memory r…