Beyond the Memory Wall: A Case for Memory-centric HPC System for Deep Learning

Youngeun Kwon, Minsoo Rhu

As the models and the datasets to train deep learning (DL) models scale, system architects are faced with new challenges, one of which is the memory capacity bottleneck, where the…