Mini-batch Serialization: CNN Training with Inter-layer Data Reuse

Sangkug Lym, Armand Behroozi, Wei Wen +3

Training convolutional neural networks (CNNs) requires intense computations and high memory bandwidth. We find that bandwidth today is over-provisioned because most memory accesses…