APack: Off-Chip, Lossless Data Compression for Efficient Deep Learning Inference

Alberto Delmas Lascorz, Mostafa Mahmoud, Andreas Moshovos

Data accesses between on- and off-chip memories account for a large fraction of overall energy consumption during inference with deep learning networks. We present APack, a simple…