Efficient Sparse Processing-in-Memory Architecture (ESPIM) for Machine Learning Inference

Mingxuan He, Mithuna Thottethodi, T. N. Vijaykumar

Emerging machine learning (ML) models (e.g., transformers) involve memory pin bandwidth-bound matrix-vector (MV) computation in inference. By avoiding pin crossings, processing in…