Hardware-Software Co-Design for Accelerating Transformer Inference Leveraging Compute-in-Memory

Dong Eun Kim, Tanvi Sharma, Kaushik Roy

Transformers have become the backbone of neural network architecture for most machine learning applications. Their widespread use has resulted in multiple efforts on accelerating a…