ITA: An Energy-Efficient Attention and Softmax Accelerator for Quantized Transformers

Gamze İslamoğlu, Moritz Scherer, Gianna Paulin +4

Transformer networks have emerged as the state-of-the-art approach for natural language processing tasks and are gaining popularity in other domains such as computer vision and aud…