A Survey of Techniques for Optimizing Transformer Inference

Krishna Teja Chitty-Venkata, Sparsh Mittal, Murali Emani +2

Recent years have seen a phenomenal rise in performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Represe…