FastFormers: Highly Efficient Transformer Models for Natural Language Understanding

Young Jin Kim, Hany Hassan Awadalla

Transformer-based models are the state-of-the-art for Natural Language Understanding (NLU) applications. Models are getting bigger and better on various tasks. However, Transformer…