Dynamic Transformers Provide a False Sense of Efficiency

Yiming Chen, Simin Chen, Zexin Li +4

Despite much success in natural language processing (NLP), pre-trained language models typically lead to a high computational cost during inference. Multi-exit is a mainstream appr…