Elbert: Fast Albert with Confidence-Window Based Early Exit

Keli Xie, Siyuan Lu, Meiqi Wang +1

Despite the great success in Natural Language Processing (NLP) area, large pre-trained language models like BERT are not well-suited for resource-constrained or real-time applicati…