DE${}^3$-BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networks

Jianing He, Qi Zhang, Weiping Ding +4

Early exiting has demonstrated its effectiveness in accelerating the inference of pre-trained language models like BERT by dynamically adjusting the number of layers executed. Howe…