2 papers
cs.CL2022
Fast and Accurate FSA System Using ELBERT: An Efficient and Lightweight BERT
Siyuan Lu, Chenchen Zhou, Keli Xie +2
With the development of deep learning and Transformer-based pre-trained models like BERT, the accuracy of many NLP tasks has been dramatically improved. However, the large number o…
cs.CL2021
Elbert: Fast Albert with Confidence-Window Based Early Exit
Keli Xie, Siyuan Lu, Meiqi Wang +1
Despite the great success in Natural Language Processing (NLP) area, large pre-trained language models like BERT are not well-suited for resource-constrained or real-time applicati…