BEBERT: Efficient and Robust Binary Ensemble BERT

Jiayi Tian, Chao Fang, Haonan Wang +1

Pre-trained BERT models have achieved impressive accuracy on natural language processing (NLP) tasks. However, their excessive amount of parameters hinders them from efficient depl…