Can depth-adaptive BERT perform better on binary classification tasks

Jing Fan, Xin Zhang, Sheng Zhang +2

In light of the success of transferring language models into NLP tasks, we ask whether the full BERT model is always the best and does it exist a simple but effective method to fin…