TangoBERT: Reducing Inference Cost by using Cascaded Architecture

Jonathan Mamou, Oren Pereg, Moshe Wasserblat +1

The remarkable success of large transformer-based models such as BERT, RoBERTa and XLNet in many NLP tasks comes with a large increase in monetary and environmental cost due to the…