TrimBERT: Tailoring BERT for Trade-offs

Sharath Nittur Sridhar, Anthony Sarah, Sairam Sundaresan

Models based on BERT have been extremely successful in solving a variety of natural language processing (NLP) tasks. Unfortunately, many of these large models require a great deal…