BabyBear: Cheap inference triage for expensive language models

Leila Khalili, Yao You, John Bohannon

Transformer language models provide superior accuracy over previous models but they are computationally and environmentally expensive. Borrowing the concept of model cascading from…