Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis

Zachary Zhou, Alisha Zachariah, Devin Conathan +1

Natural language models are often summarized through a high-dimensional set of descriptive metrics including training corpus size, training time, the number of trainable parameters…