CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion

Adam Fisch, Daniel Deutsch, Joshua Maynez +5

Evaluating generative AI models is a routine, but resource-intensive, process that is conducted over and over again during the course of model development. In this work, we propose…