Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks

Rachel Longjohn, Giri Gopalan, Emily Casleton

Modern artificial intelligence is supported by machine learning models (e.g., foundation models) that are pretrained on a massive data corpus and then adapted to solve a variety of…