PIE: Performance Interval Estimation for Free-Form Generation Tasks

Chi-Yang Hsu, Alexander Braylan, Yiheng Su +2

Confidence estimation infers a probability for whether each model output is correct or not. While predicting such binary correctness is sensible for tasks with exact answers, free-…