2 papers
cs.CL2025
Improving the Calibration of Confidence Scores in Text Generation Using the Output Distribution's Characteristics
Lorenzo Jaime Yu Flores, Ori Ernst, Jackie Chi Kit Cheung
Well-calibrated model confidence scores can improve the usefulness of text generation models. For example, users can be prompted to review predictions with low confidence scores, t…
cs.CL2025
PreSumm: Predicting Summarization Performance Without Summarizing
Steven Koniaev, Ori Ernst, Jackie Chi Kit Cheung
Despite recent advancements in automatic summarization, state-of-the-art models do not summarize all documents equally well, raising the question: why? While prior research has ext…