Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Robust AI Evaluation through Maximal Lotteries
Hadi Khalaf, Serena L. Wang, Daniel Halpern +3
The standard way to evaluate language models on subjective tasks is through pairwise comparisons: an annotator chooses the "better" of two responses to a prompt. Leaderboards aggre…
cs.LG2025
The Hidden Cost of Waiting for Accurate Predictions
Ali Shirali, Ariel Procaccia, Rediet Abebe
Algorithmic predictions are increasingly informing societal resource allocations by identifying individuals for targeting. Policymakers often build these systems with the assumptio…