3 papers
cs.LG2026
Pandora's Regret: A Proper Scoring Rule for Evaluating Sequential Search
Gerardo A. Flores, Yash Deshpande, Jannis R. Brea +1
In sequential search, alternatives are tested until the true class is found. Standard proper scoring rules like log loss are local, ignoring the ranking of competitors and misalign…
cs.LG2026
A Consequentialist Critique of Binary Classification Evaluation: Theory, Practice, and Tools
Gerardo Flores, Abigail Schiff, Alyssa H. Smith +2
Machine learning-supported decisions, such as ordering diagnostic tests or determining preventive custody, often require converting probabilistic forecasts into binary classificati…
cs.LG2026
Bridging Prediction and Intervention Problems in Social Systems
Lydia T. Liu, Inioluwa Deborah Raji, Angela Zhou +32
Many automated decision systems (ADS) are designed to solve prediction problems -- where the goal is to learn patterns from a sample of the population and apply them to individuals…