1 citations · 1 across the 5 of their papers we have counts for
7 papers
Reliability and Effectiveness of Autonomous AI Agents in Supply Chain Management
Carol Xuan Long, David Simchi-Levi, Feng Zhu +3
This paper studies the performance and reliability of autonomous generative AI agents in multi-echelon supply chains using the MIT Beer Game. We examine how model choice, operation…
Robust AI Evaluation through Maximal Lotteries
Hadi Khalaf, Serena L. Wang, Daniel Halpern +3
The standard way to evaluate language models on subjective tasks is through pairwise comparisons: an annotator chooses the "better" of two responses to a prompt. Leaderboards aggre…
Unifying Re-Identification, Attribute Inference, and Data Reconstruction Risks in Differential Privacy
Bogdan Kulynych, Juan Felipe Gomez, Georgios Kaissis +4
Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-ide…
Rigor in AI: Doing Rigorous AI Work Requires a Broader, Responsible AI-Informed Conception of Rigor
Alexandra Olteanu, Su Lin Blodgett, Agathe Balayn +7
In AI research and practice, rigor remains largely understood in terms of methodological rigor -- such as whether mathematical, statistical, or computational methods are correctly…
Gaussian DP for Reporting Differential Privacy Guarantees in Machine Learning
Juan Felipe Gomez, Bogdan Kulynych, Georgios Kaissis +4
Current practices for reporting differential privacy (DP) guarantees for machine learning (ML) algorithms such as DP-SGD provide an incomplete and potentially misleading picture. F…
Debiasing Functions of Private Statistics in Postprocessing
Flavio Calmon, Elbert Du, Cynthia Dwork +2
Given a differentially private unbiased estimate of a statistic , we wish to obtain unbiased estimates of functions of , such as , solely th…
Predictive Churn with the Set of Good Models
Jamelle Watson-Daniels, Flavio du Pin Calmon, Alexander D'Amour +3
Issues can arise when research focused on fairness, transparency, or safety is conducted separately from research driven by practical deployment concerns and vice versa. This separ…