9 papers
Desirable Effort Fairness and Optimality Trade-offs in Strategic Learning
Valia Efthymiou, Ekaterina Fedorova, Chara Podimata
Strategic classification examines how decision rules interact with agents who strategically adapt their features. Most existing models focus on maximizing predictive performance, a…
Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scale
Alessandro Morosini, Sarah H. Cen, Andrew Ilyas +3
Personalization algorithms determine what content users encounter on online platforms. Auditing these systems is difficult because independent auditors have only black-box access t…
Conformal Language Modeling via Posterior Sampling
Nicolas Emmenegger, Theo X. Olausson, Armando Solar-Lezama +1
Large Language Models remain plagued by hallucinations. Recent work has sought to tame their prevalence using statistical techniques based on conformal prediction, with both theore…
Prediction-Powered Inference Across Many Tasks for AI Evaluation & Social Science Research
Nicolas Emmenegger, Ellery Stahler, Chara Podimata
Many applications require statistically valid inference across many related tasks, while using only a handful of high-quality labels per hypothesis. In AI evaluation, these tasks m…
Can Users Fix Algorithms? A Game-Theoretic Analysis of Collective Content Amplification in Recommender Systems
Ekaterina Fedorova, Madeline Kitch, Chara Podimata
Users of social media platforms based on recommendation systems (e.g. TikTok, X, YouTube) strategically interact with platform content to influence future recommendations. On some…
Do LLMs Track Public Opinion? A Multi-Model Study of Favorability Predictions in the 2024 U.S. Presidential Election
Riya Parikh, Sarah H. Cen, Chara Podimata
We investigate whether Large Language Models (LLMs) can track public opinion as measured by exit polls during the 2024 U.S. presidential election cycle. Our analysis focuses on hea…