5 papers
When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
Mubashara Akhtar, Anka Reuel, Prajna Soni +36
Artificial intelligence benchmarks are an important mechanism to measure model progress and guide deployment decisions. However, benchmarks quickly "saturate", making it difficult…
AI for Scientific Discovery is a Social Problem
Georgia Channing, Avijit Ghosh
Artificial intelligence (AI) is being increasingly applied to scientific research, but its benefits remain unevenly distributed across different communities and disciplines. While…
Protecting Human Cognition in the Age of AI
Anjali Singh, Karan Taneja, Zhitong Guan +1
The rapid adoption of Generative AI (GenAI) is significantly reshaping human cognition, influencing how we engage with information, think, reason, and learn. This paper synthesizes…
Documenting Patterns of Exoticism of Marginalized Populations within Text-to-Image Generators
Sourojit Ghosh, Sanjana Gautam, Pranav Venkit +1
A significant majority of AI fairness research studying the harmful outcomes of GAI tools have overlooked non-Western communities and contexts, necessitating a stronger coverage in…
"It's not a representation of me": Examining Accent Bias and Digital Exclusion in Synthetic AI Voice Services
Shira Michel, Sufi Kaur, Sarah Elizabeth Gillespie +3
Recent advances in artificial intelligence (AI) speech generation and voice cloning technologies have produced naturalistic speech and accurate voice replication, yet their influen…