4 papers
A Unified Framework to Quantify Cultural Intelligence of AI
Sunipa Dev, Vinodkumar Prabhakaran, Rutledge Chin Feman +16
As generative AI technologies are increasingly being launched across the globe, assessing their competence to operate in different cultural contexts is exigently becoming a priorit…
A Systematic Study of Biomedical Retrieval Pipeline Trade-offs in Performance and Efficiency
Hayk Stepanyan, Matthew McDermott
Retrieval systems are increasingly used in biomedical and clinical natural language processing applications, yet practical guidance for researchers building such systems is limited…
Cultural Compass: A Framework for Organizing Societal Norms to Detect Violations in Human-AI Conversations
Myra Cheng, Vinodkumar Prabhakaran, Alice Oh +5
Generative AI models ought to be useful and safe across cross-cultural contexts. One critical step toward this goal is understanding how AI models adhere to sociocultural norms. Wh…
Scaling Cultural Resources for Improving Generative Models
Hayk Stepanyan, Aishwarya Verma, Andrew Zaldivar +5
Generative models are known to have reduced performance in different global cultural contexts and languages. While continual data updates have been commonly conducted to improve ov…