5 papers
Fabula: Building a Narrative Storytelling Sidekick with the Writers' Community
Piotr Mirowski, Ben Wedin, Reinald Kim Amplayo +14
We design and evaluate Fabula, an interactive app for fiction writers. Fabula uses detailed narrative plans informed by general narratological theory. Stories are structured hierar…
A Unified Framework to Quantify Cultural Intelligence of AI
Sunipa Dev, Vinodkumar Prabhakaran, Rutledge Chin Feman +16
As generative AI technologies are increasingly being launched across the globe, assessing their competence to operate in different cultural contexts is exigently becoming a priorit…
The Case for "Thick Evaluations" of Cultural Representation in AI
Rida Qadri, Mark Diaz, Ding Wang +1
Generative AI model outputs have been increasingly evaluated for their (in)ability to represent non-Western cultures. We argue that these evaluations often operate through reductiv…
Risks of Cultural Erasure in Large Language Models
Rida Qadri, Aida M. Davani, Kevin Robinson +1
Large language models are increasingly being integrated into applications that shape the production and discovery of societal knowledge such as search, online education, and travel…
Dialogue with the Machine and Dialogue with the Art World: Evaluating Generative AI for Culturally-Situated Creativity
Rida Qadri, Piotr Mirowski, Aroussiak Gabriellan +4
This paper proposes dialogue as a method for evaluating generative AI tools for culturally-situated creative practice, that recognizes the socially situated nature of art. Drawing…