2 citations · 2 across the 4 of their papers we have counts for
17 papers · 1 filter
Language Mutations Sustain the Persistences of Conspiracy Theories on Social Media
Calvin Yixiang Cheng, Dorian Quelle, Scott A. Hale
This study investigates how language mutations affect the persistent diffusion of conspiracy theories on social media. Drawing on a three-year dataset of conspiracy-related posts f…
PRISM-X: Experiments on Personalised Fine-Tuning with Human and Simulated Users
Hannah Rose Kirk, Liu Leqi, Fanzhi Zeng +4
Personalisation is a standard feature of conversational AI systems used by millions; yet, the efficacy of personalisation methods is often evaluated in academic research using simu…
Lost in translation: using global fact-checks to measure multilingual misinformation prevalence, spread, and evolution
Dorian Quelle, Calvin Cheng, Alexandre Bovet +1
Misinformation and disinformation are growing threats in the digital age, affecting people across languages and borders. However, no research has investigated the prevalence of mul…
Measuring what Matters: Construct Validity in Large Language Model Benchmarks
Andrew M. Bean, Ryan Othniel Kearns, Angelika Romanou +39
Evaluating large language models (LLMs) is crucial for both assessing their capabilities and identifying safety or robustness issues prior to deployment. Reliably measuring abstrac…
Semantic Journeys: Quantifying Change in Emoji Meaning from 2012-2018
Alexander Robertson, Farhana Ferdousi Liza, Dong Nguyen +2
The semantics of emoji has, to date, been considered from a static perspective. We offer the first longitudinal study of how emoji semantics changes over time, applying techniques…
Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
Jonathan Rystrøm, Hannah Rose Kirk, Scott Hale
Large Language Models (LLMs) are becoming increasingly capable across global languages. However, the ability to communicate across languages does not necessarily translate to appro…