652 citations · 1k across the 37 of their papers we have counts for
6 papers · 1 filter
P1SCO: Social Dimensions from a Perspectivist Lens
Amanda Cercas Curry, Gianmarco de Francisci Morales, Luca Maria Aiello
We introduce P1SCO, a dataset of social media comments collected from three distinct platforms, annotated according to ten social dimensions to capture the diversity of social inte…
Learning Perspectivist Social Meaning via Demographic-Conditioned Fusion Embeddings
Amanda Cercas Curry, Lucio La Cava, Luca Maria Aiello +1
Social meaning in language is inherently perspectival, varying across annotator backgrounds, demographics, and ideological positions. However, most NLP systems collapse this variat…
Failure of contextual invariance in large language models
Sagar Kumar, Ariel Flint, Luca Maria Aiello +1
Standard evaluation practices assume that large language model (LLM) outputs are stable when prompts are embedded in contextually equivalent discourses. Here, we test this assumpti…
Reply to "Emergent LLM behaviors are observationally equivalent to data leakage"
Ariel Flint Ashery, Luca Maria Aiello, Andrea Baronchelli
A potential concern when simulating populations of large language models (LLMs) is data contamination, i.e. the possibility that training data may shape outcomes in unintended ways…
Unmasking Conversational Bias in AI Multiagent Systems
Erica Coppolillo, Giuseppe Manco, Luca Maria Aiello
Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majori…
The Parrot Dilemma: Human-Labeled vs. LLM-augmented Data in Classification Tasks
Anders Giovanni Møller, Jacob Aarup Dalsgaard, Arianna Pera +1
In the realm of Computational Social Science (CSS), practitioners often navigate complex, low-resource domains and face the costly and time-intensive challenges of acquiring and an…