activity
20172026
most citedWhy We Need New Evaluation Metrics for NLG

157 citations · 214 across the 24 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.CL2024

Divine LLaMAs: Bias, Stereotypes, Stigmatization, and Emotion Representation of Religion in Large Language Models

Flor Miriam Plaza-del-Arco, Amanda Cercas Curry, Susanna Paoli +2

Emotions play important epistemological and cognitive roles in our lives, revealing our values and guiding our actions. Previous work has shown that LLMs display biases in emotion…

cs.CL2024★ 1 cited

Language Model Council: Democratically Benchmarking Foundation Models on Highly Subjective Tasks

Justin Zhao, Flor Miriam Plaza-del-Arco, Benjamin Genchel +1

As Large Language Models (LLMs) continue to evolve, evaluating them remains a persistent challenge. Many recent evaluations use LLMs as judges to score outputs from other LLMs, oft…

cs.CL2024★ 9 cited

Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions

Flor Miriam Plaza-del-Arco, Alba Curry, Amanda Cercas Curry +1

Emotions are a central aspect of communication. Consequently, emotion analysis (EA) is a rapidly growing field in natural language processing (NLP). However, there is no consensus…

cs.CL2024★ 1 cited

Classist Tools: Social Class Correlates with Performance in NLP

Amanda Cercas Curry, Giuseppe Attanasio, Zeerak Talat +1

Since the foundational work of William Labov on the social stratification of language (Labov, 1964), linguistics has made concentrated efforts to explore the links between sociodem…

cs.CL2024

Impoverished Language Technology: The Lack of (Social) Class in NLP

Amanda Cercas Curry, Zeerak Talat, Dirk Hovy

Since Labov's (1964) foundational work on the social stratification of language, linguistics has dedicated concerted efforts towards understanding the relationships between socio-d…

cs.CL2024

Subjective ? On the Danger of Conflating Hate and Offence in Abusive Language Detection

Amanda Cercas Curry, Gavin Abercrombie, Zeerak Talat

Natural language processing research has begun to embrace the notion of annotator subjectivity, motivated by variations in labelling. This approach understands each annotator's vie…