activity
20222024
most citedUndesirable Biases in NLP: Addressing Challenges of Measurement

10 citations · 14 across the 6 of their papers we have counts for

collaborators
Showing cs.CLShow all

7 papers · 1 filter

cs.CL2024

How far can bias go? Tracing bias from pretraining data to alignment

Marion Thaler, Abdullatif Köksal, Alina Leidinger +2

As LLMs are increasingly integrated into user-facing applications, addressing biases that perpetuate societal inequalities is crucial. While much work has gone into measuring or mi…

cs.CL2024★ 1 cited

How Are LLMs Mitigating Stereotyping Harms? Learning from Search Engine Studies

Alina Leidinger, Richard Rogers

With the widespread availability of LLMs since the release of ChatGPT and increased public scrutiny, commercial model development appears to have focused their efforts on 'safety'…

cs.CL2024

Are LLMs classical or nonmonotonic reasoners? Lessons from generics

Alina Leidinger, Robert van Rooij, Ekaterina Shutova

Recent scholarship on reasoning in LLMs has supplied evidence of impressive performance and flexible adaptation to machine generated or human feedback. Nonmonotonic reasoning, cruc…

cs.CL2024★ 1 cited

CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models

Giada Pistilli, Alina Leidinger, Yacine Jernite +3

This paper introduces the "CIVICS: Culturally-Informed & Values-Inclusive Corpus for Societal impacts" dataset, designed to evaluate the social and cultural variation of Large Lang…

cs.CL2023★ 2 cited

The language of prompting: What linguistic properties make a prompt successful?

Alina Leidinger, Robert van Rooij, Ekaterina Shutova

The latest generation of LLMs can be prompted to achieve impressive zero-shot or few-shot performance in many NLP tasks. However, since performance is highly sensitive to the choic…

cs.CL2023

Probing LLMs for Joint Encoding of Linguistic Categories

Giulio Starace, Konstantinos Papakostas, Rochelle Choenni +4

Large Language Models (LLMs) exhibit impressive performance on a range of NLP tasks, due to the general-purpose linguistic knowledge acquired during pretraining. Existing model int…