3 citations · 6 across the 5 of their papers we have counts for
5 papers
The Benchmark Trap: Structures of Power and Injustice in AI Evaluations
Jason Branford, Angelie Kraft
Artificial intelligence (AI) benchmarks are not neutral tools of evaluation but socio-technical artefacts that shape competition, power, and research priorities within AI. Benchmar…
Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructure
David Hartmann, Manuel Tonneau, Angelie Kraft +7
Perspective API closes at the end of 2026, removing the de facto standard for toxicity measurement and exposing researchers' dependence on a tool they did not control. Drawing on t…
Social Bias in Popular Question-Answering Benchmarks
Angelie Kraft, Judith Simon, Sonja Schimmler
Question-answering (QA) and reading comprehension (RC) benchmarks are commonly used for assessing the capabilities of large language models (LLMs) to retrieve and reproduce knowled…
The Lifecycle of "Facts": A Survey of Social Bias in Knowledge Graphs
Angelie Kraft, Ricardo Usbeck
Knowledge graphs are increasingly used in a plethora of downstream tasks or in the augmentation of statistical models to improve factuality. However, social biases are engraved in…
The Ethical Risks of Analyzing Crisis Events on Social Media with Machine Learning
Angelie Kraft, Ricardo Usbeck
Social media platforms provide a continuous stream of real-time news regarding crisis events on a global scale. Several machine learning methods utilize the crowd-sourced data for…