61 citations · 109 across the 11 of their papers we have counts for
11 papers
When Attention Goes Blind: Numerical Failure in ALiBi Positional Encodings
Christopher Schröder, Lukas Gienapp, Ferdinand Schlatt +2
We identify a previously overlooked failure mode of ALiBi positional encoding: its linear bias scaling underflows floating-point precision, which zeroes out a large fraction of att…
The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models
Lukas Gienapp, Christopher Schröder, Stefan Schweter +5
Large language model development relies on large-scale training corpora, yet most contain data of unclear licensing status, limiting the development of truly open models. This prob…
Reassessing Active Learning Adoption in Contemporary NLP: A Community Survey
Julia Romberg, Christopher Schröder, Julius Gonsior +2
Supervised learning relies on data annotation which usually is time-consuming and therefore expensive. A longstanding strategy to reduce annotation costs is active learning, an ite…
Self-Training for Sample-Efficient Active Learning for Text Classification with Pre-Trained Language Models
Christopher Schröder, Gerhard Heyer
Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervise…
The Infinite Index: Information Retrieval on Generative Text-To-Image Models
Niklas Deckers, Maik Fröbe, Johannes Kiesel +4
Conditional generative models such as DALL-E and Stable Diffusion generate images based on a user-defined text, the prompt. Finding and refining prompts that produce a desired imag…
Trigger Warnings: Bootstrapping a Violence Detector for FanFiction
Magdalena Wolska, Christopher Schröder, Ole Borchardt +2
We present the first dataset and evaluation results on a newly defined computational task of trigger warning assignment. Labeled corpus data has been compiled from narrative works…