54 citations · 55 across the 10 of their papers we have counts for
7 papers · 1 filter
The Missing Minimal Pair: Stereotype Evaluation in LLMs
Nataliya Stepanova, Ivan Titov, Emily Allaway +1
A common approach to measuring bias in Large Language Models is to compare the log-likelihoods of two contrastive stereotype sentences. We argue that such single-pair comparisons a…
Analyzing LLM Instruction Optimization for Tabular Fact Verification
Xiaotang Du, Giwon Hong, Wai-Chung Kwan +4
Instruction optimization provides a lightweight, model-agnostic approach to enhancing the reasoning performance of large language models (LLMs). This paper presents the first syste…
Anthropomimetic Uncertainty: What Verbalized Uncertainty in Language Models is Missing
Dennis Ulmer, Alexandra Lorson, Ivan Titov +1
Human users increasingly communicate with large language models (LLMs), but LLMs suffer from frequent overconfidence in their output, even when its accuracy is questionable, which…
Post-hoc Disentanglement of Textual and Acoustic Features in Pre-trained Speech Encoders
Hosein Mohebbi, Grzegorz Chrupała, Willem Zuidema +2
Pre-trained speech models build entangled internal representations, which capture a variety of features (e.g., pitch, loudness, syntax, or semantics of an utterance) in a distribut…
Unlearning Traces the Influential Training Data of Language Models
Masaru Isonuma, Ivan Titov
Identifying the training datasets that influence a language model's outputs is essential for minimizing the generation of harmful content and enhancing its performance. Ideally, we…
Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training
Max Müller-Eberstein, Rob van der Goot, Barbara Plank +1
Representational spaces learned via language modeling are fundamental to Natural Language Processing (NLP), however there has been limited understanding regarding how and when duri…
On the Transferability of Visually Grounded PCFGs
Yanpeng Zhao, Ivan Titov
There has been a significant surge of interest in visually grounded grammar induction in recent times. While a variety of models have been developed for the task and have demonstra…