output
20162026
most citedVALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena

55 citations

Showing cs.CLShow all

10 papers · 1 filter

cs.CL2026

Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requests

Manar Ali, Judith Sieker, Sina Zarrieß +1

In human conversation, both interlocutors play an active role in maintaining mutual understanding. When listeners are uncertain about what speakers mean, for example, they can requ…

cs.CL2025

Rationalizing Transformer Predictions via End-To-End Differentiable Self-Training

Marc Brinner, Sina Zarrieß

We propose an end-to-end differentiable training paradigm for stable training of a rationalized transformer classifier. Our approach results in a single model that simultaneously c…

cs.CL2025★ 1 cited

Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them

Marc Brinner, Tarek Al Mustafa, Sina Zarrieß

We investigate the use of LLM-generated data for continual pretraining of encoder models in specialized domains with limited training data, using the scientific domain of invasion…

cs.CL2024★ 2 cited

The Illusion of Competence: Evaluating the Effect of Explanations on Users' Mental Models of Visual Question Answering Systems

Judith Sieker, Simeon Junker, Ronja Utescher +4

We examine how users perceive the limitations of an AI system when it encounters a task that it cannot perform perfectly and whether providing explanations alongside its answers ai…

cs.CL2024★ 2 cited

Natural Language Processing RELIES on Linguistics

Juri Opitz, Shira Wein, Nathan Schneider

Large Language Models (LLMs) have become capable of generating highly fluent text in certain languages, without modules specially designed to capture grammar or semantic coherence.…

cs.CL2022★ 5 cited

Make More of Your Data: Minimal Effort Data Augmentation for Automatic Speech Recognition and Translation

Tsz Kin Lam, Shigehiko Schamoni, Stefan Riezler

Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples…

cs.CL2022★ 11 cited

Sample, Translate, Recombine: Leveraging Audio Alignments for Data Augmentation in End-to-end Speech Translation

Tsz Kin Lam, Shigehiko Schamoni, Stefan Riezler

End-to-end speech translation relies on data that pair source-language speech inputs with corresponding translations into a target language. Such data are notoriously scarce, makin…

cs.CL2021★ 55 cited

VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena

Letitia Parcalabescu, Michele Cafagna, Lilitta Muradjan +3

We propose VALSE (Vision And Language Structured Evaluation), a novel benchmark designed for testing general-purpose pretrained vision and language (V&L) models for their visio-lin…

cs.CL2018★ 10 cited

Unsupervised Abstractive Sentence Summarization using Length Controlled Variational Autoencoder

Raphael Schumann

In this work we present an unsupervised approach to summarize sentences in abstractive way using Variational Autoencoder (VAE). VAE are known to learn a semantically rich latent va…

cs.CL2016★ 12 cited

Stochastic Structured Prediction under Bandit Feedback

Artem Sokolov, Julia Kreutzer, Christopher Lo +1

Stochastic structured prediction under bandit feedback follows a learning protocol where on each of a sequence of iterations, the learner receives an input, predicts an output stru…