activity
20152026
most citedSurvey on Evaluation Methods for Dialogue Systems

215 citations · 250 across the 22 of their papers we have counts for

collaborators

25 papers

cs.CL2026

Your Voice Cloning System is Secretly a Voice Anonymizer

Romolo Muletta, Felix Matthias Saaro, Mark Cieliebak +1

Speaker anonymization suppresses speaker-identifying attributes from speech while preserving linguistic content and quality. We propose repurposing XTTSv2, a multilingual voice clo…

cs.CL2026

The RAT: A Unified Bayesian Model for RAG Evaluation

Pius von Däniken, Felix Matthias Saaro, Mark Cieliebak +1

Evaluating Retrieval-Augmented Generation (RAG) systems requires assessing not only end-to-end correctness but also how individual components interact and how errors propagate thro…

cs.CL2025

SwissGPC v1.0 -- The Swiss German Podcasts Corpus

Samuel Stucki, Mark Cieliebak, Jan Deriu

We present SwissGPC v1.0, the first mid-to-large-scale corpus of spontaneous Swiss German speech, developed to support research in ASR, TTS, dialect identification, and related fie…

cs.CL2025

Voice Adaptation for Swiss German

Samuel Stucki, Jan Deriu, Mark Cieliebak

This work investigates the performance of Voice Adaptation models for Swiss German dialects, i.e., translating Standard German text to Swiss German dialect speech. For this, we pre…

cs.CL2025

ViClaim: A Multilingual Multilabel Dataset for Automatic Claim Detection in Videos

Patrick Giedemann, Pius von Däniken, Jan Deriu +3

The growing influence of video content as a medium for communication and misinformation underscores the urgent need for effective tools to analyze claims in multilingual and multi-…

cs.CL2024

A Measure of the System Dependence of Automated Metrics

Pius von Däniken, Jan Deriu, Mark Cieliebak

Automated metrics for Machine Translation have made significant progress, with the goal of replacing expensive and time-consuming human evaluations. These metrics are typically ass…