activity
20152026
most citedSurvey on Evaluation Methods for Dialogue Systems

215 citations · 250 across the 22 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.CL2023★ 2 cited

Dialect Transfer for Swiss German Speech Translation

Claudio Paonessa, Yanick Schraner, Jan Deriu +3

This paper investigates the challenges in building Swiss German speech translation systems, specifically focusing on the impact of dialect diversity and differences between Swiss G…

cs.CL2023

Correction of Errors in Preference Ratings from Automated Metrics for Text Generation

Jan Deriu, Pius von Däniken, Don Tuggener +1

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judg…

cs.DB2023★ 1 cited

ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems

Yi Zhang, Jan Deriu, George Katsogiannis-Meimarakis +3

Natural Language to SQL systems (NL-to-SQL) have recently shown a significant increase in accuracy for natural language to SQL query translation. This improvement is due to the eme…

cs.CL2023

Text-to-Speech Pipeline for Swiss German -- A comparison

Tobias Bollinger, Jan Deriu, Manfred Vogel

In this work, we studied the synthesis of Swiss German speech using different Text-to-Speech (TTS) models. We evaluated the TTS models on three corpora, and we found, that VITS mod…

cs.CL2023

STT4SG-350: A Speech Corpus for All Swiss German Dialect Regions

Michel Plüss, Jan Deriu, Yanick Schraner +8

We present STT4SG-350 (Speech-to-Text for Swiss German), a corpus of Swiss German speech, annotated with Standard German text at the sentence level. The data is collected using a w…