5 citations · 5 across the 6 of their papers we have counts for
3 papers · 1 filter
The Role of Mixed-Language Documents for Multilingual Large Language Model Pretraining
Jiandong Shao, Raphael Tang, Crystina Zhang +4
Multilingual large language models achieve impressive cross-lingual performance despite largely monolingual pretraining. While bilingual data in pretraining corpora is widely belie…
OTTers: One-turn Topic Transitions for Open-Domain Dialogue
Karin Sevegnani, David M. Howcroft, Ioannis Konstas +1
Mixed initiative in open-domain dialogue requires a system to pro-actively introduce new topics. The one-turn topic transition task explores how a system connects two topics in a c…
Automatic Quality Estimation for Natural Language Generation: Ranting (Jointly Rating and Ranking)
Ondřej Dušek, Karin Sevegnani, Ioannis Konstas +1
We present a recurrent neural network based system for automatic quality estimation of natural language generation (NLG) outputs, which jointly learns to assign numerical ratings t…