activity
20162023
most citedFlauBERT: Unsupervised Language Model Pre-training for French

61 citations · 90 across the 11 of their papers we have counts for

collaborators

12 papers

cs.CL2023★ 1 cited

LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speech

Titouan Parcollet, Ha Nguyen, Solene Evain +19

Self-supervised learning (SSL) is at the origin of unprecedented improvements in many different domains including computer vision and natural language processing. Speech processing…

cs.CL2023★ 7 cited

Pre-training for Speech Translation: CTC Meets Optimal Transport

Phuong-Hang Le, Hongyu Gong, Changhan Wang +3

The gap between speech and text modalities is a major challenge in speech-to-text translation (ST). Different methods have been proposed to reduce this gap, but most of them requir…

cs.CL2021★ 1 cited

LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech

Solene Evain, Ha Nguyen, Hang Le +15

Self-Supervised Learning (SSL) using huge unlabeled data has been successfully explored for image and natural language processing. Recent works also investigated SSL from speech. T…

cs.CL2020

ON-TRAC Consortium for End-to-End and Simultaneous Speech Translation Challenge Tasks at IWSLT 2020

Maha Elbayad, Ha Nguyen, Fethi Bougares +5

This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2020, offline speech translation and…

cs.CL2019★ 61 cited

FlauBERT: Unsupervised Language Model Pre-training for French

Hang Le, Loïc Vial, Jibril Frej +7

Language models have become a key step to achieve state-of-the art results in many different Natural Language Processing (NLP) tasks. Leveraging the huge amount of unlabeled texts…

cs.CL2019

The LIG system for the English-Czech Text Translation Task of IWSLT 2019

Loïc Vial, Benjamin Lecouteux, Didier Schwab +2

In this paper, we present our submission for the English to Czech Text Translation Task of IWSLT 2019. Our system aims to study how pre-trained language models, used as input embed…