7 citations · 9 across the 4 of their papers we have counts for
4 papers
Pantagruel: Unified Self-Supervised Encoders for French Text and Speech
Phuong-Hang Le, Valentin Pelloin, Arnault Chatelain +27
We release Pantagruel models, a new family of self-supervised encoder models for French text and speech. Instead of predicting modality-tailored targets such as textual tokens or s…
On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding
Gaëlle Laperrière, Valentin Pelloin, Mickaël Rouvier +2
In this paper we examine the use of semantically-aligned speech representations for end-to-end spoken language understanding (SLU). We employ the recently-introduced SAMU-XLSR mode…
ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks
Valentin Pelloin, Franck Dary, Nicolas Herve +4
We aim at improving spoken language modeling (LM) using very large amount of automatically transcribed speech. We leverage the INA (French National Audiovisual Institute) collectio…
End2End Acoustic to Semantic Transduction
Valentin Pelloin, Nathalie Camelin, Antoine Laurent +4
In this paper, we propose a novel end-to-end sequence-to-sequence spoken language understanding model using an attention mechanism. It reliably selects contextual acoustic features…