19 citations · 51 across the 11 of their papers we have counts for
12 papers
Forewarned is Forearmed: When Non-Sequential Embedding Turns Into an Anomaly Detector
Elys Allesiardo, Antoine Caubrière, Valentin Vielzeuf
This paper offers an in-depth analysis of non-sequential multimodal sentence-level embeddings, with a particular focus on the SONAR model. We demonstrate that certain embedding dim…
Scaling HuBERT for African Languages: From Base to Large and XL
Antoine Caubrière, Elodie Gauthier
Despite recent progress in multilingual speech processing, African languages remain under-represented in both research and deployed systems, particularly when it comes to strong, o…
The Speech-LLM Takes It All: A Truly Fully End-to-End Spoken Dialogue State Tracking Approach
Nizar El Ghazal, Antoine Caubrière, Valentin Vielzeuf
This paper presents a comparative study of context management strategies for end-to-end Spoken Dialog State Tracking using Speech-LLMs. We systematically evaluate traditional multi…
Africa-Centric Self-Supervised Pre-Training for Multilingual Speech Representation in a Sub-Saharan Context
Antoine Caubrière, Elodie Gauthier
We present the first self-supervised multilingual speech model trained exclusively on African speech. The model learned from nearly 60 000 hours of unlabeled speech segments in 21…
Where are we in semantic concept extraction for Spoken Language Understanding?
Sahar Ghannay, Antoine Caubrière, Salima Mdhaffar +3
Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refer…
End2End Acoustic to Semantic Transduction
Valentin Pelloin, Nathalie Camelin, Antoine Laurent +4
In this paper, we propose a novel end-to-end sequence-to-sequence spoken language understanding model using an attention mechanism. It reliably selects contextual acoustic features…
ON-TRAC Consortium for End-to-End and Simultaneous Speech Translation Challenge Tasks at IWSLT 2020
Maha Elbayad, Ha Nguyen, Fethi Bougares +5
This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2020, offline speech translation and…
Dialogue history integration into end-to-end signal-to-concept spoken language understanding systems
Natalia Tomashenko, Christian Raymond, Antoine Caubriere +2
This work investigates the embeddings for representing dialog history in spoken language understanding (SLU) systems. We focus on the scenario when the semantic information is extr…
ON-TRAC Consortium End-to-End Speech Translation Systems for the IWSLT 2019 Shared Task
Ha Nguyen, Natalia Tomashenko, Marcely Zanon Boito +5
This paper describes the ON-TRAC Consortium translation systems developed for the end-to-end model task of IWSLT Evaluation 2019 for the English-to-Portuguese language pair. ON-TRA…
Recent Advances in End-to-End Spoken Language Understanding
Natalia Tomashenko, Antoine Caubriere, Yannick Esteve +2
This work investigates spoken language understanding (SLU) systems in the scenario when the semantic information is extracted directly from the speech signal by means of a single e…
Curriculum-based transfer learning for an effective end-to-end spoken language understanding and domain portability
Antoine Caubrière, Natalia Tomashenko, Antoine Laurent +3
We present an end-to-end approach to extract semantic concepts directly from the speech audio signal. To overcome the lack of data available for this spoken language understanding…
End-to-end named entity extraction from speech
Sahar Ghannay, Antoine Caubrière, Yannick Estève +2
Named entity recognition (NER) is among SLU tasks that usually extract semantic information from textual documents. Until now, NER from speech is made through a pipeline process th…