5 citations · 6 across the 6 of their papers we have counts for
6 papers
Forewarned is Forearmed: When Non-Sequential Embedding Turns Into an Anomaly Detector
Elys Allesiardo, Antoine Caubrière, Valentin Vielzeuf
This paper offers an in-depth analysis of non-sequential multimodal sentence-level embeddings, with a particular focus on the SONAR model. We demonstrate that certain embedding dim…
SENS-ASR: Semantic Embedding injection in Neural-transducer for Streaming Automatic Speech Recognition
Youness Dkhissi, Valentin Vielzeuf, Elys Allesiardo +1
Many Automatic Speech Recognition (ASR) applications require streaming processing of the audio data. In streaming mode, ASR systems need to start transcribing the input stream befo…
Do we really need Self-Attention for Streaming Automatic Speech Recognition?
Youness Dkhissi, Valentin Vielzeuf, Elys Allesiardo +1
Transformer-based architectures are the most used architectures in many deep learning fields like Natural Language Processing, Computer Vision or Speech processing. It may encourag…
Sustainable self-supervised learning for speech representations
Luis Lugo, Valentin Vielzeuf
Sustainable artificial intelligence focuses on data, hardware, and algorithms to make machine learning models more environmentally responsible. In particular, machine learning mode…
Efficiency-oriented approaches for self-supervised speech representation learning
Luis Lugo, Valentin Vielzeuf
Self-supervised learning enables the training of large neural models without the need for large, labeled datasets. It has been generating breakthroughs in several fields, including…
Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognition
Maxime Burchi, Valentin Vielzeuf
The recently proposed Conformer architecture has shown state-of-the-art performances in Automatic Speech Recognition by combining convolution with attention to model both local and…