13 citations · 32 across the 40 of their papers we have counts for
3 papers · 1 filter
An Empirical Analysis of Discrete Unit Representations in Speech Language Modeling Pre-training
Yanis Labrak, Richard Dufour, Mickaël Rouvier
This paper investigates discrete unit representations in Speech Language Models (SLMs), focusing on optimizing speech modeling during continual pre-training. In this paper, we syst…
LFAR: Accounting for Layerwise Dynamics to Improve Multimodal Adaptation of Language Models
Santiago Cuervo, Adel Moumen, Yanis Labrak +5
Text-pretrained language models (LMs) encode rich world knowledge, but adapting them to process and generate perceptual modalities such as audio and images while effectively levera…
A Benchmark of French ASR Systems Based on Error Severity
Antoine Tholly, Jane Wottawa, Mickael Rouvier +1
Automatic Speech Recognition (ASR) transcription errors are commonly assessed using metrics that compare them with a reference transcription, such as Word Error Rate (WER), which m…