6 citations · 7 across the 2 of their papers we have counts for
3 papers · 1 filter
HATS: An Open data set Integrating Human Perception Applied to the Evaluation of Automatic Speech Recognition Metrics
Thibault Bañeras Roux, Jane Wottawa, Mickael Rouvier +2
Conventionally, Automatic Speech Recognition (ASR) systems are evaluated on their ability to correctly recognize each word contained in a speech signal. In this context, the word e…
Qualitative Evaluation of Language Model Rescoring in Automatic Speech Recognition
Thibault Bañeras-Roux, Mickaël Rouvier, Jane Wottawa +1
Evaluating automatic speech recognition (ASR) systems is a classical but difficult and still open problem, which often boils down to focusing only on the word error rate (WER). How…
A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks
Yanis Labrak, Mickael Rouvier, Richard Dufour
We evaluate four state-of-the-art instruction-tuned large language models (LLMs) -- ChatGPT, Flan-T5 UL2, Tk-Instruct, and Alpaca -- on a set of 13 real-world clinical and biomedic…