19 citations · 74 across the 8 of their papers we have counts for
4 papers · 1 filter
HATS: An Open data set Integrating Human Perception Applied to the Evaluation of Automatic Speech Recognition Metrics
Thibault Bañeras Roux, Jane Wottawa, Mickael Rouvier +2
Conventionally, Automatic Speech Recognition (ASR) systems are evaluated on their ability to correctly recognize each word contained in a speech signal. In this context, the word e…
Qualitative Evaluation of Language Model Rescoring in Automatic Speech Recognition
Thibault Bañeras-Roux, Mickaël Rouvier, Jane Wottawa +1
Evaluating automatic speech recognition (ASR) systems is a classical but difficult and still open problem, which often boils down to focusing only on the word error rate (WER). How…
A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks
Yanis Labrak, Mickael Rouvier, Richard Dufour
We evaluate four state-of-the-art instruction-tuned large language models (LLMs) -- ChatGPT, Flan-T5 UL2, Tk-Instruct, and Alpaca -- on a set of 13 real-world clinical and biomedic…
WAC: A Corpus of Wikipedia Conversations for Online Abuse Detection
Noé Cecillon, Vincent Labatut, Richard Dufour +1
With the spread of online social networks, it is more and more difficult to monitor all the user-generated content. Automating the moderation process of the inappropriate exchange…