8 citations · 10 across the 4 of their papers we have counts for
4 papers
WER is Unaware: Assessing How ASR Errors Distort Clinical Understanding in Patient Facing Dialogue
Zachary Ellis, Jared Joselowitz, Yash Deo +7
As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that st…
MATRIX: Multi-Agent simulaTion fRamework for safe Interactions and conteXtual clinical conversational evaluation
Ernest Lim, Yajie Vera He, Jared Joselowitz +9
Despite the growing use of large language models (LLMs) in clinical dialogue systems, existing evaluations focus on task completion or fluency, offering little insight into the beh…
ASTRID -- An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems
Mohita Chowdhury, Yajie Vera He, Jared Joselowitz +2
Large Language Models (LLMs) have shown impressive potential in clinical question answering (QA), with Retrieval Augmented Generation (RAG) emerging as a leading approach for ensur…
Ethics in conversation: Building an ethics assurance case for autonomous AI-enabled voice agents in healthcare
Marten H. L. Kaas, Zoe Porter, Ernest Lim +3
The deployment and use of AI systems should be both safe and broadly ethically acceptable. The principles-based ethics assurance argument pattern is one proposal in the AI ethics l…