4 citations · 11 across the 11 of their papers we have counts for
11 papers
What Types of Human-AI Teams Exist?
Nathan Hughes, Ibrahim Habli
Human-AI teaming has received increasing attention in the literature. However, the range of studies conducted in multiple domains make it difficult to understand what types of team…
A Calibrated Memorization Index (MI) for Detecting Training Data Leakage in Generative MRI Models
Yash Deo, Yan Jia, Toni Lassila +5
Image generative models are known to duplicate images from the training data as part of their outputs, which can lead to privacy concerns when used for medical image generation. We…
Evaluating Metrics for Safety with LLM-as-Judges
Kester Clegg, Richard Hawkins, Ibrahim Habli +1
LLMs (Large Language Models) are increasingly used in text processing pipelines to intelligently respond to a variety of inputs and generation tasks. This raises the possibility of…
WER is Unaware: Assessing How ASR Errors Distort Clinical Understanding in Patient Facing Dialogue
Zachary Ellis, Jared Joselowitz, Yash Deo +7
As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that st…
Out-of-Distribution Detection for Safety Assurance of AI and Autonomous Systems
Victoria J. Hodge, Colin Paterson, Ibrahim Habli
The operational capabilities and application domains of AI-enabled autonomous systems have expanded significantly in recent years due to advances in robotics and machine learning (…
MATRIX: Multi-Agent simulaTion fRamework for safe Interactions and conteXtual clinical conversational evaluation
Ernest Lim, Yajie Vera He, Jared Joselowitz +9
Despite the growing use of large language models (LLMs) in clinical dialogue systems, existing evaluations focus on task completion or fluency, offering little insight into the beh…
Metrics that matter: Evaluating image quality metrics for medical image generation
Yash Deo, Yan Jia, Toni Lassila +5
Evaluating generative models for synthetic medical imaging is crucial yet challenging, especially given the high standards of fidelity, anatomical accuracy, and safety required for…
The BIG Argument for AI Safety Cases
Ibrahim Habli, Richard Hawkins, Colin Paterson +4
We present our Balanced, Integrated and Grounded (BIG) argument for assuring the safety of AI systems. The BIG argument adopts a whole-system approach to constructing a safety case…
The case for delegated AI autonomy for Human AI teaming in healthcare
Yan Jia, Harriet Evans, Zoe Porter +5
In this paper we propose an advanced approach to integrating artificial intelligence (AI) into healthcare: autonomous decision support. This approach allows the AI algorithm to act…
Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle
Marten H. L. Kaas, Christopher Burr, Zoe Porter +6
Fairness is one of the most commonly identified ethical principles in existing AI guidelines, and the development of fair AI-enabled systems is required by new and emerging AI regu…
What's my role? Modelling responsibility for AI-based safety-critical systems
Philippa Ryan, Zoe Porter, Joanna Al-Qaddoumi +2
AI-Based Safety-Critical Systems (AI-SCS) are being increasingly deployed in the real world. These can pose a risk of harm to people and the environment. Reducing that risk is an o…