Guidance on the Assurance of Machine Learning in Autonomous Systems (AMLAS)
arXiv:2102.01564
Abstract
Machine Learning (ML) is now used in a range of systems with results that are reported to exceed, under certain conditions, human performance. Many of these systems, in domains such as healthcare , automotive and manufacturing, exhibit high degrees of autonomy and are safety critical. Establishing justified confidence in ML forms a core part of the safety case for these systems. In this document we introduce a methodology for the Assurance of Machine Learning for use in Autonomous Systems (AMLAS). AMLAS comprises a set of safety case patterns and a process for (1) systematically integrating safety assurance into the development of ML components and (2) for generating the evidence base for explicitly justifying the acceptable safety of these components when integrated into autonomous system applications.
References in corpus (8)
- Towards A Rigorous Science of Interpretable Machine Learning
- DeepXplore: Automated Whitebox Testing of Deep Learning Systems
- Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy
- Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges
- DeepRoad: GAN-based Metamorphic Autonomous Driving System Testing
- DeepSafe: A Data-driven Approach for Checking Adversarial Robustness in Neural Networks
- Towards Verifying Robustness of Neural Networks Against Semantic Perturbations
- Quantifying Assurance in Learning-enabled Systems
Cited by in corpus (6)
- A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systems
- A Trustworthiness Score to Evaluate DNN Predictions
- Model predictivity assessment: incremental test-set selection and accuracy evaluation
- An NCAP-like Safety Indicator for Self-Driving Cars
- Operationalizing Assurance Cases for Data Scientists: A Showcase of Concepts and Tooling in the Context of Test Data Quality for Machine Learning
- Sample selection from a given dataset to validate machine learning models