Using Formal Methods for Autonomous Systems: Five Recipes for Formal Verification
arXiv:2012.00856 · doi:10.1177/1748006X211034970
Abstract
Formal Methods are mathematically-based techniques for software design and engineering, which enable the unambiguous description of and reasoning about a system's behaviour. Autonomous systems use software to make decisions without human control, are often embedded in a robotic system, are often safety-critical, and are increasingly being introduced into everyday settings. Autonomous systems need robust development and verification methods, but formal methods practitioners are often asked: Why use Formal Methods for Autonomous Systems? To answer this question, this position paper describes five recipes for formally verifying aspects of an autonomous system, collected from the literature. The recipes are examples of how Formal Methods can be an effective tool for the development and verification of autonomous systems. During design, they enable unambiguous description of requirements; in development, formal specifications can be verified against requirements; software components may be synthesised from verified specifications; and behaviour can be monitored at runtime and compared to its original specification. Modern Formal Methods often include highly automated tool support, which enables exhaustive checking of a system's state space. This paper argues that Formal Methods are a powerful tool for the repertoire of development techniques for safe autonomous systems, alongside other robust software engineering techniques.
arXiv commentAccepted at Journal of Risk and Reliability
References in corpus (10)
- Artificial Intelligence: the global landscape of ethics guidelines
- Formal Specification and Verification of Autonomous Robotic Systems: A Survey
- The STRANDS Project: Long-Term Autonomy in Everyday Environments
- A Corroborative Approach to Verification and Validation of Human--Robot Teams
- Robotics and Integrated Formal Methods: Necessity meets Opportunity
- New Opportunities for Integrated Formal Methods
- Towards the Verification of Safety-critical Autonomous Systems in Dynamic Environments
- Heterogeneous Verification of an Autonomous Curiosity Rover
- A Summary of Formal Specification and Verification of Autonomous Robotic Systems
- Adaptable and Verifiable BDI Reasoning