Safe-visor Architecture for Sandboxing (AI-based) Unverified Controllers in Stochastic Cyber-Physical Systems
arXiv:2102.05490 · doi:10.1016/j.nahs.2021.101110
Abstract
High performance but unverified controllers, e.g., artificial intelligence-based (a.k.a. AI-based) controllers, are widely employed in cyber-physical systems (CPSs) to accomplish complex control missions. However, guaranteeing the safety and reliability of CPSs with this kind of controllers is currently very challenging, which is of vital importance in many real-life safety-critical applications. To cope with this difficulty, we propose in this work a Safe-visor architecture for sandboxing unverified controllers in CPSs operating in noisy environments (a.k.a. stochastic CPSs). The proposed architecture contains a history-based supervisor, which checks inputs from the unverified controller and makes a compromise between functionality and safety of the system, and a safety advisor that provides fallback when the unverified controller endangers the safety of the system. Both the history-based supervisor and the safety advisor are designed based on an approximate probabilistic relation between the original system and its finite abstraction. By employing this architecture, we provide formal probabilistic guarantees on preserving the safety specifications expressed by accepting languages of deterministic finite automata (DFA). Meanwhile, the unverified controllers can still be employed in the control loop even though they are not reliable. We demonstrate the effectiveness of our proposed results by applying them to two (physical) case studies.
References in corpus (13)
- Continuous control with deep reinforcement learning
- End to End Learning for Self-Driving Cars
- Experimental Comparison of Open Source Visual-Inertial-Based State Estimation Algorithms in the Underwater Domain
- Deep Neural Network Compression for Aircraft Collision Avoidance Systems
- Temporal Logic Guided Safe Reinforcement Learning Using Control Barrier Functions
- Shield Synthesis: Runtime Enforcement for Reactive Systems
- Safe reinforcement learning for probabilistic reachability and safety specifications: A Lyapunov-based approach
- Distributed Model Predictive Safety Certification for Learning-based Control
- Generalizing from a few environments in safety-critical reinforcement learning
- Formal Policy Synthesis for Continuous-Space Systems via Reinforcement Learning
- Model order reduction methods for geometrically nonlinear structures: a review of nonlinear techniques
- Sandboxing Controllers for Stochastic Cyber-Physical Systems
- Similarity quantification for linear stochastic systems: A coupling compensator approach