4 papers
Safe and Near-Optimal Gate Control: A Case Study from the Danish West Coast
Martin Kristjansen, Kim Guldstrand Larsen, Marius MikuÄionis +1
Ringkoebing Fjord is an inland water basin on the Danish west coast separated from the North Sea by a set of gates used to control the amount of water entering and leaving the fjor…
Uppaal Coshy: Automatic Synthesis of Compact Shields for Hybrid Systems
Asger Horn Brorholt, Andreas Holck Høeg-Petersen, Andreas Holck Høeg-Petersen +8
We present Uppaal Coshy, a tool for automatic synthesis of a safety strategy -- or shield -- for Markov decision processes over continuous state spaces and complex hybrid dynamics.…
Compositional Shielding and Reinforcement Learning for Multi-Agent Systems
Asger Horn Brorholt, Kim Guldstrand Larsen, Christian Schilling
Deep reinforcement learning has emerged as a powerful tool for obtaining high-performance policies. However, the safety of these policies has been a long-standing issue. One promis…
Efficient Shield Synthesis via State-Space Transformation
Asger Horn Brorholt, Andreas Holck Høeg-Petersen, Kim Guldstrand Larsen +1
We consider the problem of synthesizing safety strategies for control systems, also known as shields. Since the state space is infinite, shields are typically computed over a finit…