119 citations · 136 across the 14 of their papers we have counts for
17 papers
ATLAS: Discovering Agent Strategies through LLM-Guided Abstraction and Automata Learning
Ignacio D. Lopez-Miguel, Andreas Happe, Jürgen Cito +3
Large Language Model (LLM)-based agents are increasingly used for complex tasks such as software testing and cybersecurity assessment. While these agents demonstrate impressive cap…
ORCAID: Oblique Rule-Based Continuous-Action Interpretation for Deep RL Policies
Ignacio D. Lopez-Miguel, Ezio Bartocci, Thomas Eiter +1
Explainability remains a key issue in reinforcement learning (RL). Distilling an interpretable policy from an agent trained in a complex environment is particularly challenging whe…
Finite-State Controllers for (Hidden-Model) POMDPs using Deep Reinforcement Learning
David Hudák, Maris F. L. Galesloot, Martin Tappler +3
Solving partially observable Markov decision processes (POMDPs) requires computing policies under imperfect state information. Despite recent advances, the scalability of existing…
Rule-Guided Reinforcement Learning Policy Evaluation and Improvement
Martin Tappler, Ignacio D. Lopez-Miguel, Sebastian Tschiatschek +1
We consider the challenging problem of using domain knowledge to improve deep reinforcement learning policies. To this end, we propose LEGIBLE, a novel approach, following a multi-…
Test Where Decisions Matter: Importance-driven Testing for Deep Reinforcement Learning
Stefan Pranger, Hana Chockler, Martin Tappler +1
In many Deep Reinforcement Learning (RL) problems, decisions in a trained policy vary in significance for the expected safety and performance of the policy. Since RL policies are v…
Learning Environment Models with Continuous Stochastic Dynamics
Martin Tappler, Edi Muškardin, Bernhard K. Aichernig +1
Solving control tasks in complex environments automatically through learning offers great potential. While contemporary techniques from deep reinforcement learning (DRL) provide ef…
On the Relationship Between RNN Hidden State Vectors and Semantic Ground Truth
Edi Muškardin, Martin Tappler, Ingo Pill +2
We examine the assumption that the hidden-state vectors of recurrent neural networks (RNNs) tend to form clusters of semantically similar vectors, which we dub the clustering hypot…
Online Shielding for Reinforcement Learning
Bettina Könighofer, Julian Rudolf, Alexander Palmisano +2
Besides the recent impressive results on reinforcement learning (RL), safety is still one of the major research challenges in RL. RL is a machine-learning approach to determine nea…
Automata Learning meets Shielding
Martin Tappler, Stefan Pranger, Bettina Könighofer +3
Safety is still one of the major research challenges in reinforcement learning (RL). In this paper, we address the problem of how to avoid safety violations of RL agents during exp…
Reinforcement Learning under Partial Observability Guided by Learned Environment Models
Edi Muskardin, Martin Tappler, Bernhard K. Aichernig +1
In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's pre…
Search-Based Testing of Reinforcement Learning
Martin Tappler, Filip Cano Córdoba, Bernhard K. Aichernig +1
Evaluation of deep reinforcement learning (RL) is inherently challenging. Especially the opaqueness of learned policies and the stochastic nature of both agents and environments ma…
Online Shielding for Stochastic Systems
Bettina Könighofer, Julian Rudolf, Alexander Palmisano +2
In this paper, we propose a method to develop trustworthy reinforcement learning systems. To ensure safety especially during exploration, we automatically synthesize a correct-by-c…
Adaptive Shielding under Uncertainty
Stefan Pranger, Bettina Könighofer, Martin Tappler +3
This paper targets control problems that exhibit specific safety and performance requirements. In particular, the aim is to ensure that an agent, operating under uncertainty, will…
Learning a Behavior Model of Hybrid Systems Through Combining Model-Based Testing and Machine Learning (Full Version)
Bernhard K. Aichernig, Roderick Bloem, Masoud Ebrahimi +6
Models play an essential role in the design process of cyber-physical systems. They form the basis for simulation and analysis and help in identifying design problems as early as p…
L*-Based Learning of Markov Decision Processes (Extended Version)
Martin Tappler, Bernhard K. Aichernig, Giovanni Bacci +2
Automata learning techniques automatically generate system models from test observations. These techniques usually fall into two categories: passive and active. Passive learning us…
Model-Based Testing IoT Communication via Active Automata Learning
Martin Tappler, Bernhard K. Aichernig, Roderick Bloem
This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specific…
Learning Timed Automata via Genetic Programming
Martin Tappler, Bernhard K. Aichernig, Kim Guldstrand Larsen +1
Model learning has gained increasing interest in recent years. It derives behavioural models from test data of black-box systems. The main advantage offered by such techniques is t…