3 citations · 3 across the 13 of their papers we have counts for
4 papers · 1 filter
Adaptive GR(1) Specification Repair for Liveness-Preserving Shielding in Reinforcement Learning
Tiberiu-Andrei Georgescu, Alexander W. Goodall, Dalal Alrajeh +2
Shielding is widely used to enforce safety in reinforcement learning (RL), ensuring that an agent's actions remain compliant with formal specifications. Classical shielding approac…
Measuring Goal-Directedness
Matt MacDermott, James Fox, Francesco Belardinelli +1
We define maximum entropy goal-directedness (MEG), a formal measure of goal-directedness in causal models and Markov decision processes, and give algorithms for computing it. Measu…
The Reasons that Agents Act: Intention and Instrumental Goals
Francis Rhys Ward, Matt MacDermott, Francesco Belardinelli +2
Intention is an important and challenging concept in AI. It is important because it underlies many other concepts we care about, such as agency, manipulation, legal responsibility,…
Honesty Is the Best Policy: Defining and Mitigating AI Deception
Francis Rhys Ward, Francesco Belardinelli, Francesca Toni +1
Deceptive agents are a challenge for the safety, trustworthiness, and cooperation of AI systems. We focus on the problem that agents might deceive in order to achieve their goals (…