129 citations · 752 across the 80 of their papers we have counts for
93 papers
On the Limitations of Markovian Rewards to Express Multi-Objective, Risk-Sensitive, and Modal Tasks
Joar Skalse, Alessandro Abate
In this paper, we study the expressivity of scalar, Markovian reward functions in Reinforcement Learning (RL), and identify several limitations to what they can express. Specifical…
Policy Evaluation in Distributional LQR (Extended Version)
Zifan Wang, Yulong Gao, Siyi Wang +3
Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random retu…
Formal Analysis and Verification of Max-Plus Linear Systems
Muhammad Syifa'ul Mufid, Andrea Micheli, Alessandro Abate +1
Max-Plus Linear (MPL) systems are an algebraic formalism with practical applications in transportation networks, manufacturing and biological systems. In this paper, we investigate…
On Imperfect Recall in Multi-Agent Influence Diagrams
James Fox, Matt MacDermott, Lewis Hammond +3
Multi-agent influence diagrams (MAIDs) are a popular game-theoretic model based on Bayesian networks. In some settings, MAIDs offer significant advantages over extensive-form game…
On the Trade-off Between Efficiency and Precision of Neural Abstraction
Alec Edwards, Mirco Giacobbe, Alessandro Abate
Neural abstractions have been recently introduced as formal approximations of complex, nonlinear dynamical models. They comprise a neural ODE and a certified upper bound on the err…
An Exact Characterisation of Flexibility in Populations of Electric Vehicles
Karan Mukhi, Alessandro Abate
Increasing penetrations of electric vehicles (EVs) presents a large source of flexibility, which can be used to assist balancing the power grid. The flexibility of an individual EV…