6 papers
Critical slowing down for predicting controller induced loss of control in quadrotors
Jasper J. van Beers, Prashant Solanki, Erik-Jan van Kampen +1
We develop a novel forecasting scheme to anticipate controller induced loss of control (LOC) in quadrotors and evaluate it on real LOC flight data from four different quadrotors. F…
Reachability-Preserving Bellman Operator for the Discounted Reach-Cost Value Function: Uniting Hamilton-Jacobi Reachability and Reinforcement Learning
Isabelle El-Hajj, Prashant Solanki, Jasper van Beers +2
Hamilton-Jacobi (HJ) reachability provides rigorous safety and reachability guarantees for continuous-time dynamical systems, but its numerical solution suffers from the curse of d…
Unifying Hamilton-Jacobi Reachability and Reinforcement Learning
Prashant Solanki, Isabelle El-Hajj, Jasper van Beers +2
We unify Hamilton-Jacobi (HJ) reachability and Reinforcement Learning (RL) through a proposed running cost formulation. We prove that the resultant travel-cost value function is th…
Temporally smoothed incremental model-based heuristic dynamic programming for command-filtered cascaded online learning flight control
Yifei Li, Erik-Jan van Kampen, Erik-jan van Kampen
Approximate Dynamic Programming (ADP) enables online adaptation of control laws through adaptive critic methods. However, its application to online learning Angle-of-Attack (AoA) t…
Certifying Hamilton-Jacobi Reachability Learned via Reinforcement Learning
Prashant Solanki, Isabelle El-Hajj, Jasper J. van Beers +2
We present a framework to \emph{certify} Hamilton--Jacobi (HJ) reachability learned by reinforcement learning (RL). Building on a discounted initial time \emph{travel-cost} formula…
Lyapunov Function-guided Reinforcement Learning for Flight Control
Yifei Li, Erik-Jan van Kampen
A cascaded online learning flight control system has been developed and enhanced with respect to action smoothness. In this paper, we investigate the convergence performance of the…