331 citations · 844 across the 47 of their papers we have counts for
10 papers · 1 filter
On the Optimization Landscape of Observer-based Dynamic Linear Quadratic Control
Jingliang Duan, Jie Li, Yinsong Ma +5
Understanding the optimization landscape of linear quadratic regulation (LQR) problems is fundamental to the design of efficient reinforcement learning solutions. Recent work has m…
Primal-dual Estimator Learning: an Offline Constrained Moving Horizon Estimation Method with Feasibility and Near-optimality Guarantees
Wenhan Cao, Jingliang Duan, Shengbo Eben Li +3
This paper proposes a primal-dual framework to learn a stable estimator for linear constrained estimation problems leveraging the moving horizon approach. To avoid the online compu…
Approximate Optimal Filter for Linear Gaussian Time-invariant Systems
Kaiming Tang, Shengbo Eben Li, Yuming Yin +4
State estimation is critical to control systems, especially when the states cannot be directly measured. This paper presents an approximate optimal filter, which enables to use pol…
Recurrent Model Predictive Control
Zhengyu Liu, Jingliang Duan, Wenxuan Wang +5
This paper proposes an off-line algorithm, called Recurrent Model Predictive Control (RMPC), to solve general nonlinear finite-horizon optimal control problems. Unlike traditional…
Recurrent Model Predictive Control: Learning an Explicit Recurrent Controller for Nonlinear Systems
Zhengyu Liu, Jingliang Duan, Wenxuan Wang +4
This paper proposes an offline control algorithm, called Recurrent Model Predictive Control (RMPC), to solve large-scale nonlinear finite-horizon optimal control problems. It can b…
Ternary Policy Iteration Algorithm for Nonlinear Robust Control
Jie Li, Shengbo Eben Li, Yang Guan +3
The uncertainties in plant dynamics remain a challenge for nonlinear control problems. This paper develops a ternary policy iteration (TPI) algorithm for solving nonlinear robust c…
Continuous-time finite-horizon ADP for automated vehicle controller design with high efficiency
Ziyu Lin, Jingliang Duan, Shengbo Eben Li +2
The design of an automated vehicle controller can be generally formulated into an optimal control problem. This paper proposes a continuous-time finite-horizon approximate dynamicp…
Hierarchical Reinforcement Learning for Self-Driving Decision-Making without Reliance on Labeled Driving Data
Jingliang Duan, Shengbo Eben Li, Yang Guan +2
Decision making for self-driving cars is usually tackled by manually encoding rules from drivers' behaviors or imitating drivers' manipulation using supervised learning techniques.…
Adaptive dynamic programming for nonaffine nonlinear optimal control problem with state constraints
Jingliang Duan, Zhengyu Liu, Shengbo Eben Li +3
This paper presents a constrained adaptive dynamic programming (CADP) algorithm to solve general nonlinear nonaffine optimal control problems with known dynamics. Unlike previous A…
Relaxed Actor-Critic with Convergence Guarantees for Continuous-Time Optimal Control of Nonlinear Systems
Jingliang Duan, Jie Li, Qiang Ge +4
This paper presents the Relaxed Continuous-Time Actor-critic (RCTAC) algorithm, a method for finding the nearly optimal policy for nonlinear continuous-time (CT) systems with known…