Model-free tracking control of complex dynamical trajectories with machine learning

Abstract

Nonlinear tracking control enabling a dynamical system to track a desired trajectory is fundamental to robotics, serving a wide range of civil and defense applications. In control engineering, designing tracking control requires complete knowledge of the system model and equations. We develop a model-free, machine-learning framework to control a two-arm robotic manipulator using only partially observed states, where the controller is realized by reservoir computing. Stochastic input is exploited for training, which consists of the observed partial state vector as the first and its immediate future as the second component so that the neural machine regards the latter as the future state of the former. In the testing (deployment) phase, the immediate-future component is replaced by the desired observational vector from the reference trajectory. We demonstrate the effectiveness of the control framework using a variety of periodic and chaotic signals, and establish its robustness against measurement noise, disturbances, and uncertainties.

arXiv comment16 pages, 8 figures

References in corpus (11)

• Recent Advances in Physical Reservoir Computing: A Review
• Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
• Next Generation Reservoir Computing
• Structure-based control of complex networks with nonlinear dynamics
• On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high Reynolds number flow over an Ahmed body
• On Explaining the Surprising Success of Reservoir Computing Forecaster of Chaos? The Universal Machine Learning Dynamical System with Contrasts to VAR and DMD
• Generalizable control for quantum parameter estimation through reinforcement learning
• Anticipating synchronization with machine learning
• Machine Learning from a Continuous Viewpoint
• Locally Optimal Control of Complex Networks
• Irrelevance of linear controllability to nonlinear dynamical networks

Cited by in corpus (4)

• Controlling Chaos Using Edge Computing Hardware
• Temporal Convolution Derived Multi-Layered Reservoir Computing
• Complex Couplings -- A universal, adaptive and bilinear formulation of power grid dynamics
• Analysis on reservoir activation with the nonlinearity harnessed from solution-processed molybdenum disulfide