Fusion Dynamical Systems with Machine Learning in Imitation Learning: A Comprehensive Overview

Abstract

Imitation Learning (IL), also referred to as Learning from Demonstration (LfD), holds significant promise for capturing expert motor skills through efficient imitation, facilitating adept navigation of complex scenarios. A persistent challenge in IL lies in extending generalization from historical demonstrations, enabling the acquisition of new skills without re-teaching. Dynamical system-based IL (DSIL) emerges as a significant subset of IL methodologies, offering the ability to learn trajectories via movement primitives and policy learning based on experiential abstraction. This paper emphasizes the fusion of theoretical paradigms, integrating control theory principles inherent in dynamical systems into IL. This integration notably enhances robustness, adaptability, and convergence in the face of novel scenarios. This survey aims to present a comprehensive overview of DSIL methods, spanning from classical approaches to recent advanced approaches. We categorize DSIL into autonomous dynamical systems and non-autonomous dynamical systems, surveying traditional IL methods with low-dimensional input and advanced deep IL methods with high-dimensional input. Additionally, we present and analyze three main stability methods for IL: Lyapunov stability, contraction theory, and diffeomorphism mapping. Our exploration also extends to popular policy improvement methods for DSIL, encompassing reinforcement learning, deep reinforcement learning, and evolutionary strategies.

References in corpus (14)

• Dynamic Movement Primitives in Robotics: A Tutorial Survey
• Dynamic Movement Primitives: Volumetric Obstacle Avoidance Using Dynamic Potential Functions
• Robot Cooking with Stir-fry: Bimanual Non-prehensile Manipulation of Semi-fluid Objects
• Learning Stable Deep Dynamics Models
• Residual Learning from Demonstration: Adapting DMPs for Contact-rich Manipulation
• Geometry-aware Dynamic Movement Primitives
• Learning Stable Robotic Skills on Riemannian Manifolds
• Retrospectives on the Embodied AI Workshop
• An Imitation from Observation Approach to Transfer Learning with Dynamics Mismatch
• Learning Deep Robotic Skills on Riemannian manifolds
• Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model
• Linearization and Identification of Multiple-Attractor Dynamical Systems through Laplacian Eigenmaps
• Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrations
• PUMA: Deep Metric Imitation Learning for Stable Motion Primitives

Cited by in corpus (2)

• Information-Theoretic Graph Fusion with Vision-Language-Action Model for Policy Reasoning and Dual Robotic Control
• A context-adaptive policy framework for robust and reactive robotic manipulation via uncertainty-aware imitation learning