Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy
arXiv:2406.16087 · doi:10.1177/02783649251353181
Abstract
Data-driven methods such as reinforcement and imitation learning have achieved remarkable success in robot autonomy. However, their data-centric nature still hinders them from generalizing well to ever-changing environments. Moreover, labeling data for robotic tasks is often impractical and expensive. To overcome these challenges, we introduce a new self-supervised neuro-symbolic (NeSy) computational framework, imperative learning (IL), for robot autonomy, leveraging the generalization abilities of symbolic reasoning. The framework of IL consists of three primary components: a neural module, a reasoning engine, and a memory system. We formulate IL as a special bilevel optimization (BLO), which enables reciprocal learning over the three modules. This overcomes the label-intensive obstacles associated with data-driven approaches and takes advantage of symbolic reasoning concerning logical reasoning, physical principles, geometric analysis, etc. We discuss several optimization techniques for IL and verify their effectiveness in five distinct robot autonomy tasks including path planning, rule induction, optimal control, visual odometry, and multi-robot routing. Through various experiments, we show that IL can significantly enhance robot autonomy capabilities and we anticipate that it will catalyze further research across diverse domains.
References in corpus (18)
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- Learning Quadrupedal Locomotion over Challenging Terrain
- DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
- Online Global Loop Closure Detection for Large-Scale Multi-Session Graph-Based SLAM
- Learning High-Speed Flight in the Wild
- Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds
- DeepFactors: Real-Time Probabilistic Dense Monocular SLAM
- A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations
- Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots
- AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System
- AirDOS: Dynamic SLAM benefits from Articulated Objects
- AirVO: An Illumination-Robust Point-Line Visual Odometry
- iPlanner: Imperative Path Planning
- iSLAM: Imperative SLAM
- Non-Iterative SLAM
- Robust Pivoting: Exploiting Frictional Stability Using Bilevel Optimization
- Physics-agnostic and Physics-infused machine learning for thin films flows: modeling, and predictions from small data