From SLAM to Situational Awareness: Challenges and Survey
arXiv:2110.00273 · doi:10.3390/s23104849
Abstract
The capability of a mobile robot to efficiently and safely perform complex missions is limited by its knowledge of the environment, namely the situation. Advanced reasoning, decision-making, and execution skills enable an intelligent agent to act autonomously in unknown environments. Situational Awareness (SA) is a fundamental capability of humans that has been deeply studied in various fields, such as psychology, military, aerospace, and education. Nevertheless, it has yet to be considered in robotics, which has focused on single compartmentalized concepts such as sensing, spatial perception, sensor fusion, state estimation, and Simultaneous Localization and Mapping (SLAM). Hence, the present research aims to connect the broad multidisciplinary existing knowledge to pave the way for a complete SA system for mobile robotics that we deem paramount for autonomy. To this aim, we define the principal components to structure a robotic SA and their area of competence. Accordingly, this paper investigates each aspect of SA, surveying the state-of-the-art robotics algorithms that cover them, and discusses their current limitations. Remarkably, essential aspects of SA are still immature since the current algorithmic development restricts their performance to only specific environments. Nevertheless, Artificial Intelligence (AI), particularly Deep Learning (DL), has brought new methods to bridge the gap that maintains these fields apart from the deployment to real-world scenarios. Furthermore, an opportunity has been discovered to interconnect the vastly fragmented space of robotic comprehension algorithms through the mechanism of Situational Graph (S-Graph), a generalization of the well-known scene graph. Therefore, we finally shape our vision for the future of robotic Situational Awareness by discussing interesting recent research directions.
22 pages, 8 figures, 5 Tables
References in corpus (30)
- YOLOv4: Optimal Speed and Accuracy of Object Detection
- Rethinking Atrous Convolution for Semantic Image Segmentation
- Domain Generalization: A Survey
- DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
- Deep Continuous Fusion for Multi-Sensor 3D Object Detection
- F-LOAM: Fast LiDAR Odometry And Mapping
- Fast-SCNN: Fast Semantic Segmentation Network
- A Comprehensive Survey of Scene Graphs: Generation and Application
- A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors
- Implicit Neural Representations with Periodic Activation Functions
- DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks
- Social Interactions for Autonomous Driving: A Review and Perspectives
- LIFT-SLAM: a deep-learning feature-based monocular visual SLAM method
- Visual SLAM: What are the Current Trends and What to Expect?
- LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
- Voxgraph: Globally Consistent, Volumetric Mapping using Signed Distance Function Submaps
- Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistency
- Panoptic Feature Pyramid Networks
- SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloud
- Noise modeling and analysis of an IMU-based attitude sensor: improvement of performance by filtering and sensor fusion
- The Oxford Multimotion Dataset: Multiple SE(3) Motions with Ground Truth
- HOG based Fast Human Detection
- Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapes
- Neural Unsigned Distance Fields for Implicit Function Learning
- An Online Semantic Mapping System for Extending and Enhancing Visual SLAM
- LVI-SAM: Tightly-coupled Lidar-Visual-Inertial Odometry via Smoothing and Mapping
- VIRAL SLAM: Tightly Coupled Camera-IMU-UWB-Lidar SLAM
- Deep Online Correction for Monocular Visual Odometry
- TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphs
- Graph-based Thermal-Inertial SLAM with Probabilistic Neural Networks
Cited by in corpus (7)
- Visual SLAM: What are the Current Trends and What to Expect?
- LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives
- On Digital Twins in Defence: Overview and Applications
- UAV-assisted Visual SLAM Generating Reconstructed 3D Scene Graphs in GPS-denied Environments
- SMapper: A Multi-Modal Data Acquisition Platform for SLAM Benchmarking
- Concept-Guided Exploration: Building Persistent, Actionable Scene Graphs
- Guessing human intentions to avoid dangerous situations in caregiving robots