Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning
arXiv:1611.03631 · doi:10.1109/IROS.2017.8202315
Abstract
Micro Aerial Vehicles (MAVs) that operate in unstructured, unexplored environments require fast and flexible local planning, which can replan when new parts of the map are explored. Trajectory optimization methods fulfill these needs, but require obstacle distance information, which can be given by Euclidean Signed Distance Fields (ESDFs). We propose a method to incrementally build ESDFs from Truncated Signed Distance Fields (TSDFs), a common implicit surface representation used in computer graphics and vision. TSDFs are fast to build and smooth out sensor noise over many observations, and are designed to produce surface meshes. Meshes allow human operators to get a better assessment of the robot's environment, and set high-level mission goals. We show that we can build TSDFs faster than Octomaps, and that it is more accurate to build ESDFs out of TSDFs than occupancy maps. Our complete system, called voxblox, will be available as open source and runs in real-time on a single CPU core. We validate our approach on-board an MAV, by using our system with a trajectory optimization local planner, entirely on-board and in real-time.
Submitted to IROS 2017. Videos available at https://www.youtube.com/watch?v=PlqT5zNsvwM and https://www.youtube.com/watch?v=lrGSwAPzMOQ
Cited by in corpus (76)
- Learning High-Speed Flight in the Wild
- An Efficient Sampling-based Method for Online Informative Path Planning in Unknown Environments
- maplab: An Open Framework for Research in Visual-inertial Mapping and Localization
- Volumetric Instance-Aware Semantic Mapping and 3D Object Discovery
- A Review on Viewpoints and Path-planning for UAV-based 3D Reconstruction
- Autonomous UAV Exploration of Dynamic Environments via Incremental Sampling and Probabilistic Roadmap
- Robust Dense Mapping for Large-Scale Dynamic Environments
- Agilicious: Open-Source and Open-Hardware Agile Quadrotor for Vision-Based Flight
- Fast Frontier-based Information-driven Autonomous Exploration with an MAV
- History-aware Autonomous Exploration in Confined Environments using MAVs
- Safe Local Exploration for Replanning in Cluttered Unknown Environments for Micro-Aerial Vehicles
- Voxgraph: Globally Consistent, Volumetric Mapping using Signed Distance Function Submaps
- PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency
- Safe Robot Navigation via Multi-Modal Anomaly Detection
- Dynablox: Real-time Detection of Diverse Dynamic Objects in Complex Environments
- An Open-Source System for Vision-Based Micro-Aerial Vehicle Mapping, Planning, and Flight in Cluttered Environments
- maplab 2.0 -- A Modular and Multi-Modal Mapping Framework
- From SLAM to Situational Awareness: Challenges and Survey
- Walking Posture Adaptation for Legged Robot Navigation in Confined Spaces
- Multi-Resolution 3D Mapping with Explicit Free Space Representation for Fast and Accurate Mobile Robot Motion Planning
- Vision-Based Autonomous UAV Navigation and Landing for Urban Search and Rescue
- Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environments
- Autonomous Cave Surveying with an Aerial Robot
- Vision-aided UAV navigation and dynamic obstacle avoidance using gradient-based B-spline trajectory optimization
- Autonomous Navigation of MAVs in Unknown Cluttered Environments
- H2-Mapping: Real-time Dense Mapping Using Hierarchical Hybrid Representation
- A Unified Approach for Autonomous Volumetric Exploration of Large Scale Environments under Severe Odometry Drift
- Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation
- Overview of Tools Supporting Planning for Automated Driving
- Neuromorphic Perception and Navigation for Mobile Robots: A Review
- VersaVIS: An Open Versatile Multi-Camera Visual-Inertial Sensor Suite
- NM: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environments
- STEAP: simultaneous trajectory estimation and planning
- Probabilistic Point Cloud Modeling via Self-Organizing Gaussian Mixture Models
- SphereMap: Dynamic Multi-Layer Graph Structure for Rapid Safety-Aware UAV Planning
- Real-Time Metric-Semantic Mapping for Autonomous Navigation in Outdoor Environments
- Confidence-rich grid mapping
- Navigating by Touch: Haptic Monte Carlo Localization via Geometric Sensing and Terrain Classification
- FD-SLAM: 3-D Reconstruction Using Features and Dense Matching
- Real-time Neural Dense Elevation Mapping for Urban Terrain with Uncertainty Estimations
- CATNIPS: Collision Avoidance Through Neural Implicit Probabilistic Scenes
- Continual Adaptation of Semantic Segmentation using Complementary 2D-3D Data Representations
- Multitask Learning for Scalable and Dense Multilayer Bayesian Map Inference
- NeuralBlox: Real-Time Neural Representation Fusion for Robust Volumetric Mapping
- Metric Monocular Localization Using Signed Distance Fields
- Incremental Multimodal Surface Mapping via Self-Organizing Gaussian Mixture Models
- Osprey: Multi-Session Autonomous Aerial Mapping with LiDAR-based SLAM and Next Best View Planning
- Simultaneous Scene Reconstruction and Whole-Body Motion Planning for Safe Operation in Dynamic Environments
- Evaluating the Impact of Semantic Segmentation and Pose Estimation on Dense Semantic SLAM
- FM-Fusion: Instance-aware Semantic Mapping Boosted by Vision-Language Foundation Models
- Learning Fast, Tool aware Collision Avoidance for Collaborative Robots
- PlaneSDF-based Change Detection for Long-term Dense Mapping
- Physics-informed Neural Mapping and Motion Planning in Unknown Environments
- gatekeeper: Online Safety Verification and Control for Nonlinear Systems in Dynamic Environments
- MICP-L: Mesh-based ICP for Robot Localization using Hardware-Accelerated Ray Casting
- Control-Barrier-Aided Teleoperation with Visual-Inertial SLAM for Safe MAV Navigation in Complex Environments
- Aerial Field Robotics
- Rendering the Directional TSDF for Tracking and Multi-Sensor Registration with Point-To-Plane Scale ICP
- AiSDF: Structure-aware Neural Signed Distance Fields in Indoor Scenes
- Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving
- Elastic and Efficient LiDAR Reconstruction for Large-Scale Exploration Tasks
- Depth-based Sampling and Steering Constraints for Memoryless Local Planners
- WildFusion: Multimodal Implicit 3D Reconstructions in the Wild
- Augmented Environment Representations with Complete Object Models
- Efficient Submap-based Autonomous MAV Exploration using Visual-Inertial SLAM Configurable for LiDARs or Depth Cameras
- Fast and Compute-efficient Sampling-based Local Exploration Planning via Distribution Learning
- ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM
- TerrainMesh: Metric-Semantic Terrain Reconstruction from Aerial Images Using Joint 2D-3D Learning
- Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities
- Scalable Outdoors Autonomous Drone Flight with Visual-Inertial SLAM and Dense Submaps Built without LiDAR
- RT-GuIDE: Real-Time Gaussian Splatting for Information-Driven Exploration
- Accurate Pose Prediction on Signed Distance Fields for Mobile Ground Robots in Rough Terrain
- Efficient Collision Detection for Long and Slender Robotic Links in Euclidean Distance Fields: Application to a Forestry Crane
- CCNDF: Curvature Constrained Neural Distance Fields from 3D LiDAR Sequences
- 2Fast-2Lamaa: Large-Scale Lidar-Inertial Localization and Mapping with Continuous Distance Fields
- An Efficient Beam Search Algorithm for Active Perception in Mobile Robotics