ORB-SLAM: a Versatile and Accurate Monocular SLAM System
arXiv:1502.00956 · doi:10.1109/TRO.2015.2463671
Abstract
This paper presents ORB-SLAM, a feature-based monocular SLAM system that operates in real time, in small and large, indoor and outdoor environments. The system is robust to severe motion clutter, allows wide baseline loop closing and relocalization, and includes full automatic initialization. Building on excellent algorithms of recent years, we designed from scratch a novel system that uses the same features for all SLAM tasks: tracking, mapping, relocalization, and loop closing. A survival of the fittest strategy that selects the points and keyframes of the reconstruction leads to excellent robustness and generates a compact and trackable map that only grows if the scene content changes, allowing lifelong operation. We present an exhaustive evaluation in 27 sequences from the most popular datasets. ORB-SLAM achieves unprecedented performance with respect to other state-of-the-art monocular SLAM approaches. For the benefit of the community, we make the source code public.
17 pages. 13 figures. IEEE Transactions on Robotics, 2015. Project webpage (videos, code): http://webdiis.unizar.es/~raulmur/orbslam/
Cited by in corpus (267)
- ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenes
- RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operation
- DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
- Visual-Inertial Monocular SLAM with Map Reuse
- The ApolloScape Open Dataset for Autonomous Driving and its Application
- Vision-based Robotic Grasping From Object Localization, Object Pose Estimation to Grasp Estimation for Parallel Grippers: A Review
- CubeSLAM: Monocular 3D Object SLAM
- F-LOAM: Fast LiDAR Odometry And Mapping
- Image Matching across Wide Baselines: From Paper to Practice
- Monocular Depth Estimation Based On Deep Learning: An Overview
- OpenVSLAM: A Versatile Visual SLAM Framework
- maplab: An Open Framework for Research in Visual-inertial Mapping and Localization
- Deep Drone Racing: From Simulation to Reality with Domain Randomization
- Direct Sparse Visual-Inertial Odometry using Dynamic Marginalization
- Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation
- Event-based, 6-DOF Camera Tracking from Photometric Depth Maps
- Unsupervised Scale-consistent Depth Learning from Video
- Fast, Autonomous Flight in GPS-Denied and Cluttered Environments
- Comparison of Various SLAM Systems for Mobile Robot in an Indoor Environment
- Location-Enabled IoT (LE-IoT): A Survey of Positioning Techniques, Error Sources, and Mitigation
- Low-effort place recognition with WiFi fingerprints using deep learning
- The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection
- Asynchronous, Photometric Feature Tracking using Events and Frames
- DM-VIO: Delayed Marginalization Visual-Inertial Odometry
- DeepFactors: Real-Time Probabilistic Dense Monocular SLAM
- A Review on Viewpoints and Path-planning for UAV-based 3D Reconstruction
- Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey
- Robust Dense Mapping for Large-Scale Dynamic Environments
- Deep EndoVO: A Recurrent Convolutional Neural Network (RCNN) based Visual Odometry Approach for Endoscopic Capsule Robots
- GSV-Cities: Toward Appropriate Supervised Visual Place Recognition
- LIFT-SLAM: a deep-learning feature-based monocular visual SLAM method
- Direct Sparse Mapping
- GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networks
- SVIn2: An Underwater SLAM System using Sonar, Visual, Inertial, and Depth Sensor
- Virtual-Blind-Road Following Based Wearable Navigation Device for Blind People
- A review of laser scanning for geological and geotechnical applications in underground mining
- Event-aided Direct Sparse Odometry
- AQUALOC: An Underwater Dataset for Visual-Inertial-Pressure Localization
- Visual SLAM: What are the Current Trends and What to Expect?
- BEBLID: Boosted efficient binary local image descriptor
- BoW3D: Bag of Words for Real-Time Loop Closing in 3D LiDAR SLAM
- Towards Real-time Semantic RGB-D SLAM in Dynamic Environments
- A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
- ReDFeat: Recoupling Detection and Description for Multimodal Feature Learning
- Approaches, Challenges, and Applications for Deep Visual Odometry: Toward to Complicated and Emerging Areas
- Omnidirectional DSO: Direct Sparse Odometry with Fisheye Cameras
- SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM
- Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignment
- RGB-D And Thermal Sensor Fusion: A Systematic Literature Review
- Monocular Object and Plane SLAM in Structured Environments
- Voxgraph: Globally Consistent, Volumetric Mapping using Signed Distance Function Submaps
- Ultra-Wideband Aided Fast Localization and Mapping System
- A New Wave in Robotics: Survey on Recent mmWave Radar Applications in Robotics
- Real-Time RGB-D Camera Pose Estimation in Novel Scenes using a Relocalisation Cascade
- Autonomous Aerial Delivery Vehicles, a Survey of Techniques on how Aerial Package Delivery is Achieved
- LS-VO: Learning Dense Optical Subspace for Robust Visual Odometry Estimation
- AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System
- ENFT: Efficient Non-Consecutive Feature Tracking for Robust Structure-from-Motion
- Real-time Monocular Visual Odometry for Turbid and Dynamic Underwater Environments
- An Open-Source System for Vision-Based Micro-Aerial Vehicle Mapping, Planning, and Flight in Cluttered Environments
- Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mapping
- Tightly-coupled Monocular Visual-odometric SLAM using Wheels and a MEMS Gyroscope
- AirDOS: Dynamic SLAM benefits from Articulated Objects
- Lightweight 3-D Localization and Mapping for Solid-State LiDAR
- Good Feature Matching: Towards Accurate, Robust VO/VSLAM with Low Latency
- From SLAM to Situational Awareness: Challenges and Survey
- Efficient LiDAR Odometry for Autonomous Driving
- Loosely-Coupled Semi-Direct Monocular SLAM
- Visual Place Recognition: A Tutorial
- AirVO: An Illumination-Robust Point-Line Visual Odometry
- RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments
- DenseLiDAR: A Real-Time Pseudo Dense Depth Guided Depth Completion Network
- Edge-Assisted Multi-Robot Visual-Inertial SLAM with Efficient Communication
- BotanicGarden: A High-Quality Dataset for Robot Navigation in Unstructured Natural Environments
- Obstacle Avoidance Strategy using Onboard Stereo Vision on a Flapping Wing MAV
- Learned Visual Navigation for Under-Canopy Agricultural Robots
- Experimental Comparison of Visual-Aided Odometry Methods for Rail Vehicles
- Range-Visual-Inertial Odometry: Scale Observability Without Excitation
- Tracking and Mapping in Medical Computer Vision: A Review
- Edge SLAM: Edge Points Based Monocular Visual SLAM
- Fast ORB-SLAM without Keypoint Descriptors
- RaLL: End-to-end Radar Localization on Lidar Map Using Differentiable Measurement Model
- MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation
- Learning to See the Wood for the Trees: Deep Laser Localization in Urban and Natural Environments on a CPU
- Keyframe-Based Visual-Inertial Online SLAM with Relocalization
- Redesigning SLAM for Arbitrary Multi-Camera Systems
- Visual SLAM: Why Bundle Adjust?
- Quaternion Based Camera Pose Estimation From Matched Feature Points
- Optical-Flow based Self-Supervised Learning of Obstacle Appearance applied to MAV Landing
- Contour Context: Abstract Structural Distribution for 3D LiDAR Loop Detection and Metric Pose Estimation
- HybVIO: Pushing the Limits of Real-time Visual-inertial Odometry
- IDOL: A Framework for IMU-DVS Odometry using Lines
- Learned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching
- Vision-based Learning for Drones: A Survey
- Bimodal Camera Pose Prediction for Endoscopy
- Empty Cities: a Dynamic-Object-Invariant Space for Visual SLAM
- Parallel Tracking and Verifying
- Feature-based visual odometry prior for real-time semi-dense stereo SLAM
- Robust GNSS Denied Localization for UAV Using Particle Filter and Visual Odometry
- Learning Binary Features Online from Motion Dynamics for Incremental Loop-Closure Detection and Place Recognition
- Fast and Robust Initialization for Visual-Inertial SLAM
- Continual SLAM: Beyond Lifelong Simultaneous Localization and Mapping Through Continual Learning
- Extending Maps with Semantic and Contextual Object Information for Robot Navigation: a Learning-Based Framework using Visual and Depth Cues
- Just-in-Time Reconstruction: Inpainting Sparse Maps using Single View Depth Predictors as Priors
- Probabilistic Visual Place Recognition for Hierarchical Localization
- Single-View and Multi-View Depth Fusion
- Rolling-Shutter Modelling for Direct Visual-Inertial Odometry
- Co-Planar Parametrization for Stereo-SLAM and Visual-Inertial Odometry
- Automatic Multi-Sensor Extrinsic Calibration for Mobile Robots
- Accurate Monocular Visual-inertial SLAM using a Map-assisted EKF Approach
- GMMLoc: Structure Consistent Visual Localization with Gaussian Mixture Models
- ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras
- Real-time Model-based Image Color Correction for Underwater Robots
- TransformLoc: Transforming MAVs into Mobile Localization Infrastructures in Heterogeneous Swarms
- VIO-DualProNet: Visual-Inertial Odometry with Learning Based Process Noise Covariance
- Online Range Image-based Pole Extractor for Long-term LiDAR Localization in Urban Environments
- 3D mapping for multi hybrid robot cooperation
- Visual Semantic SLAM with Landmarks for Large-Scale Outdoor Environment
- Nonlinear Observers Design for Vision-Aided Inertial Navigation Systems
- HRBF-Fusion: Accurate 3D reconstruction from RGB-D data using on-the-fly implicits
- HarrisZ: Harris Corner Selection for Next-Gen Image Matching Pipelines
- Simultaneous Multi-View Camera Pose Estimation and Object Tracking with Square Planar Markers
- Non-Iterative SLAM
- Unsupervised Learning of Monocular Depth and Ego-Motion Using Multiple Masks
- Minimization of GNSS-Denied Inertial Navigation Errors for Fixed Wing Autonomous Unmanned Air Vehicles
- CoVIO: Online Continual Learning for Visual-Inertial Odometry
- Consistent Depth of Moving Objects in Video
- Efficient Decentralized Visual Place Recognition From Full-Image Descriptors
- Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach
- Next-best-view Regression using a 3D Convolutional Neural Network
- NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstruction
- Sparse Pose Graph Optimization in Cycle Space
- Cross-View Visual Geo-Localization for Outdoor Augmented Reality
- Deep Online Correction for Monocular Visual Odometry
- Towards Open World NeRF-Based SLAM
- SLAM for Visually Impaired People: a Survey
- Stereo Camera Visual SLAM with Hierarchical Masking and Motion-state Classification at Outdoor Construction Sites Containing Large Dynamic Objects
- Robust On-Manifold Optimization for Uncooperative Space Relative Navigation with a Single Camera
- OmniSCV: An Omnidirectional Synthetic Image Generator for Computer Vision
- Benchmarking Neural Radiance Fields for Autonomous Robots: An Overview
- Comparative Design Space Exploration of Dense and Semi-Dense SLAM
- Versatile Multilinked Aerial Robot with Tilting Propellers: Design, Modeling, Control and State Estimation for Autonomous Flight and Manipulation
- On Incremental Structure-from-Motion using Lines
- HE-SLAM: a Stereo SLAM System Based on Histogram Equalization and ORB Features
- Hybrid Camera Pose Estimation with Online Partitioning for SLAM
- CAE-RLSM: Consistent and Efficient Redundant Line Segment Merging for Online Feature Map Building
- MOISST: Multimodal Optimization of Implicit Scene for SpatioTemporal calibration
- Indoor simultaneous localization and mapping based on fringe projection profilometry
- BIT-VO: Visual Odometry at 300 FPS using Binary Features from the Focal Plane
- Learning Local Descriptors by Optimizing the Keypoint-Correspondence Criterion: Applications to Face Matching, Learning from Unlabeled Videos and 3D-Shape Retrieval
- Scale-Adaptive Neural Dense Features: Learning via Hierarchical Context Aggregation
- Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video
- Vision-Depth Landmarks and Inertial Fusion for Navigation in Degraded Visual Environments
- EC-SfM: Efficient Covisibility-based Structure-from-Motion for Both Sequential and Unordered Images
- RAGO: Recurrent Graph Optimizer For Multiple Rotation Averaging
- Radarize: Enhancing Radar SLAM with Generalizable Doppler-Based Odometry
- Integration of the 3D Environment for UAV Onboard Visual Object Tracking
- Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs
- Four years of multi-modal odometry and mapping on the rail vehicles
- Real-time Nonrigid Mosaicking of Laparoscopy Images
- A compact neuromorphic system for ultra-energy-efficient, on-device robot localization
- TopicFM+: Boosting Accuracy and Efficiency of Topic-Assisted Feature Matching
- A Joint 3D-2D based Method for Free Space Detection on Roads
- MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesis
- Video-based Sequential Bayesian Homography Estimation for Soccer Field Registration
- Sparse Representations for Object and Ego-motion Estimation in Dynamic Scenes
- Osprey: Multi-Session Autonomous Aerial Mapping with LiDAR-based SLAM and Next Best View Planning
- An Improved Multi-State Constraint Kalman Filter for Visual-Inertial Odometry
- Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines
- RGB-D Odometry and SLAM
- MDN-VO: Estimating Visual Odometry with Confidence
- Deployment of Aerial Robots during the Flood Disaster in Erftstadt / Blessem in July 2021
- Dense Prediction Transformer for Scale Estimation in Monocular Visual Odometry
- DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields
- Tac2Structure: Object Surface Reconstruction Only through Multi Times Touch
- Monocular Trail Detection and Tracking Aided by Visual SLAM for Small Unmanned Aerial Vehicles
- ORBBuf: A Robust Buffering Method for Remote Visual SLAM
- Globally Optimal Multi-Scale Monocular Hand-Eye Calibration Using Dual Quaternions
- Level-line Guided Edge Drawing for Robust Line Segment Detection
- Sparse Semantic Map-Based Monocular Localization in Traffic Scenes Using Learned 2D-3D Point-Line Correspondences
- Large-Scale Spatial Cross-Calibration of Hinode/SOT-SP and SDO/HMI
- Multi-Camera Sensor Fusion for Visual Odometry using Deep Uncertainty Estimation
- Towards Accurate Ground Plane Normal Estimation from Ego-Motion
- Autonomous Marker-less Rapid Aerial Grasping
- Map Point Selection for Visual SLAM
- BroadTrack: Broadcast Camera Tracking for Soccer
- MORPH-DSLAM: Model Order Reduction for PHysics-based Deformable SLAM
- Multi-modal Visual Place Recognition in Dynamics-Invariant Perception Space
- Robust Extrinsic Self-Calibration of Camera and Solid State LiDAR
- GNSS-Denied Semi Direct Visual Navigation for Autonomous UAVs Aided by PI-Inspired Inertial Priors
- se(3)-TrackNet: Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domains
- NavTopo: Leveraging Topological Maps For Autonomous Navigation Of a Mobile Robot
- HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstruction
- GSORB-SLAM: Gaussian Splatting SLAM benefits from ORB features and Transmittance information
- Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video with Applications for Virtual Reality
- Entropy-Based Calibration of 2D Lidars to Egomotion Sensors
- Homography-Based Loss Function for Camera Pose Regression
- A2B: Anchor to Barycentric Coordinate for Robust Correspondence
- An experimental evaluation of Siamese Neural Networks for robot localization using omnidirectional imaging in indoor environments
- DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior
- NeSS-ST: Detecting Good and Stable Keypoints with a Neural Stability Score and the Shi-Tomasi Detector
- A comparative evaluation of learned feature descriptors on hybrid monocular visual SLAM methods
- Long Distance GNSS-Denied Visual Inertial Navigation for Autonomous Fixed Wing Unmanned Air Vehicles: SO(3) Manifold Filter based on Virtual Vision Sensor
- CNN-based Ego-Motion Estimation for Fast MAV Maneuvers
- UL-VIO: Ultra-lightweight Visual-Inertial Odometry with Noise Robust Test-time Adaptation
- Simultaneous Localization and Layout Model Selection in Manhattan Worlds
- SplatMAP: Online Dense Monocular SLAM with 3D Gaussian Splatting
- Computing Egomotion with Local Loop Closures for Egocentric Videos
- UAV-assisted Visual SLAM Generating Reconstructed 3D Scene Graphs in GPS-denied Environments
- MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance Fields
- Rendering the Directional TSDF for Tracking and Multi-Sensor Registration with Point-To-Plane Scale ICP
- Learning to Assess Danger from Movies for Cooperative Escape Planning in Hazardous Environments
- YoloTag: Vision-based Robust UAV Navigation with Fiducial Markers
- ATG-PVD: Ticketing Parking Violations on A Drone
- Visual Inertial Odometry using Focal Plane Binary Features (BIT-VIO)
- RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting
- A Real-time Spatio-Temporal Trajectory Planner for Autonomous Vehicles with Semantic Graph Optimization
- Online Robust Sliding-Windowed LiDAR SLAM in Natural Environments
- Enhancing XR Auditory Realism via Multimodal Scene-Aware Acoustic Rendering
- Line-Circle-Square (LCS): A Multilayered Geometric Filter for Edge-Based Detection
- Monocular Vision based Crowdsourced 3D Traffic Sign Positioning with Unknown Camera Intrinsics and Distortion Coefficients
- An Expert Ensemble for Detecting Anomalous Scenes, Interactions, and Behaviors in Autonomous Driving
- Learning Depth With Very Sparse Supervision
- X-SLAM: Scalable Dense SLAM for Task-aware Optimization using CSFD
- Mono-Stixels: Monocular depth reconstruction of dynamic street scenes
- DeepLocNet: Deep Observation Classification and Ranging Bias Regression for Radio Positioning Systems
- Joint Forward-Backward Visual Odometry for Stereo Cameras
- Indoor Localization for an Autonomous Model Car: A Marker-Based Multi-Sensor Fusion Framework
- Improved 3D Gaussian Splatting of Unknown Spacecraft Structure Using Space Environment Illumination Knowledge
- Original Loop-closure Detection Algorithm for Monocular vSLAM
- Virtual Testbed for Monocular Visual Navigation of Small Unmanned Aircraft Systems
- Topological Navigation Graph Framework
- Landmark Stereo Dataset for Landmark Recognition and Moving Node Localization in a Non-GPS Battlefield Environment
- A Global Asymptotic Convergent Observer for SLAM
- Visual Place Representation and Recognition from Depth Images
- Improving Depth Estimation using Location Information
- Visual SLAM-based Localization and Navigation for Service Robots: The Pepper Case
- Learning Knowledge-Rich Sequential Model for Planar Homography Estimation in Aerial Video
- Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance
- Visual Re-Ranking with Non-Visual Side Information
- TANGO: Traversability-Aware Navigation with Local Metric Control for Topological Goals
- Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation
- Opti-Acoustic Scene Reconstruction in Highly Turbid Underwater Environments
- Efficiently Closing Loops in LiDAR-Based SLAM Using Point Cloud Density Maps
- 3D Reconstruction by Looking: Instantaneous Blind Spot Detector for Indoor SLAM through Mixed Reality
- Localization in Autonomous Vehicles Using a Generalized Inner Product
- Are Minimal Radial Distortion Solvers Necessary for Relative Pose Estimation?
- Even Order Explicit Symplectic Geometric Algorithms for Solving Quaternions in Guidance Navigation and Control via Diagonal Padé Approximation and Cayley Transform
- An adaptive optimal control approach to monocular depth observability maximization
- DiffTex: Differentiable Texturing for Architectural Proxy Models
- Set-theoretic Localization for Mobile Robots with Infrastructure-based Sensing
- 3D Reconstruction of the Human Colon from Capsule Endoscope Video
- Guessing human intentions to avoid dangerous situations in caregiving robots
- Sparse-Dense Motion Modelling and Tracking for Manipulation without Prior Object Models
- Crowdsourced 3D Mapping: A Combined Multi-View Geometry and Self-Supervised Learning Approach
- Opening the Black Box of 3D Reconstruction Error Analysis with VECTOR
- LAMP: Implicit Language Map for Robot Navigation
- Avoiding Degeneracy for Monocular Visual SLAM with Point and Line Features
- Lessons from the Field: A Case Study of Robotic Intervention in an Industrial Emergency
- Concept-Guided Exploration: Building Persistent, Actionable Scene Graphs
- Novel UWB Synthetic Aperture Radar Imaging for Mobile Robot Mapping
- Self-localization on a 3D map by fusing global and local features from a monocular camera
- Localisation via Deep Imagination: learn the features not the map