Faster and better: a machine learning approach to corner detection
arXiv:0810.2434 · doi:10.1109/TPAMI.2008.275
Abstract
The repeatability and efficiency of a corner detector determines how likely it is to be useful in a real-world application. The repeatability is importand because the same scene viewed from different positions should yield features which correspond to the same real-world 3D locations [Schmid et al 2000]. The efficiency is important because this determines whether the detector combined with further processing can operate at frame rate. Three advances are described in this paper. First, we present a new heuristic for feature detection, and using machine learning we derive a feature detector from this which can fully process live PAL video using less than 5% of the available processing time. By comparison, most other detectors cannot even operate at frame rate (Harris detector 115%, SIFT 195%). Second, we generalize the detector, allowing it to be optimized for repeatability, with little loss of efficiency. Third, we carry out a rigorous comparison of corner detectors based on the above repeatability criterion applied to 3D scenes. We show that despite being principally constructed for speed, on these stringent tests, our heuristic detector significantly outperforms existing feature detectors. Finally, the comparison demonstrates that using machine learning produces significant improvements in repeatability, yielding a detector that is both very fast and very high quality.
35 pages, 11 figures
Cited by in corpus (72)
- Recent progress in semantic image segmentation
- TILDE: A Temporally Invariant Learned DEtector
- Image Matching across Wide Baselines: From Paper to Practice
- OpenVSLAM: A Versatile Visual SLAM Framework
- Visual-Inertial Mapping with Non-Linear Factor Recovery
- Predicting popularity of online videos using Support Vector Regression
- Recent Advance in Content-based Image Retrieval: A Literature Survey
- Improvements to Target-Based 3D LiDAR to Camera Calibration
- GapFlyt: Active Vision Based Minimalist Structure-less Gap Detection For Quadrotor Flight
- Closed-form Preintegration Methods for Graph-based Visual-Inertial Navigation
- MS-HLMO: Multi-scale Histogram of Local Main Orientation for Remote Sensing Image Registration
- Dual-Resolution Correspondence Networks
- Real-time Monocular Visual Odometry for Turbid and Dynamic Underwater Environments
- Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters
- Range-Visual-Inertial Odometry: Scale Observability Without Excitation
- Leveraging Photogrammetric Mesh Models for Aerial-Ground Feature Point Matching Toward Integrated 3D Reconstruction
- Visual-Inertial Odometry of Aerial Robots
- Playing Doom with SLAM-Augmented Deep Reinforcement Learning
- Quantum change point
- FFD: Fast Feature Detector
- Neuromorphic Perception and Navigation for Mobile Robots: A Review
- HarrisZ: Harris Corner Selection for Next-Gen Image Matching Pipelines
- Energy Consumption Of Visual Sensor Networks: Impact Of Spatio-Temporal Coverage
- RIFT: Multi-modal Image Matching Based on Radiation-invariant Feature Transform
- Learning Covariant Feature Detectors
- Large scale evaluation of local image feature detectors on homography datasets
- Local Feature Detectors, Descriptors, and Image Representations: A Survey
- Vision-based Pose Estimation for Augmented Reality : A Comparison Study
- Efficient Globally-Optimal Correspondence-Less Visual Odometry for Planar Ground Vehicles
- Real-time and Robust Feature Detection of Continuous Marker Pattern for Dense 3-D Deformation Measurement
- Component Divide-and-Conquer for Real-World Image Super-Resolution
- Pose Estimation for Ground Robots: On Manifold Representation, Integration, Re-Parameterization, and Optimization
- CNN-SVO: Improving the Mapping in Semi-Direct Visual Odometry Using Single-Image Depth Prediction
- Autonomous Marker-less Rapid Aerial Grasping
- Self-Supervised 3D Keypoint Learning for Ego-motion Estimation
- A Performance Evaluation of Local Features for Image Based 3D Reconstruction
- RF-Net: An End-to-End Image Matching Network based on Receptive Field
- Trifo-VIO: Robust and Efficient Stereo Visual Inertial Odometry using Points and Lines
- Comparing Feature Detectors: A bias in the repeatability criteria, and how to correct it
- Localization of Autonomous Vehicles: Proof of Concept for A Computer Vision Approach
- OrcVIO: Object residual constrained Visual-Inertial Odometry
- Line-Circle-Square (LCS): A Multilayered Geometric Filter for Edge-Based Detection
- A Comparative Study for Non-rigid Image Registration and Rigid Image Registration
- LVI-Q: Robust LiDAR-Visual-Inertial-Kinematic Odometry for Quadruped Robots Using Tightly-Coupled and Efficient Alternating Optimization
- Multi-scale PIIFD for Registration of Multi-source Remote Sensing Images
- Understanding Crowd Flow Movements Using Active-Langevin Model
- The Aqualoc Dataset: Towards Real-Time Underwater Localization from a Visual-Inertial-Pressure Acquisition System
- Limits to rover miniaturisation and their implications for solar system exploration
- Line-Circle: A Geometric Filter for Single Camera Edge-Based Object Detection
- Planar Object Tracking in the Wild: A Benchmark
- Detecting Electric Devices in 3D Images of Bags
- CodedVO: Coded Visual Odometry
- Distributed Algorithms for Feature Extraction Off-loading in Multi-Camera Visual Sensor Networks
- Enhanced image feature coverage: Key-point selection using genetic algorithms
- Toward Efficient and Robust Multiple Camera Visual-inertial Odometry
- A Machine Learning Framework for Register Placement Optimization in Digital Circuit Design
- MIMC-VINS: A Versatile and Resilient Multi-IMU Multi-Camera Visual-Inertial Navigation System
- Automatic Non-Linear Video Editing Transfer
- 4d isip: 4d implicit surface interest point detection
- Compact Binary Fingerprint for Image Copy Re-Ranking
- DASC: Robust Dense Descriptor for Multi-modal and Multi-spectral Correspondence Estimation
- Calculate distance to object in the area where car, using video analysis
- Fast Coherent Point Drift
- Autonomous 3D Reconstruction Using a MAV
- Training Deep Neural Networks to Detect Repeatable 2D Features Using Large Amounts of 3D World Capture Data
- Legged Robot State Estimation in Slippery Environments Using Invariant Extended Kalman Filter with Velocity Update
- High Speed Event Camera TRacking
- Blur-Countering Keypoint Detection via Eigenvalue Asymmetry
- Estimating a Null Model of Scientific Image Reuse to Support Research Integrity Investigations
- Interest Point Detection based on Adaptive Ternary Coding
- DCI: Discriminative and Contrast Invertible Descriptor
- Trajectory Representation and Landmark Projection for Continuous-Time Structure from Motion