Gliding vertex on the horizontal bounding box for multi-oriented object detection
arXiv:1911.09358 · doi:10.1109/TPAMI.2020.2974745
Abstract
Object detection has recently experienced substantial progress. Yet, the widely adopted horizontal bounding box representation is not appropriate for ubiquitous oriented objects such as objects in aerial images and scene texts. In this paper, we propose a simple yet effective framework to detect multi-oriented objects. Instead of directly regressing the four vertices, we glide the vertex of the horizontal bounding box on each corresponding side to accurately describe a multi-oriented object. Specifically, We regress four length ratios characterizing the relative gliding offset on each corresponding side. This may facilitate the offset learning and avoid the confusion issue of sequential label points for oriented objects. To further remedy the confusion issue for nearly horizontal objects, we also introduce an obliquity factor based on area ratio between the object and its horizontal bounding box, guiding the selection of horizontal or oriented detection for each object. We add these five extra target variables to the regression head of faster R-CNN, which requires ignorable extra computation time. Extensive experimental results demonstrate that without bells and whistles, the proposed method achieves superior performances on multiple multi-oriented object detection benchmarks including object detection in aerial images, scene text detection, pedestrian detection in fisheye images.
arXiv commentAccepted by TPAMI 2020. The experiments of pedestrian detection are updated as the benchmark has been changed
References in corpus (11)
- SSD: Single Shot MultiBox Detector
- YOLOv3: An Incremental Improvement
- R-FCN: Object Detection via Region-based Fully Convolutional Networks
- Arbitrary-Oriented Scene Text Detection via Rotation Proposals
- TextBoxes++: A Single-Shot Oriented Scene Text Detector
- CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery
- TextField: Learning A Deep Direction Field for Irregular Scene Text Detection
- Light-Head R-CNN: In Defense of Two-Stage Object Detector
- Learning a Rotation Invariant Detector with Rotatable Bounding Box
- SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects
- Improved Person Detection on Omnidirectional Images with Non-maxima Suppression
Cited by in corpus (42)
- Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
- Towards Large-Scale Small Object Detection: Survey and Benchmarks
- Anchor-free Oriented Proposal Generator for Object Detection
- MMRotate: A Rotated Object Detection Benchmark using PyTorch
- CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Images
- Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergence
- An Empirical Study of Remote Sensing Pretraining
- Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss
- R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object
- A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detection
- ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detection
- Optimization for Arbitrary-Oriented Object Detection via Representation Invariance Loss
- Fewer is More: Efficient Object Detection in Large Aerial Images
- PolarDet: A Fast, More Precise Detector for Rotated Target in Aerial Images
- G-Rep: Gaussian Representation for Arbitrary-Oriented Object Detection
- Arbitrary-Oriented Ship Detection through Center-Head Point Extraction
- LO-Det: Lightweight Oriented Object Detection in Remote Sensing Images
- PETDet: Proposal Enhancement for Two-Stage Fine-Grained Object Detection
- Oriented object detection in optical remote sensing images using deep learning: a survey
- ReDet: A Rotation-equivariant Detector for Aerial Object Detection
- RQFormer: Rotated Query Transformer for End-to-End Oriented Object Detection
- Task-wise Sampling Convolutions for Arbitrary-Oriented Object Detection in Aerial Images
- Improving the Detection of Small Oriented Objects in Aerial Images
- EARL: An Elliptical Distribution aided Adaptive Rotation Label Assignment for Oriented Object Detection in Remote Sensing Images
- Dynamic Anchor Learning for Arbitrary-Oriented Object Detection
- Linear Gaussian Bounding Box Representation and Ring-Shaped Rotated Convolution for Oriented Object Detection
- Multi-Grained Angle Representation for Remote Sensing Object Detection
- Dense Label Encoding for Boundary Discontinuity Free Rotation Detection
- Knowledge Amalgamation for Object Detection with Transformers
- Align Deep Features for Oriented Object Detection
- Oriented RepPoints for Aerial Object Detection
- MRDet: A Multi-Head Network for Accurate Oriented Object Detection in Aerial Images
- On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances and Million-AID
- Anchor Retouching via Model Interaction for Robust Object Detection in Aerial Images
- Oriented R-CNN for Object Detection
- Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images
- Investigating Long-term Training for Remote Sensing Object Detection
- Learning Polar Encodings for Arbitrary-Oriented Ship Detection in SAR Images
- Learning Oriented Remote Sensing Object Detection via Naive Geometric Computing
- MidNet: An Anchor-and-Angle-Free Detector for Oriented Ship Detection in Aerial Images
- LUAI Challenge 2021 on Learning to Understand Aerial Images
- OSKDet: Towards Orientation-sensitive Keypoint Localization for Rotated Object Detection