Cascade R-CNN: Delving into High Quality Object Detection
arXiv:1712.00726
Abstract
In object detection, an intersection over union (IoU) threshold is required to define positives and negatives. An object detector, trained with low IoU threshold, e.g. 0.5, usually produces noisy detections. However, detection performance tends to degrade with increasing the IoU thresholds. Two main factors are responsible for this: 1) overfitting during training, due to exponentially vanishing positive samples, and 2) inference-time mismatch between the IoUs for which the detector is optimal and those of the input hypotheses. A multi-stage object detection architecture, the Cascade R-CNN, is proposed to address these problems. It consists of a sequence of detectors trained with increasing IoU thresholds, to be sequentially more selective against close false positives. The detectors are trained stage by stage, leveraging the observation that the output of a detector is a good distribution for training the next higher quality detector. The resampling of progressively improved hypotheses guarantees that all detectors have a positive set of examples of equivalent size, reducing the overfitting problem. The same cascade procedure is applied at inference, enabling a closer match between the hypotheses and the detector quality of each stage. A simple implementation of the Cascade R-CNN is shown to surpass all single-model object detectors on the challenging COCO dataset. Experiments also show that the Cascade R-CNN is widely applicable across detector architectures, achieving consistent gains independently of the baseline detector strength. The code will be made available at https://github.com/zhaoweicai/cascade-rcnn.
References in corpus (7)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Caffe: Convolutional Architecture for Fast Feature Embedding
- R-FCN: Object Detection via Region-based Fully Convolutional Networks
- Focal Loss for Dense Object Detection
- Deformable Convolutional Networks
- Speed/accuracy trade-offs for modern convolutional object detectors
- Learning Chained Deep Features and Classifiers for Cascade in Object Detection
Cited by in corpus (42)
- CornerNet: Detecting Objects as Paired Keypoints
- Rethinking ImageNet Pre-training
- Video Instance Segmentation using Inter-Frame Communication Transformers
- Acquisition of Localization Confidence for Accurate Object Detection
- ThunderNet: Towards Real-time Generic Object Detection
- Bounding Box Regression with Uncertainty for Accurate Object Detection
- Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
- ShapeMask: Learning to Segment Novel Objects by Refining Shape Priors
- Consistent Optimization for Single-Shot Object Detection
- EVJVQA Challenge: Multilingual Visual Question Answering
- Solution for Large-Scale Hierarchical Object Detection Datasets with Incomplete Annotation and Data Imbalance
- Cross-dataset Training for Class Increasing Object Detection
- Dense RepPoints: Representing Visual Objects with Dense Point Sets
- Learning Visual Knowledge Memory Networks for Visual Question Answering
- Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection
- Single-Shot Bidirectional Pyramid Networks for High-Quality Object Detection
- Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluation
- NETNet: Neighbor Erasing and Transferring Network for Better Single Shot Object Detection
- Deep Regionlets for Object Detection
- gSwin: Gated MLP Vision Model with Hierarchical Structure of Shifted Window
- Joint COCO and Mapillary Workshop at ICCV 2019: COCO Instance Segmentation Challenge Track
- Evaluating Large-Vocabulary Object Detectors: The Devil is in the Details
- Few-shot Adaptive Faster R-CNN
- Towards large-scale, automated, accurate detection of CCTV camera objects using computer vision. Applications and implications for privacy, safety, and cybersecurity. (Preprint)
- TCDCaps: Visual Tracking via Cascaded Dense Capsules
- Learning from Web Data: the Benefit of Unsupervised Object Localization
- Learning an Efficient Network for Large-Scale Hierarchical Object Detection with Data Imbalance: 3rd Place Solution to Open Images Challenge 2019
- Financial Table Extraction in Image Documents
- Pedestrian Detection with Autoregressive Network Phases
- 2nd Place Solution in Google AI Open Images Object Detection Track 2019
- Balance Scene Learning Mechanism for Offshore and Inshore Ship Detection in SAR Images
- Box2Poly: Memory-Efficient Polygon Prediction of Arbitrarily Shaped and Rotated Text
- 2nd Place Solution for SODA10M Challenge 2021 -- Continual Detection Track
- Augmentation Inside the Network
- Plug & Play Convolutional Regression Tracker for Video Object Detection
- PSDet: Efficient and Universal Parking Slot Detection
- MaskPlus: Improving Mask Generation for Instance Segmentation
- Efficient Transfer Learning via Joint Adaptation of Network Architecture and Weight
- Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration
- AGSFCOS: Based on attention mechanism and Scale-Equalizing pyramid network of object detection
- Working with scale: 2nd place solution to Product Detection in Densely Packed Scenes [Technical Report]
- Utilizing Complex-valued Network for Learning to Compare Image Patches