YOLO9000: Better, Faster, Stronger
arXiv:1612.08242
Abstract
We introduce YOLO9000, a state-of-the-art, real-time object detection system that can detect over 9000 object categories. First we propose various improvements to the YOLO detection method, both novel and drawn from prior work. The improved model, YOLOv2, is state-of-the-art on standard detection tasks like PASCAL VOC and COCO. At 67 FPS, YOLOv2 gets 76.8 mAP on VOC 2007. At 40 FPS, YOLOv2 gets 78.6 mAP, outperforming state-of-the-art methods like Faster RCNN with ResNet and SSD while still running significantly faster. Finally we propose a method to jointly train on object detection and classification. Using this method we train YOLO9000 simultaneously on the COCO detection dataset and the ImageNet classification dataset. Our joint training allows YOLO9000 to predict detections for object classes that don't have labelled detection data. We validate our approach on the ImageNet detection task. YOLO9000 gets 19.7 mAP on the ImageNet detection validation set despite only having detection data for 44 of the 200 classes. On the 156 classes not in COCO, YOLO9000 gets 16.0 mAP. But YOLO can detect more than just 200 classes; it predicts detections for more than 9000 different object categories. And it still runs in real-time.
References in corpus (4)
Cited by in corpus (209)
- YOLOv3: An Incremental Improvement
- Focal Loss for Dense Object Detection
- Evaluate the Malignancy of Pulmonary Nodules Using the 3D Deep Leaky Noisy-or Network
- GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks
- RetinaFace: Single-stage Dense Face Localisation in the Wild
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
- AdvHat: Real-world adversarial attack on ArcFace Face ID system
- DetNet: A Backbone network for Object Detection
- Adversarial Examples: Attacks and Defenses for Deep Learning
- ARbis Pictus: A Study of Language Learning with Augmented Reality
- Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey
- DPatch: An Adversarial Patch Attack on Object Detectors
- DOTA: A Large-scale Dataset for Object Detection in Aerial Images
- ICNet for Real-Time Semantic Segmentation on High-Resolution Images
- Receptive Field Block Net for Accurate and Fast Object Detection
- RetinaMask: Learning to predict masks improves state-of-the-art single-shot detection for free
- Single-Shot Refinement Neural Network for Object Detection
- Zero-Shot Detection
- Adversarial Examples that Fool Detectors
- Physical Adversarial Examples for Object Detectors
- Tiny-DSOD: Lightweight Object Detection for Resource-Restricted Usages
- Hierarchy-based Image Embeddings for Semantic Image Retrieval
- Focus: Querying Large Video Datasets with Low Latency and Low Cost
- DSOD: Learning Deeply Supervised Object Detectors from Scratch
- Object Detection with Deep Learning: A Review
- Complex-YOLO: Real-time 3D Object Detection on Point Clouds
- Vehicle Tracking Using Surveillance with Multimodal Data Fusion
- NSML: A Machine Learning Platform That Enables You to Focus on Your Models
- Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyond
- Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos
- Region Proposal by Guided Anchoring
- Trained Quantization Thresholds for Accurate and Efficient Fixed-Point Inference of Deep Neural Networks
- TBD: Benchmarking and Analyzing Deep Neural Network Training
- A Comparison of CNN-based Face and Head Detectors for Real-Time Video Surveillance Applications
- Standard detectors aren't (currently) fooled by physical adversarial stop signs
- MODNet: Moving Object Detection Network with Motion and Appearance for Autonomous Driving
- Syn2Real: A New Benchmark forSynthetic-to-Real Visual Domain Adaptation
- Mid-Level Visual Representations Improve Generalization and Sample Efficiency for Learning Visuomotor Policies
- NoScope: Optimizing Neural Network Queries over Video at Scale
- RefinedMPL: Refined Monocular PseudoLiDAR for 3D Object Detection in Autonomous Driving
- ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks
- AdaScale: Towards Real-time Video Object Detection Using Adaptive Scaling
- Fully Convolutional Networks for Chip-wise Defect Detection Employing Photoluminescence Images
- Note on Attacking Object Detectors with Adversarial Stickers
- Fast object detection in compressed JPEG Images
- EXTD: Extremely Tiny Face Detector via Iterative Filter Reuse
- Towards High Performance Video Object Detection for Mobiles
- Daedalus: Breaking Non-Maximum Suppression in Object Detection via Adversarial Examples
- A Non-Technical Survey on Deep Convolutional Neural Network Architectures
- Object Detection in Video with Spatiotemporal Sampling Networks
- Occlusion-aware R-CNN: Detecting Pedestrians in a Crowd
- MegDet: A Large Mini-Batch Object Detector
- Chainer: A Deep Learning Framework for Accelerating the Research Cycle
- MobilePose: Real-Time Pose Estimation for Unseen Objects with Weak Shape Supervision
- Cell Detection in Microscopy Images with Deep Convolutional Neural Network and Compressed Sensing
- Scaling Video Analytics on Constrained Edge Nodes
- Real-Time Referring Expression Comprehension by Single-Stage Grounding Network
- 3D-A-Nets: 3D Deep Dense Descriptor for Volumetric Shapes with Adversarial Networks
- A Saliency-based Convolutional Neural Network for Table and Chart Detection in Digitized Documents
- Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships
- Quantization for Rapid Deployment of Deep Neural Networks
- Incremental Deep Learning for Robust Object Detection in Unknown Cluttered Environments
- Crowd counting via scale-adaptive convolutional neural network
- Robust and High Performance Face Detector
- Residual Features and Unified Prediction Network for Single Stage Detection
- Deep Affinity Network for Multiple Object Tracking
- A Fast and Accurate One-Stage Approach to Visual Grounding
- Highrisk Prediction from Electronic Medical Records via Deep Attention Networks
- Self-supervised Moving Vehicle Tracking with Stereo Sound
- Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection
- A survey of Object Classification and Detection based on 2D/3D data
- Rotation-Sensitive Regression for Oriented Scene Text Detection
- PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments
- Extend the shallow part of Single Shot MultiBox Detector via Convolutional Neural Network
- Fusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection
- Knowledge Projection for Deep Neural Networks
- S3K: Self-Supervised Semantic Keypoints for Robotic Manipulation via Multi-View Consistency
- Dynamic Zoom-in Network for Fast Object Detection in Large Images
- Feature Intertwiner for Object Detection
- FD-MobileNet: Improved MobileNet with a Fast Downsampling Strategy
- A Framework of Transfer Learning in Object Detection for Embedded Systems
- Advanced Methods for the Optical Quality Assurance of Silicon Sensors
- Crack Semantic Segmentation using the U-Net with Full Attention Strategy
- Road Segmentation Using CNN with GRU
- Multi-scale Location-aware Kernel Representation for Object Detection
- Optimizing Video Object Detection via a Scale-Time Lattice
- Collaborative Learning for Weakly Supervised Object Detection
- Single-Shot Bidirectional Pyramid Networks for High-Quality Object Detection
- Traffic Signs Detection and Recognition System using Deep Learning
- Efficient Golf Ball Detection and Tracking Based on Convolutional Neural Networks and Kalman Filter
- Euphrates: Algorithm-SoC Co-Design for Low-Power Mobile Continuous Vision
- Learning Deep Representations with Probabilistic Knowledge Transfer
- Improving Fingerprint Pore Detection with a Small FCN
- SQuantizer: Simultaneous Learning for Both Sparse and Low-precision Neural Networks
- Improving Multiple Object Tracking with Optical Flow and Edge Preprocessing
- Building Robust Deep Neural Networks for Road Sign Detection
- UAV Visual Teach and Repeat Using Only Semantic Object Features
- Weaving Multi-scale Context for Single Shot Detector
- Benanza: Automatic Benchmark Generation to Compute "Lower-bound" Latency and Inform Optimizations of Deep Learning Models on GPUs
- Scene Classification in Indoor Environments for Robots using Context Based Word Embeddings
- Deep Regionlets for Object Detection
- Learning to Interpret Satellite Images Using Wikipedia
- Context-Aware Single-Shot Detector
- PAFNet: An Efficient Anchor-Free Object Detector Guidance
- Learning from Noisy Anchors for One-stage Object Detection
- 360-Indoor: Towards Learning Real-World Objects in 360° Indoor Equirectangular Images
- Zoom Out-and-In Network with Map Attention Decision for Region Proposal and Object Detection
- Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks
- Towards High Performance Video Object Detection
- A Large-scale Attribute Dataset for Zero-shot Learning
- Learning From Less Data: Diversified Subset Selection and Active Learning in Image Classification Tasks
- Building Proactive Voice Assistants: When and How (not) to Interact
- Joint Face Detection and Facial Motion Retargeting for Multiple Faces
- GestARLite: An On-Device Pointing Finger Based Gestural Interface for Smartphones and Video See-Through Head-Mounts
- Report on UG^2+ Challenge Track 1: Assessing Algorithms to Improve Video Object Detection and Classification from Unconstrained Mobility Platforms
- Fast and Accurate, Convolutional Neural Network Based Approach for Object Detection from UAV
- Grab: Fast and Accurate Sensor Processing for Cashier-Free Shopping
- Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection
- Visual Attribute-augmented Three-dimensional Convolutional Neural Network for Enhanced Human Action Recognition
- Detecting Small, Densely Distributed Objects with Filter-Amplifier Networks and Loss Boosting
- Spot the Difference by Object Detection
- Solving Service Robot Tasks: UT Austin Villa@Home 2019 Team Report
- What Are You Looking at? Detecting Human Intention in Gaze based Human-Robot Interaction
- Matrix and tensor decompositions for training binary neural networks
- 3D-DETNet: a Single Stage Video-Based Vehicle Detector
- Attention Mechanisms for Object Recognition with Event-Based Cameras
- A Large-Scale Dataset for Benchmarking Elevator Button Segmentation and Character Recognition
- Learning with Hierarchical Complement Objective
- Merging and Evolution: Improving Convolutional Neural Networks for Mobile Applications
- Developing a Compressed Object Detection Model based on YOLOv4 for Deployment on Embedded GPU Platform of Autonomous System
- Deep Feature Pyramid Reconfiguration for Object Detection
- Frustum VoxNet for 3D object detection from RGB-D or Depth images
- Automatic Dataset Annotation to Learn CNN Pore Description for Fingerprint Recognition
- Fast Efficient Object Detection Using Selective Attention
- Detecting Heads using Feature Refine Net and Cascaded Multi-Scale Architecture
- Effects of Interruptibility-Aware Robot Behavior
- Action Detection from a Robot-Car Perspective
- Automated flow for compressing convolution neural networks for efficient edge-computation with FPGA
- Using Deep Networks for Drone Detection
- Symbol, Conversational, and Societal Grounding with a Toy Robot
- TextTubes for Detecting Curved Text in the Wild
- Spot Evasion Attacks: Adversarial Examples for License Plate Recognition Systems with Convolutional Neural Networks
- Single Shot Multitask Pedestrian Detection and Behavior Prediction
- A Survey of FPGA-Based Robotic Computing
- Dense xUnit Networks
- Loop Closure Detection with RGB-D Feature Pyramid Siamese Networks
- Cascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localization
- Towards a Generic Diver-Following Algorithm: Balancing Robustness and Efficiency in Deep Visual Detection
- Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutions
- Evaluating robustness of You Only Hear Once(YOHO) Algorithm on noisy audios in the VOICe Dataset
- DeepSIC: Deep Semantic Image Compression
- Foresee: Attentive Future Projections of Chaotic Road Environments with Online Training
- Co-Optimizing Performance and Memory FootprintVia Integrated CPU/GPU Memory Management, anImplementation on Autonomous Driving Platform
- Fusion of an Ensemble of Augmented Image Detectors for Robust Object Detection
- Temporal-Spatial Mapping for Action Recognition
- Exploring Effectiveness of Inter-Microtask Qualification Tests in Crowdsourcing
- R-TOD: Real-Time Object Detector with Minimized End-to-End Delay for Autonomous Driving
- Mask R-CNN Based Object Detection for Intelligent Wireless Power Transfer
- Phasic dopamine release identification using ensemble of AlexNet
- Focal Loss Dense Detector for Vehicle Surveillance
- ResIST: Layer-Wise Decomposition of ResNets for Distributed Training
- Visual Diver Recognition for Underwater Human-Robot Collaboration
- LIP: Learning Instance Propagation for Video Object Segmentation
- Semantic Segmentation and Object Detection Towards Instance Segmentation: Breast Tumor Identification
- Plug & Play Convolutional Regression Tracker for Video Object Detection
- Simultaneous x, y Pixel Estimation and Feature Extraction for Multiple Small Objects in a Scene: A Description of the ALIEN Network
- Pseudo-labels for Supervised Learning on Dynamic Vision Sensor Data, Applied to Object Detection under Ego-motion
- Fault-Diagnosing SLAM for Varying Scale Change Detection
- AirPen: A Touchless Fingertip Based Gestural Interface for Smartphones and Head-Mounted Devices
- The Role of Compute in Autonomous Aerial Vehicles
- Serious Games Application for Memory Training Using Egocentric Images
- Corpus Conversion Service: A machine learning platform to ingest documents at scale [Poster abstract]
- Progressive Representation Adaptation for Weakly Supervised Object Localization
- ClusterNet: Detecting Small Objects in Large Scenes by Exploiting Spatio-Temporal Information
- Single Shot Scene Text Retrieval
- Semantic Image Retrieval by Uniting Deep Neural Networks and Cognitive Architectures
- A Distributed Framework to Orchestrate Video Analytics Applications
- Learning Pixel Representations for Generic Segmentation
- Proactive Network Maintenance using Fast, Accurate Anomaly Localization and Classification on 1-D Data Series
- Place-specific Background Modeling Using Recursive Autoencoders
- Gaussian Filter in CRF Based Semantic Segmentation
- Scalable Object Detection for Stylized Objects
- Deep Learning Approximation: Zero-Shot Neural Network Speedup
- The Research of the Real-time Detection and Recognition of Targets in Streetscape Videos
- Model-based active learning to detect isometric deformable objects in the wild with deep architectures
- Bottom-up Pose Estimation of Multiple Person with Bounding Box Constraint
- Active Object Perceiver: Recognition-guided Policy Learning for Object Searching on Mobile Robots
- TraMNet - Transition Matrix Network for Efficient Action Tube Proposals
- Car Monitoring System in Apartment Garages by Small Autonomous Car using Deep Learning
- Part-Level Convolutional Neural Networks for Pedestrian Detection Using Saliency and Boundary Box Alignment
- Online Visual Robot Tracking and Identification using Deep LSTM Networks
- DeepKey: Towards End-to-End Physical Key Replication From a Single Photograph
- Target-Tailored Source-Transformation for Scene Graph Generation
- Meta R-CNN : Towards General Solver for Instance-level Few-shot Learning
- ODE guided Neural Data Augmentation Techniques for Time Series Data and its Benefits on Robustness
- Robust Assessment of Real-World Adversarial Examples
- Machine Vision for Improved Human-Robot Cooperation in Adverse Underwater Conditions
- A Study on Trees's Knots Prediction from their Bark Outer-Shape
- Non-local RoIs for Instance Segmentation
- Adversarial Semantic Contour for Object Detection
- Latent Cognizance: What Machine Really Learns
- Recurrent Residual Module for Fast Inference in Videos
- Efficient Pipelines for Vision-Based Context Sensing
- LBGP: Learning Based Goal Planning for Autonomous Following in Front
- Learning to Predict the 3D Layout of a Scene
- MyFood: A Food Segmentation and Classification System to Aid Nutritional Monitoring
- Clique: Spatiotemporal Object Re-identification at the City Scale
- Convolutional Neural Networks for Real-Time Localization and Classification in Feedback Digital Microscopy
- Learning to Parse Wireframes in Images of Man-Made Environments