A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector

Abstract

Automatic License Plate Recognition (ALPR) has been a frequent topic of research due to many practical applications. However, many of the current solutions are still not robust in real-world situations, commonly depending on many constraints. This paper presents a robust and efficient ALPR system based on the state-of-the-art YOLO object detector. The Convolutional Neural Networks (CNNs) are trained and fine-tuned for each ALPR stage so that they are robust under different conditions (e.g., variations in camera, lighting, and background). Specially for character segmentation and recognition, we design a two-stage approach employing simple data augmentation tricks such as inverted License Plates (LPs) and flipped characters. The resulting ALPR approach achieved impressive results in two datasets. First, in the SSIG dataset, composed of 2,000 frames from 101 vehicle videos, our system achieved a recognition rate of 93.53% and 47 Frames Per Second (FPS), performing better than both Sighthound and OpenALPR commercial systems (89.80% and 93.03%, respectively) and considerably outperforming previous results (81.80%). Second, targeting a more realistic scenario, we introduce a larger public dataset, called UFPR-ALPR dataset, designed to ALPR. This dataset contains 150 videos and 4,500 frames captured when both camera and vehicles are moving and also contains different types of vehicles (cars, motorcycles, buses and trucks). In our proposed dataset, the trial versions of commercial systems achieved recognition rates below 70%. On the other hand, our system performed better, with recognition rate of 78.33% and 35 FPS.

Accepted for presentation at the International Joint Conference on Neural Networks (IJCNN) 2018

References in corpus (4)

• Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs
• Benchmark for License Plate Character Segmentation
• License Plate Detection and Recognition Using Deeply Learned Convolutional Neural Networks
• Towards End-to-End Car License Plates Detection and Recognition with Deep Neural Networks

Cited by in corpus (38)

• A Survey of Deep Learning-based Object Detection
• An Efficient and Layout-Independent Automatic License Plate Recognition System Based on the YOLO detector
• Rethinking and Designing a High-performing Automatic License Plate Recognition Approach
• Convolutional Neural Networks for Automatic Meter Reading
• On the Cross-dataset Generalization in License Plate Recognition
• Towards Image-based Automatic Meter Reading in Unconstrained Scenarios: A Robust and Efficient Approach
• Deep Learning for Image-based Automatic Dial Meter Reading: Dataset and Baselines
• Zero-Shot Action Recognition in Videos: A Survey
• Vehicle-Rear: A New Dataset to Explore Feature Fusion for Vehicle Identification Using Convolutional Neural Networks
• Robust Iris Segmentation Based on Fully Convolutional Networks and Generative Adversarial Networks
• Fully Convolutional Networks and Generative Adversarial Networks Applied to Sclera Segmentation
• Deep Representations for Cross-spectral Ocular Biometrics
• Traffic Surveillance using Vehicle License Plate Detection and Recognition in Bangladesh
• A First Look at Dataset Bias in License Plate Recognition
• Do We Train on Test Data? The Impact of Near-Duplicates on License Plate Recognition
• Leveraging Model Fusion for Improved License Plate Recognition
• Simultaneous Iris and Periocular Region Detection Using Coarse Annotations
• Forensic License Plate Recognition with Compression-Informed Transformers
• License Plate Detection and Character Recognition Using Deep Learning and Font Evaluation
• Character Time-series Matching For Robust License Plate Recognition
• Multi-Feature Aggregation in Diffusion Models for Enhanced Face Super-Resolution
• Toward Enhancing Vehicle Color Recognition in Adverse Conditions: A Dataset and Benchmark
• Advancing Multinational License Plate Recognition Through Synthetic and Real Data Fusion: A Comprehensive Evaluation
• MF-LPR${}^2$: Multi-Frame License Plate Image Restoration and Recognition using Optical Flow
• Let the Cloud Watch Over Your IoT File Systems
• Toward Unified Fine-Grained Vehicle Classification and Automatic License Plate Recognition
• Efficient License Plate Recognition via Pseudo-Labeled Supervision with Grounding DINO and YOLOv8
• SNIDER: Single Noisy Image Denoising and Rectification for Improving License Plate Recognition
• End-to-end trainable network for degraded license plate detection via vehicle-plate relation mining
• Practical License Plate Recognition in Unconstrained Surveillance Systems with Adversarial Super-Resolution
• SuperOCR: A Conversion from Optical Character Recognition to Image Captioning
• Histogram of Cell Types: Deep Learning for Automated Bone Marrow Cytology
• Automatic Counting and Identification of Train Wagons Based on Computer Vision and Deep Learning
• Towards End-to-end Car License Plate Location and Recognition in Unconstrained Scenarios
• A Cloud-Based Hybrid Model for Real-Time Detection of BRTA-Approved Licence Plates Using YOLO Tiny and Haar Cascade
• Indian Licence Plate Dataset in the wild
• Car Monitoring System in Apartment Garages by Small Autonomous Car using Deep Learning
• Deep Learning Based Vehicle Tracking System Using License Plate Detection And Recognition