Enhancing License Plate Super-Resolution: A Layout-Aware and Character-Driven Approach

Abstract

Despite significant advancements in License Plate Recognition (LPR) through deep learning, most improvements rely on high-resolution images with clear characters. This scenario does not reflect real-world conditions where traffic surveillance often captures low-resolution and blurry images. Under these conditions, characters tend to blend with the background or neighboring characters, making accurate LPR challenging. To address this issue, we introduce a novel loss function, Layout and Character Oriented Focal Loss (LCOFL), which considers factors such as resolution, texture, and structural details, as well as the performance of the LPR task itself. We enhance character feature learning using deformable convolutions and shared weights in an attention module and employ a GAN-based training approach with an Optical Character Recognition (OCR) model as the discriminator to guide the super-resolution process. Our experimental results show significant improvements in character reconstruction quality, outperforming two state-of-the-art methods in both quantitative and qualitative measures. Our code is publicly available at https://github.com/valfride/lpsr-lacd

Accepted for presentation at the Conference on Graphics, Patterns and Images (SIBGRAPI) 2024

References in corpus (11)

• An Efficient and Layout-Independent Automatic License Plate Recognition System Based on the YOLO detector
• Rethinking and Designing a High-performing Automatic License Plate Recognition Approach
• On the Cross-dataset Generalization in License Plate Recognition
• Vehicle-Rear: A New Dataset to Explore Feature Fusion for Vehicle Identification Using Convolutional Neural Networks
• Super-Resolution of License Plate Images Using Attention Modules and Sub-Pixel Convolution Layers
• A First Look at Dataset Bias in License Plate Recognition
• Combining Attention Module and Pixel Shuffle for License Plate Super-Resolution
• Leveraging Model Fusion for Improved License Plate Recognition
• Face Super-Resolution Using Stochastic Differential Equations
• Forensic License Plate Recognition with Compression-Informed Transformers
• Ambiguity of Objective Image Quality Metrics: A New Methodology for Performance Evaluation

Cited by in corpus (4)

• Toward Advancing License Plate Super-Resolution in Real-World Scenarios: A Dataset and Benchmark
• LPLC: A Dataset for License Plate Legibility Classification
• Toward Unified Fine-Grained Vehicle Classification and Automatic License Plate Recognition
• Robust Face Super-Resolution and Recognition Through Multi-Feature Aggregation in Diffusion Models