Vehicle-Rear: A New Dataset to Explore Feature Fusion for Vehicle Identification Using Convolutional Neural Networks

Abstract

This work addresses the problem of vehicle identification through non-overlapping cameras. As our main contribution, we introduce a novel dataset for vehicle identification, called Vehicle-Rear, that contains more than three hours of high-resolution videos, with accurate information about the make, model, color and year of nearly 3,000 vehicles, in addition to the position and identification of their license plates. To explore our dataset we design a two-stream CNN that simultaneously uses two of the most distinctive and persistent features available: the vehicle's appearance and its license plate. This is an attempt to tackle a major problem: false alarms caused by vehicles with similar designs or by very close license plate identifiers. In the first network stream, shape similarities are identified by a Siamese CNN that uses a pair of low-resolution vehicle patches recorded by two different cameras. In the second stream, we use a CNN for OCR to extract textual information, confidence scores, and string similarities from a pair of high-resolution license plate patches. Then, features from both streams are merged by a sequence of fully connected layers for decision. In our experiments, we compared the two-stream network against several well-known CNN architectures using single or multiple vehicle features. The architectures, trained models, and dataset are publicly available at https://github.com/icarofua/vehicle-rear.

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Albumentations: fast and flexible image augmentations
• A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector
• An Efficient and Layout-Independent Automatic License Plate Recognition System Based on the YOLO detector
• A survey of advances in vision-based vehicle re-identification
• Hydra: an Ensemble of Convolutional Neural Networks for Geospatial Land Classification
• Evaluating Two-Stream CNN for Video Classification
• Convolutional Neural Networks for Automatic Meter Reading
• License Plate Detection and Recognition Using Deeply Learned Convolutional Neural Networks
• Towards Image-based Automatic Meter Reading in Unconstrained Scenarios: A Robust and Efficient Approach

Cited by in corpus (11)

• An Efficient and Layout-Independent Automatic License Plate Recognition System Based on the YOLO detector
• On the Cross-dataset Generalization in License Plate Recognition
• A First Look at Dataset Bias in License Plate Recognition
• Toward Advancing License Plate Super-Resolution in Real-World Scenarios: A Dataset and Benchmark
• Enhancing License Plate Super-Resolution: A Layout-Aware and Character-Driven Approach
• Toward Enhancing Vehicle Color Recognition in Adverse Conditions: A Dataset and Benchmark
• Multi-Feature Aggregation in Diffusion Models for Enhanced Face Super-Resolution
• CORE-ReID V2: Advancing the Domain Adaptation for Object Re-Identification with Optimized Training and Ensemble Fusion
• Toward Unified Fine-Grained Vehicle Classification and Automatic License Plate Recognition
• Nighttime Driver Behavior Prediction Using Taillight Signal Recognition via CNN-SVM Classifier
• Automatic Counting and Identification of Train Wagons Based on Computer Vision and Deep Learning