Synthetic Datasets for Autonomous Driving: A Survey

Abstract

Autonomous driving techniques have been flourishing in recent years while thirsting for huge amounts of high-quality data. However, it is difficult for real-world datasets to keep up with the pace of changing requirements due to their expensive and time-consuming experimental and labeling costs. Therefore, more and more researchers are turning to synthetic datasets to easily generate rich and changeable data as an effective complement to the real world and to improve the performance of algorithms. In this paper, we summarize the evolution of synthetic dataset generation methods and review the work to date in synthetic datasets related to single and multi-task categories for to autonomous driving study. We also discuss the role that synthetic dataset plays the evaluation, gap test, and positive effect in autonomous driving related algorithm testing, especially on trustworthiness and safety aspects. Finally, we discuss general trends and possible development directions. To the best of our knowledge, this is the first survey focusing on the application of synthetic datasets in autonomous driving. This survey also raises awareness of the problems of real-world deployment of autonomous driving technology and provides researchers with a possible solution.

arXiv comment19 pages, 5 figures

References in corpus (14)

• Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
• ShapeNet: An Information-Rich 3D Model Repository
• A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation
• Deep Visual Domain Adaptation: A Survey
• Shortcut Learning in Deep Neural Networks
• Semantic Foggy Scene Understanding with Synthetic Data
• NeRF++: Analyzing and Improving Neural Radiance Fields
• Tent: Fully Test-time Adaptation by Entropy Minimization
• Data Augmentation for Low-Resource Neural Machine Translation
• Synscapes: A Photorealistic Synthetic Dataset for Street Scene Parsing
• Is synthetic data from generative models ready for image recognition?
• Training Constrained Deconvolutional Networks for Road Scene Semantic Segmentation
• Active Perception using Light Curtains for Autonomous Driving
• Bridging the Sim2Real gap with CARE: Supervised Detection Adaptation with Conditional Alignment and Reweighting

Cited by in corpus (6)

• MatSynth: A Modern PBR Materials Dataset
• MatFuse: Controllable Material Generation with Diffusion Models
• Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey
• AIGC-assisted Federated Learning for Vehicular Edge Intelligence: Vehicle Selection, Resource Allocation and Model Augmentation
• Synthetic Dataset Evaluation Based on Generalized Cross Validation
• Can AI Dream of Unseen Galaxies? Conditional Diffusion Model for Galaxy Morphology Augmentation