One Million Scenes for Autonomous Driving: ONCE Dataset

Abstract

Current perception models in autonomous driving have become notorious for greatly relying on a mass of annotated data to cover unseen cases and address the long-tail problem. On the other hand, learning from unlabeled large-scale collected data and incrementally self-training powerful recognition models have received increasing attention and may become the solutions of next-generation industry-level powerful and robust perception models in autonomous driving. However, the research community generally suffered from data inadequacy of those essential real-world scene data, which hampers the future exploration of fully/semi/self-supervised methods for 3D perception. In this paper, we introduce the ONCE (One millioN sCenEs) dataset for 3D object detection in the autonomous driving scenario. The ONCE dataset consists of 1 million LiDAR scenes and 7 million corresponding camera images. The data is selected from 144 driving hours, which is 20x longer than the largest 3D autonomous driving dataset available (e.g. nuScenes and Waymo), and it is collected across a range of different areas, periods and weather conditions. To facilitate future research on exploiting unlabeled data for 3D detection, we additionally provide a benchmark in which we reproduce and evaluate a variety of self-supervised and semi-supervised methods on the ONCE dataset. We conduct extensive analyses on those methods and provide valuable observations on their performance related to the scale of used data. Data, code, and more information are available at https://once-for-auto-driving.github.io/index.html.

arXiv commentNeurIPS 2021 Datasets and Benchmarks Track

References in corpus (16)

• Bootstrap your own latent: A new approach to self-supervised Learning
• Learning Transferable Features with Deep Adaptation Networks
• FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
• Improved Baselines with Momentum Contrastive Learning
• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
• Unsupervised Data Augmentation for Consistency Training
• Temporal Ensembling for Semi-Supervised Learning
• MixMatch: A Holistic Approach to Semi-Supervised Learning
• A2D2: Audi Autonomous Driving Dataset
• ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring
• Argoverse: 3D Tracking and Forecasting with Rich Maps
• Self-labelling via simultaneous clustering and representation learning
• Center-based 3D Object Detection and Tracking
• Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detection
• 3DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detection
• ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection

Cited by in corpus (12)

• Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
• Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey
• A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
• Deep Long-Tailed Learning: A Survey
• Perception Datasets for Anomaly Detection in Autonomous Driving: A Survey
• Multimodal Detection of Unknown Objects on Roads for Autonomous Driving
• Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection
• Reliable Student: Addressing Noise in Semi-Supervised 3D Object Detection
• Voxel Transformer for 3D Object Detection
• Neural Rendering for Sensor Adaptation in 3D Object Detection
• Scalable Distributed Algorithms for Size-Constrained Submodular Maximization in the MapReduce and Adaptive Complexity Models
• Long-Tailed Learning for Generalized Category Discovery