Scalability in Perception for Autonomous Driving: Waymo Open Dataset
arXiv:1912.04838
Abstract
The research community has increasing interest in autonomous driving research, despite the resource intensity of obtaining representative real world data. Existing self-driving datasets are limited in the scale and variation of the environments they capture, even though generalization within and between operating regions is crucial to the overall viability of the technology. In an effort to help align the research community's contributions with real-world self-driving problems, we introduce a new large scale, high quality, diverse dataset. Our new dataset consists of 1150 scenes that each span 20 seconds, consisting of well synchronized and calibrated high quality LiDAR and camera data captured across a range of urban and suburban geographies. It is 15x more diverse than the largest camera+LiDAR dataset available based on our proposed diversity metric. We exhaustively annotated this data with 2D (camera image) and 3D (LiDAR) bounding boxes, with consistent identifiers across frames. Finally, we provide strong baselines for 2D as well as 3D detection and tracking tasks. We further study the effects of dataset size and generalization across geographies on 3D detection methods. Find data, code and more up-to-date information at http://www.waymo.com/open.
CVPR 2020
References in corpus (4)
Cited by in corpus (73)
- A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving
- A Survey of End-to-End Driving: Architectures and Training Methods
- WILDS: A Benchmark of in-the-Wild Distribution Shifts
- One Thousand and One Hours: Self-driving Motion Prediction Dataset
- BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
- JRDB: A Dataset and Benchmark of Egocentric Robot Visual Perception of Humans in Built Environments
- A Survey on Deep Learning for Localization and Mapping: Towards the Age of Spatial Machine Intelligence
- Dynamic Object Aware LiDAR SLAM based on Automatic Generation of Training Data
- AFDet: Anchor Free One Stage 3D Object Detection
- Unsupervised Monocular Depth Learning in Dynamic Scenes
- Bridging the Gap between Events and Frames through Unsupervised Domain Adaptation
- LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving
- The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions
- A Unified Longitudinal Trajectory Dataset for Automated Vehicle
- PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentation
- Pillar-based Object Detection for Autonomous Driving
- SimpleTrack: Understanding and Rethinking 3D Multi-object Tracking
- Simple Training Strategies and Model Scaling for Object Detection
- Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challenges
- LiDAR Spoofing Meets the New-Gen: Capability Improvements, Broken Assumptions, and New Attack Strategies
- Stereo Correspondence and Reconstruction of Endoscopic Data Challenge
- What-If Motion Prediction for Autonomous Driving
- Optimal Pose and Shape Estimation for Category-level 3D Object Perception
- Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Clouds
- See Eye to Eye: A Lidar-Agnostic 3D Detection Framework for Unsupervised Multi-Target Domain Adaptation
- The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning
- 1st Place Solution for Waymo Open Dataset Challenge -- 3D Detection and Domain Adaptation
- Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learning
- PLOP: Probabilistic poLynomial Objects trajectory Planning for autonomous driving
- Lidar Upsampling with Sliced Wasserstein Distance
- Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation
- Confidence Guided Stereo 3D Object Detection with Split Depth Estimation
- Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection
- Towards Performance Clarity of Edge Video Analytics
- An LSTM Approach to Temporal 3D Object Detection in LiDAR Point Clouds
- Identifying the Defective: Detecting Damaged Grains for Cereal Appearance Inspection
- Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation
- CARRADA Dataset: Camera and Automotive Radar with Range-Angle-Doppler Annotations
- 1st Place Solutions for Waymo Open Dataset Challenges -- 2D and 3D Tracking
- Quantifying Data Augmentation for LiDAR based 3D Object Detection
- ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
- 3D for Free: Crossmodal Transfer Learning using HD Maps
- PV-RCNN: The Top-Performing LiDAR-only Solutions for 3D Detection / 3D Tracking / Domain Adaptation of Waymo Open Dataset Challenges
- RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detection
- An Overview Of 3D Object Detection
- 1st Place Solutions of Waymo Open Dataset Challenge 2020 -- 2D Object Detection Track
- Inferring Spatial Uncertainty in Object Detection
- Simultaneous Detection and Tracking with Motion Modelling for Multiple Object Tracking
- 2nd Place Solution for Waymo Open Dataset Challenge -- Real-time 2D Object Detection
- 2nd Place Solution for Waymo Open Dataset Challenge -- 2D Object Detection
- Real-Time Anchor-Free Single-Stage 3D Detection with IoU-Awareness
- SoDA: Multi-Object Tracking with Soft Data Association
- Learning Multiplicative Interactions with Bayesian Neural Networks for Visual-Inertial Odometry
- Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection
- Are We Hungry for 3D LiDAR Data for Semantic Segmentation? A Survey and Experimental Study
- SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving
- Pseudo-labeling for Scalable 3D Object Detection
- Vehicle Telematics Via Exteroceptive Sensors: A Survey
- Towards Streaming Perception
- Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehicles
- Detecting Out-of-distribution Objects Using Neuron Activation Patterns
- Leveraging Temporal Information for 3D Detection and Domain Adaptation
- Radar-Camera Pixel Depth Association for Depth Completion
- CenterAtt: Fast 2-stage Center Attention Network
- Unsupervised Object Detection with LiDAR Clues
- Using Formal Models, Safety Shields and Certified Control to Validate AI-Based Train Systems
- MARNet: Multi-Abstraction Refinement Network for 3D Point Cloud Analysis
- DROMO: Distributionally Robust Offline Model-based Policy Optimization
- OpenRadar: A Toolkit for Prototyping mmWave Radar Applications
- A LiDAR Assisted Control Module with High Precision in Parking Scenarios for Autonomous Driving Vehicle
- AccSS3D: Accelerator for Spatially Sparse 3D DNNs
- To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernels
- Synthetic-to-Real Domain Adaptation for Lane Detection