CNN based Road User Detection using the 3D Radar Cube
arXiv:2004.12165 · doi:10.1109/LRA.2020.2967272
Abstract
This letter presents a novel radar based, single-frame, multi-class detection method for moving road users (pedestrian, cyclist, car), which utilizes low-level radar cube data. The method provides class information both on the radar target- and object-level. Radar targets are classified individually after extending the target features with a cropped block of the 3D radar cube around their positions, thereby capturing the motion of moving parts in the local velocity distribution. A Convolutional Neural Network (CNN) is proposed for this classification step. Afterwards, object proposals are generated with a clustering step, which not only considers the radar targets' positions and velocities, but their calculated class scores as well. In experiments on a real-life dataset we demonstrate that our method outperforms the state-of-the-art methods both target- and object-wise by reaching an average of 0.70 (baseline: 0.68) target-wise and 0.56 (baseline: 0.48) object-wise F1 score. Furthermore, we examine the importance of the used features in an ablation study.
References in corpus (6)
- The EuroCity Persons Dataset: A Novel Benchmark for Object Detection
- Extended Object Tracking: Introduction, Overview and Applications
- 2D Car Detection in Radar Data with PointNets
- A Multi-Stage Clustering Framework for Automotive Radar Data
- Radar-based Feature Design and Multiclass Classification for Road User Recognition
- Radar-based Road User Classification and Novelty Detection with Recurrent Neural Network Ensembles
Cited by in corpus (17)
- Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
- RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization
- A New Wave in Robotics: Survey on Recent mmWave Radar Applications in Robotics
- Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review
- CenterNet3D: An Anchor Free Object Detector for Point Cloud
- RadarGNN: Transformation Invariant Graph Neural Network for Radar-based Perception
- Off-the-shelf sensor vs. experimental radar -- How much resolution is necessary in automotive radar classification?
- Super-Resolution Radar Imaging with Sparse Arrays Using a Deep Neural Network Trained with Enhanced Virtual Data
- Self-Supervised Learning for Enhancing Angular Resolution in Automotive MIMO Radars
- Self-Supervised Velocity Estimation for Automotive Radar Object Detection Networks
- Coherent, super resolved radar beamforming using self-supervised learning
- See Further Than CFAR: a Data-Driven Radar Detector Trained by Lidar
- DeepHybrid: Deep Learning on Automotive Radar Spectra and Reflections for Object Classification
- A Deep Automotive Radar Detector using the RaDelft Dataset
- SparseRadNet: Sparse Perception Neural Network on Subsampled Radar Data
- A Resource Efficient Fusion Network for Object Detection in Bird's-Eye View using Camera and Raw Radar Data
- REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View