Self-supervised learning for autonomous vehicles perception: A conciliation between analytical and learning methods

Abstract

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled training data. In the context of autonomous vehicles perception, this requirement is critical, as the distribution of sensor data can continuously change and include several unexpected variations. It turns out that a category of learning techniques, referred to as self-supervised learning (SSL), consists of replacing the manual labeling effort by an automatic labeling process. Thanks to their ability to learn on the application time and in varying environments, state-of-the-art SSL techniques provide a valid alternative to supervised learning for a variety of different tasks, including long-range traversable area segmentation, moving obstacle instance segmentation, long-term moving obstacle tracking, or depth map prediction. In this tutorial-style article, we present an overview and a general formalization of the concept of self-supervised learning (SSL) for autonomous vehicles perception. This formalization provides helpful guidelines for developing novel frameworks based on generic SSL principles. Moreover, it enables to point out significant challenges in the design of future SSL systems.

References in corpus (11)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Overcoming catastrophic forgetting in neural networks
• Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
• Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
• Deep Clustering for Unsupervised Learning of Visual Features
• Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding
• Dimensionality-Driven Learning with Noisy Labels
• Self-Supervised Learning for Stereo Matching with Self-Improving Ability
• Estimating the class prior and posterior from noisy positives and unlabeled data
• Theoretical Comparisons of Positive-Unlabeled Learning against Positive-Negative Learning
• Autonomous driving challenge: To Infer the property of a dynamic object based on its motion pattern using recurrent neural network

Cited by in corpus (3)

• Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions
• On the Road with 16 Neurons: Mental Imagery with Bio-inspired Deep Neural Networks
• Feature-Filter: Detecting Adversarial Examples through Filtering off Recessive Features