An Empirical Evaluation of Deep Learning on Highway Driving

Abstract

Numerous groups have applied a variety of deep learning techniques to computer vision problems in highway perception scenarios. In this paper, we presented a number of empirical evaluations of recent deep learning advances. Computer vision, combined with deep learning, has the potential to bring about a relatively inexpensive, robust solution to autonomous driving. To prepare deep learning for industry uptake and practical applications, neural networks will require large data sets that represent all possible driving environments and scenarios. We collect a large data set of highway data and apply deep learning and computer vision algorithms to problems such as car and lane detection. We show how existing convolutional neural networks (CNNs) can be used to perform lane and vehicle detection while running at frame rates required for a real-time system. Our results lend credence to the hypothesis that deep learning holds promise for autonomous driving.

Added a video for lane detection

References in corpus (3)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
• Going Deeper with Convolutions

Cited by in corpus (44)

• Deep Machine Learning Approach to Develop a New Asphalt Pavement Condition Index
• CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices
• End-to-End Deep Reinforcement Learning for Lane Keeping Assist
• Characterizing Driving Styles with Deep Learning
• Beyond Grand Theft Auto V for Training, Testing and Enhancing Deep Learning in Self Driving Cars
• On the Robustness of Convolutional Neural Networks to Internal Architecture and Weight Perturbations
• DeepCruiser: Automated Guided Testing for Stateful Deep Learning Systems
• Learning from Maps: Visual Common Sense for Autonomous Driving
• 3D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representation
• End-to-end people detection in crowded scenes
• End to End Video Segmentation for Driving : Lane Detection For Autonomous Car
• Software Engineering Practice in the Development of Deep Learning Applications
• Structure-Aware Network for Lane Marker Extraction with Dynamic Vision Sensor
• Improving Interpretability of Deep Neural Networks with Semantic Information
• RoboNet: Large-Scale Multi-Robot Learning
• Coverage Testing of Deep Learning Models using Dataset Characterization
• Can Single Neurons Solve MNIST? The Computational Power of Biological Dendritic Trees
• Uniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Control
• Interpreting and Evaluating Neural Network Robustness
• Brain Inspired Cognitive Model with Attention for Self-Driving Cars
• Incorporating Unlabeled Data into Distributionally Robust Learning
• Driver Behavior Analysis Using Lane Departure Detection Under Challenging Conditions
• A Fog Computing Framework for Autonomous Driving Assist: Architecture, Experiments, and Challenges
• Verification of Binarized Neural Networks via Inter-Neuron Factoring
• Deep Learning and Control Algorithms of Direct Perception for Autonomous Driving
• SEALing Neural Network Models in Secure Deep Learning Accelerators
• FFT-Based Deep Learning Deployment in Embedded Systems
• Tuned Inception V3 for Recognizing States of Cooking Ingredients
• Perspective: A Phase Diagram for Deep Learning unifying Jamming, Feature Learning and Lazy Training
• An Empirical Study of Explainable AI Techniques on Deep Learning Models For Time Series Tasks
• Multi-modal Experts Network for Autonomous Driving
• Analyzing Accuracy Loss in Randomized Smoothing Defenses
• An Evolution of CNN Object Classifiers on Low-Resolution Images
• WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving
• Vehicle Detection in Deep Learning
• Real-Time Road Segmentation Using LiDAR Data Processing on an FPGA
• Instance-Aware Predictive Navigation in Multi-Agent Environments
• On the Adversarial Robustness of Multivariate Robust Estimation
• PipeTune: Pipeline Parallelism of Hyper and System Parameters Tuning for Deep Learning Clusters
• Network Horizon Dynamics I: Qualitative Aspects
• Hierarchical Recurrent Attention Networks for Structured Online Maps
• Multi-lane Detection Using Instance Segmentation and Attentive Voting
• The Aleatoric Uncertainty Estimation Using a Separate Formulation with Virtual Residuals
• Deep Multi-Sensor Lane Detection