Robust Lane Detection from Continuous Driving Scenes Using Deep Neural Networks

Abstract

Lane detection in driving scenes is an important module for autonomous vehicles and advanced driver assistance systems. In recent years, many sophisticated lane detection methods have been proposed. However, most methods focus on detecting the lane from one single image, and often lead to unsatisfactory performance in handling some extremely-bad situations such as heavy shadow, severe mark degradation, serious vehicle occlusion, and so on. In fact, lanes are continuous line structures on the road. Consequently, the lane that cannot be accurately detected in one current frame may potentially be inferred out by incorporating information of previous frames. To this end, we investigate lane detection by using multiple frames of a continuous driving scene, and propose a hybrid deep architecture by combining the convolutional neural network (CNN) and the recurrent neural network (RNN). Specifically, information of each frame is abstracted by a CNN block, and the CNN features of multiple continuous frames, holding the property of time-series, are then fed into the RNN block for feature learning and lane prediction. Extensive experiments on two large-scale datasets demonstrate that, the proposed method outperforms the competing methods in lane detection, especially in handling difficult situations.

arXiv commentIEEE Transactions on Vehicular Technology, 69(1), 2020

References in corpus (3)

• Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach
• Real time Detection of Lane Markers in Urban Streets
• A Deep Spatio-Temporal Fuzzy Neural Network for Passenger Demand Prediction

Cited by in corpus (11)

• Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
• Lane Detection Model Based on Spatio-Temporal Network With Double Convolutional Gated Recurrent Units
• Learned Visual Navigation for Under-Canopy Agricultural Robots
• A Hybrid Spatial-temporal Deep Learning Architecture for Lane Detection
• Identification of point sources in gamma rays using U-shaped convolutional neural networks and a data challenge
• Robust Lane Detection through Self Pre-training with Masked Sequential Autoencoders and Fine-tuning with Customized PolyLoss
• CropNav: a Framework for Autonomous Navigation in Real Farms
• Efficient Perception, Planning, and Control Algorithm for Vision-Based Automated Vehicles
• CoLD Fusion: A Real-time Capable Spline-based Fusion Algorithm for Collective Lane Detection
• Dynamic loss balancing and sequential enhancement for road-safety assessment and traffic scene classification
• Towards Scenario- and Capability-Driven Dataset Development and Evaluation: An Approach in the Context of Mapless Automated Driving