DeepIPC: Deeply Integrated Perception and Control for an Autonomous Vehicle in Real Environments

Abstract

In this work, we introduce DeepIPC, a novel end-to-end model tailored for autonomous driving, which seamlessly integrates perception and control tasks. Unlike traditional models that handle these tasks separately, DeepIPC innovatively combines a perception module, which processes RGBD images for semantic segmentation and generates bird's eye view (BEV) mappings, with a controller module that utilizes these insights along with GNSS and angular speed measurements to accurately predict navigational waypoints. This integration allows DeepIPC to efficiently translate complex environmental data into actionable driving commands. Our comprehensive evaluation demonstrates DeepIPC's superior performance in terms of drivability and multi-task efficiency across diverse real-world scenarios, setting a new benchmark for end-to-end autonomous driving systems with a leaner model architecture. The experimental results underscore DeepIPC's potential to significantly enhance autonomous vehicular navigation, promising a step forward in the development of autonomous driving technologies. For further insights and replication, we will make our code and datasets available at https://github.com/oskarnatan/DeepIPC.

Accepted for Publication in IEEE Access

References in corpus (10)

• Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges
• Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives
• Multi-modal Sensor Fusion-Based Deep Neural Network for End-to-end Autonomous Driving with Scene Understanding
• Modeling Human Driving Behavior through Generative Adversarial Imitation Learning
• Semantic Understanding of Foggy Scenes with Purely Synthetic Data
• End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent
• Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion
• Image-based scene recognition for robot navigation considering traversable plants and its manual annotation-free training
• Multi-source Pseudo-label Learning of Semantic Segmentation for the Scene Recognition of Agricultural Mobile Robots
• Estimation of articulated angle in six-wheeled dump trucks using multiple GNSS receivers for autonomous driving

Cited by in corpus (2)

• Seq-DeepIPC: Sequential Sensing for End-to-End Control in Legged Robot Navigation
• DeepIPCv2: LiDAR-powered Robust Environmental Perception and Navigational Control for Autonomous Vehicle