Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regression
arXiv:2412.16889 · doi:10.1109/TPAMI.2024.3508798
Abstract
In this paper, we focus on the challenging task of monocular 3D lane detection. Previous methods typically adopt inverse perspective mapping (IPM) to transform the Front-Viewed (FV) images or features into the Bird-Eye-Viewed (BEV) space for lane detection. However, IPM's dependence on flat ground assumption and context information loss in BEV representations lead to inaccurate 3D information estimation. Though efforts have been made to bypass BEV and directly predict 3D lanes from FV representations, their performances still fall behind BEV-based methods due to a lack of structured modeling of 3D lanes. In this paper, we propose a novel BEV-free method named Anchor3DLane++ which defines 3D lane anchors as structural representations and makes predictions directly from FV features. We also design a Prototype-based Adaptive Anchor Generation (PAAG) module to generate sample-adaptive sparse 3D anchors dynamically. In addition, an Equal-Width (EW) loss is developed to leverage the parallel property of lanes for regularization. Furthermore, camera-LiDAR fusion is also explored based on Anchor3DLane++ to leverage complementary information. Extensive experiments on three popular 3D lane detection benchmarks show that our Anchor3DLane++ outperforms previous state-of-the-art methods. Code is available at: https://github.com/tusen-ai/Anchor3DLane.
Published in IEEE Transactions on Pattern Analysis and Machine Intelligence
References in corpus (6)
- Real time Detection of Lane Markers in Urban Streets
- Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detection
- 3D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representation
- Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformer
- BEVPoolv2: A Cutting-edge Implementation of BEVDet Toward Deployment
- LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving