most citedForging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities

3 citations · 7 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CV2024★ 2 cited

An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training

Haiming Zhang, Ying Xue, Xu Yan +6

The field of autonomous driving is experiencing a surge of interest in world models, which aim to predict potential future scenarios based on historical observations. In this paper…

cs.CV2024

DisEnvisioner: Disentangled and Enriched Visual Prompt for Customized Image Generation

Jing He, Haodong Li, Yongzhe Hu +4

In the realm of image generation, creating customized images from visual prompt with additional textual instruction emerges as a promising endeavor. However, existing methods, both…

cs.CV2024

OmniBooth: Learning Latent Control for Image Synthesis with Multi-modal Instruction

Leheng Li, Weichao Qiu, Xu Yan +6

We present OmniBooth, an image generation framework that enables spatial control with instance-level multi-modal customization. For all instances, the multimodal instruction can be…

cs.CV2024

SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIs

Leheng Li, Weichao Qiu, Yingjie Cai +4

The advancement of autonomous driving is increasingly reliant on high-quality annotated datasets, especially in the task of 3D occupancy prediction, where the occupancy labels requ…

cs.CV2024

Efficient Depth-Guided Urban View Synthesis

Sheng Miao, Jiaxin Huang, Dongfeng Bai +4

Recent advances in implicit scene representation enable high-fidelity street view novel view synthesis. However, existing methods optimize a neural radiance field for each scene, r…

cs.CV2024

The RoboDrive Challenge: Drive Anytime Anywhere in Any Condition

Lingdong Kong, Shaoyuan Xie, Hanjiang Hu +88

In the realm of autonomous driving, robust perception under out-of-distribution conditions is paramount for the safe deployment of vehicles. Challenges such as adverse weather, sen…

cs.CV2024

Neural Radiance Fields with Torch Units

Bingnan Ni, Huanyu Wang, Dongfeng Bai +4

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvem…

cs.CV2024★ 2 cited

HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting

Hongyu Zhou, Jiahao Shao, Lu Xu +6

Holistic understanding of urban scenes based on RGB images is a challenging yet important problem. It encompasses understanding both the geometry and appearance to enable novel vie…

cs.CV2024★ 3 cited

Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities

Xu Yan, Haiming Zhang, Yingjie Cai +13

The rise of large foundation models, trained on extensive datasets, is revolutionizing the field of AI. Models such as SAM, DALL-E2, and GPT-4 showcase their adaptability by extrac…