15 papers
VITAL: From Visual Motion to Precise Action
Ao Liang, Youquan Liu, Mingxiao Li +7
World-action models aim to turn visual anticipation into driving decisions, yet typically train action experts on trajectory representations defined independently of visual dynamic…
Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis
Xiang Xu, Alan Liang, Youquan Liu +5
Constructing faithful 4D worlds from LiDAR-acquired sequences is crucial for embodied AI, yet current generative frameworks apply uniform modeling capacity across all spatial regio…
Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving
Yang Wu, Qiang Meng, Zhaojiang Liu +3
Current end-to-end autonomous driving models are fundamentally constrained by the behavioral cloning ceiling of imitation learning. While reinforcement learning offers a path to sm…
OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation
Youquan Liu, Weidong Yang, Ao Liang +9
LiDAR scene generation is increasingly important for scalable simulation and synthetic data creation, especially under diverse sensing conditions that are costly to capture at scal…
Is Your Driving World Model an All-Around Player?
Lingdong Kong, Ao Liang, Tianyi Yan +20
Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic textures but violate basic phys…
GEM: Generating LiDAR World Model via Deformable Mamba
Yang Wu, Zhaojiang Liu, Qiang Meng +5
World models, which simulate environmental dynamics and generate sensor observations, are gaining increasing attention in autonomous driving. However, progress in LiDAR-based world…
WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World
Ao Liang, Lingdong Kong, Tianyi Yan +19
Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. D…
U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences
Xiang Xu, Alan Liang, Youquan Liu +4
Modeling dynamic 3D environments from LiDAR sequences is central to building reliable 4D worlds for autonomous driving and embodied AI. Existing generative frameworks, however, oft…
3EED: Ground Everything Everywhere in 3D
Rong Li, Yuhao Dong, Tianshuai Hu +7
Visual grounding in 3D is the key for embodied agents to localize language-referred objects in open-world environments. However, existing benchmarks are limited to indoor focus, si…
Learning to Generate 4D LiDAR Sequences
Ao Liang, Youquan Liu, Yu Yang +5
While generative world models have advanced video and occupancy-based data synthesis, LiDAR generation remains underexplored despite its importance for accurate 3D perception. Exte…
3D and 4D World Modeling: A Survey
Lingdong Kong, Yu Yang, Jianbiao Mei +20
World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphas…
La La LiDAR: Large-Scale Layout Generation from LiDAR Data
Youquan Liu, Lingdong Kong, Weidong Yang +5
Controllable generation of realistic LiDAR scenes is crucial for applications such as autonomous driving and robotics. While recent diffusion-based models achieve high-fidelity LiD…
Veila: Panoramic LiDAR Generation from a Monocular RGB Image
Youquan Liu, Lingdong Kong, Weidong Yang +8
Realistic and controllable panoramic LiDAR data generation is critical for scalable 3D perception in autonomous driving and robotics. Existing methods either perform unconditional…
LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequences
Ao Liang, Youquan Liu, Yu Yang +5
Generative world models have become essential data engines for autonomous driving, yet most existing efforts focus on videos or occupancy grids, overlooking the unique LiDAR proper…
Perspective-Invariant 3D Object Detection
Ao Liang, Lingdong Kong, Dongyue Lu +4
With the rise of robotics, LiDAR-based 3D object detection has garnered significant attention in both academia and industry. However, existing datasets and methods predominantly fo…