158 citations · 419 across the 62 of their papers we have counts for
67 papers
Mem4Act: Learning Effective Latent Memory for Long-Horizon Robotic Manipulation
Yun Zhang, Zhiyu Huang, Tianhui Cai +3
Long-horizon robotic manipulation fundamentally requires memory: agents must retain task-relevant information from past observations and interactions and use it to guide future act…
AutoAgent0: An Agentic Runtime for Safe Closed-Loop Driving
Jiageng Liu, Seth Z. Zhao, Zewei Zhou +9
Safe autonomous driving requires more than accurate planning at a single frame: it demands reliable closed-loop execution in dynamic environments. Although end-to-end driving polic…
SCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation
Dijie Zhu, Seunghun Oh, Ruopeng Huang +3
Reliable performance evaluation is a central bottleneck for deploying robot-learning policies in real-world conditions. Real-world testing is faithful but costly and difficult to s…
Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesis
Chenghao Qian, Nedko Savov, Lingdong Kong +7
Weather synthesis aims to add weather effects to input videos while preserving scene identity, structure, and motion. The key limitation of existing methods is the lack of diversit…
nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving
Zhiyu Huang, Johnson Liu, Rui Song +13
Reasoning is essential for autonomous driving (AD) in long-tail scenarios, where vehicles must apply commonsense knowledge, understand spatial relations, infer agent interactions,…
What-If World: A Causal Benchmark for General World Models in Embodied Scenarios
Kunlin Cai, Rui Song, Jinghuai Zhang +7
Video generation models are increasingly used as world simulators for tasks like driving and robotic manipulation. What matters in these settings is not whether a single video look…
MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems
Marco Coscoy, Zewei Zhou, Seth Z. Zhao +9
Vehicle-to-Everything (V2X) communication has emerged as a promising paradigm for autonomous driving, enabling connected agents to share complementary perception information and ne…
ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
Rui Song, Tianhui Cai, Markus Gross +5
Feedforward 3D Gaussian Splatting (3DGS) often struggles in trajectory-based sparse-view driving scenes. Existing Gaussian repair methods mainly target optimization-based 3DGS, whi…
EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priors
Rui Song, Tianhui Cai, Markus Gross +5
3D Gaussian Splatting (3DGS) has been widely adopted for scene reconstruction, where training inherently constitutes a highly coupled and non-convex optimization problem. Recent wo…
SpanVLA: Learning from Negative-Recovery Samples with Fast Action Bridging for Vision-Language-Action Model
Zewei Zhou, Ruining Yang, Xuewei Qi +9
Vision-Language-Action (VLA) models bring rich world knowledge and reasoning capabilities to autonomous driving. However, most driving VLAs are trained only on positive expert demo…
BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Driving
Seth Z. Zhao, Luobin Wang, Hongwei Ruan +13
Open-loop (OL) to closed-loop (CL) gap (OL-CL gap) exists when OL-pretrained policies scoring high in OL evaluations fail to transfer effectively in closed-loop (CL) deployment. In…
TIC-VLA: A Think-in-Control Vision-Language-Action Model for Robot Navigation in Dynamic Environments
Zhiyu Huang, Yun Zhang, Johnson Liu +3
Robots in dynamic, human-centric environments must follow language instructions while maintaining real-time reactive control. Vision-language-action (VLA) models offer a promising…
MDG: Masked Denoising Generation for Multi-Agent Behavior Modeling in Traffic Environments
Zhiyu Huang, Zewei Zhou, Tianhui Cai +2
Modeling realistic and interactive multi-agent behavior is critical to autonomous driving and traffic simulation. However, existing diffusion and autoregressive approaches are limi…
MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection
Yun Zhang, Zhaoliang Zheng, Johnson Liu +5
Infrastructure-based perception plays a crucial role in intelligent transportation systems, offering global situational awareness and enabling cooperative autonomy. However, existi…
QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception
Seth Z. Zhao, Huizhi Zhang, Zhaowei Li +11
Cooperative perception through Vehicle-to-Everything (V2X) communication offers significant potential for enhancing vehicle perception by mitigating occlusions and expanding the fi…
TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and Prediction
Zewei Zhou, Seth Z. Zhao, Tianhui Cai +3
End-to-end training of multi-agent systems offers significant advantages in improving multi-task performance. However, training such models remains challenging and requires extensi…
Risk Map As Middleware: Towards Interpretable Cooperative End-to-end Autonomous Driving for Risk-Aware Planning
Mingyue Lei, Zewei Zhou, Hongchen Li +2
End-to-end paradigm has emerged as a promising approach to autonomous driving. However, existing single-agent end-to-end pipelines are often constrained by occlusion and limited pe…
CDA-SimBoost: A Unified Framework Bridging Real Data and Simulation for Infrastructure-Based CDA Systems
Zhaoliang Zheng, Xu Han, Yuxin Bao +5
Cooperative Driving Automation (CDA) has garnered increasing research attention, yet the role of intelligent infrastructure remains insufficiently explored. Existing solutions offe…
Beyond 9-to-5: A Generative Model for Augmenting Mobility Data of Underrepresented Shift Workers
Haoxuan Ma, Xishun Liao, Yifan Liu +2
This paper addresses a critical gap in urban mobility modeling by focusing on shift workers, a population segment comprising 15-20% of the workforce in industrialized societies yet…
Next-Generation Travel Demand Modeling with a Generative Framework for Household Activity Coordination
Xishun Liao, Haoxuan Ma, Yifan Liu +4
Travel demand models are critical tools for planning, policy, and mobility system design. Traditional activity-based models (ABMs), although grounded in behavioral theories, often…
RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors
Tianhui Cai, Yun Zhang, Zewei Zhou +2
Online high-definition (HD) map construction is crucial for scaling autonomous driving systems. While Transformer-based methods have become prevalent in online HD map construction,…
MobiVerse: Scaling Urban Mobility Simulation with Hybrid Lightweight Domain-Specific Generator and Large Language Models
Yifan Liu, Xishun Liao, Haoxuan Ma +3
Understanding and modeling human mobility patterns is crucial for effective transportation planning and urban development. Despite significant advances in mobility research, there…
CooperRisk: A Driving Risk Quantification Pipeline with Multi-Agent Cooperative Perception and Prediction
Mingyue Lei, Zewei Zhou, Hongchen Li +2
Risk quantification is a critical component of safe autonomous driving, however, constrained by the limited perception range and occlusion of single-vehicle systems in complex and…
AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
Zewei Zhou, Tianhui Cai, Seth Z. Zhao +4
Recent advancements in Vision-Language-Action (VLA) models have shown promise for end-to-end autonomous driving by leveraging world knowledge and reasoning capabilities. However, c…