activity
20212026
most citedA Survey on Multimodal Large Language Models for Autonomous Driving

27 citations · 62 across the 21 of their papers we have counts for

collaborators

21 papers

cs.RO2026

Controllable Sim Agents with Behavior Latents

Juanwu Lu, Junyu Zhu, Ziran Wang

Realistic traffic simulation requires agents that imitate logged behavior and can also be steered along interpretable axes. Such controllability enables engineers to isolate variab…

cs.LG2026

On Variance Reduction in Learning Mean Flows

Juanwu Lu, Ziran Wang

One-step generative modeling has emerged as a leading approach for amortizing the inference cost of diffusion and flow-matching models. Among distillation-free methods, MeanFlow tr…

cs.RO2026

OmniV2X: A Generative Foundation Planner for Efficient End-to-End Cooperative Driving

Juntong Peng, Juanwu Lu, Yupeng Zhou +3

We present OmniV2X, a generative foundation model for vehicle-to-everything (V2X) cooperative driving. The model directly interprets independent context sequences comprising multi-…

cs.LG2026

Model Merging on Loss Landscape: A Geometry Perspective

Juanwu Lu, Anand Bhaskar, Brian Axelrod +2

Model merging offers a promising avenue for knowledge integration and parallel development without retraining. Yet, existing methods either ignore the geometry of the loss landscap…

cs.LG2026

Analytical Correction for Subsampling Bias in Drifting Models

Jiaru Zhang, Zeyun Deng, Juanwu Lu +2

Drifting models are capable one-step generative models trained to follow a drifting field. The field combines attractive and repulsive softmax-weighted centroids over the data and…

cs.LG2026

Mollified Value Learning

Hrishikesh Viswanath, Juanwu Lu, S. Talha Bukhari +4

Offline goal-conditioned reinforcement learning (GCRL) learns goal-reaching behaviors from static datasets, but accurate value estimation remains challenging under limited state-ac…

astro-ph.IM2025★ 1 cited

AstroMMBench: A Benchmark for Evaluating Multimodal Large Language Models Capabilities in Astronomy

Jinghang Shi, Xiaoyu Tang, Yang Huang +4

Astronomical image interpretation presents a significant challenge for applying multimodal large language models (MLLMs) to specialized scientific tasks. Existing benchmarks focus…

cs.RO2025

SIMSplat: Language-Aligned 4D Gaussian Splatting for Driving Scenario Generation

Sung-Yeon Park, Adam Lee, Juanwu Lu +6

Driving scene manipulation using real-world sensor data has emerged as a promising alternative to traditional driving simulators. Despite advances in language control and neural sc…

cs.RO2025

On Learning Closed-Loop Probabilistic Multi-Agent Simulator

Juanwu Lu, Rohit Gupta, Ahmadreza Moradipari +3

The rapid iteration of autonomous vehicle (AV) deployments leads to increasing needs for building realistic and scalable multi-agent traffic simulators for efficient evaluation. Re…

cs.RO2025

A Hierarchical Test Platform for Vision Language Model (VLM)-Integrated Real-World Autonomous Driving

Yupeng Zhou, Can Cui, Juntong Peng +5

Vision-Language Models (VLMs) have demonstrated notable promise in autonomous driving by offering the potential for multimodal reasoning through pretraining on extensive image-text…

cs.LG2025

Accelerating Inference of Discrete Autoregressive Normalizing Flows by Selective Jacobi Decoding

Jiaru Zhang, Juanwu Lu, Xiaoyu Wu +2

Discrete normalizing flows are promising generative models with advantages such as analytical log-likelihood computation and end-to-end training. However, the architectural constra…

cs.RO2024★ 1 cited

LLM4AD: Large Language Models for Autonomous Driving -- Concept, Review, Benchmark, Experiments, and Future Trends

Can Cui, Yunsheng Ma, Sung-Yeon Park +14

With the broader adoption and highly successful development of Large Language Models (LLMs), there has been growing interest and demand for applying LLMs to autonomous driving tech…

cs.CV2024

Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixture

Juanwu Lu, Can Cui, Yunsheng Ma +2

Safety and robustness are crucial factors in developing trustworthy autonomous vehicles. One essential aspect of addressing these factors is to equip vehicles with the capability t…

cs.AI2024★ 1 cited

Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach

Juanwu Lu, Wei Zhan, Masayoshi Tomizuka +1

Estimating the potential behavior of the surrounding human-driven vehicles is crucial for the safety of autonomous vehicles in a mixed traffic flow. Recent state-of-the-art achieve…

cs.AI2023★ 9 cited

Personalized Autonomous Driving with Large Language Models: Field Experiments

Can Cui, Zichong Yang, Yupeng Zhou +6

Integrating large language models (LLMs) in autonomous vehicles enables conversation with AI systems to drive the vehicle. However, it also emphasizes the requirement for such syst…

cs.CL2023★ 1 cited

LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs

Yunsheng Ma, Can Cui, Xu Cao +9

Autonomous driving (AD) has made significant strides in recent years. However, existing frameworks struggle to interpret and execute spontaneous user instructions, such as "overtak…

cs.AI2023★ 27 cited

A Survey on Multimodal Large Language Models for Autonomous Driving

Can Cui, Yunsheng Ma, Xu Cao +18

With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive th…

cs.CV2023

MACP: Efficient Model Adaptation for Cooperative Perception

Yunsheng Ma, Juanwu Lu, Can Cui +4

Vehicle-to-vehicle (V2V) communications have greatly enhanced the perception capabilities of connected and automated vehicles (CAVs) by enabling information sharing to "see through…

cs.CV2023★ 2 cited

Radar Enlighten the Dark: Enhancing Low-Visibility Perception for Automated Vehicles with Camera-Radar Fusion

Can Cui, Yunsheng Ma, Juanwu Lu +1

Sensor fusion is a crucial augmentation technique for improving the accuracy and reliability of perception systems for automated vehicles under diverse driving conditions. However,…

cs.LG2022★ 6 cited

Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representation

Juanwu Lu, Wei Zhan, Masayoshi Tomizuka +1

Trajectory prediction is one of the essential tasks for autonomous vehicles. Recent progress in machine learning gave birth to a series of advanced trajectory prediction algorithms…

cs.LG2021★ 14 cited

An Automated Machine Learning (AutoML) Method for Driving Distraction Detection Based on Lane-Keeping Performance

Chen Chai, Juanwu Lu, Xuan Jiang +2

With the enrichment of smartphones, driving distractions caused by phone usages have become a threat to driving safety. A promising way to mitigate driving distractions is to detec…