14 citations · 39 across the 31 of their papers we have counts for
22 papers · 1 filter
Quo Vadis, World Modeling?
Yu Yang, Xuemeng Yang, Licheng Wen +17
Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to paralleliz…
SPIKE: An Adaptive Dual Controller Framework for Cost-Efficient Long-Horizon Game Agents
Wencan Jiang, Jiangning Zhang, Jianbiao Mei +6
Long-horizon multimodal agents in open-world games must stay goal-directed across many low-level interactions under tight token and latency budgets. Existing approaches often trade…
SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents
Yu Yang, Yue Liao, Jianbiao Mei +11
Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural…
UR-Bench: A Benchmark for Multi-Hop Reasoning over Ultra-High-Resolution Images
Siqi Li, Xinyu Cai, Jianbiao Mei +7
Recent multimodal large language models (MLLMs) show strong capabilities in visual-language reasoning, yet their performance on ultra-high-resolution imagery remains largely unexpl…
Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Models
Jianbiao Mei, Yu Yang, Xuemeng Yang +4
End-to-end autonomous driving systems increasingly rely on vision-centric world models to understand and predict their environment. However, a common ineffectiveness in these model…
IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?
Yang Chen, Minghao Liu, Yufan Shen +18
The webpage-to-code task requires models to understand visual representations of webpages and generate corresponding code. However, existing benchmarks primarily focus on static sc…
3D and 4D World Modeling: A Survey
Lingdong Kong, Yu Yang, Jianbiao Mei +20
World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphas…
X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllability
Yu Yang, Alan Liang, Jianbiao Mei +3
Diffusion models are advancing autonomous driving by enabling realistic data synthesis, predictive end-to-end planning, and closed-loop simulation, with a primary focus on temporal…
DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes
Jianbiao Mei, Tao Hu, Xuemeng Yang +7
Recent advances in diffusion models have improved controllable streetscape generation and supported downstream perception and planning tasks. However, challenges remain in accurate…
DQFormer: Towards Unified LiDAR Panoptic Segmentation with Decoupled Queries
Yu Yang, Jianbiao Mei, Liang Liu +6
LiDAR panoptic segmentation, which jointly performs instance and semantic segmentation for things and stuff classes, plays a fundamental role in LiDAR perception tasks. While most…
Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving
Yu Yang, Jianbiao Mei, Yukai Ma +5
World models envision potential future states based on various ego actions. They embed extensive knowledge about the driving environment, facilitating safe and scalable autonomous…
LiCROcc: Teach Radar for Accurate Semantic Occupancy Prediction using LiDAR and Camera
Yukai Ma, Jianbiao Mei, Xuemeng Yang +6
Semantic Scene Completion (SSC) is pivotal in autonomous driving perception, frequently confronted with the complexities of weather and illumination changes. The long-term strategy…
M2-CLIP: A Multimodal, Multi-task Adapting Framework for Video Action Recognition
Mengmeng Wang, Jiazheng Xing, Boyuan Jiang +6
Recently, the rise of large-scale vision-language pretrained models like CLIP, coupled with the technology of Parameter-Efficient FineTuning (PEFT), has captured substantial attrac…
CR-SFP: Learning Consistent Representation for Soft Filter Pruning
Jingyang Xiang, Zhuangzhi Chen, Jianbiao Mei +3
Soft filter pruning~(SFP) has emerged as an effective pruning technique for allowing pruned filters to update and the opportunity for them to regrow to the network. However, this p…
Camera-based 3D Semantic Scene Completion with Sparse Guidance Network
Jianbiao Mei, Yu Yang, Mengmeng Wang +5
Semantic scene completion (SSC) aims to predict the semantic occupancy of each voxel in the entire 3D scene from limited observations, which is an emerging and critical task for au…
SSC-RS: Elevate LiDAR Semantic Scene Completion with Representation Separation and BEV Fusion
Jianbiao Mei, Yu Yang, Mengmeng Wang +3
Semantic scene completion (SSC) jointly predicts the semantics and geometry of the entire 3D scene, which plays an essential role in 3D scene understanding for autonomous driving s…
PANet: LiDAR Panoptic Segmentation with Sparse Instance Proposal and Aggregation
Jianbiao Mei, Yu Yang, Mengmeng Wang +3
Reliable LiDAR panoptic segmentation (LPS), including both semantic and instance segmentation, is vital for many robotic applications, such as autonomous driving. This work propose…
A Coarse-to-Fine Place Recognition Approach using Attention-guided Descriptors and Overlap Estimation
Chencan Fu, Lin Li, Jianbiao Mei +4
Place recognition is a challenging but crucial task in robotics. Current description-based methods may be limited by representation capabilities, while pairwise similarity-based me…
E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Context
Zizhang Li, Mengmeng Wang, Huaijin Pi +3
Recently, the image-wise implicit neural representation of videos, NeRV, has gained popularity for its promising results and swift speed compared to regular pixel-wise implicit rep…
MaIL: A Unified Mask-Image-Language Trimodal Network for Referring Image Segmentation
Zizhang Li, Mengmeng Wang, Jianbiao Mei +1
Referring image segmentation is a typical multi-modal task, which aims at generating a binary mask for referent described in given language expressions. Prior arts adopt a bimodal…
TransVOS: Video Object Segmentation with Transformers
Jianbiao Mei, Mengmeng Wang, Yeneng Lin +2
Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this tas…
The DongNiao International Birds 10000 Dataset
Jian Mei, Hao Dong
DongNiao International Birds 10000 (DIB-10K) is a challenging image dataset which has more than 10 thousand different types of birds. It was created to enable the study of machine…