activity
20232026
most citedIncorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models

3 citations · 3 across the 17 of their papers we have counts for

collaborators

17 papers

cs.NI2026

WirelessOpsAgent: A Benchmark and Agent Design for Action Assurance in Wireless Networks

Zijian Lu, Yiping Zuo, Hao Xu +4

Large language model (LLM) agents are emerging as planners for autonomous wireless network operations. Yet a task answer that is correct at proposal time can still be unsafe at exe…

cs.SE2026

VITAL-RAG: Invariance Race for Context Allocation in Coding Agents

Zijian Lu, Yonghua Lu, Mingcai Chen +4

Coding agents often retrieve code from an entire repository, but only limited evidence can fit into the final model input. Conventional retrieval-augmented generation (RAG) for cod…

cs.CV2026

Prior Directions: Separating Geometric Identification from Behavioral Efficacy in Visual Revision

Weile Gong, Zijian Lu, Mingcai Chen +3

Vision-language models can remain anchored to stale verbal priors even when current visual evidence supports a different answer. We use this controlled revision failure to ask whet…

cs.RO2026

Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories

Xiaomi Robotics Team, Jun Guo, Piaopiao Jin +31

We present Xiaomi-Robotics-1, a foundational vision-language-action (VLA) model capable of (1) following diverse language instructions to perform a wide range of mobile manipulatio…

cs.RO2026

Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Execution

Rui Cai, Jun Guo, Xinze He +20

In this report, we introduce Xiaomi-Robotics-0, an advanced vision-language-action (VLA) model optimized for high performance and fast and smooth real-time execution. The key to ou…

cs.CV2026

Geometric Risk Control for Vision-Language Model OCR

Weile Gong, Zijian Lu, Mingcai Chen +3

Vision-language models (VLMs) enable flexible generative optical character recognition (OCR), while their open-ended decoders can expose wrong but fluent text with weak visual supp…

cs.CV2026

The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation

Chenyu Mu, Xin He, Qu Yang +13

Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-f…

cs.AI2025

FC-MIR: A Mobile Screen Awareness Framework for Intent-Aware Recommendation based on Frame-Compressed Multimodal Trajectory Reasoning

Zhe Yang, Xiaoshuang Sheng, Zhengnan Zhang +5

Identifying user intent from mobile UI operation trajectories is critical for advancing UI understanding and enabling task automation agents. While Multimodal Large Language Models…

cs.CV2025

EMMA: Efficient Multimodal Understanding, Generation, and Editing with a Unified Architecture

Xin He, Longhui Wei, Jianbo Ouyang +3

We propose EMMA, an efficient and unified architecture for multimodal understanding, generation and editing. Specifically, EMMA primarily consists of 1) An efficient autoencoder wi…

cs.CV2025

PSR: Scaling Multi-Subject Personalized Image Generation with Pairwise Subject-Consistency Rewards

Shulei Wang, Longhui Wei, Xin He +4

Personalized generation models for a single subject have demonstrated remarkable effectiveness, highlighting their significant potential. However, when extended to multiple subject…

cs.AI2025

Lang-PINN: From Language to Physics-Informed Neural Networks via a Multi-Agent Framework

Xin He, Liangliang You, Hongduan Tian +3

Physics-informed neural networks (PINNs) provide a powerful approach for solving partial differential equations (PDEs), but constructing a usable PINN remains labor-intensive and e…

cs.CV2025

A Comprehensive Survey on World Models for Embodied AI

Xinqing Li, Xin He, Le Zhang +3

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics,…

cs.CV2025

Mixpert: Mitigating Multimodal Learning Conflicts with Efficient Mixture-of-Vision-Experts

Xin He, Xumeng Han, Longhui Wei +2

Multimodal large language models (MLLMs) require a nuanced interpretation of complex image information, typically leveraging a vision encoder to perceive various visual scenarios.…

cs.CV2024

ViMoE: An Empirical Study of Designing Vision Mixture-of-Experts

Xumeng Han, Longhui Wei, Zhiyang Dou +6

Mixture-of-Experts (MoE) models embody the divide-and-conquer concept and are a promising approach for increasing model capacity, demonstrating excellent scalability across multipl…

cs.CV2024★ 3 cited

Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models

Xin He, Longhui Wei, Lingxi Xie +1

Multimodal Large Language Models (MLLMs) are experiencing rapid growth, yielding a plethora of noteworthy contributions in recent months. The prevailing trend involves adopting dat…

cs.CV2023

Boosting Segment Anything Model Towards Open-Vocabulary Learning

Xumeng Han, Longhui Wei, Xuehui Yu +6

The recent Segment Anything Model (SAM) has emerged as a new paradigmatic vision foundation model, showcasing potent zero-shot generalization and flexible prompting. Despite SAM fi…

cs.CV2023

SemanticBoost: Elevating Motion Generation with Augmented Textual Cues

Xin He, Shaoli Huang, Xiaohang Zhan +2

Current techniques face difficulties in generating motions from intricate semantic descriptions, primarily due to insufficient semantic annotations in datasets and weak contextual…