13 papers
InJePA: Intention-First Latent Planning with Coupled JEPA World Models for Visual Navigation
Siming Zhou, Bowen Ma, Ruiran Du +7
Visual navigation requires goal directed planning informed by predictions of environment dynamics. Representative navigation world model methods propose complete action candidates…
MoR-MLLM: Mixture of Recursions for Efficient Multimodal Large Language Models
Pengcheng Zheng, Chaoning Zhang, Jiaxin Yan +8
Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities across vision and language tasks. However, their massive computational and memory deman…
When and What to Teach: Budget-Aware Online Adaptation for Web Agents
Jianwei Zhang, Sihan Cao, Pengcheng Zheng +7
Web agents have achieved significant success in automating complex internet tasks but deploying them in real-world environments requires continuous online adaptation. Given that de…
Lightweight LLM Agent Memory with Small Language Models
Jiaquan Zhang, Chaoning Zhang, Shuxu Chen +9
Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions…
Relaxing Anchor-Frame Dominance for Mitigating Hallucinations in Video Large Language Models
Zijian Liu, Sihan Cao, Pengcheng Zheng +5
Recent Video Large Language Models (Video-LLMs) have demonstrated strong capability in video understanding, yet they still suffer from hallucinations. Existing mitigation methods t…
Immunizing 3D Gaussian Generative Models Against Unauthorized Fine-Tuning via Attribute-Space Traps
Jianwei Zhang, Sihan Cao, Chaoning Zhang +7
Recent large-scale generative models enable high-quality 3D synthesis. However, the public accessibility of pre-trained weights introduces a critical vulnerability. Adversaries can…
RCP: Representation Consistency Pruner for Mitigating Distribution Shift in Large Vision-Language Models
Jianwei Zhang, Chaoning Zhang, Sihan Cao +7
Large Vision-Language Models (LVLMs) suffer from prohibitive inference costs due to the massive number of visual tokens processed by the language decoder. Existing pruning methods…
Topology-Aware Layer Pruning for Large Vision-Language Models
Pengcheng Zheng, Chaoning Zhang, Ya Wen +10
Large Language Models (LLMs) have demonstrated strong capabilities in natural language understanding and reasoning, while recent extensions that incorporate visual inputs enable th…
TDA-RC: Task-Driven Alignment for Knowledge-Based Reasoning Chains in Large Language Models
Jiaquan Zhang, Qigan Sun, Chaoning Zhang +11
Enhancing the reasoning capability of large language models (LLMs) remains a core challenge in natural language processing. The Chain-of-Thought (CoT) paradigm dominates practical…
Language-Guided Token Compression with Reinforcement Learning in Large Vision-Language Models
Sihan Cao, Jianwei Zhang, Pengcheng Zheng +7
Large Vision-Language Models (LVLMs) incur substantial inference costs due to the processing of a vast number of visual tokens. Existing methods typically struggle to model progres…
Learning Global Hypothesis Space for Enhancing Synergistic Reasoning Chain
Jiaquan Zhang, Chaoning Zhang, Shuxu Chen +9
Chain-of-Thought (CoT) has been shown to significantly improve the reasoning accuracy of large language models (LLMs) on complex tasks. However, due to the autoregressive, step-by-…
LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Models
Pengcheng Zheng, Chaoning Zhang, Jiarong Mo +8
Large multimodal models (LMMs) have achieved impressive performance on various vision-language tasks, but their substantial computational and memory costs hinder their practical de…
GRASP: Guided Region-Aware Sparse Prompting for Adapting MLLMs to Remote Sensing
Qigan Sun, Chaoning Zhang, Jianwei Zhang +8
In recent years, Multimodal Large Language Models (MLLMs) have made significant progress in visual question answering tasks. However, directly applying existing fine-tuning methods…