4 papers
MP-ISMoE: Mixed-Precision Interactive Side Mixture-of-Experts for Efficient Transfer Learning
Yutong Zhang, Zimeng Wu, Shangcai Liao +2
Parameter-efficient transfer learning (PETL) has emerged as a pivotal paradigm for adapting pre-trained foundation models to downstream tasks, significantly reducing trainable para…
Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection
Wenhao Li, Zimeng Wu, Yu Wu +2
Unmanned aerial vehicle (UAV) based object detection is a critical but challenging task, when applied in dynamically changing scenarios with limited annotated training data. Layout…
Collaborative Multi-Mode Pruning for Vision-Language Models
Zimeng Wu, Yunhong Wang, Donghao Wang +1
Vision-Language Models (VLMs) have advanced rapidly within the unified Transformer architecture, yet their deployment on resource-constrained devices remains challenging due to hig…
Probe and Skip: Self-Predictive Token Skipping for Efficient Long-Context LLM Inference
Zimeng Wu, Donghao Wang, Chaozhe Jin +2
Long-context inference enhances the reasoning capability of Large Language Models (LLMs), but incurs significant computational overhead. Token-oriented methods, such as pruning and…