18 papers
ReTrace: Rejected-Trajectory Conditioning for Speculative Decoding
Luxi Lin, Zhanpeng Zeng, Shuang Peng +2
Speculative decoding accelerates autoregressive language model inference by having a lightweight draft model propose multiple candidate tokens, which are then verified in parallel…
Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling
Wengyi Zhan, Chenqian Yan, Songwei Liu +2
Unified multimodal models jointly support understanding and generation, but incur substantial redundant computation across tokens, layers, and generation timesteps. Through token-i…
Parallel Vision Token Scheduling for Fast and Accurate Multimodal LMMs Inference
Wengyi Zhan, Mingbao Lin, Zhihang Lin +1
Multimodal large language models (MLLMs) deliver impressive vision-language reasoning but suffer steep inference latency because self-attention scales quadratically with sequence l…
DSNet: Detail-Semantic Deep Supervision Network for Medical Image Segmentation
Zhaohong Huang, Yuxin Zhang, Taojian Zhou +2
Deep Supervision Networks exhibit significant efficacy for the medical imaging community. Nevertheless, existing work merely supervises either the coarse-grained semantic features…
Speculative Decoding Reimagined for Multimodal Large Language Models
Luxi Lin, Zhihang Lin, Zhanpeng Zeng +1
This paper introduces Multimodal Speculative Decoding (MSD) to accelerate Multimodal Large Language Models (MLLMs) inference. Speculative decoding has been shown to accelerate Larg…
CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models
Zhihang Lin, Mingbao Lin, Yuan Xie +1
This paper introduces Completion Pruning Policy Optimization (CPPO) to accelerate the training of reasoning models based on Group Relative Policy Optimization (GRPO). GRPO, while e…