3 papers
cs.LG2025
Ada-MoGE: Adaptive Mixture of Gaussian Expert Model for Time Series Forecasting
Zhenliang Ni, Xiaowen Ma, Zhenkai Wu +3
Multivariate time series forecasts are widely used, such as industrial, transportation and financial forecasts. However, the dominant frequencies in time series may shift with the…
cs.CV2025
ViSpec: Accelerating Vision-Language Models with Vision-Aware Speculative Decoding
Jialiang Kang, Han Shu, Wenshuo Li +2
Speculative decoding is a widely adopted technique for accelerating inference in large language models (LLMs), yet its application to vision-language models (VLMs) remains underexp…
cs.LG2025
Expert Merging: Model Merging with Unsupervised Expert Alignment and Importance-Guided Layer Chunking
Dengming Zhang, Xiaowen Ma, Zhenliang Ni +4
Model merging, which combines multiple domain-specialized experts into a single model, offers a practical path to endow Large Language Models (LLMs) and Multimodal Large Language M…