Showing 2025Show all
2 papers · 1 filter
cs.DC2025
WarmServe: Enabling One-for-Many GPU Prewarming for Multi-LLM Serving
Chiheng Lou, Sheng Qi, Rui Kang +5
Deploying multiple models within shared GPU clusters is a key strategy to improve resource efficiency in large language model (LLM) serving. Existing multi-LLM serving systems impr…
cs.CV2025
A Separable Self-attention Inspired by the State Space Model for Computer Vision
Juntao Zhang, Shaogeng Liu, Kun Bian +5
Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still de…