4 papers
pper and Lower Bounds for Blow-up Times in Coupled Reaction--Diffusion Systems with Nonlocal Sources
Xin Zhao, Aynuer Ailatusi, Xianfa Song +1
In this paper, we consider the following reaction-diffusion system \begin{equation*} \begin{cases} u_t=Δu+F\bigl(x,t,u,v,V(t)\bigr), & (x,t)\in\Om\times(0,T), v_t=Δv+G\bigl(x,t,u,v…
KUBEDIRECT: Unleashing the Full Power of the Cluster Manager for Serverless Computing
Sheng Qi, Zhiquan Zhang, Xuanzhe Liu +1
FaaS platforms rely on cluster managers like Kubernetes for resource management. Kubernetes is popular due to its state-centric APIs that decouple the control plane into modular co…
WarmServe: Enabling One-for-Many GPU Prewarming for Multi-LLM Serving
Chiheng Lou, Sheng Qi, Rui Kang +5
Deploying multiple models within shared GPU clusters is a key strategy to improve resource efficiency in large language model (LLM) serving. Existing multi-LLM serving systems impr…
HydraServe: Minimizing Cold Start Latency for Serverless LLM Serving in Public Clouds
Chiheng Lou, Sheng Qi, Chao Jin +5
With the proliferation of large language model (LLM) variants, developers are turning to serverless computing for cost-efficient LLM deployment. However, public cloud providers oft…