10 citations · 16 across the 8 of their papers we have counts for
Showing 2024 · cs.DCShow all
2 papers · 2 filters
cs.DC2024★ 2 cited
FaaSTube: Optimizing GPU-oriented Data Transfer for Serverless Computing
Hao Wu, Junxiao Deng, Minchen Yu +5
Serverless computing has gained significant traction for machine learning inference applications, which are often deployed as serverless workflows consisting of multiple CPU and GP…
cs.DC2024★ 1 cited
CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference
Suyi Li, Hanfeng Lu, Tianyuan Wu +6
Pre-trained large language models (LLMs) often need specialization for domain-specific tasks. Low-Rank Adaptation (LoRA) is a popular approach that adapts a base model to multiple…