3 papers
cs.DC2024
Towards Fast Setup and High Throughput of GPU Serverless Computing
Han Zhao, Weihao Cui, Quan Chen +6
Integrating GPUs into serverless computing platforms is crucial for improving efficiency. However, existing solutions for GPU-enabled serverless computing platforms face two signif…
cs.DC2024
OTAS: An Elastic Transformer Serving System via Token Adaptation
Jinyu Chen, Wenchao Xu, Zicong Hong +4
Transformer model empowered architectures have become a pillar of cloud services that keeps reshaping our society. However, the dynamic query loads and heterogeneous user requireme…
cs.LG2023
STAG: Enabling Low Latency and Low Staleness of GNN-based Services with Dynamic Graphs
Jiawen Wang, Quan Chen, Deze Zeng +3
Many emerging user-facing services adopt Graph Neural Networks (GNNs) to improve serving accuracy. When the graph used by a GNN model changes, representations (embedding) of nodes…