activity
20232026
most citedCloud Native System for LLM Inference Serving

1 citations · 3 across the 7 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.DC2023

Resource Management for GPT-based Model Deployed on Clouds: Challenges, Solutions, and Future Directions

Yongkang Dang, Minxian Xu, Kejiang Ye

The widespread adoption of the large language model (LLM), e.g. Generative Pre-trained Transformer (GPT), deployed on cloud computing environment (e.g. Azure) has led to a huge inc…