11 citations · 24 across the 24 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Scalable Joint Resource Allocation for SLO-Constrained LLM Inference in Heterogeneous GPU Clouds
Jiaming Cheng, Duong Tung Nguyen
Serving large language model (LLM) inference in cloud environments requires jointly optimizing model selection, GPU provisioning, parallelism configuration, and workload routing un…
cs.LG2023
A Bandit Approach to Online Pricing for Heterogeneous Edge Resource Allocation
Jiaming Cheng, Duong Thuy Anh Nguyen, Lele Wang +2
Edge Computing (EC) offers a superior user experience by positioning cloud resources in close proximity to end users. The challenge of allocating edge resources efficiently while m…