1 citations · 1 across the 4 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2024★ 1 cited
Aladdin: Joint Placement and Scaling for SLO-Aware LLM Serving
Chengyi Nie, Rodrigo Fonseca, Zhenhua Liu
The demand for large language model (LLM) inference is gradually dominating the artificial intelligence workloads. Therefore, there is an urgent need for cost-efficient inference s…
cs.DC2024
Training DNN Models over Heterogeneous Clusters with Optimal Performance
Chengyi Nie, Jessica Maghakian, Zhenhua Liu
Adjusting batch sizes and adaptively tuning other hyperparameters can significantly speed up deep neural network (DNN) training. Despite the ubiquity of heterogeneous clusters, exi…