1 citations · 1 across the 3 of their papers we have counts for
3 papers
Power Aware Dynamic Reallocation For Inference
Yiwei Jiang, Sangeeta Chowdhary, Nathaniel Morris +3
Disaggregation has emerged as a powerful strategy for optimizing large language model (LLM) inference by separating compute-intensive prefill and memory-bound decode phases across…
PipeTune: Pipeline Parallelism of Hyper and System Parameters Tuning for Deep Learning Clusters
Isabelly Rocha, Nathaniel Morris, Lydia Y. Chen +3
DNN learning jobs are common in today's clusters due to the advances in AI driven services such as machine translation and image recognition. The most critical phase of these jobs…
Measuring and Managing Answer Quality for Online Data-Intensive Services
Jaimie Kelley, Christopher Stewart, Nathaniel Morris +3
Online data-intensive services parallelize query execution across distributed software components. Interactive response time is a priority, so online query executions return answer…