76 citations · 107 across the 6 of their papers we have counts for
9 papers
Koi: Evidence-Guided, Self-Calibrating Planning for Multi-Cloud, Heterogeneous LLM Inference Fleets
Mankeerat Sidhu, Gangmuk Lim, Hetarth Chopra +10
Deploying a large language model (LLM) requires choosing the right accelerator, parallelization strategy, engine configuration, and replica count amongst ~140 other variables acros…
SafePar: Monitoring Asynchrony in Microservices
Karuna Grewal, P. Brighten Godfrey, Justin Hsu +1
Modern cloud applications are built from loosely-coupled microservices that coordinate through well-defined APIs to service user requests. A single API request often triggers multi…
SafeNom: Data-Aware Microservice Policies
Karuna Grewal, P. Brighten Godfrey, Justin Hsu
Many cloud-based applications are organized as loosely coupled microservices, where invoking a service's API triggers a cascade of APIs across many services and leads to inter-serv…
Flock: Accurate network fault localization at scale
Vipul Harsh, Tong Meng, Kapil Agrawal +1
Inferring the root cause of failures among thousands of components in a data center network is challenging, especially for "gray" failures that are not reported directly by switche…
Measuring and Understanding Throughput of Network Topologies
Sangeetha Abdu Jyothi, Ankit Singla, P. Brighten Godfrey +1
High throughput is of particular interest in data center and HPC networks. Although myriad network topologies have been proposed, a broad head-to-head comparison across topologies…
Low latency via redundancy
Ashish Vulimiri, P. Brighten Godfrey, Radhika Mittal +3
Low latency is critical for interactive networked applications. But while we know how to scale systems to increase capacity, reducing latency --- especially the tail of the latency…
Finishing Flows Quickly with Preemptive Scheduling
Chi-Yao Hong, Matthew Caesar, P. Brighten Godfrey
Today's data centers face extreme challenges in providing low latency. However, fair sharing, a principle commonly adopted in current congestion control protocols, is far from opti…
Shortest Paths in Less Than a Millisecond
Rachit Agarwal, Matthew Caesar, P. Brighten Godfrey +1
We consider the problem of answering point-to-point shortest path queries on massive social networks. The goal is to answer queries within tens of milliseconds while minimizing the…
Slick Packets
Giang T. K. Nguyen, Rachit Agarwal, Junda Liu +3
Source-controlled routing has been proposed as a way to improve flexibility of future network architectures, as well as simplifying the data plane. However, if a packet specifies i…