4 papers
KramaBench: A Benchmark for AI Systems on Data-to-Insight Pipelines over Data Lakes
Eugenie Lai, Gerardo Vitagliano, Ziyu Zhang +16
Discovering insights from a real-world data lake potentially containing unclean, semi-structured, and unstructured data requires a variety of data processing tasks, ranging from ex…
MonkeyTree: Near-Minimal Congestion for Multi-tenant Training via Migration
Anton A. Zabreyko, Weiyang Wang, Manya Ghobadi
We present MonkeyTree, the first system to mitigate network congestion in multi-tenant GPU clusters through job-migration based defragmentation rather than network-layer techniques…
Prediction-Guided Control in Data Center Networks
Kevin Zhao, Chenning Li, Anton A. Zabreyko +7
In this paper, we design, implement, and evaluate Polyphony, a system to give network operators a new way to control and reduce the frequency of poor tail latency events in multi-c…
m4: A Learned Flow-level Network Simulator
Chenning Li, Anton A. Zabreyko, Arash Nasr-Esfahany +4
Flow-level simulation is widely used to model large-scale data center networks due to its scalability. Unlike packet-level simulators that model individual packets, flow-level simu…