187 citations · 649 across the 22 of their papers we have counts for
23 papers
Symphony: Optimized DNN Model Serving using Deferred Batch Scheduling
Lequn Chen, Weixin Deng, Anirudh Canumalla +4
Having large batch sizes is one of the most critical aspects of increasing the accelerator efficiency and the performance of DNN model inference. However, existing model serving sy…
Bandwidth Optimal Pipeline Schedule for Collective Communication
Liangyu Zhao, Arvind Krishnamurthy
We present a strongly polynomial-time algorithm to generate bandwidth optimal allgather/reduce-scatter on any network topology, with or without switches. Our algorithm constructs p…
TSoR: TCP Socket over RDMA Container Network for Cloud Native Computing
Yulin Sun, Qingming Qu, Chenxingyu Zhao +3
Cloud-native containerized applications constantly seek high-performance and easy-to-operate container network solutions. RDMA network is a potential enabler with higher throughput…
Dissecting Service Mesh Overheads
Xiangfeng Zhu, Guozhen She, Bowen Xue +9
Service meshes play a central role in the modern application ecosystem by providing an easy and flexible way to connect different services that form a distributed application. Howe…
Efficient Direct-Connect Topologies for Collective Communications
Liangyu Zhao, Siddharth Pal, Tapan Chugh +5
We consider the problem of distilling efficient network topologies for collective communications. We provide an algorithmic framework for constructing direct-connect topologies opt…
SuperNIC: A Hardware-Based, Programmable, and Multi-Tenant SmartNIC
Yizhou Shan, Will Lin, Ryan Kosta +2
With CPU scaling slowing down in today's data centers, more functionalities are being offloaded from the CPU to auxiliary devices. One such device is the SmartNIC, which is being i…