961 citations · 1.4k across the 33 of their papers we have counts for
3 papers · 1 filter
Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification
Saurabh Agarwal, Hongyi Wang, Kangwook Lee +2
Distributed model training suffers from communication bottlenecks due to frequent model updates transmitted across compute nodes. To alleviate these bottlenecks, practitioners use…
Move Fast and Meet Deadlines: Fine-grained Real-time Stream Processing with Cameo
Le Xu, Shivaram Venkataraman, Indranil Gupta +2
Resource provisioning in multi-tenant stream processing systems faces the dual challenges of keeping resource utilization high (without over-provisioning), and ensuring performance…
Accelerating Deep Learning Inference via Freezing
Adarsh Kumar, Arjun Balasubramanian, Shivaram Venkataraman +1
Over the last few years, Deep Neural Networks (DNNs) have become ubiquitous owing to their high accuracy on real-world tasks. However, this increase in accuracy comes at the cost o…