27 citations · 29 across the 3 of their papers we have counts for
3 papers
cs.DB2025
Category-Aware Semantic Caching for Heterogeneous LLM Workloads
Chen Wang, Xunzhuo Liu, Yue Zhu +3
LLM serving systems process heterogeneous query workloads where different categories exhibit different characteristics. Code queries cluster densely in embedding space while conver…
cs.DC2024★ 2 cited
Transforming the Hybrid Cloud for Emerging AI Workloads
Deming Chen, Alaa Youssef, Ruchi Pendse +42
This white paper, developed through close collaboration between IBM Research and UIUC researchers within the IIDAI Institute, envisions transforming hybrid cloud systems to meet th…
stat.ML2018★ 27 cited
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD
Sanghamitra Dutta, Gauri Joshi, Soumyadip Ghosh +2
Distributed Stochastic Gradient Descent (SGD) when run in a synchronous manner, suffers from delays in waiting for the slowest learners (stragglers). Asynchronous methods can allev…