6 citations · 9 across the 11 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.DC2024★ 2 cited
Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow
Yixuan Mei, Yonghao Zhuang, Xupeng Miao +3
This paper introduces Helix, a distributed system for high-throughput, low-latency large language model (LLM) serving in heterogeneous GPU clusters. The key idea behind Helix is to…
cs.PF2024★ 1 cited
Can Increasing the Hit Ratio Hurt Cache Throughput? (Long Version)
Ziyue Qiu, Juncheng Yang, Mor Harchol-Balter
Software caches are an intrinsic component of almost every computer system. Consequently, caching algorithms, particularly eviction policies, are the topic of many papers. Almost a…