29 citations · 46 across the 25 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.DC2024★ 6 cited
PerLLM: Personalized Inference Scheduling with Edge-Cloud Collaboration for Diverse LLM Services
Zheming Yang, Yuanhao Yang, Chang Zhao +3
With the rapid growth in the number of large language model (LLM) users, it is difficult for bandwidth-constrained cloud servers to simultaneously process massive LLM services in r…
cs.DC2024★ 1 cited
DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers
Xuanlei Zhao, Shenggan Cheng, Chang Chen +4
Scaling multi-dimensional transformers to long sequences is indispensable across various domains. However, the challenges of large memory requirements and slow speeds of such seque…