Showing cs.DCShow all
2 papers · 1 filter
cs.DC2024
INSPIRIT: Optimizing Heterogeneous Task Scheduling through Adaptive Priority in Task-based Runtime Systems
Yiqing Wang, Xiaoyan Liu, Hailong Yang +5
As modern HPC computing platforms become increasingly heterogeneous, it is challenging for programmers to fully leverage the computation power of massive parallelism offered by suc…
cs.DC2024
Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution
Siqi Wang, Hailong Yang, Xuezhu Wang +10
Large language models (LLM) have recently attracted surging interest due to their outstanding capabilities across various domains. However, enabling efficient LLM inference is chal…