2 citations · 4 across the 9 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.DC2025
Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms
Yaozheng Zhang, Wei Wang, Jie Kong +5
The increasing adoption of large language models (LLMs) on heterogeneous computing platforms poses significant challenges to achieving high inference efficiency. To address these e…
cs.DC2025
HAP: Hybrid Adaptive Parallelism for Efficient Mixture-of-Experts Inference
Haoran Lin, Xianzhi Yu, Kang Zhao +7
Current inference systems for Mixture-of-Experts (MoE) models primarily employ static parallelization strategies. However, these static approaches cannot consistently achieve optim…