3 papers
cs.DC2025
PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization
Kelun Lei, Hailong Yang, Huaitao Zhang +5
Designing high-performance kernels requires expert-level tuning and a deep understanding of hardware characteristics. Recent advances in large language models (LLMs) have enabled a…
cs.DC2025
LOw-cOst yet High-Performant Sparse Matrix-Matrix Multiplication on Arm SME Architectures
Kelun Lei, Hailong Yang, Kaige Zhang +8
Sparse matrix-dense matrix multiplication (SpMM) is a critical kernel in both scientific computing and emerging graph learning workloads. The recent Armv9 architecture introduces S…
cs.DC2024
Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution
Siqi Wang, Hailong Yang, Xuezhu Wang +10
Large language models (LLM) have recently attracted surging interest due to their outstanding capabilities across various domains. However, enabling efficient LLM inference is chal…