4 papers
AutoLALA: Automatic Loop Algebraic Locality Analysis for AI and HPC Kernels
Yifan Zhu, Yekai Pan, Yanghui Wu +1
Data movement is the primary bottleneck in modern computing systems. For loop-based programs common in high-performance computing (HPC) and AI workloads, including matrix multiplic…
Fully Symbolic Analysis of Loop Locality: Using Imaginary Reuse to Infer Real Performance
Yifan Zhu, Yekai Pan, Chen Ding +1
This paper presents a new theory of locality and its compiler support. The theory is fully symbolic and derives locality as polynomials, and the compiler analysis supports affine l…
Sawtooth Wavefront Reordering: Enhanced CuTile FlashAttention on NVIDIA GB10
Yifan Zhu, Yekai Pan, Chen Ding
High-performance attention kernels are essential for Large Language Models. This paper presents analysis of CuTile-based Flash Attention memory behavior and a technique to improve…
Scalable CP Decomposition for Tensor Learning using GPU Tensor Cores
Zeliang Zhang, Zhuo Liu, Susan Liang +4
CP decomposition is a powerful tool for data science, especially gene analysis, deep learning, and quantum computation. However, the application of tensor decomposition is largely…