ML-Triton, A Multi-Level Compilation and Language Extension to Triton GPU Programming

Dewei Wang, Wei Zhu, Liyang Ling +5

In the era of LLMs, dense operations such as GEMM and MHA are critical components. These operations are well-suited for parallel execution using a tilebased approach. While traditi…