FalconGEMM: Surpassing Hardware Peaks with Lower-Complexity Matrix Multiplication

Honglin Zhu, Jiaping Cao, Jiang Shao +10

Peak breaking Matrix Multiplication is a promising technique to improve the performance of DL, especially in LLM training and inference. We present FalconGEMM, a cross-platform fra…