3 papers
cs.DC2026
Space Filling Curves is All You Need: Communication-Avoiding Matrix Multiplication Made Simple
Evangelos Georganas, Alexander Heinecke, Pradeep Dubey
General Matrix Multiplication (GEMM) is the cornerstone of HPC workloads and Deep Learning. State-of-the-art vendor libraries tune tensor layouts, parallelization schemes, and cach…
cs.AI2025
Pushing the Envelope of LLM Inference with Ultra-Low-Bit Quantized Models
Evangelos Georganas, Dhiraj Kalamkar, Alexander Heinecke +1
The advent of ultra-low-bit LLM models, approaching the perplexity and task accuracy of their full precision counterparts, is ushering in a new era of LLM inference. While these ad…
cs.LG2023★ 9 cited
Microscaling Data Formats for Deep Learning
Bita Darvish Rouhani, Ritchie Zhao, Ankit More +30
Narrow bit-width data formats are key to reducing the computational and storage costs of modern deep learning applications. This paper evaluates Microscaling (MX) data formats that…