Adaptive Block-Scaled Data Types

Jack Cook, Hyemin S. Lee, Kathryn Le +4

NVFP4 has grown increasingly popular as a 4-bit format for quantizing large language models due to its hardware support and its ability to retain useful information with relatively…