OCGQuant: Outlier-Companion Grouping for NVFP4 Quantization

Yishan Yao, Binjun Li, Hanling Yi +5

NVFP4 is an efficient microscaling format for low-bit inference, but activation outliers can still degrade quantization accuracy within NVFP4 blocks. Within each quantization block…