ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization

Li Lin, Xiaojun Wan

NVFP4 is a recently introduced hardware-supported FP4 format that improves the fidelity of 4-bit quantization through fine-grained block scales. However, existing NVFP4 scale initi…