H-Scale: Hessian-Guided Scale Refinement for NVFP4 Sub-Byte LLM Inference

Hao Yu, Zheng Li, Dayiheng Liu +1

The NVIDIA Blackwell architecture, with native support for the ultra-fine-grained NVFP4 format, opens new opportunities for accelerating large language model (LLM) inference. NVFP4…