Characterizing the Impact of NVFP4 Quantization for Low-Power Edge AI Deployment

Ovishake Sen, Venkata Nithin Kamineni, Daniel Lobo +3

Energy-efficient neural-network inference at the edge requires reducing arithmetic cost, memory traffic, computation energy, and storage overhead while maintaining acceptable accur…