BiLoCo: Binary Low-Rank Corrections for Post-Training Quantization

David Jin, Beshr IslamBouli, Tarushii Goel +2

Post-training quantization (PTQ) to FP4 has emerged as a key technique for reducing large language model inference cost, especially on Blackwell GPUs, which offer native FP4 tensor…