ShamAN-Q: Shampoo Augmented NanoQuant for Sub-1-bit LLM Weights

Jonathan Mei, Sang Hyub Kim, Oliver Knitter +2

We introduce ShamAN-Q, a sub-1-bit post-training quantization method that extends NanoQuant by replacing each its diagonal reconstruction geometry with a tractable dense curvature…