LoRaQ: Optimized Low Rank Approximation for 4-bit Quantization

Yann Bouquet, Alireza Khodamoradi, Sophie Yáng Shen +2

Post-training quantization (PTQ) is essential for deploying large diffusion transformers on resource-constrained hardware, but aggressive 4-bit quantization significantly degrades…