JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization

Kaicheng Yang, Kaisen Yang, Chunyu Liu +8

Recent generative models have become increasingly powerful, but their inference cost continues to grow. Model quantization offers a promising way to compress these models and accel…