FreeAct: Freeing Activations for LLM Quantization

Xiaohao Liu, Xiaobo Xia, Manyi Zhang +6

Quantization is pivotal for mitigating the significant memory and computational overhead of Large Language Models (LLMs). While emerging transformation-based methods have successfu…