Mitigating Quantization Errors Due to Activation Spikes in GLU-Based LLMs

Jaewoo Yang, Hayun Kim, Younghoon Kim

Modern large language models (LLMs) have established state-of-the-art performance through architectural improvements, but still require significant computational cost for inference…