Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers

Junhan Kim, Chungman Lee, Eulrang Cho +4

With the increasing complexity of generative AI models, post-training quantization (PTQ) has emerged as a promising solution for deploying hyper-scale models on edge devices such a…