Quadapter: Adapter for GPT-2 Quantization

Minseop Park, Jaeseong You, Markus Nagel +1

Transformer language models such as GPT-2 are difficult to quantize because of outliers in activations leading to a large quantization error. To adapt to the error, one must use qu…