Opt-GPTQ: An Optimized GPTQ Combining Sparse Attention and Quantization Techniques

Jie Kong, Junxiang Zhang, Jiheng Xu +7

In the field of deep learning, traditional attention mechanisms face significant challenges related to high computational complexity and large memory consumption when processing lo…