LoopQuant: Accurate and Efficient Post-Training Quantization for Looped Transformers

Zhixiong Zhao, Zukang Xu, Xing Hu +3

Looped Language Models (LoopLMs) improve parameter efficiency by recursively reusing shared Transformer modules, yet their repeated computation over evolving recurrent states poses…