LinQuant: Functional Invariances for Low-Precision Linear Recurrences

Neehal Tumma, Philipp Nazari, Rohan Cherukuri +2

Linear recurrences are emerging as practical alternatives to softmax attention in large language models, appearing in both standalone and hybrid architectures. However, despite the…