D-com: Accelerating Iterative Processing to Enable Low-rank Decomposition of Activations

Faraz Tahmasebi, Michael Pelluer, Hyoukjun Kwon

The computation and memory costs of large language models kept increasing over last decade, which reached over the scale of 1T parameters. To address the challenges from the large…