An Overview of Low-Rank Structures in the Training and Adaptation of Large Models

Laura Balzano, Tianjiao Ding, Benjamin D. Haeffele +5

The substantial computational demands of modern large-scale deep learning present significant challenges for efficient training and deployment. Recent research has revealed a wides…