Big2Small: A Unifying Neural Network Framework for Model Compression

Jing-Xiao Liao, Haoran Wang, Tao Li +4

With the development of foundational models, model compression has become a critical requirement. Various model compression approaches have been proposed such as low-rank decomposi…