SWSC: Shared Weight for Similar Channel in LLM

Binrui Zeng, Yongtao Tang, Xiaodong Liu +1

Large language models (LLMs) have spurred development in multiple industries. However, the growing number of their parameters brings substantial storage and computing burdens, maki…