Yu Gong

activity

20222026

most citedHALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks

15 citations · 17 across the 8 of their papers we have counts for

collaborators

Showing 2024Show all

2 papers · 1 filter

cs.LG2024

MoE-I $^{2}$ : Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition

Cheng Yang, Yang Sui, Jinqi Xiao +7

The emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models. Compared to traditional LLMs, MoE LLMs outperform traditional LLMs by…

cs.CV2024

ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks

Yang Sui, Miao Yin, Yu Gong +3

Low-rank compression, a popular model compression technique that produces compact convolutional neural networks (CNNs) with low rankness, has been well-studied in the literature. O…

MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition

ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks

MoE-I $^{2}$ : Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition