230 citations · 331 across the 19 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2024
ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking
Wenshuo Li, Xinghao Chen, Han Shu +2
Large language models (LLM) have recently attracted significant attention in the field of artificial intelligence. However, the training process of these models poses significant c…
cs.LG2021
Winograd Algorithm for AdderNet
Wenshuo Li, Hanting Chen, Mingqiang Huang +3
Adder neural network (AdderNet) is a new kind of deep model that replaces the original massive multiplications in convolutions by additions while preserving the high performance. S…
cs.LG2017★ 230 cited
Exploring the Regularity of Sparse Structure in Convolutional Neural Networks
Huizi Mao, Song Han, Jeff Pool +4
Sparsity helps reduce the computational complexity of deep neural networks by skipping zeros. Taking advantage of sparsity is listed as a high priority in next generation DNN accel…