66 citations · 102 across the 9 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022★ 2 cited
Compressing Models with Few Samples: Mimicking then Replacing
Huanyu Wang, Junjie Liu, Xin Ma +3
Few-sample compression aims to compress a big redundant model into a small compact one with only few samples. If we fine-tune models with these limited few samples directly, models…
cs.LG2020★ 27 cited
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers
Junjie Liu, Zhe Xu, Runbin Shi +2
We present a novel network pruning algorithm called Dynamic Sparse Training that can jointly find the optimal network parameters and sparse network structure in a unified optimizat…