27 citations · 73 across the 11 of their papers we have counts for
11 papers
MILAN: Masked Image Pretraining on Language Assisted Representation
Zejiang Hou, Fei Sun, Yen-Kuang Chen +2
Self-attention based transformer models have been dominating many computer vision tasks in the past few years. Their superb model qualities heavily depend on the excessively large…
CHEX: CHannel EXploration for CNN Model Compression
Zejiang Hou, Minghai Qin, Fei Sun +7
Channel pruning has been broadly recognized as an effective technique to reduce the computation and memory cost of deep convolutional neural networks. However, conventional pruning…
Shfl-BW: Accelerating Deep Neural Network Inference with Tensor-Core Aware Weight Pruning
Guyue Huang, Haoran Li, Minghai Qin +3
Weight pruning in deep neural networks (DNNs) can reduce storage and computation cost, but struggles to bring practical speedup to the model inference time. Tensor-cores can signif…
Compact Multi-level Sparse Neural Networks with Input Independent Dynamic Rerouting
Minghai Qin, Tianyun Zhang, Fei Sun +4
Deep neural networks (DNNs) have shown to provide superb performance in many real life applications, but their large computation cost and storage requirement have prevented them fr…
Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks
Fei Sun, Minghai Qin, Tianyun Zhang +6
Deep neural networks (DNNs) have been proven to be effective in solving many real-life problems, but its high computation cost prohibits those models from being deployed to edge de…
Effective Model Sparsification by Scheduled Grow-and-Prune Methods
Xiaolong Ma, Minghai Qin, Fei Sun +7
Deep neural networks (DNNs) are effective in solving many real-world problems. Larger DNN models usually exhibit better quality (e.g., accuracy) but their excessive computation res…