3 citations · 12 across the 12 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CL2022★ 2 cited
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters
Shwai He, Liang Ding, Daize Dong +2
Adapter Tuning, which freezes the pretrained language models (PLMs) and only fine-tunes a few extra modules, becomes an appealing efficient alternative to the full model fine-tunin…
cs.LG2022★ 3 cited
PAD-Net: An Efficient Framework for Dynamic Networks
Shwai He, Liang Ding, Daize Dong +3
Dynamic networks, e.g., Dynamic Convolution (DY-Conv) and the Mixture of Experts (MoE), have been extensively explored as they can considerably improve the model's representation p…
cs.CV2022
SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution
Shwai He, Chenbo Jiang, Daize Dong +1
Dynamic convolution achieves better performance for efficient CNNs at the cost of negligible FLOPs increase. However, the performance increase can not match the significantly expan…