5 citations · 27 across the 26 of their papers we have counts for
4 papers · 1 filter
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters
Shwai He, Liang Ding, Daize Dong +2
Adapter Tuning, which freezes the pretrained language models (PLMs) and only fine-tunes a few extra modules, becomes an appealing efficient alternative to the full model fine-tunin…
PAD-Net: An Efficient Framework for Dynamic Networks
Shwai He, Liang Ding, Daize Dong +3
Dynamic networks, e.g., Dynamic Convolution (DY-Conv) and the Mixture of Experts (MoE), have been extensively explored as they can considerably improve the model's representation p…
Vega-MT: The JD Explore Academy Translation System for WMT22
Changtong Zan, Keqin Peng, Liang Ding +9
We describe the JD Explore Academy's submission of the WMT 2022 shared general translation task. We participated in all high-resource tracks and one medium-resource track, includin…
SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution
Shwai He, Chenbo Jiang, Daize Dong +1
Dynamic convolution achieves better performance for efficient CNNs at the cost of negligible FLOPs increase. However, the performance increase can not match the significantly expan…