11 citations · 36 across the 16 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2021
Bag of Tricks for Optimizing Transformer Efficiency
Ye Lin, Yanyang Li, Tong Xiao +1
Improving Transformer efficiency has become increasingly attractive recently. A wide range of methods has been proposed, e.g., pruning, quantization, new architectures and etc. But…
cs.LG2020★ 1 cited
Towards Differentially Private Text Representations
Lingjuan Lyu, Yitong Li, Xuanli He +1
Most deep learning frameworks require users to pool their local data or model updates to a trusted server to train or maintain a global model. The assumption of a trusted server wh…
cs.LG2020★ 1 cited
Learning Architectures from an Extended Search Space for Language Modeling
Yinqiao Li, Chi Hu, Yuhao Zhang +6
Neural architecture search (NAS) has advanced significantly in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell. In…