10 citations · 10 across the 2 of their papers we have counts for
2 papers
cs.LG2021★ 10 cited
FedSkel: Efficient Federated Learning on Heterogeneous Systems with Skeleton Gradients Update
Junyu Luo, Jianlei Yang, Xucheng Ye +2
Federated learning aims to protect users' privacy while performing data analysis from different participants. However, it is challenging to guarantee the training efficiency on het…
cs.CL2021
RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models
Xin Guo, Jianlei Yang, Haoyi Zhou +2
Pre-trained language models achieve outstanding performance in NLP tasks. Various knowledge distillation methods have been proposed to reduce the heavy computation and storage requ…