most citedFedSkel: Efficient Federated Learning on Heterogeneous Systems with Skeleton Gradients Update

10 citations · 10 across the 2 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2021

RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models

Xin Guo, Jianlei Yang, Haoyi Zhou +2

Pre-trained language models achieve outstanding performance in NLP tasks. Various knowledge distillation methods have been proposed to reduce the heavy computation and storage requ…