44 citations · 69 across the 4 of their papers we have counts for
4 papers
Knowledge Distillation of Transformer-based Language Models Revisited
Chengqiang Lu, Jianwei Zhang, Yunfei Chu +5
In the past few years, transformer-based pre-trained language models have achieved astounding success in both industry and academia. However, the large model size and high run-time…
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
Jiangchao Yao, Shengyu Zhang, Yang Yao +15
Influenced by the great success of deep learning via cloud computing and the rapid development of edge chips, research in artificial intelligence (AI) has shifted to both of the co…
Federated Graph Learning -- A Position Paper
Huanding Zhang, Tao Shen, Fei Wu +3
Graph neural networks (GNN) have been successful in many fields, and derived various researches and applications in real industries. However, in some privacy sensitive scenarios (l…
KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation
Hao-Zhe Feng, Zhaoyang You, Minghao Chen +5
Conventional unsupervised multi-source domain adaptation (UMDA) methods assume all source domains can be accessed directly. This neglects the privacy-preserving policy, that is, al…