42 citations · 57 across the 8 of their papers we have counts for
3 papers · 1 filter
DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization
Zheqi Lv, Wenqiao Zhang, Shengyu Zhang +8
Device Model Generalization (DMG) is a practical yet under-investigated research topic for on-device machine learning applications. It aims to improve the generalization ability of…
Knowledge Distillation of Transformer-based Language Models Revisited
Chengqiang Lu, Jianwei Zhang, Yunfei Chu +5
In the past few years, transformer-based pre-trained language models have achieved astounding success in both industry and academia. However, the large model size and high run-time…
Decoupled Self-supervised Learning for Non-Homophilous Graphs
Teng Xiao, Zhengyu Chen, Zhimeng Guo +2
This paper studies the problem of conducting self-supervised learning for node representation learning on graphs. Most existing self-supervised learning methods assume the graph is…