17 citations · 24 across the 4 of their papers we have counts for
4 papers
EasyScale: Accuracy-consistent Elastic Training for Deep Learning
Mingzhen Li, Wencong Xiao, Biao Sun +9
Distributed synchronized GPU training is commonly used for deep learning. The resource constraint of using a fixed number of GPUs makes large-scale training jobs suffer from long q…
Instance-wise Prompt Tuning for Pretrained Language Models
Yuezihan Jiang, Hao Yang, Junyang Lin +6
Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and on…
ZOOMER: Boosting Retrieval on Web-scale Graphs by Regions of Interest
Yuezihan Jiang, Yu Cheng, Hanyu Zhao +6
We introduce ZOOMER, a system deployed at Taobao, the largest e-commerce platform in China, for training and serving GNN-based recommendations over web-scale graphs. ZOOMER is desi…
MSD: Multi-Self-Distillation Learning via Multi-classifiers within Deep Neural Networks
Yunteng Luan, Hanyu Zhao, Zhi Yang +1
As the development of neural networks, more and more deep neural networks are adopted in various tasks, such as image classification. However, as the huge computational overhead, t…