activity
20182022
most citedOn the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization

146 citations · 204 across the 16 of their papers we have counts for

collaborators

17 papers

cs.IR2022★ 2 cited

LPFS: Learnable Polarizing Feature Selection for Click-Through Rate Prediction

Yi Guo, Zhaocheng Liu, Jianchao Tan +6

In industry, feature selection is a standard but necessary step to search for an optimal set of informative feature fields for efficient and effective training of deep Click-Throug…

cs.LG2022★ 29 cited

Unified Visual Transformer Compression

Shixing Yu, Tianlong Chen, Jiayi Shen +5

Vision transformers (ViTs) have gained popularity recently. Even without customized image operators such as convolutions, ViTs can yield competitive performance when properly train…

cs.CV2022

Adversarial Contrastive Self-Supervised Learning

Wentao Zhu, Hang Shang, Tingxun Lv +3

Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention. Self-supervised learning followed by the sup…

cs.LG2021

Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters

Xiangru Lian, Binhang Yuan, Xuefeng Zhu +24

Deep learning based models have dominated the current landscape of production recommender systems. Furthermore, recent years have witnessed an exponential growth of the model scale…

cs.LG2021★ 2 cited

ProxyBO: Accelerating Neural Architecture Search via Bayesian Optimization with Zero-cost Proxies

Yu Shen, Yang Li, Jian Zheng +6

Designing neural architectures requires immense manual efforts. This has promoted the development of neural architecture search (NAS) to automate the design. While previous NAS met…

cs.SD2021★ 2 cited

SpeechNAS: Towards Better Trade-off between Latency and Accuracy for Large-Scale Speaker Verification

Wentao Zhu, Tianlong Kong, Shun Lu +6

Recently, x-vector has been a successful and popular approach for speaker verification, which employs a time delay neural network (TDNN) and statistics pooling to extract speaker c…