activity
20212023
most citedBlack-box Prompt Learning for Pre-trained Language Models

30 citations · 59 across the 5 of their papers we have counts for

collaborators

5 papers

cs.LG2023

Probabilistic Bilevel Coreset Selection

Xiao Zhou, Renjie Pi, Weizhong Zhang +2

The goal of coreset selection in supervised learning is to produce a weighted subset of data, so that training only on the subset achieves similar performance as training on the en…

cs.LG2023★ 10 cited

Model Agnostic Sample Reweighting for Out-of-Distribution Learning

Xiao Zhou, Yong Lin, Renjie Pi +4

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of…

cs.CL2022★ 30 cited

Black-box Prompt Learning for Pre-trained Language Models

Shizhe Diao, Zhichao Huang, Ruijia Xu +4

The increasing scale of general-purpose Pre-trained Language Models (PLMs) necessitates the study of more efficient adaptation across different downstream tasks. In this paper, we…

cs.LG2021★ 15 cited

Efficient Neural Network Training via Forward and Backward Propagation Sparsification

Xiao Zhou, Weizhong Zhang, Zonghao Chen +2

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantl…

cs.LG2021★ 4 cited

Effective Sparsification of Neural Networks with Global Sparsity Constraint

Xiao Zhou, Weizhong Zhang, Hang Xu +1

Weight pruning is an effective technique to reduce the model size and inference time for deep neural networks in real-world deployments. However, since magnitudes and relative impo…