12 citations · 42 across the 8 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023★ 3 cited
Understanding and Improving Feature Learning for Out-of-Distribution Generalization
Yongqiang Chen, Wei Huang, Kaiwen Zhou +3
A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead o…
cs.CV2023
Generic-to-Specific Distillation of Masked Autoencoders
Wei Huang, Zhiliang Peng, Li Dong +3
Large vision Transformers (ViTs) driven by self-supervised pre-training mechanisms achieved unprecedented progress. Lightweight ViT models limited by the model capacity, however, b…