20 citations · 134 across the 33 of their papers we have counts for
10 papers · 1 filter
On the Connection between Invariant Learning and Adversarial Training for Out-of-Distribution Generalization
Shiji Xin, Yifei Wang, Jingtong Su +1
Despite impressive success in many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD…
When Adversarial Training Meets Vision Transformers: Recipes from Training to Architecture
Yichuan Mo, Dongxian Wu, Yifei Wang +2
Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provid…
Improving Out-of-Distribution Generalization by Adversarial Training with Structured Priors
Qixun Wang, Yifei Wang, Hong Zhu +1
Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Dist…
How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders
Qi Zhang, Yifei Wang, Yisen Wang
Masked Autoencoders (MAE) based on a reconstruction task have risen to be a promising paradigm for self-supervised learning (SSL) and achieve state-of-the-art performance across di…
Overparameterized ReLU Neural Networks Learn the Simplest Models: Neural Isometry and Exact Recovery
Yifei Wang, Yixuan Hua, Emmanuel Candés +1
The practice of deep learning has shown that neural networks generalize remarkably well even with an extreme number of learned parameters. This appears to contradict traditional st…
Optimization-Induced Graph Implicit Nonlinear Diffusion
Qi Chen, Yifei Wang, Yisen Wang +2
Due to the over-smoothing issue, most existing graph neural networks can only capture limited dependencies with their inherently finite aggregation layers. To overcome this limitat…
A DTCWT-SVD Based Video Watermarking resistant to frame rate conversion
Yifei Wang, Qichao Ying, Zhenxing Qian +2
Videos can be easily tampered, copied and redistributed by attackers for illegal and monetary usage. Such behaviors severely jeopardize the interest of content owners. Despite huge…
Optimal Neural Network Approximation of Wasserstein Gradient Direction via Convex Optimization
Yifei Wang, Peng Chen, Mert Pilanci +1
The computation of Wasserstein gradient direction is essential for posterior sampling problems and scientific computing. The approximation of the Wasserstein gradient with finite s…
A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Training
Yifei Wang, Yisen Wang, Jiansheng Yang +1
Adversarial Training (AT) is known as an effective approach to enhance the robustness of deep neural networks. Recently researchers notice that robust models with AT have good gene…
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap
Yifei Wang, Qi Zhang, Yisen Wang +2
Recently, contrastive learning has risen to be a promising approach for large-scale self-supervised learning. However, theoretical understanding of how it works is still unclear. I…