109 citations · 207 across the 9 of their papers we have counts for
5 papers · 1 filter
GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization
Zhiyuan Zhang, Ruixuan Luo, Qi Su +1
Recently, Sharpness-Aware Minimization (SAM) algorithm has shown state-of-the-art generalization abilities in vision tasks. It demonstrates that flat minima tend to imply better ge…
Adversarial Parameter Defense by Multi-Step Risk Minimization
Zhiyuan Zhang, Ruixuan Luo, Xuancheng Ren +3
Previous studies demonstrate DNNs' vulnerability to adversarial examples and adversarial training can establish a defense to adversarial examples. In addition, recent studies show…
Learning Robust Representation for Clustering through Locality Preserving Variational Discriminative Network
Ruixuan Luo, Wei Li, Zhiyuan Zhang +3
Clustering is one of the fundamental problems in unsupervised learning. Recent deep learning based methods focus on learning clustering oriented representations. Among those method…
Exploring the Vulnerability of Deep Neural Networks: A Study of Parameter Corruption
Xu Sun, Zhiyuan Zhang, Xuancheng Ren +2
We argue that the vulnerability of model parameters is of crucial value to the study of model robustness and generalization but little research has been devoted to understanding th…
An Adaptive and Momental Bound Method for Stochastic Learning
Jianbang Ding, Xuancheng Ren, Ruixuan Luo +1
Training deep neural networks requires intricate initialization and careful selection of learning rates. The emergence of stochastic gradient optimization methods that use adaptive…