7 citations · 13 across the 18 of their papers we have counts for
4 papers · 1 filter
Exploring Optimal Substructure for Out-of-distribution Generalization via Feature-targeted Model Pruning
Yingchun Wang, Jingcai Guo, Song Guo +2
Recent studies show that even highly biased dense networks contain an unbiased substructure that can achieve better out-of-distribution (OOD) generalization than the original model…
Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning
Yingchun Wang, Song Guo, Jingcai Guo +4
Network pruning is a promising way to generate light but accurate models and enable their deployment on resource-limited edge devices. However, the current state-of-the-art assumes…
Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application
Leijie Wu, Song Guo, Yaohong Ding +4
Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However,…
Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations
Tao Guo, Song Guo, Jiewei Zhang +2
Recently, the enactment of privacy regulations has promoted the rise of the machine unlearning paradigm. Existing studies of machine unlearning mainly focus on sample-wise unlearni…