25 citations · 85 across the 36 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CV2022
Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application
Leijie Wu, Song Guo, Yaohong Ding +4
Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However,…
cs.CV2022★ 1 cited
Domain Decorrelation with Potential Energy Ranking
Sen Pei, Jiaxi Sun, Richard Yi Da Xu +2
Machine learning systems, especially the methods based on deep learning, enjoy great success in modern computer vision tasks under experimental settings. Generally, these classic d…
cs.LG2022★ 1 cited
Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning
Wei Huang, Chunrui Liu, Yilan Chen +2
PAC-Bayesian is an analysis framework where the training error can be expressed as the weighted average of the hypotheses in the posterior distribution whilst incorporating the pri…