40 citations · 69 across the 26 of their papers we have counts for
12 papers · 1 filter
A Unified Masked Jigsaw Puzzle Framework for Vision and Language Models
Weixin Ye, Wei Wang, Yahui Liu +5
In federated learning, Transformer, as a popular architecture, faces critical challenges in defending against gradient attacks and improving model performance in both Computer Visi…
Understanding Matrix Function Normalizations in Covariance Pooling through the Lens of Riemannian Geometry
Ziheng Chen, Yue Song, Xiao-Jun Wu +2
Global Covariance Pooling (GCP) has been demonstrated to improve the performance of Deep Neural Networks (DNNs) by exploiting second-order statistics of high-level representations.…
Householder Projector for Unsupervised Latent Semantics Discovery
Yue Song, Jichao Zhang, Nicu Sebe +1
Generative Adversarial Networks (GANs), especially the recent style-based generators (StyleGANs), have versatile semantics in the structured latent space. Latent semantics discover…
Orthogonal SVD Covariance Conditioning and Latent Disentanglement
Yue Song, Nicu Sebe, Wei Wang
Inserting an SVD meta-layer into neural networks is prone to make the covariance ill-conditioned, which could harm the model in the training stability and generalization abilities.…
Batch-efficient EigenDecomposition for Small and Medium Matrices
Yue Song, Nicu Sebe, Wei Wang
EigenDecomposition (ED) is at the heart of many computer vision algorithms and applications. One crucial bottleneck limiting its usage is the expensive computation cost, particular…
Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality
Yue Song, Nicu Sebe, Wei Wang
Inserting an SVD meta-layer into neural networks is prone to make the covariance ill-conditioned, which could harm the model in the training stability and generalization abilities.…
On the Eigenvalues of Global Covariance Pooling for Fine-grained Visual Recognition
Yue Song, Nicu Sebe, Wei Wang
The Fine-Grained Visual Categorization (FGVC) is challenging because the subtle inter-class variations are difficult to be captured. One notable research line uses the Global Covar…
Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers
Bin Ren, Yahui Liu, Yue Song +4
Position Embeddings (PEs), an arguably indispensable component in Vision Transformers (ViTs), have been shown to improve the performance of ViTs on many vision tasks. However, PEs…
Disentangle Saliency Detection into Cascaded Detail Modeling and Body Filling
Yue Song, Hao Tang, Nicu Sebe +1
Salient object detection has been long studied to identify the most visually attractive objects in images/videos. Recently, a growing amount of approaches have been proposed all of…
Fast Differentiable Matrix Square Root
Yue Song, Nicu Sebe, Wei Wang
Computing the matrix square root or its inverse in a differentiable manner is important in a variety of computer vision tasks. Previous methods either adopt the Singular Value Deco…
Fast Differentiable Matrix Square Root and Inverse Square Root
Yue Song, Nicu Sebe, Wei Wang
Computing the matrix square root and its inverse in a differentiable manner is important in a variety of computer vision tasks. Previous methods either adopt the Singular Value Dec…
Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling?
Yue Song, Nicu Sebe, Wei Wang
Global covariance pooling (GCP) aims at exploiting the second-order statistics of the convolutional feature. Its effectiveness has been demonstrated in boosting the classification…