25 citations · 166 across the 22 of their papers we have counts for
19 papers · 1 filter
Dynamic Perceiver for Efficient Visual Recognition
Yizeng Han, Dongchen Han, Zeyu Liu +7
Early exiting has become a promising approach to improving the inference efficiency of deep networks. By structuring models with multiple classifiers (exits), predictions for ``eas…
Slide-Transformer: Hierarchical Vision Transformer with Local Self-Attention
Xuran Pan, Tianzhu Ye, Zhuofan Xia +2
Self-attention mechanism has been a key factor in the recent progress of Vision Transformer (ViT), which enables adaptive feature extraction from global contexts. However, existing…
Zero-shot Generative Model Adaptation via Image-specific Prompt Learning
Jiayi Guo, Chaofei Wang, You Wu +6
Recently, CLIP-guided image synthesis has shown appealing performance on adapting a pre-trained source-domain generator to an unseen target domain. It does not require any target-d…
Adaptive Rotated Convolution for Rotated Object Detection
Yifan Pu, Yiru Wang, Zhuofan Xia +6
Rotated object detection aims to identify and locate objects in images with arbitrary orientation. In this scenario, the oriented directions of objects vary considerably across dif…
Joint Representation Learning for Text and 3D Point Cloud
Rui Huang, Xuran Pan, Henry Zheng +4
Recent advancements in vision-language pre-training (e.g. CLIP) have shown that vision models can benefit from language supervision. While many models using language modality have…
EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones
Yulin Wang, Yang Yue, Rui Lu +4
The superior performance of modern deep networks usually comes with a costly training procedure. This paper presents a new curriculum learning approach for the efficient training o…
Cross-Modal Adapter for Vision-Language Retrieval
Haojun Jiang, Jianke Zhang, Rui Huang +4
Vision-language retrieval is an important multi-modal learning topic, where the goal is to retrieve the most relevant visual candidate for a given text query. Recently, pre-trained…
Contrastive Language-Image Pre-Training with Knowledge Graphs
Xuran Pan, Tianzhu Ye, Dongchen Han +2
Recent years have witnessed the fast development of large-scale pre-training frameworks that can extract multi-modal representations in a unified form and achieve promising perform…
Latency-aware Spatial-wise Dynamic Networks
Yizeng Han, Zhihang Yuan, Yifan Pu +4
Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixe…
AdaFocusV3: On Unified Spatial-temporal Dynamic Video Recognition
Yulin Wang, Yang Yue, Xinhong Xu +6
Recent research has revealed that reducing the temporal and spatial redundancy are both effective approaches towards efficient video recognition, e.g., allocating the majority of c…
Learning to Weight Samples for Dynamic Early-exiting Networks
Yizeng Han, Yifan Pu, Zihang Lai +6
Early exiting is an effective paradigm for improving the inference efficiency of deep networks. By constructing classifiers with varying resource demands (the exits), such networks…
Learn From the Past: Experience Ensemble Knowledge Distillation
Chaofei Wang, Shaowei Zhang, Shiji Song +1
Traditional knowledge distillation transfers "dark knowledge" of a pre-trained teacher network to a student network, and ignores the knowledge in the training process of the teache…
Glance and Focus Networks for Dynamic Visual Recognition
Gao Huang, Yulin Wang, Kangchen Lv +4
Spatial redundancy widely exists in visual recognition tasks, i.e., discriminative features in an image or video frame usually correspond to only a subset of pixels, while the rema…
Vision Transformer with Deformable Attention
Zhuofan Xia, Xuran Pan, Shiji Song +2
Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representati…
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework
Chenxin Tao, Honghui Wang, Xizhou Zhu +4
Self-supervised learning has shown its great potential to extract powerful visual representations without human annotations. Various works are proposed to deal with self-supervised…
On the Integration of Self-Attention and Convolution
Xuran Pan, Chunjiang Ge, Rui Lu +4
Convolution and self-attention are two powerful techniques for representation learning, and they are usually considered as two peer approaches that are distinct from each other. In…
Fine-Grained Few Shot Learning with Foreground Object Transformation
Chaofei Wang, Shiji Song, Qisen Yang +2
Traditional fine-grained image classification generally requires abundant labeled samples to deal with the low inter-class variance but high intra-class variance problem. However,…
CAM-loss: Towards Learning Spatially Discriminative Feature Representations
Chaofei Wang, Jiayu Xiao, Yizeng Han +3
The backbone of traditional CNN classifier is generally considered as a feature extractor, followed by a linear layer which performs the classification. We propose a novel loss fun…
Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition
Yulin Wang, Rui Huang, Shiji Song +2
Vision Transformers (ViT) have achieved remarkable success in large-scale image recognition. They split every 2D image into a fixed number of patches, each of which is treated as a…