activity
20212026
most citedKnowledge Distillation from A Stronger Teacher

96 citations · 233 across the 23 of their papers we have counts for

collaborators
Showing cs.CVShow all

17 papers · 1 filter

cs.CV2024

Decoupled Video Generation with Chain of Training-free Diffusion Model Experts

Wenhao Li, Yichao Cao, Xiu Su +5

Video generation models hold substantial potential in areas such as filmmaking. However, current video diffusion models need high computational costs and produce suboptimal results…

cs.CV2024★ 32 cited

LocalMamba: Visual State Space Model with Windowed Selective Scan

Tao Huang, Xiaohuan Pei, Shan You +3

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their applic…

cs.CV2024

Active Generation for Image Classification

Tao Huang, Jiaqi Liu, Shan You +1

Recently, the growing capabilities of deep generative models have underscored their potential in enhancing image classification accuracy. However, existing methods often demand the…

cs.CV2023★ 10 cited

Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models

Yichao Cao, Qingfei Tang, Xiu Su +4

Human-object interaction (HOI) detection aims to comprehend the intricate relationships between humans and objects, predicting triplets, and serving as th…

cs.CV2023★ 1 cited

CoNe: Contrast Your Neighbours for Supervised Image Classification

Mingkai Zheng, Shan You, Lang Huang +5

Image classification is a longstanding problem in computer vision and machine learning research. Most recent works (e.g. SupCon , Triplet, and max-margin) mainly focus on grouping…

cs.CV2023

SimMatchV2: Semi-Supervised Learning with Graph Consistency

Mingkai Zheng, Shan You, Lang Huang +4

Semi-Supervised image classification is one of the most fundamental problem in computer vision, which significantly reduces the need for human labor. In this paper, we introduce a…

cs.CV2023★ 1 cited

Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection

Yichao Cao, Qingfei Tang, Feng Yang +4

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and object…

cs.CV2023★ 20 cited

Knowledge Diffusion for Distillation

Tao Huang, Yuan Zhang, Mingkai Zheng +4

The representation gap between teacher and student is an emerging topic in knowledge distillation (KD). To reduce the gap and improve the performance, current methods often resort…

cs.CV2022★ 42 cited

LightViT: Towards Light-Weight Convolution-Free Vision Transformers

Tao Huang, Lang Huang, Shan You +3

Vision transformers (ViTs) are usually considered to be less light-weight than convolutional neural networks (CNNs) due to the lack of inductive bias. Recent works thus resort to c…

cs.CV2022★ 7 cited

Masked Distillation with Receptive Tokens

Tao Huang, Yuan Zhang, Shan You +4

Distilling from the feature maps can be fairly effective for dense prediction tasks since both the feature discriminability and localization priors can be well transferred. However…

cs.CV2022★ 96 cited

Knowledge Distillation from A Stronger Teacher

Tao Huang, Shan You, Fei Wang +2

Unlike existing knowledge distillation methods focus on the baseline settings, where the teacher models and training strategies are not that strong and competing as state-of-the-ar…

cs.CV2022★ 2 cited

Searching for Network Width with Bilaterally Coupled Network

Xiu Su, Shan You, Jiyang Xie +4

Searching for a more compact network width recently serves as an effective way of channel pruning for the deployment of convolutional neural networks (CNNs) under hardware constrai…

cs.CV2022★ 3 cited

DyRep: Bootstrapping Training with Dynamic Re-parameterization

Tao Huang, Shan You, Bohan Zhang +4

Structural re-parameterization (Rep) methods achieve noticeable improvements on simple VGG-style networks. Despite the prevalence, current Rep methods simply re-parameterize all op…

cs.CV2022

SimMatch: Semi-supervised Learning with Similarity Matching

Mingkai Zheng, Shan You, Lang Huang +3

Learning with few labeled data has been a longstanding problem in the computer vision and machine learning research community. In this paper, we introduced a new semi-supervised le…

cs.CV2022★ 1 cited

Weak Augmentation Guided Relational Self-Supervised Learning

Mingkai Zheng, Shan You, Fei Wang +4

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most m…

cs.CV2021★ 1 cited

GreedyNASv2: Greedier Search with a Greedy Path Filter

Tao Huang, Shan You, Fei Wang +4

Training a good supernet in one-shot NAS methods is difficult since the search space is usually considerably huge (e.g., ). In order to enhance the supernet's evaluation a…

cs.CV2021★ 1 cited

ViTAS: Vision Transformer Architecture Search

Xiu Su, Shan You, Jiyang Xie +6

Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions i…