activity
20212026
most citedKnowledge Distillation from A Stronger Teacher

96 citations · 233 across the 23 of their papers we have counts for

collaborators
Showing 2023Show all

8 papers · 1 filter

cs.LG2023

Adaptive Training Meets Progressive Scaling: Elevating Efficiency in Diffusion Models

Wenhao Li, Xiu Su, Yu Han +3

Diffusion models have demonstrated remarkable efficacy in various generative tasks with the predictive prowess of denoising model. Currently, diffusion models employ a uniform deno…

cs.CV2023★ 10 cited

Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models

Yichao Cao, Qingfei Tang, Xiu Su +4

Human-object interaction (HOI) detection aims to comprehend the intricate relationships between humans and objects, predicting triplets, and serving as th…

cs.AI2023

DiffNAS: Bootstrapping Diffusion Models by Prompting for Better Architectures

Wenhao Li, Xiu Su, Shan You +3

Diffusion models have recently exhibited remarkable performance on synthetic data. After a diffusion path is selected, a base model, such as UNet, operates as a denoising autoencod…

cs.CV2023★ 1 cited

CoNe: Contrast Your Neighbours for Supervised Image Classification

Mingkai Zheng, Shan You, Lang Huang +5

Image classification is a longstanding problem in computer vision and machine learning research. Most recent works (e.g. SupCon , Triplet, and max-margin) mainly focus on grouping…

cs.CV2023

SimMatchV2: Semi-Supervised Learning with Graph Consistency

Mingkai Zheng, Shan You, Lang Huang +4

Semi-Supervised image classification is one of the most fundamental problem in computer vision, which significantly reduces the need for human labor. In this paper, we introduce a…

cs.CV2023★ 1 cited

Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection

Yichao Cao, Qingfei Tang, Feng Yang +4

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and object…

cs.CV2023★ 20 cited

Knowledge Diffusion for Distillation

Tao Huang, Yuan Zhang, Mingkai Zheng +4

The representation gap between teacher and student is an emerging topic in knowledge distillation (KD). To reduce the gap and improve the performance, current methods often resort…

cs.LG2023★ 16 cited

Can GPT-4 Perform Neural Architecture Search?

Mingkai Zheng, Xiu Su, Shan You +4

We investigate the potential of GPT-4~\cite{gpt4} to perform Neural Architecture Search (NAS) -- the task of designing effective neural architectures. Our proposed approach, \textb…