activity
20182023
most citedKnowledge Distillation from A Stronger Teacher

96 citations · 580 across the 59 of their papers we have counts for

collaborators
Showing 2022Show all

29 papers · 1 filter

cs.LG2022

Influence-Based Mini-Batching for Graph Neural Networks

Johannes Gasteiger, Chendi Qian, Stephan Günnemann

Using graph neural networks for large graphs is challenging since there is no clear way of constructing mini-batches. To solve this, previous methods have relied on sampling or gra…

cs.LG2022

A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization

Jian Cao, Chen Qian, Yihui Huang +5

Implicit regularization is an important way to interpret neural networks. Recent theory starts to explain implicit regularization with the model of deep matrix factorization (DMF)…

eess.IV2022★ 6 cited

CloudBrain-ReconAI: An Online Platform for MRI Reconstruction and Image Quality Evaluation

Yirong Zhou, Chen Qian, Jiayu Li +11

Efficient collaboration between engineers and radiologists is important for image reconstruction algorithm development and image quality evaluation in magnetic resonance imaging (M…

cs.CV2022★ 4 cited

Weak-shot Semantic Segmentation via Dual Similarity Transfer

Junjie Chen, Li Niu, Siyuan Zhou +3

Semantic segmentation is an important and prevalent task, but severely suffers from the high cost of pixel-level annotations when extending to more classes in wider applications. T…

cs.CV2022

PoseTrans: A Simple Yet Effective Pose Transformation Augmentation for Human Pose Estimation

Wentao Jiang, Sheng Jin, Wentao Liu +3

Human pose estimation aims to accurately estimate a wide variety of human poses. However, existing datasets often follow a long-tailed distribution that unusual poses only occupy a…

cs.CV2022★ 5 cited

3D Interacting Hand Pose Estimation by Hand De-occlusion and Removal

Hao Meng, Sheng Jin, Wentao Liu +4

Estimating 3D interacting hand pose from a single RGB image is essential for understanding human actions. Unlike most previous works that directly predict the 3D poses of two inter…

cs.CV2022★ 3 cited

Pose for Everything: Towards Category-Agnostic Pose Estimation

Lumin Xu, Sheng Jin, Wang Zeng +5

Existing works on 2D pose estimation mainly focus on a certain category, e.g. human, animal, and vehicle. However, there are lots of application scenarios that require detecting th…

cs.CV2022

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

Jingwang Ling, Zhibo Wang, Ming Lu +3

Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable models mostly focus on large-scale facial geometry but ignore facial details. T…

cs.CV2022

ScaleNet: Searching for the Model to Scale

Jiyang Xie, Xiu Su, Shan You +3

Recently, community has paid increasing attention on model scaling and contributed to developing a model family with a wide spectrum of scales. Current methods either simply resort…

cs.CV2022★ 42 cited

LightViT: Towards Light-Weight Convolution-Free Vision Transformers

Tao Huang, Lang Huang, Shan You +3

Vision transformers (ViTs) are usually considered to be less light-weight than convolutional neural networks (CNNs) due to the lack of inductive bias. Recent works thus resort to c…

cs.CV2022★ 3 cited

HEAD: HEtero-Assists Distillation for Heterogeneous Object Detectors

Luting Wang, Xiaojie Li, Yue Liao +5

Conventional knowledge distillation (KD) methods for object detection mainly concentrate on homogeneous teacher-student detectors. However, the design of a lightweight detector for…

cs.CV2022★ 1 cited

Submission to Generic Event Boundary Detection Challenge@CVPR 2022: Local Context Modeling and Global Boundary Decoding Approach

Jiaqi Tang, Zhaoyang Liu, Jing Tan +3

Generic event boundary detection (GEBD) is an important yet challenging task in video understanding, which aims at detecting the moments where humans naturally perceive event bound…

cs.LG2022★ 8 cited

Ordered Subgraph Aggregation Networks

Chendi Qian, Gaurav Rattan, Floris Geerts +2

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limite…

cs.CV2022★ 7 cited

Masked Distillation with Receptive Tokens

Tao Huang, Yuan Zhang, Shan You +4

Distilling from the feature maps can be fairly effective for dense prediction tasks since both the feature discriminability and localization priors can be well transferred. However…

cs.CV2022★ 25 cited

Green Hierarchical Vision Transformer for Masked Image Modeling

Lang Huang, Shan You, Mingkai Zheng +3

We present an efficient approach for Masked Image Modeling (MIM) with hierarchical Vision Transformers (ViTs), allowing the hierarchical ViTs to discard masked patches and operate…

cs.CV2022★ 96 cited

Knowledge Distillation from A Stronger Teacher

Tao Huang, Shan You, Fei Wang +2

Unlike existing knowledge distillation methods focus on the baseline settings, where the teacher models and training strategies are not that strong and competing as state-of-the-ar…

cs.CV2022★ 5 cited

StyleGAN-Human: A Data-Centric Odyssey of Human Generation

Jianglin Fu, Shikai Li, Yuming Jiang +5

Unconditional human image generation is an important task in vision and graphics, which enables various applications in the creative industry. Existing studies in this field mainly…

cs.CV2022★ 20 cited

Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis

Wei Cheng, Su Xu, Jingtan Piao +4

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as in…

cs.CV2022★ 10 cited

Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer

Wang Zeng, Sheng Jin, Wentao Liu +4

Vision transformers have achieved great successes in many computer vision tasks. Most methods generate vision tokens by splitting an image into a regular and fixed grid and treatin…

cs.CV2022★ 10 cited

A Keypoint-based Global Association Network for Lane Detection

Jinsheng Wang, Yinchao Ma, Shaofei Huang +4

Lane detection is a challenging task that requires predicting complex topology shapes of lane lines and distinguishing different types of lanes simultaneously. Earlier works follow…

cs.CV2022

Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsing

Haoyue Cheng, Zhaoyang Liu, Hang Zhou +3

This paper focuses on the weakly-supervised audio-visual video parsing task, which aims to recognize all events belonging to each modality and localize their temporal boundaries. T…

cs.CV2022★ 78 cited

CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

Chinedu Innocent Nwoye, Deepak Alapatt, Tong Yu +59

Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works…

cs.CV2022★ 2 cited

Learning Where to Learn in Cross-View Self-Supervised Learning

Lang Huang, Shan You, Mingkai Zheng +3

Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection…

cs.CV2022★ 2 cited

Searching for Network Width with Bilaterally Coupled Network

Xiu Su, Shan You, Jiyang Xie +4

Searching for a more compact network width recently serves as an effective way of channel pruning for the deployment of convolutional neural networks (CNNs) under hardware constrai…