31 citations · 49 across the 3 of their papers we have counts for
3 papers
cs.CV2024★ 17 cited
GhostNetV3: Exploring the Training Strategies for Compact Models
Zhenhua Liu, Zhiwei Hao, Kai Han +2
Compact neural networks are specially designed for applications on edge devices with faster inference speed yet modest performance. However, training strategies of compact models a…
cs.CV2023★ 31 cited
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation
Zhiwei Hao, Jianyuan Guo, Kai Han +4
Knowledge distillation~(KD) has proven to be a highly effective approach for enhancing model performance through a teacher-student training scheme. However, most existing distillat…
cs.CV2023★ 1 cited
DeViT: Decomposing Vision Transformers for Collaborative Inference in Edge Devices
Guanyu Xu, Zhiwei Hao, Yong Luo +3
Recent years have witnessed the great success of vision transformer (ViT), which has achieved state-of-the-art performance on multiple computer vision benchmarks. However, ViT mode…