103 citations · 104 across the 15 of their papers we have counts for
Showing 2023 · cs.CVShow all
2 papers · 2 filters
cs.CV2023
StableKD: Breaking Inter-block Optimization Entanglement for Stable Knowledge Distillation
Shiu-hong Kao, Jierun Chen, S. H. Gary Chan
Knowledge distillation (KD) has been recognized as an effective tool to compress and accelerate models. However, current KD approaches generally suffer from an accuracy drop and/or…
cs.CV2023★ 103 cited
Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks
Jierun Chen, Shiu-hong Kao, Hao He +4
To design fast neural networks, many works have been focusing on reducing the number of floating-point operations (FLOPs). We observe that such reduction in FLOPs, however, does no…