37 citations · 80 across the 7 of their papers we have counts for
4 papers · 1 filter
VanillaKD: Revisit the Power of Vanilla Knowledge Distillation from Small Scale to Large Scale
Zhiwei Hao, Jianyuan Guo, Kai Han +3
The tremendous success of large models trained on extensive datasets demonstrates that scale is a key ingredient in achieving superior results. Therefore, the reflection on the rat…
EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention
Xinyu Liu, Houwen Peng, Ningxin Zheng +3
Vision transformers have shown great success due to their high model capabilities. However, their remarkable performance is accompanied by heavy computation costs, which makes them…
The applicability of transperceptual and deep learning approaches to the study and mimicry of complex cartilaginous tissues
J. Waghorne, C. Howard, H. Hu +4
Complex soft tissues, for example the knee meniscus, play a crucial role in mobility and joint health, but when damaged are incredibly difficult to repair and replace. This is due…
Boosting Adversarial Transferability through Enhanced Momentum
Xiaosen Wang, Jiadong Lin, Han Hu +2
Deep learning models are known to be vulnerable to adversarial examples crafted by adding human-imperceptible perturbations on benign images. Many existing adversarial attack metho…