most citedAre Large Kernels Better Teachers than Transformers for ConvNets?

1 citations · 1 across the 5 of their papers we have counts for

collaborators
Showing cs.CVShow all

2 papers · 1 filter

cs.CV2024

(PASS) Visual Prompt Locates Good Structure Sparsity through a Recurrent HyperNetwork

Tianjin Huang, Fang Meng, Li Shen +5

Large-scale neural networks have demonstrated remarkable performance in different domains like vision and language processing, although at the cost of massive computation resources…

cs.CV2023★ 1 cited

Are Large Kernels Better Teachers than Transformers for ConvNets?

Tianjin Huang, Lu Yin, Zhenyu Zhang +5

This paper reveals a new appeal of the recently emerged large-kernel Convolutional Neural Networks (ConvNets): as the teacher in Knowledge Distillation (KD) for small-kernel ConvNe…