2 papers
cs.CV2024
RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization
Chengpeng Chen, Zichao Guo, Haien Zeng +2
Feature reuse has been a key technique in light-weight convolutional neural networks (CNNs) architecture design. Current methods usually utilize a concatenation operator to keep la…
cs.CV2024
Pixel-Wise Contrastive Distillation
Junqiang Huang, Zichao Guo
We present a simple but effective pixel-level self-supervised distillation framework friendly to dense prediction tasks. Our method, called Pixel-Wise Contrastive Distillation (PCD…