Showing cs.CVShow all
2 papers · 1 filter
cs.CV2024
Learn from Balance: Rectifying Knowledge Transfer for Long-Tailed Scenarios
Xinlei Huang, Jialiang Tang, Xubin Zheng +3
Knowledge Distillation (KD) transfers knowledge from a large pre-trained teacher network to a compact and efficient student network, making it suitable for deployment on resource-l…
cs.CV2023
Distribution Shift Matters for Knowledge Distillation with Webly Collected Images
Jialiang Tang, Shuo Chen, Gang Niu +2
Knowledge distillation aims to learn a lightweight student network from a pre-trained teacher network. In practice, existing knowledge distillation methods are usually infeasible w…