HDKD: Hybrid Data-Efficient Knowledge Distillation Network for Medical Image Classification

Omar S. EL-Assiouti, Ghada Hamed, Dina Khattab +1

Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when…