works on
diabetic retinopathy screening 1edge deployment 1heterogeneous teachers 1knowledge distillation 1model compression 1orthogonal projection 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.LG2026

OrthKD: Extracting Generalized Clinical Knowledge from Heterogeneous Teachers for Lightweight Deployment

Yi Xu, Cheng Chen, Mufan Cao

The paper introduces OrthKD, a knowledge distillation framework that selectively trusts a strong CNN and a weaker transformer teacher to train a lightweight MobileNetV3 model for d…