works on
adaptive coefficient regulation 1feature decorrelation 1heterogeneous models 1knowledge distillation 1redundancy suppression 1

From the 1 of 1 linked paper with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

CoCaRS: Correlation Calibration-Based Redundancy Suppression for Heterogeneous Knowledge Distillation

Fengming Yu, Haiwei Pan, Kejia Zhang +3

The paper introduces CoCaRS, a method for heterogeneous knowledge distillation that calibrates feature decorrelation to suppress redundancy while preserving structural information,…