Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix

Peng Liu

In the context of multi-modality knowledge distillation research, the existing methods was mainly focus on the problem of only learning teacher final output. Thus, there are still…