Quantifying Knowledge Distillation Using Partial Information Decomposition

Pasan Dissanayake, Faisal Hamman, Barproda Halder +3

Knowledge distillation deploys complex machine learning models in resource-constrained environments by training a smaller student model to emulate internal representations of a com…