4 papers · 1 filter
UniDFKD: A Unified Semantic Prior Framework for Architecture-Agnostic Data-Free Knowledge Distillation
Xuewan He, Tong Chu, Zihan Cheng +5
Data-Free Knowledge Distillation (DFKD) transfers knowledge from a pretrained teacher model to a compact student model by synthesizing semantically informative data, eliminating th…
EDITS: Enhancing Dataset Distillation with Implicit Textual Semantics
Qianxin Xia, Jiawei Du, Guoming Lu +2
Dataset distillation aims to synthesize a compact dataset from the original large-scale one, enabling highly efficient learning while preserving competitive model performance. Howe…
Efficient Dataset Distillation for Pre-Trained Self-Supervised Models via Statistical Flow Matching
Qianxin Xia, Jiawei Du, Xin Zhang +3
Dataset distillation seeks to synthesize a highly compact dataset that achieves performance comparable to the original dataset on downstream tasks. For the classification task that…
PRISM: Precision-Recall Informed Data-Free Knowledge Distillation via Generative Diffusion
Xuewan He, Jielei Wang, Zihan Cheng +3
Data-free knowledge distillation (DFKD) transfers knowledge from a teacher to a student without access to the real in-distribution (ID) data. While existing methods perform well on…