4 papers · 1 filter
UniDFKD: A Unified Semantic Prior Framework for Architecture-Agnostic Data-Free Knowledge Distillation
Xuewan He, Tong Chu, Zihan Cheng +5
Data-Free Knowledge Distillation (DFKD) transfers knowledge from a pretrained teacher model to a compact student model by synthesizing semantically informative data, eliminating th…
Efficient Dataset Distillation for Pre-Trained Self-Supervised Models via Statistical Flow Matching
Qianxin Xia, Jiawei Du, Xin Zhang +6
Dataset distillation seeks to synthesize a compact surrogate dataset that enables performance comparable to training on the original dataset for downstream tasks. For the scenario…
PRISM: Precision-Recall Informed Data-Free Knowledge Distillation via Generative Diffusion
Xuewan He, Jielei Wang, Zihan Cheng +3
Data-free knowledge distillation (DFKD) transfers knowledge from a teacher to a student without access to the real in-distribution (ID) data. While existing methods perform well on…
EDITS: Enhancing Dataset Distillation with Implicit Textual Semantics
Qianxin Xia, Jiawei Du, Guoming Lu +2
Dataset distillation aims to synthesize a compact dataset from the original large-scale one, enabling highly efficient learning while preserving competitive model performance. Howe…