5 papers
Self-Supervised Representation-Guided Generative Dataset Distillation
Mingzhuo Li, Guang Li, Linfeng Ye +4
Dataset distillation compresses a large training set into a compact synthetic set while retaining its downstream utility. Most existing methods target randomly initialized networks…
SAS: Semantic-aware Sampling for Generative Dataset Distillation
Mingzhuo Li, Guang Li, Linfeng Ye +4
Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-s…
Difficulty-guided Sampling: Bridging the Target Gap between Dataset Distillation and Downstream Tasks
Mingzhuo Li, Guang Li, Linfeng Ye +4
In this paper, we propose difficulty-guided sampling (DGS) to bridge the target gap between the distillation objective and the downstream task, therefore improving the performance…
Task-Specific Generative Dataset Distillation with Difficulty-Guided Sampling
Mingzhuo Li, Guang Li, Jiafeng Mao +3
To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparabl…
Information-Guided Diffusion Sampling for Dataset Distillation
Linfeng Ye, Shayan Mohajer Hamidi, Guang Li +3
Dataset distillation aims to create a compact dataset that retains essential information while maintaining model performance. Diffusion models (DMs) have shown promise for this tas…