Dataset Distillation as Pushforward Optimal Quantization

Hong Ye Tan, Emma Slade

Dataset distillation aims to find a synthetic training set such that training on the synthetic data achieves similar performance to training on real data, with orders of magnitude…