Learning to Generate Synthetic Training Data using Gradient Matching and Implicit Differentiation

Dmitry Medvedev, Alexander D'yakonov

Using huge training datasets can be costly and inconvenient. This article explores various data distillation techniques that can reduce the amount of data required to successfully…