TAKE: Trajectory-Aware Knowledge Estimation for Text Dataset Distillation

Tri-Nhan Vo, Dang Nguyen, Sunil Gupta

Large-scale text corpora have become a quiet bottleneck in modern NLP, not just in storage, but in the accumulated cost of training, fine-tuning, and continual learning. We propose…