1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2024
Linear Projections of Teacher Embeddings for Few-Class Distillation
Noel Loo, Fotis Iliopoulos, Wei Hu +1
Knowledge Distillation (KD) has emerged as a promising approach for transferring knowledge from a larger, more complex teacher model to a smaller student model. Traditionally, KD i…
cs.LG2023★ 1 cited
On the Size and Approximation Error of Distilled Sets
Alaa Maalouf, Murad Tukan, Noel Loo +3
Dataset Distillation is the task of synthesizing small datasets from large ones while still retaining comparable predictive accuracy to the original uncompressed dataset. Despite s…