Shadow loss: Memory-linear deep metric learning for efficient training

Alif Elham Khan, Mohammad Junayed Hasan, Humayra Anjum +1

Deep metric learning objectives (e.g., triplet loss) require storing and comparing high-dimensional embeddings, making the per-batch loss buffer scale as $O(S\cdot D)$, where $S$ i…