Learning Compatible Embeddings

Abstract

Achieving backward compatibility when rolling out new models can highly reduce costs or even bypass feature re-encoding of existing gallery images for in-production visual retrieval systems. Previous related works usually leverage losses used in knowledge distillation which can cause performance degradations or not guarantee compatibility. To address these issues, we propose a general framework called Learning Compatible Embeddings (LCE) which is applicable for both cross model compatibility and compatible training in direct/forward/backward manners. Our compatibility is achieved by aligning class centers between models directly or via a transformation, and restricting more compact intra-class distributions for the new model. Experiments are conducted in extensive scenarios such as changes of training dataset, loss functions, network architectures as well as feature dimensions, and demonstrate that LCE efficiently enables model compatibility with marginal sacrifices of accuracies. The code will be available at https://github.com/IrvingMeng/LCE.

arXiv commentaccepted at ICCV 2021

References in corpus (11)

• Distilling the Knowledge in a Neural Network
• Neural Architecture Search with Reinforcement Learning
• Knowledge Distillation: A Survey
• In Defense of the Triplet Loss for Person Re-Identification
• FitNets: Hints for Thin Deep Nets
• The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
• DeepID3: Face Recognition with Very Deep Neural Networks
• A survey of advances in vision-based vehicle re-identification
• Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Net
• PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition
• Searching for Alignment in Face Recognition