LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes
arXiv:2106.01487
Abstract
Learning binary representations of instances and classes is a classical problem with several high potential applications. In modern settings, the compression of high-dimensional neural representations to low-dimensional binary codes is a challenging task and often require large bit-codes to be accurate. In this work, we propose a novel method for Learning Low-dimensional binary Codes (LLC) for instances as well as classes. Our method does not require any side-information, like annotated attributes or label meta-data, and learns extremely low-dimensional binary codes (~20 bits for ImageNet-1K). The learnt codes are super-efficient while still ensuring nearly optimal classification accuracy for ResNet50 on ImageNet-1K. We demonstrate that the learnt codes capture intrinsically important features in the data, by discovering an intuitive taxonomy over classes. We further quantitatively measure the quality of our codes by applying it to the efficient image retrieval as well as out-of-distribution (OOD) detection problems. For ImageNet-100 retrieval problem, our learnt binary codes outperform 16 bit HashNet using only 10 bits and also are as accurate as 10 dimensional real representations. Finally, our learnt binary codes can perform OOD detection, out-of-the-box, as accurately as a baseline that needs ~3000 samples to tune its threshold, while we require none. Code is open-sourced at https://github.com/RAIVNLab/LLC.
arXiv commentNeurIPS 2021 Camera Ready. 19 pages, 6 figures
References in corpus (11)
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
- Binarized Neural Networks
- Label-Embedding for Image Classification
- Zero-Shot Learning by Convex Combination of Semantic Embeddings
- Large-scale Multi-label Learning with Missing Labels
- Multi-Label Prediction via Compressed Sensing
- DeepXML: A Deep Extreme Multi-Label Learning Framework Applied to Short Text Documents
- Binary embeddings with structured hashed projections
- A survey on deep hashing for image retrieval