Deep Recurrent Quantization for Generating Sequential Binary Codes

Abstract

Quantization has been an effective technology in ANN (approximate nearest neighbour) search due to its high accuracy and fast search speed. To meet the requirement of different applications, there is always a trade-off between retrieval accuracy and speed, reflected by variable code lengths. However, to encode the dataset into different code lengths, existing methods need to train several models, where each model can only produce a specific code length. This incurs a considerable training time cost, and largely reduces the flexibility of quantization methods to be deployed in real applications. To address this issue, we propose a Deep Recurrent Quantization (DRQ) architecture which can generate sequential binary codes. To the end, when the model is trained, a sequence of binary codes can be generated and the code length can be easily controlled by adjusting the number of recurrent iterations. A shared codebook and a scalar factor is designed to be the learnable weights in the deep recurrent quantization block, and the whole framework can be trained in an end-to-end manner. As far as we know, this is the first quantization method that can be trained once and generate sequential binary codes. Experimental results on the benchmark datasets show that our model achieves comparable or even better performance compared with the state-of-the-art for image retrieval. But it requires significantly less number of parameters and training times. Our code is published online: https://github.com/cfm-uestc/DRQ.

References in corpus (6)

• Simultaneous Feature Learning and Hash Coding with Deep Neural Networks
• Self-Supervised Video Hashing with Hierarchical Binary Auto-encoder
• Binary Voting with Delegable Proxy: An Analysis of Liquid Democracy
• Stacked Quantizers for Compositional Vector Compression
• Proxy Voting for Better Outcomes
• What Do We Elect Committees For? A Voting Committee Model for Multi-Winner Rules

Cited by in corpus (47)

• What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
• Accelerating high-throughput virtual screening through molecular pool-based active learning
• Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needs
• Annotating Columns with Pre-trained Language Models
• Counterfactual State Explanations for Reinforcement Learning Agents via Generative Deep Learning
• Multiple Birds with One Stone: Beating $1/2$ for EFX and GMMS via Envy Cycle Elimination
• Forecast Network-Wide Traffic States for Multiple Steps Ahead: A Deep Learning Approach Considering Dynamic Non-Local Spatial Correlation and Non-Stationary Temporal Dependency
• Automating Data Science: Prospects and Challenges
• Comprehensible Artificial Intelligence on Knowledge Graphs: A survey
• Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing
• LMMS Reloaded: Transformer-based Sense Embeddings for Disambiguation and Beyond
• A Survey on Intent-aware Recommender Systems
• Empathetic Response Generation through Graph-based Multi-hop Reasoning on Emotional Causality
• Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goals
• AEDNet: Adaptive Edge-Deleting Network For Subgraph Matching
• Unsupervised Social Event Detection via Hybrid Graph Contrastive Learning and Reinforced Incremental Clustering
• Sketching Robot Programs On the Fly
• Portrayal: Leveraging NLP and Visualization for Analyzing Fictional Characters
• A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Tasks
• GripNet: Graph Information Propagation on Supergraph for Heterogeneous Graphs
• Cardinality Estimation over Knowledge Graphs with Embeddings and Graph Neural Networks
• Knowledge Graph Entity Alignment with Graph Convolutional Networks: Lessons Learned
• VAL: Interactive Task Learning with GPT Dialog Parsing
• Distantly Supervised Relation Extraction via Recursive Hierarchy-Interactive Attention and Entity-Order Perception
• A Local Method for Identifying Causal Relations under Markov Equivalence
• Robust Multimodal Sentiment Analysis of Image-Text Pairs by Distribution-Based Feature Recovery and Fusion
• Learning Attention-based Representations from Multiple Patterns for Relation Prediction in Knowledge Graphs
• Model-based inexact graph matching on top of CNNs for semantic scene understanding
• From the Fair Distribution of Predictions to the Fair Distribution of Social Goods: Evaluating the Impact of Fair Machine Learning on Long-Term Unemployment
• Making Intelligence: Ethical Values in IQ and ML Benchmarks
• Session-based Social and Dependency-aware Software Recommendation
• Deontic Paradoxes in ASP with Weak Constraints
• Exploring the Representational Power of Graph Autoencoder
• Predictive Modeling: BIM Command Recommendation Based on Large-scale Usage Logs
• Enhancing Function Name Prediction using Votes-Based Name Tokenization and Multi-Task Learning
• Blind Source Separation of Single-Channel Mixtures via Multi-Encoder Autoencoders
• Variational Prefix Tuning for Diverse and Accurate Code Summarization Using Pre-trained Language Models
• Formal Verification of Robustness and Resilience of Learning-Enabled State Estimation Systems
• Language as a Latent Sequence: deep latent variable models for semi-supervised paraphrase generation
• Fairness in Ranking under Disparate Uncertainty
• Backretrieval: An Image-Pivoted Evaluation Metric for Cross-Lingual Text Representations Without Parallel Corpora
• Semantic Graph Neural Network with Multi-measure Learning for Semi-supervised Classification
• A Contribution to the Defense of Liquid Democracy
• Towards Interactive Reinforcement Learning with Intrinsic Feedback
• Before It's Too Late: A State Space Model for the Early Prediction of Misinformation and Disinformation Engagement
• Self-adhesivity in lattices of abstract conditional independence models
• Reward Augmentation in Reinforcement Learning for Testing Distributed Systems