Multi-View Matrix Completion for Multi-Label Image Classification

Abstract

There is growing interest in multi-label image classification due to its critical role in web-based image analytics-based applications, such as large-scale image retrieval and browsing. Matrix completion has recently been introduced as a method for transductive (semi-supervised) multi-label classification, and has several distinct advantages, including robustness to missing data and background noise in both feature and label space. However, it is limited by only considering data represented by a single-view feature, which cannot precisely characterize images containing several semantic concepts. To utilize multiple features taken from different views, we have to concatenate the different features as a long vector. But this concatenation is prone to over-fitting and often leads to very high time complexity in MC based image classification. Therefore, we propose to weightedly combine the MC outputs of different views, and present the multi-view matrix completion (MVMC) framework for transductive multi-label image classification. To learn the view combination weights effectively, we apply a cross validation strategy on the labeled set. In the learning process, we adopt the average precision (AP) loss, which is particular suitable for multi-label image classification. A least squares loss formulation is also presented for the sake of efficiency, and the robustness of the algorithm based on the AP loss compared with the other losses is investigated. Experimental evaluation on two real world datasets (PASCAL VOC' 07 and MIR Flickr) demonstrate the effectiveness of MVMC for transductive (semi-supervised) multi-label image classification, and show that MVMC can exploit complementary properties of different features and output-consistent labels for improved multi-label image classification.

References in corpus (4)

• Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation
• Multi-view Vector-valued Manifold Regularization for Multi-label Image Classification
• Consistency and robustness of kernel-based regression in convex risk minimization
• Learning Multi-modal Similarity

Cited by in corpus (15)

• Multi-view Low-rank Sparse Subspace Clustering
• Large Margin Multi-modal Multi-task Feature Extraction for Image Classification
• A Concise yet Effective model for Non-Aligned Incomplete Multi-view and Missing Multi-label Learning
• Fast Low-Rank Bayesian Matrix Completion with Hierarchical Gaussian Prior Models
• A New Distance Measure for Non-Identical Data with Application to Image Classification
• Tensor factorization based method for low rank matrix completion and its application on tensor completion
• Double Weighted Truncated Nuclear Norm Regularization for Low-Rank Matrix Completion
• Active Feature Acquisition with Supervised Matrix Completion
• Robust Triple-Matrix-Recovery-Based Auto-Weighted Label Propagation for Classification
• Cross-view kernel transfer
• Associating Multi-Scale Receptive Fields for Fine-grained Recognition
• Efficient Low Rank Matrix Recovery With Flexible Group Sparse Regularization
• Simulation comparisons between Bayesian and de-biased estimators in low-rank matrix completion
• Correlated Logistic Model With Elastic Net Regularization for Multilabel Image Classification
• A Multi-View Approach Based on Naming Behavioral Modeling for Aligning Chinese User Accounts across Multiple Networks