Regularizing Reasons for Outfit Evaluation with Gradient Penalty
arXiv:2002.00460
Abstract
In this paper, we build an outfit evaluation system which provides feedbacks consisting of a judgment with a convincing explanation. The system is trained in a supervised manner which faithfully follows the domain knowledge in fashion. We create the EVALUATION3 dataset which is annotated with judgment, the decisive reason for the judgment, and all corresponding attributes (e.g. print, silhouette, and material \etc.). In the training process, features of all attributes in an outfit are first extracted and then concatenated as the input for the intra-factor compatibility net. Then, the inter-factor compatibility net is used to compute the loss for judgment. We penalize the gradient of judgment loss of so that our Grad-CAM-like reason is regularized to be consistent with the labeled reason. In inference, according to the obtained information of judgment, reason, and attributes, a user-friendly explanation sentence is generated by the pre-defined templates. The experimental results show that the obtained network combines the advantages of high precision and good interpretation.
10 pages
References in corpus (10)
- Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks
- Methods for Interpreting and Understanding Deep Neural Networks
- Striving for Simplicity: The All Convolutional Net
- Towards Robust Interpretability with Self-Explaining Neural Networks
- Explainable Outfit Recommendation with Joint Outfit Matching and Comment Generation
- Visually Explainable Recommendation
- Regularizing Black-box Models for Improved Interpretability
- Compatibility Family Learning for Item Recommendation and Generation
- Modeling Visual Compatibility through Hierarchical Mid-level Elements
- Complete the Look: Scene-based Complementary Product Recommendation