A Hybrid Framework for Matching Printing Design Files to Product Photos

Abstract

We propose a real-time image matching framework, which is hybrid in the sense that it uses both hand-crafted features and deep features obtained from a well-tuned deep convolutional network. The matching problem, which we concentrate on, is specific to a certain application, that is, printing design to product photo matching. Printing designs are any kind of template image files, created using a design tool, thus are perfect image signals. However, photographs of a printed product suffer many unwanted effects, such as uncontrolled shooting angle, uncontrolled illumination, occlusions, printing deficiencies in color, camera noise, optic blur, et cetera. For this purpose, we create an image set that includes printing design and corresponding product photo pairs with collaboration of an actual printing facility. Using this image set, we benchmark various hand-crafted and deep features for matching performance and propose a framework in which deep learning is utilized with highest contribution, but without disabling real-time operation using an ordinary desktop computer.

References in corpus (8)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
• Understanding Neural Networks Through Deep Visualization
• OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
• A Review on Deep Learning Techniques Applied to Semantic Segmentation
• A Survey of Semantic Segmentation
• A Revisit on Deep Hashings for Large-scale Content Based Image Retrieval
• Semantic Video Segmentation: A Review on Recent Approaches