Personalized Classifier for Food Image Recognition
arXiv:1804.04600 · doi:10.1109/TMM.2018.2814339
Abstract
Currently, food image recognition tasks are evaluated against fixed datasets. However, in real-world conditions, there are cases in which the number of samples in each class continues to increase and samples from novel classes appear. In particular, dynamic datasets in which each individual user creates samples and continues the updating process often have content that varies considerably between different users, and the number of samples per person is very limited. A single classifier common to all users cannot handle such dynamic data. Bridging the gap between the laboratory environment and the real world has not yet been accomplished on a large scale. Personalizing a classifier incrementally for each user is a promising way to do this. In this paper, we address the personalization problem, which involves adapting to the user's domain incrementally using a very limited number of samples. We propose a simple yet effective personalization framework which is a combination of the nearest class mean classifier and the 1-nearest neighbor classifier based on deep features. To conduct realistic experiments, we made use of a new dataset of daily food images collected by a food-logging application. Experimental results show that our proposed method significantly outperforms existing methods.
Accepted to IEEE Transaction on Multimedia. http://ieeexplore.ieee.org/document/8316919/
References in corpus (1)
Cited by in corpus (10)
- Multi-modal Cooking Workflow Construction for Food Recipes
- Large Scale Visual Food Recognition
- ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network
- Recognition of Multiple Food Items in a Single Photo for Use in a Buffet-Style Restaurant
- Food Recommendation: Framework, Existing Solutions and Challenges
- Muti-Stage Hierarchical Food Classification
- Cross-Modal Food Retrieval: Learning a Joint Embedding of Food Images and Recipes with Semantic Consistency and Attention Mechanism
- Simulating Personal Food Consumption Patterns using a Modified Markov Chain
- An Artificial Intelligence-Based System to Assess Nutrient Intake for Hospitalised Patients
- FoodLogAthl-218: Constructing a Real-World Food Image Dataset Using Dietary Management Applications