8 citations · 21 across the 16 of their papers we have counts for
16 papers
ReGraph: Learning to Generate Recipe Graphs from Food Images
Guoshan Liu, Bin Zhu, Pengkun Jiao +3
Recent Large Multimodal Models (LMMs) have achieved impressive performance in recipe generation from food images.However, cooking is a structured transformation process in which in…
Enhancing Action and Ingredient Modeling for Semantically Grounded Recipe Generation
Guoshan Liu, Bin Zhu, Yian Li +3
Recent advances in Multimodal Large Language Models (MLMMs) have enabled recipe generation from food images, yet outputs often contain semantically incorrect actions or ingredients…
LLMs-based Augmentation for Domain Adaptation in Long-tailed Food Datasets
Qing Wang, Chong-Wah Ngo, Ee-Peng Lim +1
Training a model for food recognition is challenging because the training samples, which are typically crawled from the Internet, are visually different from the pictures captured…
Efficient Test-Time Retrieval Augmented Generation
Hailong Yin, Bin Zhu, Jingjing Chen +1
Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG)…
Towards Unbiased Cross-Modal Representation Learning for Food Image-to-Recipe Retrieval
Qing Wang, Chong-Wah Ngo, Ee-Peng Lim
This paper addresses the challenges of learning representations for recipes and food images in the cross-modal retrieval problem. As the relationship between a recipe and its cooke…
Mitigating Cross-modal Representation Bias for Multicultural Image-to-Recipe Retrieval
Qing Wang, Chong-Wah Ngo, Yu Cao +1
Existing approaches for image-to-recipe retrieval have the implicit assumption that a food image can fully capture the details textually documented in its recipe. However, a food i…
Class Agnostic Instance-level Descriptor for Visual Instance Search
Qi-Ying Sun, Wan-Lei Zhao, Hui-Ying Xie +2
Despite the great success of the deep features in content-based image retrieval, the visual instance search remains challenging due to the lack of effective instance-level feature…
Advancing Food Nutrition Estimation via Visual-Ingredient Feature Fusion
Huiyan Qi, Bin Zhu, Chong-Wah Ngo +2
Nutrition estimation is an important component of promoting healthy eating and mitigating diet-related health risks. Despite advances in tasks such as food classification and ingre…
Efficient Prompt Tuning for Hierarchical Ingredient Recognition
Yinxuan Gui, Bin Zhu, Jingjing Chen +1
Fine-grained ingredient recognition presents a significant challenge due to the diverse appearances of ingredients, resulting from different cutting and cooking methods. While exis…
Don't Deceive Me: Mitigating Gaslighting through Attention Reallocation in LMMs
Pengkun Jiao, Bin Zhu, Jingjing Chen +2
Large Multimodal Models (LMMs) have demonstrated remarkable capabilities across a wide range of tasks. However, their vulnerability to user gaslighting-the deliberate use of mislea…
CookingDiffusion: Cooking Procedural Image Generation with Stable Diffusion
Yuan Wang, Bin Zhu, Yanbin Hao +3
Recent advancements in text-to-image generation models have excelled in creating diverse and realistic images. This success extends to food imagery, where various conditional input…
Benchmarking Gaslighting Negation Attacks Against Multimodal Large Language Models
Bin Zhu, Yinxuan Gui, Huiyan Qi +3
Multimodal Large Language Models (MLLMs) have exhibited remarkable advancements in integrating different modalities, excelling in complex understanding and generation tasks. Despit…
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan +48
Vision Language Models (VLMs) often struggle with culture-specific knowledge, particularly in languages other than English and in underrepresented cultural contexts. To evaluate th…
Navigating Weight Prediction with Diet Diary
Yinxuan Gui, Bin Zhu, Jingjing Chen +2
Current research in food analysis primarily concentrates on tasks such as food recognition, recipe retrieval and nutrition estimation from a single image. Nevertheless, there is a…
Towards Multimodal Emotional Support Conversation Systems
Yuqi Chu, Lizi Liao, Zhiyuan Zhou +2
The integration of conversational artificial intelligence (AI) into mental health care promises a new horizon for therapist-client interactions, aiming to closely emulate the depth…
PosMLP-Video: Spatial and Temporal Relative Position Encoding for Efficient Video Recognition
Yanbin Hao, Diansong Zhou, Zhicai Wang +2
In recent years, vision Transformers and MLPs have demonstrated remarkable performance in image understanding tasks. However, their inherently dense computational operators, such a…