238 citations · 486 across the 15 of their papers we have counts for
15 papers
AI Hiring with LLMs: A Context-Aware and Explainable Multi-Agent Framework for Resume Screening
Frank P. -W. Lo, Jianing Qiu, Zeyu Wang +4
Resume screening is a critical yet time-intensive process in talent acquisition, requiring recruiters to analyze vast volume of job applications while remaining objective, accurate…
Dietary Assessment with Multimodal ChatGPT: A Systematic Analysis
Frank P. -W. Lo, Jianing Qiu, Zeyu Wang +6
Conventional approaches to dietary assessment are primarily grounded in self-reporting methods or structured interviews conducted under the supervision of dietitians. These methods…
Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentation
Peilun Shi, Jianing Qiu, Sai Mu Dalike Abaxi +3
In this paper, we examine the recent Segment Anything Model (SAM) on medical images, and report both quantitative and qualitative zero-shot segmentation results on nine medical ima…
Large AI Models in Health Informatics: Applications, Challenges, and the Future
Jianing Qiu, Lin Li, Jiankai Sun +11
Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions. Once p…
EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditions
Peilun Shi, Jiachuan Peng, Jianing Qiu +3
Accurate depth estimation under adverse night conditions has practical impact and applications, such as on autonomous driving and rescue robots. In this work, we studied monocular…
MenuAI: Restaurant Food Recommendation System via a Transformer-based Deep Learning Model
Xinwei Ju, Frank Po Wen Lo, Jianing Qiu +3
Food recommendation system has proven as an effective technology to provide guidance on dietary choices, and this is especially important for patients suffering from chronic diseas…
Clustering Egocentric Images in Passive Dietary Monitoring with Self-Supervised Learning
Jiachuan Peng, Peilun Shi, Jianing Qiu +12
In our recent dietary assessment field studies on passive dietary monitoring in Ghana, we have collected over 250k in-the-wild images. The dataset is an ongoing effort to facilitat…
Tackling Long-Tailed Category Distribution Under Domain Shifts
Xiao Gu, Yao Guo, Zeju Li +5
Machine learning models fail to perform well on real-world applications when 1) the category distribution P(Y) of the training dataset suffers from long-tailed distribution and 2)…
Mining Discriminative Food Regions for Accurate Food Recognition
Jianing Qiu, Frank P. -W. Lo, Yingnan Sun +2
Automatic food recognition is the very first step towards passive dietary monitoring. In this paper, we address the problem of food recognition by mining discriminative food region…
Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion
Jianing Qiu, Lipeng Chen, Xiao Gu +5
In this paper, we address the problem of forecasting the trajectory of an egocentric camera wearer (ego-person) in crowded spaces. The trajectory forecasting ability learned from t…
Occlusion-Invariant Rotation-Equivariant Semi-Supervised Depth Based Cross-View Gait Pose Estimation
Xiao Gu, Jianxin Yang, Hanxiao Zhang +5
Accurate estimation of three-dimensional human skeletons from depth images can provide important metrics for healthcare applications, especially for biomechanical gait analysis. Ho…
TransAction: ICL-SJTU Submission to EPIC-Kitchens Action Anticipation Challenge 2021
Xiao Gu, Jianing Qiu, Yao Guo +2
In this report, the technical details of our submission to the EPIC-Kitchens Action Anticipation Challenge 2021 are given. We developed a hierarchical attention model for action an…
Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring
Jianing Qiu, Frank P. -W. Lo, Xiao Gu +10
Camera-based passive dietary intake monitoring is able to continuously capture the eating episodes of a subject, recording rich visual information, such as the type and volume of f…
An Intelligent Passive Food Intake Assessment System with Egocentric Cameras
Frank Po Wen Lo, Modou L Jobarteh, Yingnan Sun +4
Malnutrition is a major public health concern in low-and-middle-income countries (LMICs). Understanding food and nutrient intake across communities, households and individuals is c…
Indoor Future Person Localization from an Egocentric Wearable Camera
Jianing Qiu, Frank P. -W. Lo, Xiao Gu +3
Accurate prediction of future person location and movement trajectory from an egocentric wearable camera can benefit a wide range of applications, such as assisting visually impair…