55 citations · 138 across the 22 of their papers we have counts for
23 papers
Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planning
Kellie Yu Hui Sim, Pin Sym Foong, Chenyu Zhao +3
Loss of decisional capacity, coupled with the increasing absence of reliable human proxies, raises urgent questions about how individuals' values can be represented in Advance Care…
TalkSketch: Multimodal Generative AI for Real-time Sketch Ideation with Speech
Weiyan Shi, Sunaya Upadhyay, Geraldine Quek +1
Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designer…
Towards Aligning Multimodal LLMs with Human Experts: A Focus on Parent-Child Interaction
Weiyan Shi, Kenny Tsu Wei Choo
While multimodal large language models (MLLMs) are increasingly applied in human-centred AI systems, their ability to understand complex social interactions remains uncertain. We p…
BLEnD-Vis: Benchmarking Multimodal Cultural Understanding in Vision Language Models
Bryan Chen Zhengyu Tan, Zheng Weihua, Zhengyuan Liu +4
As vision-language models (VLMs) are deployed globally, their ability to understand culturally situated knowledge becomes essential. Yet, existing evaluations largely assess static…
Humor in Pixels: Benchmarking Large Multimodal Models Understanding of Online Comics
Yuriel Ryan, Rui Yang Tan, Kenny Tsu Wei Choo +1
Understanding humor is a core aspect of social intelligence, yet it remains a significant challenge for Large Multimodal Models (LMMs). We introduce PixelHumor, a benchmark dataset…
Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation
Gionnieve Lim, Bryan Chen Zhengyu Tan, Kellie Yu Hui Sim +6
The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, c…
"I Said Things I Needed to Hear Myself": Peer Support as an Emotional, Organisational, and Sociotechnical Practice in Singapore
Kellie Yu Hui Sim, Kenny Tsu Wei Choo
Peer support plays a vital role in expanding access to mental health care by providing empathetic, community-based support outside formal clinical systems. As digital platforms inc…
"Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported Interactions
Kellie Yu Hui Sim, Roy Ka-Wei Lee, Kenny Tsu Wei Choo
Mental health is a growing global concern, prompting interest in AI-driven solutions to expand access to psychosocial support. Peer support, grounded in lived experience, offers a…
Human-AI Alignment of Multimodal Large Language Models with Speech-Language Pathologists in Parent-Child Interactions
Weiyan Shi, Kenny Tsu Wei Choo
Joint attention is a critical marker of early social-communicative development, yet remains difficult for caregivers to assess without expert guidance. In this work, we explore how…
Envisioning an AI-Enhanced Mental Health Ecosystem
Kellie Yu Hui Sim, Kenny Tsu Wei Choo
The rapid advancement of Large Language Models (LLMs), reasoning models, and agentic AI approaches coincides with a growing global mental health crisis, where increasing demand has…
Analyzing Swimming Performance Using Drone Captured Aerial Videos
Thu Tran, Kenny Tsu Wei Choo, Shaohui Foong +5
Monitoring swimmer performance is crucial for improving training and enhancing athletic techniques. Traditional methods for tracking swimmers, such as above-water and underwater ca…
Empath-D: VR-based Empathetic App Design for Accessibility
Wonjung Kim, Kenny Tsu Wei Choo, Youngki Lee +2
With app-based interaction increasingly permeating all aspects of daily living, it is essential to ensure that apps are designed to be \emph{inclusive} and are usable by a wider au…
Examining Augmented Virtuality Impairment Simulation for Mobile App Accessibility Design
Kenny Tsu Wei Choo, Rajesh Krishna Balan, Youngki Lee
With mobile apps rapidly permeating all aspects of daily living with use by all segments of the population, it is crucial to support the evaluation of app usability for specific im…
Towards Multimodal Large-Language Models for Parent-Child Interaction: A Focus on Joint Attention
Weiyan Shi, Viet Hai Le, Kenny Tsu Wei Choo
Joint attention is a critical component of early speech-language development and a key indicator of effective parent-child interaction. However, research on detecting and analysing…
Exploring Gaze Pattern Differences Between Autistic and Neurotypical Children: Clustering, Visualisation, and Prediction
Weiyan Shi, Haihong Zhang, Wei Wang +1
Autism Spectrum Disorder (ASD) affects children's social and communication abilities, with eye-tracking widely used to identify atypical gaze patterns. While unsupervised clusterin…
ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbations
Yunze Xiao, Yujia Hu, Kenny Tsu Wei Choo +1
Detecting hate speech and offensive language is essential for maintaining a safe and respectful digital environment. This study examines the limitations of state-of-the-art large l…
Towards Understanding Emotions for Engaged Mental Health Conversations
Kellie Yu Hui Sim, Kohleen Tijing Fortuno, Kenny Tsu Wei Choo
Providing timely support and intervention is crucial in mental health settings. As the need to engage youth comfortable with texting increases, mental health providers are explorin…
SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singapore
Ri Chi Ng, Nirmalendu Prakash, Ming Shan Hee +2
To address the limitations of current hate speech detection models, we introduce \textsf{SGHateCheck}, a novel framework designed for the linguistic and cultural context of Singapo…
A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
Jie Gao, Simret Araya Gebreegziabher, Kenny Tsu Wei Choo +3
With ChatGPT's release, conversational prompting has become the most popular form of human-LLM interaction. However, its effectiveness is limited for more complex tasks involving r…
Impact of Human-AI Interaction on User Trust and Reliance in AI-Assisted Qualitative Coding
Jie Gao, Junming Cao, ShunYi Yeo +5
While AI shows promise for enhancing the efficiency of qualitative analysis, the unique human-AI interaction resulting from varied coding strategies makes it challenging to develop…
Evaluating GPT-3 Generated Explanations for Hateful Content Moderation
Han Wang, Ming Shan Hee, Md Rabiul Awal +2
Recent research has focused on using large language models (LLMs) to generate explanations for hate speech through fine-tuning or prompting. Despite the growing interest in this ar…
CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysis
Jie Gao, Kenny Tsu Wei Choo, Junming Cao +2
While AI-assisted individual qualitative analysis has been substantially studied, AI-assisted collaborative qualitative analysis (CQA)-a process that involves multiple researchers…
Pose Estimation for Facilitating Movement Learning from Online Videos
Atima Tharatipyakul, Kenny Choo, Simon T. Perrault
There exists a multitude of online video tutorials to teach physical movements such as exercises. Yet, users lack support to verify the accuracy of their movements when following s…