55 citations · 138 across the 22 of their papers we have counts for
14 papers · 1 filter
Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planning
Kellie Yu Hui Sim, Pin Sym Foong, Chenyu Zhao +3
Loss of decisional capacity, coupled with the increasing absence of reliable human proxies, raises urgent questions about how individuals' values can be represented in Advance Care…
TalkSketch: Multimodal Generative AI for Real-time Sketch Ideation with Speech
Weiyan Shi, Sunaya Upadhyay, Geraldine Quek +1
Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designer…
Towards Aligning Multimodal LLMs with Human Experts: A Focus on Parent-Child Interaction
Weiyan Shi, Kenny Tsu Wei Choo
While multimodal large language models (MLLMs) are increasingly applied in human-centred AI systems, their ability to understand complex social interactions remains uncertain. We p…
BLEnD-Vis: Benchmarking Multimodal Cultural Understanding in Vision Language Models
Bryan Chen Zhengyu Tan, Zheng Weihua, Zhengyuan Liu +4
As vision-language models (VLMs) are deployed globally, their ability to understand culturally situated knowledge becomes essential. Yet, existing evaluations largely assess static…
Humor in Pixels: Benchmarking Large Multimodal Models Understanding of Online Comics
Yuriel Ryan, Rui Yang Tan, Kenny Tsu Wei Choo +1
Understanding humor is a core aspect of social intelligence, yet it remains a significant challenge for Large Multimodal Models (LMMs). We introduce PixelHumor, a benchmark dataset…
Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation
Gionnieve Lim, Bryan Chen Zhengyu Tan, Kellie Yu Hui Sim +6
The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, c…
"I Said Things I Needed to Hear Myself": Peer Support as an Emotional, Organisational, and Sociotechnical Practice in Singapore
Kellie Yu Hui Sim, Kenny Tsu Wei Choo
Peer support plays a vital role in expanding access to mental health care by providing empathetic, community-based support outside formal clinical systems. As digital platforms inc…
"Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported Interactions
Kellie Yu Hui Sim, Roy Ka-Wei Lee, Kenny Tsu Wei Choo
Mental health is a growing global concern, prompting interest in AI-driven solutions to expand access to psychosocial support. Peer support, grounded in lived experience, offers a…
Human-AI Alignment of Multimodal Large Language Models with Speech-Language Pathologists in Parent-Child Interactions
Weiyan Shi, Kenny Tsu Wei Choo
Joint attention is a critical marker of early social-communicative development, yet remains difficult for caregivers to assess without expert guidance. In this work, we explore how…
Envisioning an AI-Enhanced Mental Health Ecosystem
Kellie Yu Hui Sim, Kenny Tsu Wei Choo
The rapid advancement of Large Language Models (LLMs), reasoning models, and agentic AI approaches coincides with a growing global mental health crisis, where increasing demand has…
Analyzing Swimming Performance Using Drone Captured Aerial Videos
Thu Tran, Kenny Tsu Wei Choo, Shaohui Foong +5
Monitoring swimmer performance is crucial for improving training and enhancing athletic techniques. Traditional methods for tracking swimmers, such as above-water and underwater ca…
Empath-D: VR-based Empathetic App Design for Accessibility
Wonjung Kim, Kenny Tsu Wei Choo, Youngki Lee +2
With app-based interaction increasingly permeating all aspects of daily living, it is essential to ensure that apps are designed to be \emph{inclusive} and are usable by a wider au…
Examining Augmented Virtuality Impairment Simulation for Mobile App Accessibility Design
Kenny Tsu Wei Choo, Rajesh Krishna Balan, Youngki Lee
With mobile apps rapidly permeating all aspects of daily living with use by all segments of the population, it is crucial to support the evaluation of app usability for specific im…
Towards Multimodal Large-Language Models for Parent-Child Interaction: A Focus on Joint Attention
Weiyan Shi, Viet Hai Le, Kenny Tsu Wei Choo
Joint attention is a critical component of early speech-language development and a key indicator of effective parent-child interaction. However, research on detecting and analysing…