4 papers
TalkSketch: Multimodal Generative AI for Real-time Sketch Ideation with Speech
Weiyan Shi, Sunaya Upadhyay, Geraldine Quek +1
Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designer…
Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation
Gionnieve Lim, Bryan Chen Zhengyu Tan, Kellie Yu Hui Sim +6
The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, c…
Human-AI Alignment of Multimodal Large Language Models with Speech-Language Pathologists in Parent-Child Interactions
Weiyan Shi, Kenny Tsu Wei Choo
Joint attention is a critical marker of early social-communicative development, yet remains difficult for caregivers to assess without expert guidance. In this work, we explore how…
Towards Multimodal Large-Language Models for Parent-Child Interaction: A Focus on Joint Attention
Weiyan Shi, Viet Hai Le, Kenny Tsu Wei Choo
Joint attention is a critical component of early speech-language development and a key indicator of effective parent-child interaction. However, research on detecting and analysing…