1 citations · 2 across the 7 of their papers we have counts for
8 papers · 1 filter
When Drawing Is Not Enough: Exploring Spontaneous Speech with Sketch for Intent Alignment in Multimodal LLMs
Weiyan Shi, Dorien Herremans, Kenny Tsu Wei Choo
Early-stage design ideation often relies on rough sketches created under time pressure, leaving much of the designer's intent implicit. In practice, designers frequently speak whil…
More Than 1v1: Human-AI Alignment in Early Developmental Communities with Multimodal LLMs
Weiyan Shi, Kenny Tsu Wei Choo
In early developmental contexts, particularly in parent-child interaction analysis, alignment involves families and professionals such as speech-language pathologists (SLPs) who in…
A Taxonomy of Human--MLLM Interaction in Early-Stage Sketch-Based Design Ideation
Weiyan Shi, Kenny Tsu Wei Choo
As multimodal large language models (MLLMs) are increasingly integrated into early-stage design tools, it is important to understand how designers collaborate with AI during ideati…
TalkSketch: Multimodal Generative AI for Real-time Sketch Ideation with Speech
Weiyan Shi, Sunaya Upadhyay, Geraldine Quek +1
Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designer…
Towards Aligning Multimodal LLMs with Human Experts: A Focus on Parent-Child Interaction
Weiyan Shi, Kenny Tsu Wei Choo
While multimodal large language models (MLLMs) are increasingly applied in human-centred AI systems, their ability to understand complex social interactions remains uncertain. We p…
Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation
Gionnieve Lim, Bryan Chen Zhengyu Tan, Kellie Yu Hui Sim +6
The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, c…