7 papers
Sidekick: Designing Communication for Effective Multitasking with Computer Use Agents
Ruei-Che Chang, Wenqian Xu, Dingzeyu Li +2
Computer Use Agents (CUAs) can autonomously execute complex, multi-step tasks within GUIs, enhancing efficiency through parallel multitasking. However, our formative studies with C…
Schemex: Discovering Structural Abstractions from Examples
Sitong Wang, Samia Menon, Dingzeyu Li +3
Creative and communicative work is often underpinned by implicit structures, such as the Hero's Journey in storytelling, design patterns in software, or chord progressions in music…
Rewriting Video: Text-Driven Reauthoring of Video Footage
Sitong Wang, Anh Truong, Lydia B. Chilton +1
Video is a powerful medium for communication and storytelling, yet reauthoring existing footage remains challenging. Even simple edits often demand expertise, time, and careful pla…
A Text-Native Interface for Generative Video Authoring
Xingyu Bruce Liu, Mira Dontcheva, Dingzeyu Li
Everyone can write their stories in freeform text format -- it's something we all learn in school. Yet storytelling via video requires one to learn specialized and complicated tool…
SweeperBot: Making 3D Browsing Accessible through View Analysis and Visual Question Answering
Chen Chen, Cuong Nguyen, Alexa Siu +2
Accessing 3D models remains challenging for Screen Reader (SR) users. While some existing 3D viewers allow creators to provide alternative text, they often lack sufficient detail a…
Facilitating Longitudinal Interaction Studies of AI Systems
Tao Long, Sitong Wang, Ãmilie Fabre +14
UIST researchers develop tools to address user challenges. However, user interactions with AI evolve over time through learning, adaptation, and repurposing, making one time evalua…