5 papers
Compass vs Railway Tracks: Unpacking User Mental Models for Communicating Long-Horizon Work to Humans vs. AI
Savvas Petridis, Michael Xieyang Liu, Alexander J. Fiannaca +2
As AI systems grow increasingly capable of operating for hours or days at a time, users' prompts are transforming into elaborate specifications for the AI to autonomously work on.…
Position: Towards Bidirectional Human-AI Alignment
Hua Shen, Tiffany Knearem, Reshmi Ghosh +21
Recent advances in general-purpose AI underscore the urgent need to align AI systems with human goals and values. Yet, the lack of a clear, shared understanding of what constitutes…
Facilitating Longitudinal Interaction Studies of AI Systems
Tao Long, Sitong Wang, Ãmilie Fabre +14
UIST researchers develop tools to address user challenges. However, user interactions with AI evolve over time through learning, adaptation, and repurposing, making one time evalua…
Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning
Michael Xieyang Liu, Savvas Petridis, Vivian Tsai +4
Multimodal large language models (MLLMs), with their expansive world knowledge and reasoning capabilities, present a unique opportunity for end-users to create personalized AI sens…
In Situ AI Prototyping: Infusing Multimodal Prompts into Mobile Settings with MobileMaker
Savvas Petridis, Michael Xieyang Liu, Alexander J. Fiannaca +3
Recent advances in multimodal large language models (LLMs) have made it easier to rapidly prototype AI-powered features, especially for mobile use cases. However, gathering early,…