19 citations · 29 across the 11 of their papers we have counts for
8 papers · 1 filter
The Way We Notice, That's What Really Matters: Instantiating UI Components with Distinguishing Variations
Priyan Vaithilingam, Alan Leung, Jeffrey Nichols +1
Front-end developers author UI components to be broadly reusable by parameterizing visual and behavioral properties. While flexible, this makes instantiation harder, as developers…
Mapping the Design Space of User Experience for Computer Use Agents
Ruijia Cheng, Jenny T. Liang, Eldon Schoop +1
Large language model (LLM)-based computer use agents execute user commands by interacting with available UI elements, but little is known about how users want to interact with thes…
Understanding User Experiences of Computer Use Agents: Design Space and Opportunities for Building Agent UX Prototypes
Jenny T. Liang, Titus Barik, Jeffrey Nichols +2
Computer use agents (or "agents") are generative AI that automates actions within user interfaces from user commands. Current research focuses on training and evaluating the underl…
Improving User Interface Generation Models from Designer Feedback
Jason Wu, Amanda Swearngin, Arun Krishna Vajjala +3
Despite being trained on vast amounts of data, most LLMs are unable to reliably generate well-designed UIs. Designer feedback is essential to improving performance on UI generation…
Athena: Intermediate Representations for Iterative Scaffolded App Generation with an LLM
Jazbo Beason, Ruijia Cheng, Eldon Schoop +1
It is challenging to generate the code for a complete user interface using a Large Language Model (LLM). User interfaces are complex and their implementations often consist of mult…
Misty: UI Prototyping Through Interactive Conceptual Blending
Yuwen Lu, Alan Leung, Amanda Swearngin +2
UI prototyping often involves iterating and blending elements from examples such as screenshots and sketches, but current tools offer limited support for incorporating these exampl…
BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks
Ruijia Cheng, Titus Barik, Alan Leung +2
Programmers frequently engage with machine learning tutorials in computational notebooks and have been adopting code generation technologies based on large language models (LLMs).…
Keyframer: Empowering Animation Design using Large Language Models
Tiffany Tseng, Ruijia Cheng, Jeffrey Nichols
Creating 2D animations is a complex, iterative process requiring continuous adjustments to movement, timing, and coordination of multiple elements within a scene. To support design…