19 citations · 25 across the 8 of their papers we have counts for
8 papers
FlowEval: Reference-based Evaluation of Generated User Interfaces
Jason Wu, Priyan Vaithilingam, Eldon Schoop +2
While large language models (LLMs) and coding agents are often applied to user interface (UI) development, developers find it difficult to reliably assess their proficiency in visu…
The Way We Notice, That's What Really Matters: Instantiating UI Components with Distinguishing Variations
Priyan Vaithilingam, Alan Leung, Jeffrey Nichols +1
Front-end developers author UI components to be broadly reusable by parameterizing visual and behavioral properties. While flexible, this makes instantiation harder, as developers…
Understanding User Experiences of Computer Use Agents: Design Space and Opportunities for Building Agent UX Prototypes
Jenny T. Liang, Titus Barik, Jeffrey Nichols +2
Computer use agents (or "agents") are generative AI that automates actions within user interfaces from user commands. Current research focuses on training and evaluating the underl…
Improving User Interface Generation Models from Designer Feedback
Jason Wu, Amanda Swearngin, Arun Krishna Vajjala +3
Despite being trained on vast amounts of data, most LLMs are unable to reliably generate well-designed UIs. Designer feedback is essential to improving performance on UI generation…
Misty: UI Prototyping Through Interactive Conceptual Blending
Yuwen Lu, Alan Leung, Amanda Swearngin +2
UI prototyping often involves iterating and blending elements from examples such as screenshots and sketches, but current tools offer limited support for incorporating these exampl…
Automated Code Fix Suggestions for Accessibility Issues in Mobile Apps
Forough Mehralian, Titus Barik, Jeff Nichols +1
Accessibility is crucial for inclusive app usability, yet developers often struggle to identify and fix app accessibility issues due to a lack of awareness, expertise, and inadequa…
UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback
Jason Wu, Eldon Schoop, Alan Leung +3
Large language models (LLMs) struggle to consistently generate UI code that compiles and produces visually relevant designs. Existing approaches to improve generation rely on expen…
Make It Make Sense! Understanding and Facilitating Sensemaking in Computational Notebooks
Souti Chattopadhyay, Zixuan Feng, Emily Arteaga +4
Reusing and making sense of other scientists' computational notebooks. However, making sense of existing notebooks is a struggle, as these reference notebooks are often exploratory…