50 citations · 57 across the 7 of their papers we have counts for
8 papers
iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents
Yuting Ning, Ruijia Cheng, Sushobhan Ghosh +7
An agent that truly knows and acts on behalf of its user has been a long-standing promise of AI assistants. Computer-use agents bring this promise within reach by capably executing…
Mapping the Design Space of User Experience for Computer Use Agents
Ruijia Cheng, Jenny T. Liang, Eldon Schoop +1
Large language model (LLM)-based computer use agents execute user commands by interacting with available UI elements, but little is known about how users want to interact with thes…
Understanding User Experiences of Computer Use Agents: Design Space and Opportunities for Building Agent UX Prototypes
Jenny T. Liang, Titus Barik, Jeffrey Nichols +2
Computer use agents (or "agents") are generative AI that automates actions within user interfaces from user commands. Current research focuses on training and evaluating the underl…
Athena: Intermediate Representations for Iterative Scaffolded App Generation with an LLM
Jazbo Beason, Ruijia Cheng, Eldon Schoop +1
It is challenging to generate the code for a complete user interface using a Large Language Model (LLM). User interfaces are complex and their implementations often consist of mult…
BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks
Ruijia Cheng, Titus Barik, Alan Leung +2
Programmers frequently engage with machine learning tutorials in computational notebooks and have been adopting code generation technologies based on large language models (LLMs).…
Keyframer: Empowering Animation Design using Large Language Models
Tiffany Tseng, Ruijia Cheng, Jeffrey Nichols
Creating 2D animations is a complex, iterative process requiring continuous adjustments to movement, timing, and coordination of multiple elements within a scene. To support design…
AXNav: Replaying Accessibility Tests from Natural Language
Maryam Taeb, Amanda Swearngin, Eldon Schoop +3
Developers and quality assurance testers often rely on manual testing to test accessibility features throughout the product lifecycle. Unfortunately, manual testing can be tedious,…
An Exploration of Post-Editing Effectiveness in Text Summarization
Vivian Lai, Alison Smith-Renner, Ke Zhang +4
Automatic summarization methods are efficient but can suffer from low quality. In comparison, manual summarization is expensive but produces higher quality. Can humans and AI colla…