activity
20192026
most citedScreen2Vec: Semantic Embedding of GUI Screens and GUI Components

72 citations · 252 across the 15 of their papers we have counts for

collaborators
Showing cs.HCShow all

11 papers · 1 filter

cs.HC2026

Intelligent Interaction Techniques (IIxT) - Proposal

Brad A. Myers

Interaction techniques (IxTs) are the low-level, reusable components out of which user interfaces are designed, including menus, scroll bars, text input fields, and also copy-paste…

cs.HC2022

ScrollTest: Evaluating Scrolling Speed and Accuracy

Chaoran Chen, Brad A. Myers, Cem Ergin +3

Scrolling is an essential interaction technique enabling users to display previously off-screen content. Existing evaluation models for scrolling are often entangled with the selec…

cs.HC2022★ 62 cited

Wigglite: Low-cost Information Collection and Triage

Michael Xieyang Liu, Andrew Kuznetsov, Yongsung Kim +3

Consumers conducting comparison shopping, researchers making sense of competitive space, and developers looking for code snippets online all face the challenge of capturing the inf…

cs.HC2021★ 26 cited

Understanding How Programmers Can Use Annotations on Documentation

Amber Horvath, Michael Xieyang Liu, River Hendriksen +5

Modern software development requires developers to find and effectively utilize new APIs and their documentation, but documentation has many well-known issues. Despite this, develo…

cs.HC2021★ 2 cited

A Need-finding Study for Understanding Text Entry in Smartphone App Usage

Toby Jia-Jun Li, Brad A. Myers

Text entry makes up about one-fourth of the smartphone interaction events, and is known to be challenging and difficult. However, there has been little study about the characterist…

cs.HC2021

To Reuse or Not To Reuse? A Framework and System for Evaluating Summarized Knowledge

Michael Xieyang Liu, Aniket Kittur, Brad A. Myers

As the amount of information online continues to grow, a correspondingly important opportunity is for individuals to reuse knowledge which has been summarized by others rather than…

cs.HC2021★ 72 cited

Screen2Vec: Semantic Embedding of GUI Screens and GUI Components

Toby Jia-Jun Li, Lindsay Popowski, Tom M. Mitchell +1

Representing the semantics of GUI screens and components is crucial to data-driven computational methods for modeling user-GUI interactions and mining GUI designs. Existing GUI sem…

cs.HC2020★ 5 cited

Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration Systems

Toby Jia-Jun Li, Jingya Chen, Brandon Canfield +1

An important concern in end user development (EUD) is accidentally embedding personal information in program artifacts when sharing them. This issue is particularly important in GU…

cs.HC2020

Towards Effective Human-AI Collaboration in GUI-Based Interactive Task Learning Agents

Toby Jia-Jun Li, Jingya Chen, Tom M. Mitchell +1

We argue that a key challenge in enabling usable and useful interactive task learning for intelligent agents is to facilitate effective Human-AI collaboration. We reflect on our pa…

cs.HC2019★ 2 cited

PLIERS: A Process that Integrates User-Centered Methods into Programming Language Design

Michael Coblenz, Gauri Kambhatla, Paulette Koronkevich +5

Programming language design requires making many usability-related design decisions. However, existing HCI methods can be impractical to apply to programming languages: they have h…

cs.HC2019★ 6 cited

Interactive Task and Concept Learning from Natural Language Instructions and GUI Demonstrations

Toby Jia-Jun Li, Marissa Radensky, Justin Jia +3

Natural language programming is a promising approach to enable end users to instruct new tasks for intelligent agents. However, our formative study found that end users would often…