338 citations · 419 across the 12 of their papers we have counts for
12 papers
STAR: Smartphone-analogous Typing in Augmented Reality
Taejun Kim, Amy Karlson, Aakar Gupta +6
While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge.…
How Novices Use LLM-Based Code Generators to Solve CS1 Coding Tasks in a Self-Paced Learning Environment
Majeed Kazemitabaar, Xinying Hou, Austin Henley +3
As Large Language Models (LLMs) gain in popularity, it is important to understand how novice programmers use them. We present a thematic analysis of 33 learners, aged 10-17, indepe…
XR Input Error Mediation for Hand-Based Input: Task and Context Influences a User's Preference
Tica Lin, Ben Lafreniere, Yan Xu +3
Many XR devices use bare-hand gestures to reduce the need for handheld controllers. Such gestures, however, lead to false positive and false negative recognition errors, which detr…
DiLogics: Creating Web Automation Programs With Diverse Logics
Kevin Pu, Jim Yang, Angel Yuan +5
Knowledge workers frequently encounter repetitive web data entry tasks, like updating records or placing orders. Web automation increases productivity, but translating tasks to web…
Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models
Stephen Brade, Bryan Wang, Mauricio Sousa +2
Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capt…
Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues
Jiannan Li, Mauricio Sousa, Karthik Mahadevan +7
Live and pre-recorded video tutorials are an effective means for teaching physical skills such as cooking or prototyping electronics. A dedicated cameraperson following an instruct…
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Majeed Kazemitabaar, Justin Chow, Carl Ka To Ma +3
AI code generators like OpenAI Codex have the potential to assist novice programmers by generating code from natural language descriptions, however, over-reliance might negatively…
Scaffolding Progress: How Structured Editors Shape Novice Errors When Transitioning from Blocks to Text
Majeed Kazemitabaar, Viktar Chyhir, David Weintrop +1
Transitioning from block-based programming to text-based programming environments can be challenging as it requires students to learn new programming language concepts. In this pap…
Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning
Bryan Wang, Gang Li, Xin Zhou +3
Mobile User Interface Summarization generates succinct language descriptions of mobile screens for conveying important contents and functionalities of the screen, which can be usef…
"Grip-that-there": An Investigation of Explicit and Implicit Task Allocation Techniques for Human-Robot Collaboration
Karthik Mahadevan, Maurício Sousa, Anthony Tang +1
In ad-hoc human-robot collaboration (HRC), humans and robots work on a task without pre-planning the robot's actions prior to execution; instead, task allocation occurs in real-tim…
Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing
Bryan Wang, Mengyu Yang, Tovi Grossman
Learning musical instruments using online instructional videos has become increasingly prevalent. However, pre-recorded videos lack the instantaneous feedback and personal tailorin…
Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training
Geoffrey X. Yu, Tovi Grossman, Gennady Pekhimenko
Training a state-of-the-art deep neural network (DNN) is a computationally-expensive and time-consuming process, which incentivizes deep learning developers to debug their DNNs for…