122 citations · 188 across the 20 of their papers we have counts for
20 papers
Facilitating Longitudinal Interaction Studies of AI Systems
Tao Long, Sitong Wang, Émilie Fabre +14
UIST researchers develop tools to address user challenges. However, user interactions with AI evolve over time through learning, adaptation, and repurposing, making one time evalua…
Understanding the Challenges of Maker Entrepreneurship
Natalie Friedman, Alexandra Bremers, Adelaide Nyanyo +5
The maker movement embodies a resurgence in DIY creation, merging physical craftsmanship and arts with digital technology support. However, mere technological skills and creativity…
Nudge: Haptic Pre-Cueing to Communicate Automotive Intent
Nikhil Gowda, Srinath Sibi, Sonia Baltodano +4
To increase driver awareness in a fully autonomous vehicle, we developed several haptic interaction prototypes that signal what the car is planning to do next. The goal was to use…
Power and Play: Investigating "License to Critique" in Teams' AI Ethics Discussions
David Gray Widder, Laura Dabbish, James Herbsleb +1
Past work has sought to design AI ethics interventions--such as checklists or toolkits--to help practitioners design more ethical AI systems. However, other work demonstrates how t…
Co-design Accessible Public Robots: Insights from People with Mobility Disability, Robotic Practitioners and Their Collaborations
Howard Ziyu Han, Franklin Mingzhe Li, Alesandra Baca Vazquez +3
Sidewalk robots are increasingly common across the globe. Yet, their operation on public paths poses challenges for people with mobility disabilities (PwMD) who face barriers to ac…
BioSpark: An End-to-End Generative System for Biological-Analogical Inspirations and Ideation
Hyeonsu B. Kang, David Chuan-En Lin, Nikolas Martelaro +3
Nature is often used to inspire solutions for complex engineering problems, but achieving its full potential is challenging due to difficulties in discovering relevant analogies an…
"What's important here?": Opportunities and Challenges of Using LLMs in Retrieving Information from Web Interfaces
Faria Huq, Jeffrey P. Bigham, Nikolas Martelaro
Large language models (LLMs) that have been trained on a corpus that includes large amount of code exhibit a remarkable ability to understand HTML code. As web interfaces are prima…
What Do I Hear? Generating Sounds for Visuals with ChatGPT
David Chuan-En Lin, Nikolas Martelaro
This short paper introduces a workflow for generating realistic soundscapes for visual media. In contrast to prior work, which primarily focus on matching sounds for on-screen visu…
The AI Incident Database as an Educational Tool to Raise Awareness of AI Harms: A Classroom Exploration of Efficacy, Limitations, & Future Improvements
Michael Feffer, Nikolas Martelaro, Hoda Heidari
Prior work has established the importance of integrating AI ethics topics into computer and data sciences curricula. We provide evidence suggesting that one of the critical objecti…
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
David Chuan-En Lin, Nikolas Martelaro
Recent advancements in AI foundation models have made it possible for them to be utilized off-the-shelf for creative tasks, including ideating design concepts or generating visual…
Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools
Frederic Gmeiner, Humphrey Yang, Lining Yao +2
AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more…
Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee +2
This paper investigates the challenge of extracting highlight moments from videos. To perform this task, we need to understand what constitutes a highlight for arbitrary video doma…
VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee +2
Video editing is a creative and complex endeavor and we believe that there is potential for reimagining a new video editing interface to better support the creative and exploratory…
Exploring the Future of Remote User Research
Nikolas Martelaro
The rapid move to remote work due to COVID-19 social distancing policies has slowed or stopped most in-person qualitative user research activities. The limitation on in-person acti…
Team Learning as a Lens for Designing Human-AI Co-Creative Systems
Frederic Gmeiner, Kenneth Holstein, Nikolas Martelaro
Generative, ML-driven interactive systems have the potential to change how people interact with computers in creative processes - turning tools into co-creators. However, it is sti…
End-User Puppeteering of Expressive Movements
Hongyu Wang, Nikolas Martelaro
The end-user programming of social robot behavior is usually limited by a predefined set of movements. We are proposing a puppeteering robotic interface that provides a more intuit…
Exploring Opportunities in Usable Hazard Analysis Processes for AI Engineering
Nikolas Martelaro, Carol J. Smith, Tamara Zilovic
Embedding artificial intelligence into systems introduces significant challenges to modern engineering practices. Hazard analysis tools and processes have not yet been adequately a…
Soundify: Matching Sound Effects to Video
David Chuan-En Lin, Anastasis Germanidis, Cristóbal Valenzuela +2
In the art of video editing, sound helps add character to an object and immerse the viewer within a space. Through formative interviews with professional editors (N=10), we found t…
Learning Personal Style from Few Examples
David Chuan-En Lin, Nikolas Martelaro
A key task in design work is grasping the client's implicit tastes. Designers often do this based on a set of examples from the client. However, recognizing a common pattern among…
Remote Observation of Field Work on the Farm
Wendy Ju, Ilan Mandel, Kevin Weatherwax +3
Travel restrictions and social distancing measures make it difficult to observe, monitor or manage physical fieldwork. We describe research in progress that applies technologies fo…