21 citations · 52 across the 9 of their papers we have counts for
10 papers
FigAct: Turning Scientific Figures into Active Canvases for Explanation
Shishi Xiao, Zichao Wang, Alexa Siu +2
Scientific figures are designed to communicate information visually, yet MLLMs typically explain them by translating their visual content back into text. This requires readers to m…
PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences
Chen Chen, Cuong Nguyen, Jane Hoffswell +3
While paper instructions are one of the mainstream medium for sharing knowledge, consuming such instructions and translating them into activities are inefficient due to the lack of…
Experts prefer text but videos help novices: an analysis of the utility of multi-media content
Hayeong Song, Jennifer Healey, Alexa Siu +2
Multi-media increases engagement and is increasingly prevalent in online content including news, web blogs, and social media, however, it may not always be beneficial to users. To…
VRDoc: Gaze-based Interactions for VR Reading Experience
Geonsun Lee, Jennifer Healey, Dinesh Manocha
Virtual reality (VR) offers the promise of an infinite office and remote collaboration, however, existing interactions in VR do not strongly support one of the most essential tasks…
Gaudí: Conversational Interactions with Deep Representations to Generate Image Collections
Victor S. Bursztyn, Jennifer Healey, Vishwa Vinay
Based on recent advances in realistic language modeling (GPT-3) and cross-modal representations (CLIP), Gaudí was developed to help designers search for inspirational images using…
"It doesn't look good for a date": Transforming Critiques into Preferences for Conversational Recommendation Systems
Victor S. Bursztyn, Jennifer Healey, Nedim Lipka +3
Conversations aimed at determining good recommendations are iterative in nature. People often express their preferences in terms of a critique of the current recommendation (e.g.,…