27 citations · 62 across the 5 of their papers we have counts for
5 papers
Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues
Jiannan Li, Mauricio Sousa, Karthik Mahadevan +7
Live and pre-recorded video tutorials are an effective means for teaching physical skills such as cooking or prototyping electronics. A dedicated cameraperson following an instruct…
Enabling Conversational Interaction with Mobile UI using Large Language Models
Bryan Wang, Gang Li, Yang Li
Conversational agents show the promise to allow users to interact with mobile devices using language. However, to perform diverse UI tasks with natural language, developers typical…
AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality
Zhuoyue Lyu, Jiannan Li, Bryan Wang
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy…
Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning
Bryan Wang, Gang Li, Xin Zhou +3
Mobile User Interface Summarization generates succinct language descriptions of mobile screens for conveying important contents and functionalities of the screen, which can be usef…
Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing
Bryan Wang, Mengyu Yang, Tovi Grossman
Learning musical instruments using online instructional videos has become increasingly prevalent. However, pre-recorded videos lack the instantaneous feedback and personal tailorin…