91 citations · 213 across the 10 of their papers we have counts for
10 papers
Notational Animating: An Interactive Approach to Creating and Editing Animation Keyframes
Xinyu Shi, Li-Yi Wei, Nanxuan Zhao +2
We introduce the concept of notational animating, an interaction paradigm for animation authoring where users sketch high-level notations over static drawings to indicate intended…
MapStory: Prototyping Editable Map Animations with LLM Agents
Aditya Gunturu, Ben Pearman, Keiichi Ihara +4
We introduce MapStory, an LLM-powered animation prototyping tool that generates editable map animation sequences directly from natural language text by leveraging a dual-agent LLM…
Video2MR: Automatically Generating Mixed Reality 3D Instructions by Augmenting Extracted Motion from 2D Videos
Keiichi Ihara, Kyzyl Monteiro, Mehrad Faridan +2
This paper introduces Video2MR, a mixed reality system that automatically generates 3D sports and exercise instructions from 2D videos. Mixed reality instructions have great potent…
Augmented Physics: Creating Interactive and Embedded Physics Simulations from Static Textbook Diagrams
Aditya Gunturu, Yi Wen, Nandi Zhang +3
We introduce Augmented Physics, a machine learning-integrated authoring tool designed for creating embedded interactive physics simulations from static textbook diagrams. Leveragin…
LogoMotion: Visually-Grounded Code Synthesis for Creating and Editing Animation
Vivian Liu, Rubaiat Habib Kazi, Li-Yi Wei +4
Creating animation takes time, effort, and technical expertise. To help novices with animation, we present LogoMotion, an AI code generation approach that helps users create semant…
DrawTalking: Building Interactive Worlds by Sketching and Speaking
Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei +2
We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, an…
Automated Conversion of Music Videos into Lyric Videos
Jiaju Ma, Anyi Rao, Li-Yi Wei +3
Musicians and fans often produce lyric videos, a form of music videos that showcase the song's lyrics, for their favorite songs. However, making such videos can be challenging and…
RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live Storytelling
Jian Liao, Adnan Karim, Shivesh Jadon +2
We present RealityTalk, a system that augments real-time live presentations with speech-driven interactive virtual elements. Augmented presentations leverage embedded visuals and a…
PoseCoach: A Customizable Analysis and Visualization System for Video-based Running Coaching
Jingyuan Liu, Nazmus Saquib, Zhutian Chen +4
Videos are an accessible form of media for analyzing sports postures and providing feedback to athletes. Existing sport-specific systems embed bespoke human pose attributes and thu…
RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching
Ryo Suzuki, Rubaiat Habib Kazi, Li-Yi Wei +3
We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable u…