5 papers · 1 filter
Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision Models
Ada Yi Zhao, Aditya Gunturu, Ellen Yi-Luen Do +1
Large language models (LLMs) have enabled the automatic generation of step-by-step augmented reality (AR) instructions for a wide range of physical tasks. However, existing LLM-bas…
RealitySummary: Exploring On-Demand Mixed Reality Text Summarization and Question Answering using Large Language Models
Aditya Gunturu, Shivesh Jadon, Nandi Zhang +4
Large Language Models (LLMs) are gaining popularity as reading and summarization aids. However, little is known about their potential benefits when integrated with mixed reality (M…
MapStory: Prototyping Editable Map Animations with LLM Agents
Aditya Gunturu, Ben Pearman, Keiichi Ihara +4
We introduce MapStory, an LLM-powered animation prototyping tool that generates editable map animation sequences directly from natural language text by leveraging a dual-agent LLM…
From Following to Understanding: Investigating the Role of Reflective Prompts in AR-Guided Tasks to Promote Task Understanding
Nandi Zhang, Yukang Yan, Ryo Suzuki
Augmented Reality (AR) is a promising medium for guiding users through tasks, yet its impact on fostering deeper task understanding remains underexplored. This paper investigates t…
Augmented Physics: Creating Interactive and Embedded Physics Simulations from Static Textbook Diagrams
Aditya Gunturu, Yi Wen, Nandi Zhang +3
We introduce Augmented Physics, a machine learning-integrated authoring tool designed for creating embedded interactive physics simulations from static textbook diagrams. Leveragin…