4 papers · 1 filter
Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision Models
Ada Yi Zhao, Aditya Gunturu, Ellen Yi-Luen Do +1
Large language models (LLMs) have enabled the automatic generation of step-by-step augmented reality (AR) instructions for a wide range of physical tasks. However, existing LLM-bas…
RealitySummary: Exploring On-Demand Mixed Reality Text Summarization and Question Answering using Large Language Models
Aditya Gunturu, Shivesh Jadon, Nandi Zhang +4
Large Language Models (LLMs) are gaining popularity as reading and summarization aids. However, little is known about their potential benefits when integrated with mixed reality (M…
MapStory: Prototyping Editable Map Animations with LLM Agents
Aditya Gunturu, Ben Pearman, Keiichi Ihara +4
We introduce MapStory, an LLM-powered animation prototyping tool that generates editable map animation sequences directly from natural language text by leveraging a dual-agent LLM…
Augmented Physics: Creating Interactive and Embedded Physics Simulations from Static Textbook Diagrams
Aditya Gunturu, Yi Wen, Nandi Zhang +3
We introduce Augmented Physics, a machine learning-integrated authoring tool designed for creating embedded interactive physics simulations from static textbook diagrams. Leveragin…