7 papers
Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini
Ruofei Du, Benjamin Hersh, David Li +11
While large language models (LLMs) have accelerated 2D software development through intent-driven "vibe coding", prototyping intelligent Extended Reality (XR) experiences remains a…
Enhancing XR Auditory Realism via Multimodal Scene-Aware Acoustic Rendering
Tianyu Xu, Jihan Li, Penghe Zu +9
In Extended Reality (XR), rendering sound that accurately simulates real-world acoustics is pivotal in creating lifelike and believable virtual experiences. However, existing XR sp…
Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents
Geonsun Lee, Min Xia, Nels Numan +9
Proactive AR agents promise context-aware assistance, but their interactions often rely on explicit voice prompts or responses, which can be disruptive or socially awkward. We intr…
XR Blocks: Accelerating Human-centered AI + XR Innovation
David Li, Nels Numan, Xun Qian +17
We are on the cusp where Artificial Intelligence (AI) and Extended Reality (XR) are converging to unlock new paradigms of interactive computing. However, a significant gap exists b…
NoteIt: A System Converting Instructional Videos to Interactable Notes Through Multimodal Video Understanding
Running Zhao, Zhihan Jiang, Xinchen Zhang +7
Users often take notes for instructional videos to access key knowledge later without revisiting long videos. Automated note generation tools enable users to obtain informative not…
InstructPipe: Generating Visual Blocks Pipelines with Human Instructions and LLMs
Zhongyi Zhou, Jing Jin, Vrushank Phadnis +16
Visual programming has the potential of providing novice programmers with a low-code experience to build customized processing pipelines. Existing systems typically require users t…