3 citations · 5 across the 26 of their papers we have counts for
27 papers
Harnessing Vision-Language Models for Perceptual Quality Assessment and Autonomous Content Adjustment in Augmented Reality
Elias Rotondo, Lin Duan, Yanming Xiu +3
Advancements in augmented reality (AR) continue to foster innovative solutions, facilitating novel methodologies within educational systems, healthcare delivery, and risk-mitigatio…
Better Situational Awareness in AR-HRC? A Comparative Study of Augmented Reality and Mobile Interfaces for Human-Robot Collaboration
Zhehan Qu, Christian Fronk, Jaewoong Jeong +2
Augmented reality (AR) facilitates human-robot collaboration (HRC) by enabling in-situ spatial visualizations of the robot and the joint task. However, in safety-critical HRC scena…
FlexSplat: Flexible Feed-Forward 3D Gaussian Splatting without Point Cloud Correspondence
Amir Sabbaghziarani, Hanting Ye, Maria Gorlatova +1
We present FlexSplat, a feed-forward framework for novel view synthesis (NVS) from uncalibrated, object-centric multi-view image collections. A recent line of query-based methods r…
Real-Time Visual Obstruction Detection in Surgical Augmented Reality
Shih-Chin Yang, Yanming Xiu, Hanting Ye +3
Surgical augmented reality (AR) can provide contextual guidance by overlaying virtual annotations, tool cues, and procedural information onto the surgical workspace. However, the v…
SHARE: Towards Head-Mounted AR with User-Centric SLAM in Shared Human-Robot Workspaces
Tianyuan Du, Tianyi Hu, Hanting Ye +1
Human-Robot Collaboration (HRC) in shared physical spaces using Augmented Reality (AR) interfaces is powered by Simultaneous Localization and Mapping (SLAM). Existing multi-agent S…
ARTOO-DARTU: Studying AR-HRC With AR Obstruction Mitigation During a Warehouse Task
Christian Fronk, Hanting Ye, Zhehan Qu +1
Human-robot collaboration (HRC) often requires robot intentions and internal states to be conveyed to users for task efficiency and safety. Recently, augmented reality (AR) situate…
fARfetch: Enabling Collocated AR-HRC in Large Visually Diverse Environments with VLM-Driven AR Content Adaptation
Christian Fronk, Hanting Ye, David Hunt +2
Augmented Reality (AR) can improve collocated human-robot collaboration by making robot state and intent visible and enabling intuitive control, yet large, visually diverse environ…
Is It Real? Exploiting Virtual-Physical Discrimination Vulnerability in Mixed Reality
Xueyang Wang, Xihuan Yao, Yanming Xiu +3
Consumer mixed reality (MR) headsets seamlessly blend virtual content into physical environments with sufficient fidelity that users may be unable to distinguish virtual objects fr…
Benchmarking Vision-Language Models under Contradictory Virtual Content Attacks in Augmented Reality
Yanming Xiu, Zhengyuan Jiang, Neil Zhenqiang Gong +1
Augmented reality (AR) has rapidly expanded over the past decade. As AR becomes increasingly integrated into daily life, its security and reliability emerge as critical challenges.…
Rhythms of Recovery: Patient-Centered Virtual Reality Exergame for Physical Rehabilitation in the Intensive Care Unit
Sangjun Eom, Tianyi Hu, Wenyi Xu +6
Early mobilization is a structured protocol designed to facilitate motor recovery in intensive care unit (ICU) patients with ICU-acquired weakness. This process is typically implem…
User Prompting Strategies and Prompt Enhancement Methods for Open-Set Object Detection in XR Environments
Junfeng Lin, Yanming Xiu, Maria Gorlatova
Open-set object detection (OSOD) localizes objects while identifying and rejecting unknown classes at inference. While recent OSOD models perform well on benchmarks, their behavior…
Can a Unimodal Language Agent Provide Preferences to Tune a Multimodal Vision-Language Model?
Sazia Tabasum Mim, Jack Morris, Manish Dhakal +3
To explore a more scalable path for adding multimodal capabilities to existing LLMs, this paper addresses a fundamental question: Can a unimodal LLM, relying solely on text, reason…
AR-TMT: Investigating the Impact of Distraction Types on Attention and Behavior in AR-based Trail Making Test
Sihun Baek, Zhehan Qu, Maria Gorlatova
Despite the growing use of AR in safety-critical domains, the field lacks a systematic understanding of how different types of distraction affect user behavior in AR environments.…
Demonstrating Visual Information Manipulation Attacks in Augmented Reality: A Hands-On Miniature City-Based Setup
Yanming Xiu, Maria Gorlatova
Augmented reality (AR) enhances user interaction with the real world but also presents vulnerabilities, particularly through Visual Information Manipulation (VIM) attacks. These at…
Will You Be Aware? Eye Tracking-Based Modeling of Situational Awareness in Augmented Reality
Zhehan Qu, Tianyi Hu, Christian Fronk +1
Augmented Reality (AR) systems, while enhancing task performance through real-time guidance, pose risks of inducing cognitive tunneling-a hyperfocus on virtual content that comprom…
Say It, See It: A Systematic Evaluation on Speech-Based 3D Content Generation Methods in Augmented Reality
Yanming Xiu, Joshua Chilukuri, Shunav Sen +1
As augmented reality (AR) applications increasingly require 3D content, generative pipelines driven by natural input such as speech offer an alternative to manual asset creation. I…
XR Reality Check: What Commercial Devices Deliver for Spatial Tracking
Tianyi Hu, Tianyuan Du, Zhehan Qu +1
Inaccurate spatial tracking in extended reality (XR) devices leads to virtual object jitter, misalignment, and user discomfort, fundamentally limiting immersive experiences and nat…
A Neurosymbolic Framework for Interpretable Cognitive Attack Detection in Augmented Reality
Rongqian Chen, Allison Andreyev, Yanming Xiu +7
Augmented Reality (AR) enriches human perception by overlaying virtual elements onto the physical world. However, this tight coupling between virtual and real content makes AR vuln…
Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approach
Yanming Xiu, Maria Gorlatova
The virtual content in augmented reality (AR) can introduce misleading or harmful information, leading to semantic misunderstandings or user errors. In this work, we focus on visua…
Advancing the Understanding and Evaluation of AR-Generated Scenes: When Vision-Language Models Shine and Stumble
Lin Duan, Yanming Xiu, Maria Gorlatova
Augmented Reality (AR) enhances the real world by integrating virtual content, yet ensuring the quality, usability, and safety of AR experiences presents significant challenges. Co…
ViDDAR: Vision Language Model-Based Task-Detrimental Content Detection for Augmented Reality
Yanming Xiu, Tim Scargill, Maria Gorlatova
In Augmented Reality (AR), virtual content enhances user experience by providing additional information. However, improperly positioned or designed virtual content can be detriment…
SiTAR: Situated Trajectory Analysis for In-the-Wild Pose Error Estimation
Tim Scargill, Ying Chen, Tianyi Hu +1
Virtual content instability caused by device pose tracking error remains a prevalent issue in markerless augmented reality (AR), especially on smartphones and tablets. However, whe…
PrivaScissors: Enhance the Privacy of Collaborative Inference through the Lens of Mutual Information
Lin Duan, Jingwei Sun, Yiran Chen +1
Edge-cloud collaborative inference empowers resource-limited IoT devices to support deep learning applications without disclosing their raw data to the cloud server, thus preservin…
Ambient Intelligence for Next-Generation AR
Tim Scargill, Sangjun Eom, Ying Chen +1
Next-generation augmented reality (AR) promises a high degree of context-awareness - a detailed knowledge of the environmental, user, social and system conditions in which an AR ex…