10 papers
SkillComposer: Learning Reusable Skills for Natural-Language Robot Programming
John Woods, Hasti Seifi
Natural-language interfaces can lower the barrier to programming robots, but existing systems struggle when users request complex tasks. While large language models (LLMs) perform…
VisionPulse: A Virtual Reality System Enabling Accessible Discovery and Navigation for Blind and Low Vision Users
Samuel Martin, Pooyan Fazli, Hasti Seifi
Free exploration is an important aspect of many engaging virtual reality (VR) experiences, yet remains largely inaccessible to blind and low vision (BLV) users due to its reliance…
Adaptive Geodesic Conformal Prediction for Egocentric Camera Pose Estimation
Aishani Pathak, Hasti Seifi
Egocentric pose estimation for Augmented Reality (AR) and assistive devices requires not just accurate predictions but guaranteed uncertainty regions. Conformal prediction (CP) pro…
Sound2Hap: Learning Audio-to-Vibrotactile Haptic Generation from Human Ratings
Yinan Li, Hasti Seifi
Environmental sounds like footsteps, keyboard typing, or dog barking carry rich information and emotional context, making them valuable for designing haptics in user applications.…
ChartQA-X: Generating Explanations for Visual Chart Reasoning
Shamanthak Hegde, Pooyan Fazli, Hasti Seifi
The ability to explain complex information from chart images is vital for effective data-driven decision-making. In this work, we address the challenge of generating detailed expla…
DescribePro: Collaborative Audio Description with Human-AI Interaction
Maryam Cheema, Sina Elahimanesh, Samuel Martin +2
Audio description (AD) makes video content accessible to millions of blind and low vision (BLV) users. However, creating high-quality AD involves a trade-off between the precision…