5 papers
SENT Map -- Semantically Enhanced Topological Maps with Foundation Models
Raj Surya Rajendran Kathirvel, Zach A Chavis, Stephen J. Guy +1
We introduce SENT-Map, a semantically enhanced topological map for representing indoor environments, designed to support autonomous navigation and manipulation by leveraging advanc…
Simultaneous Localization and Affordance Prediction of Tasks from Egocentric Video
Zachary Chavis, Hyun Soo Park, Stephen J. Guy
Vision-Language Models (VLMs) have shown great success as foundational models for downstream vision and natural language applications in a variety of domains. However, these models…
Improving Keystep Recognition in Ego-Video via Dexterous Focus
Zachary Chavis, Stephen J. Guy, Hyun Soo Park
In this paper, we address the challenge of understanding human activities from an egocentric perspective. Traditional activity recognition techniques face unique challenges in egoc…
Reaching Motion Characterization Across Childhood via Augmented Reality Games
Shelby Ziccardi, Zach Chavis, Rachel L. Hawe +1
While performance in coordinated motor tasks has been shown to improve in children as they age, the characterization of children's movement strategies has been underexplored. In th…
Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives
Kristen Grauman, Andrew Westbury, Lorenzo Torresani +98
We present Ego-Exo4D, a diverse, large-scale multimodal multiview video dataset and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric and exocentric…