5 papers
Human-AI Divergence in Ego-centric Action Recognition under Spatial and Spatiotemporal Manipulations
Sadegh Rahmaniboldaji, Filip Rybansky, Quoc C. Vuong +3
Humans consistently outperform state-of-the-art AI models in action recognition, particularly in challenging real-world conditions involving low resolution, occlusion, and visual c…
Zero-shot Interactive Perception
Venkatesh Sripada, Frank Guerin, Amir Ghalamzan
Interactive perception (IP) enables robots to extract hidden information in their workspace and execute manipulation plans by physically interacting with objects and altering the s…
Automated Multiple Mini Interview (MMI) Scoring
Ryan Huynh, Frank Guerin, Alison Callwood
Assessing soft skills such as empathy, ethical judgment, and communication is essential in competitive selection processes, yet human scoring is often inconsistent and biased. Whil…
DEL: Dense Event Localization for Multi-modal Audio-Visual Understanding
Mona Ahmadian, Amir Shirian, Frank Guerin +1
Real-world videos often contain overlapping events and complex temporal dependencies, making multimodal interaction modeling particularly challenging. We introduce DEL, a framework…
Scene Exploration by Vision-Language Models
Venkatesh Sripada, Samuel Carter, Frank Guerin +1
Active perception enables robots to dynamically gather information by adjusting their viewpoints, a crucial capability for interacting with complex, partially observable environmen…