4 papers
SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory
Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx +4
AI glasses present a compelling platform for AI agents to serve as personalized memory assistants. To be genuinely useful, such systems must move beyond short-term video comprehens…
GazeMind: A Gaze-Guided LLM Agent for Personalized Cognitive Load Assessment
Bin Wang, Yue Liu, Benjamin Newman +9
Smart glasses with AI assistants are increasingly used in daily life. However, current systems lack awareness of the user's internal cognitive state, leaving them unable to proacti…
Gaze-Enhanced Multimodal Turn-Taking Prediction in Triadic Conversations
Seongsil Heo, Calvin Murdock, Michael Proulx +1
Turn-taking prediction is crucial for seamless interactions. This study introduces a novel, lightweight framework for accurate turn-taking prediction in triadic conversations witho…
Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems
Ethan Wilson, Naveen Sendhilnathan, Charlie S. Burlingham +5
Advanced multimodal AI agents can now collaborate with users to solve challenges in the world. Yet, these emerging contextual AI systems rely on explicit communication channels bet…