254 citations · 390 across the 30 of their papers we have counts for
14 papers · 1 filter
Integrating Affordances and Attention models for Short-Term Object Interaction Anticipation
Lorenzo Mur Labadia, Ruben Martinez-Cantin, Jose J. Guerrero +2
Short Term object-interaction Anticipation consists in detecting the location of the next active objects, the noun and verb categories of the interaction, as well as the time to co…
O-MaMa: Learning Object Mask Matching between Egocentric and Exocentric Views
Lorenzo Mur-Labadia, Maria Santos-Villafranca, Jesus Bermudez-Cameo +3
Understanding the world from multiple perspectives is essential for intelligent systems operating together, where segmenting common objects across different views remains an open p…
DIV-FF: Dynamic Image-Video Feature Fields For Environment Understanding in Egocentric Videos
Lorenzo Mur-Labadia, Josechu Guerrero, Ruben Martinez-Cantin
Environment understanding in egocentric videos is an important step for applications like robotics, augmented reality and assistive technologies. These videos are characterized by…
FALCONEye: Finding Answers and Localizing Content in ONE-hour-long videos with multi-modal LLMs
Carlos Plou, Cesar Borja, Ruben Martinez-Cantin +1
Finding information in hour-long videos is a challenging task even for top-performing Vision Language Models (VLMs), as encoding visual content quickly exceeds available context wi…
ZARRIO @ Ego4D Short Term Object Interaction Anticipation Challenge: Leveraging Affordances and Attention-based models for STA
Lorenzo Mur-Labadia, Ruben Martinez-Cantin, Josechu Guerrero-Campo +1
Short-Term object-interaction Anticipation (STA) consists of detecting the location of the next-active objects, the noun and verb categories of the interaction, and the time to con…
CARLOR @ Ego4D Step Grounding Challenge: Bayesian temporal-order priors for test time refinement
Carlos Plou, Lorenzo Mur-Labadia, Ruben Martinez-Cantin +1
The goal of the Step Grounding task is to locate temporal boundaries of activities based on natural language descriptions. This technical report introduces a Bayesian-VSLNet to add…
AFF-ttention! Affordances and Attention models for Short-Term Object Interaction Anticipation
Lorenzo Mur-Labadia, Ruben Martinez-Cantin, Josechu Guerrero +2
Short-Term object-interaction Anticipation consists of detecting the location of the next-active objects, the noun and verb categories of the interaction, and the time to contact f…
EventSleep: Sleep Activity Recognition with Event Cameras
Carlos Plou, Nerea Gallego, Alberto Sabater +5
Event cameras are a promising technology for activity recognition in dark environments due to their unique properties. However, real event camera datasets under low-lighting condit…
Multi-label affordance mapping from egocentric vision
Lorenzo Mur-Labadia, Jose J. Guerrero, Ruben Martinez-Cantin
Accurate affordance detection and segmentation with pixel precision is an important piece in many complex systems based on interactions, such as robots and assitive devices. We pre…
Bayesian Deep Learning for Affordance Segmentation in images
Lorenzo Mur-Labadia, Ruben Martinez-Cantin, Jose J. Guerrero
Affordances are a fundamental concept in robotics since they relate available actions for an agent depending on its sensory-motor capabilities and the environment. We present a nov…
Assessing visual acuity in visual prostheses through a virtual-reality system
Melani Sanchez-Garcia, Roberto Morollon-Ruiz, Ruben Martinez-Cantin +2
Current visual implants still provide very low resolution and limited field of view, thus limiting visual acuity in implanted patients. Developments of new strategies of artificial…
Augmented reality navigation system for visual prosthesis
Melani Sanchez-Garcia, Alejandro Perez-Yus, Ruben Martinez-Cantin +1
The visual functions of visual prostheses such as field of view, resolution and dynamic range, seriously restrict the person's ability to navigate in unknown environments. Implante…
Bayesian deep learning of affordances from RGB images
Lorenzo Mur-Labadia, Ruben Martinez-Cantin
Autonomous agents, such as robots or intelligent devices, need to understand how to interact with objects and its environment. Affordances are defined as the relationships between…
Semantic and structural image segmentation for prosthetic vision
Melani Sanchez-Garcia, Ruben Martinez-Cantin, Jose J. Guerrero
Prosthetic vision is being applied to partially recover the retinal stimulation of visually impaired people. However, the phosphenic images produced by the implants have very limit…