11 citations · 13 across the 19 of their papers we have counts for
21 papers
Results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in Conjunction with CVPR 2026
Luca Rossetto, Werner Bailer, Cathal Gurrin +5
This report summarizes the contributions and results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in conjunction with CVPR 2026.
Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagation
Lecheng Yan, Jianze Lin, Yichong Zhang +5
Long-horizon video editing agents receive final-product feedback only after many interdependent decisions. Yet editing quality is subjective, admits multiple valid solutions, and i…
Decoding EEG Signals to Explore Next-Word Predictability in the Human Brain
Boi Mai Quach, Binh T. Nguyen, Cathal Gurrin +1
Humans invented reading and have passed down this complex skill across generations through language. This study provides empirical evidence of the neural mechanisms underlying bott…
Encoding EEG Signals to Examine Human-Like Next-Word Prediction Behaviour in Language Models
Boi Mai Quach, Binh T. Nguyen, Cathal Gurrin +1
Language models (LMs) are trained to excel at predicting the next word in the sequence given prior context, and humans also share this predictability in reading comprehension. Neur…
HANCLIP: A Family of Hyperbolic Angular Negation Vision Language Models
Hoang-Bao Le, Aiden Durrant, Thai Son Mai +3
Vision-language models (VLMs) achieve strong cross-modal alignment but remain brittle to negation, often relying on shallow word associations rather than compositional reasoning. F…
UNION: A Lightweight Target Representation for Efficient Zero-Shot Image-Guided Retrieval with Optional Textual Queries
Hoang-Bao Le, Allie Tran, Binh T. Nguyen +2
Image-Guided Retrieval with Optional Text (IGROT) is a general retrieval setting where a query consists of an anchor image, with or without accompanying text, aiming to retrieve se…
FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Text
Hoang-Bao Le, Allie Tran, Binh T. Nguyen +2
Image-Guided Retrieval with Optional Text (IGROT) unifies visual retrieval (without text) and composed retrieval (with text). Despite its relevance in applications like Google Imag…
Results of the 2025 Video Browser Showdown
Luca Rossetto, Klaus Schoeffmann, Cathal Gurrin +2
This report presents the results of the 14th Video Browser Showdown, held at the 2025 International Conference on Multimedia Modeling on the 8th of January 2025 in Nara, Japan.
OpenLifelogQA: An Open-Ended Multi-Modal Lifelog Question-Answering Dataset
Quang-Linh Tran, Hoang-Bao Le, Tuong-Nghiem Diep +3
We introduce OpenLifelogQA, a large-scale open-ended lifelog QA dataset constructed from 18 months of multimodal lifelog data. Lifelogging is the passive collection and analysis of…
Quizzard@INOVA Challenge 2025 -- Track A: Plug-and-Play Technique in Interleaved Multi-Image Model
Dinh Viet Cuong, Hoang-Bao Le, An Pham Ngoc Nguyen +2
This paper addresses two main objectives. Firstly, we demonstrate the impressive performance of the LLaVA-NeXT-interleave on 22 datasets across three different tasks: Multi-Image R…
The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-24
Allie Tran, Werner Bailer, Duc-Tien Dang-Nguyen +8
The ACM Lifelog Search Challenge (LSC) is a venue that welcomes and compares systems that support the exploration of lifelog data, and in particular the retrieval of specific infor…
LSC-ADL: An Activity of Daily Living (ADL)-Annotated Lifelog Dataset Generated via Semi-Automatic Clustering
Minh-Quan Ho-Le, Duy-Khang Ho, Van-Tu Ninh +2
Lifelogging involves continuously capturing personal data through wearable cameras, providing an egocentric view of daily activities. Lifelog retrieval aims to search and retrieve…
The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understanding
Luca Rossetto, Werner Bailer, Duc-Tien Dang-Nguyen +11
Egocentric video has seen increased interest in recent years, as it is used in a range of areas. However, most existing datasets are limited to a single perspective. In this paper,…
Results of the 2024 Video Browser Showdown
Luca Rossetto, Klaus Schoeffmann, Cathal Gurrin +2
This report presents the results of the 13th Video Browser Showdown, held at the 2024 International Conference on Multimedia Modeling on the 29th of January 2024 in Amsterdam, the…
Lifelogging As An Extreme Form of Personal Information Management -- What Lessons To Learn
Ly-Duyen Tran, Cathal Gurrin, Alan F. Smeaton
Personal data includes the digital footprints that we leave behind as part of our everyday activities, both online and offline in the real world. It includes data we collect oursel…
Dialogue-to-Video Retrieval
Chenyang Lyu, Manh-Duy Nguyen, Van-Tu Ninh +3
Recent years have witnessed an increasing amount of dialogue/conversation on the web especially on social media. That inspires the development of dialogue-based retrieval, in which…
HADA: A Graph-based Amalgamation Framework in Image-text Retrieval
Manh-Duy Nguyen, Binh T. Nguyen, Cathal Gurrin
Many models have been proposed for vision and language tasks, especially the image-text retrieval task. All state-of-the-art (SOTA) models in this challenge contained hundreds of m…
Analysing the Performance of Stress Detection Models on Consumer-Grade Wearable Devices
Van-Tu Ninh, Sinéad Smyth, Minh-Triet Tran +1
Identifying stress levels can provide valuable data for mental health analytics as well as labels for annotation systems. Although much research has been conducted into stress dete…
An Improved Subject-Independent Stress Detection Model Applied to Consumer-grade Wearable Devices
Van-Tu Ninh, Manh-Duy Nguyen, Sinéad Smyth +4
Stress is a complex issue with wide-ranging physical and psychological impacts on human daily performance. Specifically, acute stress detection is becoming a valuable application i…
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval
Manh-Duy Nguyen, Binh T. Nguyen, Cathal Gurrin
Conventional approaches to image-text retrieval mainly focus on indexing visual objects appearing in pictures but ignore the interactions between these objects. Such objects occurr…
Temporal Saliency Adaptation in Egocentric Videos
Panagiotis Linardos, Eva Mohedano, Monica Cherto +2
This work adapts a deep neural model for image saliency prediction to the temporal domain of egocentric video. We compute the saliency map for each video frame, firstly with an off…