6 citations · 10 across the 13 of their papers we have counts for
14 papers
Imprint: Online Memory Compression for Long-Horizon Egocentric QA
Kousik Das, Debaditya Roy
Long-horizon egocentric question answering involves answering about events that have occurred hours or days in the past. This requires memory representations that remain both retri…
H-GRPO: Permutation-Invariant Reinforcement Learning for Grounded Visual Reasoning
Eric Peh, Debaditya Roy, Basura Fernando
Vision-Language Models (VLMs) often achieve high performance on benchmarks while remaining "black boxes", yet they remain prone to hallucination or rely on superficial shortcuts. I…
Do VLMs Reason Like Engineers? A Benchmark and a Stage-wise Evaluation
Syed Wasiq, Syed Mohamad Tawseeq, Yashwant Pravinrao Bangde +1
Vision-Language Models (VLMs) demonstrate strong performance on general multimodal reasoning benchmarks, yet their ability to perform engineering reasoning remains largely unexplor…
Improving Temporal Action Segmentation via Constraint-Aware Decoding
Yeo Keat Ee, Debaditya Roy, Chen Li +2
Temporal action segmentation (TAS) divides untrimmed videos into labeled action segments. While fully supervised methods have advanced the field, challenges such as action variabil…
Instruction-Evidence Contrastive Dual-Stream Decoding for Grounded Vision-Language Reasoning
Yashwant Pravinrao Bangde, Debaditya Roy
Vision-Language Models (VLMs) exhibit strong performance in instruction following and open-ended vision-language reasoning, yet they frequently generate fluent outputs that are wea…
Learning to Generate Long-term Future Narrations Describing Activities of Daily Living
Ramanathan Rajendiran, Debaditya Roy, Basura Fernando
Anticipating future events is crucial for various application domains such as healthcare, smart home technology, and surveillance. Narrative event descriptions provide context-rich…
Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios
Shantanu Jaiswal, Debaditya Roy, Basura Fernando +1
Complex visual reasoning and question answering (VQA) is a challenging task that requires compositional multi-step processing and higher-level reasoning capabilities beyond the imm…
Effectively Leveraging CLIP for Generating Situational Summaries of Images and Videos
Dhruv Verma, Debaditya Roy, Basura Fernando
Situation recognition refers to the ability of an agent to identify and understand various situations or contexts based on available information and sensory inputs. It involves the…
ClipSitu: Effectively Leveraging CLIP for Conditional Predictions in Situation Recognition
Debaditya Roy, Dhruv Verma, Basura Fernando
Situation Recognition is the task of generating a structured summary of what is happening in an image using an activity verb and the semantic roles played by actors and objects. In…
Modelling Spatio-Temporal Interactions For Compositional Action Recognition
Ramanathan Rajendiran, Debaditya Roy, Basura Fernando
Humans have the natural ability to recognize actions even if the objects involved in the action or the background are changed. Humans can abstract away the action from the appearan…
Interaction Region Visual Transformer for Egocentric Action Anticipation
Debaditya Roy, Ramanathan Rajendiran, Basura Fernando
Human-object interaction is one of the most important visual cues and we propose a novel way to represent human-object interactions for egocentric action anticipation. We propose a…
Predicting the Next Action by Modeling the Abstract Goal
Debaditya Roy, Basura Fernando
The problem of anticipating human actions is an inherently uncertain one. However, we can reduce this uncertainty if we have a sense of the goal that the actor is trying to achieve…
Defining Traffic States using Spatio-temporal Traffic Graphs
Debaditya Roy, K. Naveen Kumar, C. Krishna Mohan
Intersections are one of the main sources of congestion and hence, it is important to understand traffic behavior at intersections. Particularly, in developing countries with high…
Detection of Collision-Prone Vehicle Behavior at Intersections using Siamese Interaction LSTM
Debaditya Roy, Tetsuhiro Ishizaka, Krishna Mohan C. +1
As a large proportion of road accidents occur at intersections, monitoring traffic safety of intersections is important. Existing approaches are designed to investigate accidents i…