7 papers
MedCTA: A Benchmark for Clinical Tool Agents
Tajamul Ashraf, Hyewon Jeong, Fida Mohammad Thoker +1
To make clinically grounded decisions, medical AI agents are expected to go beyond simple recognition and be capable of tool retrieval, evidence acquisition, and integration. Exist…
FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales
Jorge L. Rodriguez, Victor Angulo Morales, Areej Alwahas +6
Foundation models offer a promising route to transferable remote sensing representations, but many current approaches depend on very large pretraining datasets and fixed sensor con…
TrackMAE: Video Representation Learning via Track Mask and Predict
Renaud Vandeghen, Fida Mohammad Thoker, Marc Van Droogenbroeck +1
Masked video modeling (MVM) has emerged as a simple and scalable self-supervised pretraining paradigm, but only encodes motion information implicitly, limiting the encoding of temp…
SEVERE++: Evaluating Benchmark Sensitivity in Generalization of Video Representation Learning
Fida Mohammad Thoker, Letian Jiang, Chen Zhao +4
Continued advances in self-supervised learning have led to significant progress in video representation learning, offering a scalable alternative to supervised approaches by removi…
SMILE: Infusing Spatial and Motion Semantics in Masked Video Learning
Fida Mohammad Thoker, Letian Jiang, Chen Zhao +1
Masked video modeling, such as VideoMAE, is an effective paradigm for video self-supervised learning (SSL). However, they are primarily based on reconstructing pixel-level details…
Structured-Noise Masked Modeling for Video, Audio and Beyond
Aritra Bhowmik, Fida Mohammad Thoker, Carlos Hinojosa +2
Masked modeling has emerged as a powerful self-supervised learning framework, but existing methods largely rely on random masking, disregarding the structural properties of differe…