149 citations · 278 across the 55 of their papers we have counts for
13 papers · 1 filter
Re:Cognize -- A Framework For Open-Set Comic Character Re-Identification
Aaditya Baranwal, Madhav Kataria, Yogesh S Rawat +1
Comics and manga tell stories through characters whose appearances change from panel to panel, yet readers recognise them hundreds of pages later without ever consulting a cast lis…
Position Aware Layer Queries for Test Time Training in Vision Language Models
Rajat Modi, Priyank Pathak, Xin Liang +1
Test-Time Training (TTT) adapts models to incoming test samples (e.g. out-of-distribution, (OOD)) when conventional fine-tuning is infeasible. Existing TTT methods for Vision-Langu…
Modern GLOM: Canonical locks that encode part-whole hierarchies
Rajat Modi, Yogesh Singh Rawat
One of the challenges in representational learning is how to encode part-whole hierarchies in a neural net. Prior works rely on flattening tree-like structures into string-like seq…
A Generative Approach for Improving Multi-Label Defect Classification in Photovoltaic Modules
Abdul Mueez, Yogesh S. Rawat, Shruti Vyas
This paper addresses the challenge of multi-label defect classification in electroluminescence (EL) images of photovoltaic (PV) cells. Training models on images where multiple defe…
Forget, Anticipate and Adapt: Test Time Training for Long Videos
Rajat Modi, Sebastian Noel, Xin Liang +1
Test Time Training (TTT) is a mechanism in which a model adapts to an incoming test-sample by performing some self-supervised (SSL) task and updating its weights even during infere…
Learning to Deny: Action Denial in Multimodal Large Language Models
Raiyaan Abdullah, Shehreen Azad, Yogesh Singh Rawat
Multimodal large language models (MLLMs) have rapidly advanced video understanding, achieving strong zero-shot and few-shot recognition across standard benchmarks. Yet their abilit…
Robust Onion: Peeling Open Vocab Object Detectors Under Noise
Priyank Pathak, Mukilan Karuppasamy, Aaditya Baranwal +2
The impact of real-world noise on Open Vocabulary Object Detectors (OV-ODs) remains poorly understood due to their architectural complexity. We present our comprehensive analysis R…
MolSight: Molecular Property Prediction with Images
Aaditya Baranwal, Akshaj Gupta, Yogesh S Rawat +1
Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour…
VISTA: Video Interaction Spatio-Temporal Analysis Benchmark
Alejandro Aparcedo, Akash Kumar, Aaryan Garg +5
Existing benchmarks for Vision-Language Models (VLMs) primarily evaluate spatio-temporal understanding on simple single-action videos, closed attribute sets and restricted entity t…
Sky2Ground: A Benchmark for Site Modeling under Varying Altitude
Zengyan Wang, Sirshapan Mitra, Rajat Modi +2
We introduce Sky2Ground, a three-view dataset designed for varying altitude camera localization, correspondence learning, and reconstruction. The dataset combines structured synthe…
ProDiG: Progressive Diffusion-Guided Gaussian Splatting for Aerial to Ground Reconstruction
Sirshapan Mitra, Yogesh S. Rawat
Generating ground-level views and coherent 3D site models from aerial-only imagery is challenging due to extreme viewpoint changes, missing intermediate observations, and large sca…
VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
Chaoyang Wang, Wenrui Bao, Sicheng Gao +5
Vision-Language-Action (VLA) models have shown promising capabilities for embodied intelligence, but most existing approaches rely on text-based chain-of-thought reasoning where vi…
StreamReady: Learning What to Answer and When in Long Streaming Videos
Shehreen Azad, Vibhav Vineet, Yogesh Singh Rawat
Streaming video understanding often involves time-sensitive scenarios where models need to answer exactly when the supporting visual evidence appears: answering before the evidence…