6 citations · 17 across the 23 of their papers we have counts for
27 papers
Re:Cognize -- A Framework For Open-Set Comic Character Re-Identification
Aaditya Baranwal, Madhav Kataria, Yogesh S Rawat +1
Comics and manga tell stories through characters whose appearances change from panel to panel, yet readers recognise them hundreds of pages later without ever consulting a cast lis…
Vision-Language Models for Analog Gauge Reading: An Empirical Study of Specialization, Transfer and Reliability
Abdul Mueez, Aaditya Baranwal, Junior Chaj-Mejia +3
Analog gauges remain common in industrial environments where manual inspection is costly or hazardous. The engineering application addressed here is direct numerical reading of sin…
A Generative Approach for Improving Multi-Label Defect Classification in Photovoltaic Modules
Abdul Mueez, Yogesh S. Rawat, Shruti Vyas
This paper addresses the challenge of multi-label defect classification in electroluminescence (EL) images of photovoltaic (PV) cells. Training models on images where multiple defe…
Robust Onion: Peeling Open Vocab Object Detectors Under Noise
Priyank Pathak, Mukilan Karuppasamy, Aaditya Baranwal +2
The impact of real-world noise on Open Vocabulary Object Detectors (OV-ODs) remains poorly understood due to their architectural complexity. We present our comprehensive analysis R…
PHOEBI: An Open-World Benchmark for Multi-Label Bacterial Identification in Phase-Contrast Microscopy
Aaditya Baranwal, Md Jahid Hasan, Shruti Vyas
Optical microscopy lets us watch living bacteria in real time without stains or labels, and it remains the standard instrument for identifying species across clinical, environmenta…
MolSight: Molecular Property Prediction with Images
Aaditya Baranwal, Akshaj Gupta, Yogesh S Rawat +1
Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour…
Bridging Foundation Models and ASTM Metallurgical Standards for Automated Grain Size Estimation from Microscopy Images
Abdul Mueez, Shruti Vyas
Extracting standardized metallurgical metrics from microscopy images remains challenging due to complex grain morphology and the data demands of supervised segmentation. To bridge…
Where Do Vision-Language Models Fail? World Scale Analysis for Image Geolocalization
Siddhant Bharadwaj, Ashish Vashist, Fahimul Aleem +1
Image geolocalization has traditionally been addressed through retrieval-based place recognition or geometry-based visual localization pipelines. Recent advances in Vision-Language…
ChemPro: A Progressive Chemistry Benchmark for Large Language Models
Aaditya Baranwal, Shruti Vyas
We introduce ChemPro, a progressive benchmark with 4100 natural language question-answer pairs in Chemistry, across 4 coherent sections of difficulty designed to assess the profici…
Re:Verse -- Can Your VLM Read a Manga?
Aaditya Baranwal, Madhav Kataria, Naitik Agrawal +2
Current Vision Language Models (VLMs) demonstrate a critical gap between surface-level recognition and deep narrative reasoning when processing sequential visual storytelling. Thro…
SynSpill: Improved Industrial Spill Detection With Synthetic Data
Aaditya Baranwal, Abdul Mueez, Jason Voelker +2
Large-scale Vision-Language Models (VLMs) have transformed general-purpose visual recognition through strong zero-shot capabilities. However, their performance degrades significant…
iSafetyBench: A video-language benchmark for safety in industrial environment
Raiyaan Abdullah, Yogesh Singh Rawat, Shruti Vyas
Recent advances in vision-language models (VLMs) have enabled impressive generalization across diverse video understanding tasks under zero-shot settings. However, their capabiliti…
MolVision: Molecular Property Prediction with Vision Language Models
Deepan Adak, Yogesh Singh Rawat, Shruti Vyas
Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored…
LR0.FM: Low-Res Benchmark and Improving Robustness for Zero-Shot Classification in Foundation Models
Priyank Pathak, Shyam Marjit, Shruti Vyas +1
Visual-language foundation Models (FMs) exhibit remarkable zero-shot generalization across diverse tasks, largely attributed to extensive pre-training on largescale datasets. Howev…
Advancing Automatic Photovoltaic Defect Detection using Semi-Supervised Semantic Segmentation of Electroluminescence Images
Abhishek Jha, Yogesh Rawat, Shruti Vyas
Photovoltaic (PV) systems allow us to tap into all abundant solar energy, however they require regular maintenance for high efficiency and to prevent degradation. Traditional manua…
Semi-supervised Active Learning for Video Action Detection
Ayush Singh, Aayush J Rana, Akash Kumar +2
In this work, we focus on label efficient learning for video action detection. We develop a novel semi-supervised active learning approach which utilizes both labeled as well as un…
GAMa: Cross-view Video Geo-localization
Shruti Vyas, Chen Chen, Mubarak Shah
The existing work in cross-view geo-localization is based on images where a ground panorama is matched to an aerial image. In this work, we focus on ground videos instead of images…
Robustness Analysis of Video-Language Models Against Visual and Language Perturbations
Madeline C. Schiappa, Shruti Vyas, Hamid Palangi +2
Joint visual and language modeling on large-scale datasets has recently shown good progress in multi-modal tasks when compared to single modal learning. However, robustness of thes…
Large-scale Robustness Analysis of Video Action Recognition Models
Madeline Chantry Schiappa, Naman Biyani, Prudvi Kamtam +4
We have seen a great progress in video action recognition in recent years. There are several models based on convolutional neural network (CNN) and some recent transformer based ap…
Video Action Detection: Analysing Limitations and Challenges
Rajat Modi, Aayush Jung Rana, Akash Kumar +4
Beyond possessing large enough size to feed data hungry machines (eg, transformers), what attributes measure the quality of a dataset? Assuming that the definitions of such attribu…
LARNet: Latent Action Representation for Human Action Synthesis
Naman Biyani, Aayush J Rana, Shruti Vyas +1
We present LARNet, a novel end-to-end approach for generating human action videos. A joint generative modeling of appearance and dynamics to synthesize a video is very challenging…
NoisyActions2M: A Multimedia Dataset for Video Understanding from Noisy Labels
Mohit Sharma, Raj Patra, Harshal Desai +3
Deep learning has shown remarkable progress in a wide range of problems. However, efficient training of such models requires large-scale datasets, and getting annotations for such…
Pose-guided Generative Adversarial Net for Novel View Action Synthesis
Xianhang Li, Junhao Zhang, Kunchang Li +2
We focus on the problem of novel-view human action synthesis. Given an action video, the goal is to generate the same action from an unseen viewpoint. Naturally, novel view video s…
TinyAction Challenge: Recognizing Real-world Low-resolution Activities in Videos
Praveen Tirupattur, Aayush J Rana, Tushar Sangam +3
This paper summarizes the TinyAction challenge which was organized in ActivityNet workshop at CVPR 2021. This challenge focuses on recognizing real-world low-resolution activities…