85 citations · 114 across the 34 of their papers we have counts for
9 papers · 1 filter
Leveraging Registers in Vision Transformers for Robust Adaptation
Srikar Yellapragada, Kowshik Thopalli, Vivek Narayanaswamy +5
Vision Transformers (ViTs) have shown success across a variety of tasks due to their ability to capture global image representations. Recent studies have identified the existence o…
DECIDER: Leveraging Foundation Model Priors for Improved Model Failure Detection and Explanation
Rakshith Subramanyam, Kowshik Thopalli, Vivek Narayanaswamy +1
Reliably detecting when a deployed machine learning model is likely to fail on a given input is crucial for ensuring safe operation. In this work, we propose DECIDER (Debiasing Cla…
Speeding Up Image Classifiers with Little Companions
Yang Liu, Kowshik Thopalli, Jayaraman Thiagarajan
Scaling up neural networks has been a key recipe to the success of large language and vision models. However, in practice, up-scaled models can be disproportionately costly in term…
`Eyes of a Hawk and Ears of a Fox': Part Prototype Network for Generalized Zero-Shot Learning
Joshua Feinglass, Jayaraman J. Thiagarajan, Rushil Anirudh +2
Current approaches in Generalized Zero-Shot Learning (GZSL) are built upon base models which consider only a single class attribute vector representation over the entire image. Thi…
CREPE: Learnable Prompting With CLIP Improves Visual Relationship Prediction
Rakshith Subramanyam, T. S. Jayram, Rushil Anirudh +1
In this paper, we explore the potential of Vision-Language Models (VLMs), specifically CLIP, in predicting visual object relationships, which involves interpreting visual features…
Target-Aware Generative Augmentations for Single-Shot Adaptation
Kowshik Thopalli, Rakshith Subramanyam, Pavan Turaga +1
In this paper, we address the problem of adapting models from a source domain to a target domain, a task that has become increasingly important due to the brittle generalization of…
On-the-fly Object Detection using StyleGAN with CLIP Guidance
Yuzhe Lu, Shusen Liu, Jayaraman J. Thiagarajan +2
We present a fully automated framework for building object detectors on satellite imagery without requiring any human annotation or intervention. We achieve this by leveraging the…
Single-Shot Domain Adaptation via Target-Aware Generative Augmentation
Rakshith Subramanyam, Kowshik Thopalli, Spring Berman +2
The problem of adapting models from a source domain using data from any target domain of interest has gained prominence, thanks to the brittle generalization in deep neural network…
Know Your Space: Inlier and Outlier Construction for Calibrating Medical OOD Detectors
Vivek Narayanaswamy, Yamen Mubarka, Rushil Anirudh +3
We focus on the problem of producing well-calibrated out-of-distribution (OOD) detectors, in order to enable safe deployment of medical image classifiers. Motivated by the difficul…