1 citations · 1 across the 8 of their papers we have counts for
9 papers
O3SLM: Open Weight, Open Data, and Open Vocabulary Sketch-Language Model
Rishi Gupta, Mukilan Karuppasamy, Shyam Marjit +2
While Large Vision Language Models (LVLMs) are increasingly deployed in real-world applications, their ability to interpret abstract visual inputs remains limited. Specifically, th…
Prompt Estimation from Prototypes for Federated Prompt Tuning of Vision Transformers
M Yashwanth, Sharannya Ghosh, Aditay Tripathi +1
Visual Prompt Tuning (VPT) of pre-trained Vision Transformers (ViTs) has proven highly effective as a parameter-efficient fine-tuning technique for adapting large models to downstr…
Sketch-guided Image Inpainting with Partial Discrete Diffusion Process
Nakul Sharma, Aditay Tripathi, Anirban Chakraborty +1
In this work, we study the task of sketch-guided image inpainting. Unlike the well-explored natural language-guided image inpainting, which excels in capturing semantic details, th…
Query-guided Attention in Vision Transformers for Localizing Objects Using a Single Sketch
Aditay Tripathi, Anand Mishra, Anirban Chakraborty
In this work, we investigate the problem of sketch-based object localization on natural images, where given a crude hand-drawn sketch of an object, the goal is to localize all the…
Multimodal Query-guided Object Localization
Aditay Tripathi, Rajath R Dani, Anand Mishra +1
Consider a scenario in one-shot query-guided object localization where neither an image of the object nor the object category name is available as a query. In such a scenario, a ha…
Robustifying Deep Vision Models Through Shape Sensitization
Aditay Tripathi, Rishubh Singh, Anirban Chakraborty +1
Recent work has shown that deep vision models tend to be overly dependent on low-level or "texture" features, leading to poor generalization. Various data augmentation strategies h…
Grounding Scene Graphs on Natural Images via Visio-Lingual Message Passing
Aditay Tripathi, Anand Mishra, Anirban Chakraborty
This paper presents a framework for jointly grounding objects that follow certain semantic relationship constraints given in a scene graph. A typical natural scene contains several…
Sketch-Guided Object Localization in Natural Images
Aditay Tripathi, Rajath R Dani, Anand Mishra +1
We introduce the novel problem of localizing all the instances of an object (seen or unseen during training) in a natural image via sketch query. We refer to this problem as sketch…
Adversarial Learning of Raw Speech Features for Domain Invariant Speech Recognition
Aditay Tripathi, Aanchan Mohan, Saket Anand +1
Recent advances in neural network based acoustic modelling have shown significant improvements in automatic speech recognition (ASR) performance. In order for acoustic models to be…