5 citations · 7 across the 9 of their papers we have counts for
11 papers · 1 filter
Sketch-guided Image Inpainting with Partial Discrete Diffusion Process
Nakul Sharma, Aditay Tripathi, Anirban Chakraborty +1
In this work, we study the task of sketch-guided image inpainting. Unlike the well-explored natural language-guided image inpainting, which excels in capturing semantic details, th…
Show Me the World in My Language: Establishing the First Baseline for Scene-Text to Scene-Text Translation
Shreyas Vaidya, Arvind Kumar Sharma, Prajwal Gatti +1
In this work, we study the task of ``visually'' translating scene text from a source language (e.g., Hindi) to a target language (e.g., English). Visual translation involves not ju…
Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answering
Abhirama Subramanyam Penamakuri, Manish Gupta, Mithun Das Gupta +1
We study visual question answering in a setting where the answer has to be mined from a pool of relevant and irrelevant images given as a context. For such a setting, a model must…
Query-guided Attention in Vision Transformers for Localizing Objects Using a Single Sketch
Aditay Tripathi, Anand Mishra, Anirban Chakraborty
In this work, we investigate the problem of sketch-based object localization on natural images, where given a crude hand-drawn sketch of an object, the goal is to localize all the…
Multimodal Query-guided Object Localization
Aditay Tripathi, Rajath R Dani, Anand Mishra +1
Consider a scenario in one-shot query-guided object localization where neither an image of the object nor the object category name is available as a query. In such a scenario, a ha…
Look, Read and Ask: Learning to Ask Questions by Reading Text in Images
Soumya Jahagirdar, Shankar Gangisetty, Anand Mishra
We present a novel problem of text-based visual question generation or TextVQG in short. Given the recent growing interest of the document image analysis community in combining tex…
Contrastive Multi-View Textual-Visual Encoding: Towards One Hundred Thousand-Scale One-Shot Logo Identification
Nakul Sharma, Abhirama S. Penamakuri, Anand Mishra
In this paper, we study the problem of identifying logos of business brands in natural scenes in an open-set one-shot setting. This problem setup is significantly more challenging…
Grounding Scene Graphs on Natural Images via Visio-Lingual Message Passing
Aditay Tripathi, Anand Mishra, Anirban Chakraborty
This paper presents a framework for jointly grounding objects that follow certain semantic relationship constraints given in a scene graph. A typical natural scene contains several…
COFAR: Commonsense and Factual Reasoning in Image Search
Prajwal Gatti, Abhirama Subramanyam Penamakuri, Revant Teotia +3
One characteristic that makes humans superior to modern artificially intelligent models is the ability to interpret images beyond what is visually apparent. Consider the following…
Few-shot Visual Relationship Co-localization
Revant Teotia, Vaibhav Mishra, Mayank Maheshwari +1
In this paper, given a small bag of images, each containing a common but latent predicate, we are interested in localizing visual subject-object pairs connected via the common pred…
Sketch-Guided Object Localization in Natural Images
Aditay Tripathi, Rajath R Dani, Anand Mishra +1
We introduce the novel problem of localizing all the instances of an object (seen or unseen during training) in a natural image via sketch query. We refer to this problem as sketch…