14 citations · 59 across the 26 of their papers we have counts for
28 papers
NoTeS-Bank: Benchmarking Neural Transcription and Search for Scientific Notes Understanding
Aniket Pal, Sanket Biswas, Alloy Das +6
Understanding and reasoning over academic handwritten notes remains a challenge in document AI, particularly for mathematical equations, diagrams, and scientific notations. Existin…
Source-free Video Domain Adaptation by Learning from Noisy Labels
Avijit Dasgupta, C. V. Jawahar, Karteek Alahari
Despite the progress seen in classification methods, current approaches for handling videos with distribution shifts in source and target domains remain source-dependent as they re…
Understanding Video Scenes through Text: Insights from Text-based Video Question Answering
Soumya Jahagirdar, Minesh Mathew, Dimosthenis Karatzas +1
Researchers have extensively studied the field of vision and language, discovering that both visual and textual content is crucial for understanding scenes effectively. Particularl…
Towards Real-Time Analysis of Broadcast Badminton Videos
Nitin Nilesh, Tushar Sharma, Anurag Ghosh +1
Analysis of player movements is a crucial subset of sports analysis. Existing player movement analysis methods use recorded videos after the match is over. In this work, we propose…
Reading Between the Lanes: Text VideoQA on the Road
George Tom, Minesh Mathew, Sergi Garcia +2
Text and signs around roads provide crucial information for drivers, vital for safe navigation and situational awareness. Scene text recognition in motion is a challenging problem,…
CueCAn: Cue Driven Contextual Attention For Identifying Missing Traffic Signs on Unconstrained Roads
Varun Gupta, Anbumani Subramanian, C. V. Jawahar +1
Unconstrained Asian roads often involve poor infrastructure, affecting overall road safety. Missing traffic signs are a regular part of such roads. Missing or non-existing object d…
A Fine-Grained Vehicle Detection (FGVD) Dataset for Unconstrained Roads
Prafful Kumar Khoba, Chirag Parikh, Rohit Saluja +2
The previous fine-grained datasets mainly focus on classification and are often captured in a controlled setup, with the camera focusing on the objects. We introduce the first Fine…
Towards Robust Handwritten Text Recognition with On-the-fly User Participation
Ajoy Mondal, Rohit saluja, C. V. Jawahar
Long-term OCR services aim to provide high-quality output to their users at competitive costs. It is essential to upgrade the models because of the complex data loaded by the users…
Watching the News: Towards VideoQA Models that can Read
Soumya Jahagirdar, Minesh Mathew, Dimosthenis Karatzas +1
Video Question Answering methods focus on commonsense reasoning and visual cognition of objects or persons and their interactions over time. Current VideoQA approaches ignore the t…
IDD-3D: Indian Driving Dataset for 3D Unstructured Road Scenes
Shubham Dokania, A. H. Abdul Hafez, Anbumani Subramanian +2
Autonomous driving and assistance systems rely on annotated data from traffic and road scenarios to model and learn the various object relations in complex real-world scenarios. Pr…
Grounded Video Situation Recognition
Zeeshan Khan, C. V. Jawahar, Makarand Tapaswi
Dense video understanding requires answering several questions such as who is doing what to whom, with what, how, why, and where. Recently, Video Situation Recognition (VidSitu) is…
Compressing Video Calls using Synthetic Talking Heads
Madhav Agarwal, Anchit Gupta, Rudrabha Mukhopadhyay +2
We leverage the modern advancements in talking head generation to propose an end-to-end system for talking head video compression. Our algorithm transmits pivot frames intermittent…
Site Split of Antiferromagnetic -Mn Revealed by Mn Nuclear Magnetic Resonance
Masahiro Manago, Gaku Motoyama, Shijo Nishigori +8
The magnetic structure of antiferromagnetic -Mn has been unclarified for almost 70 years since its magnetism was discovered. We measured the zero-field nuclear magnetic resonanc…
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild
Sindhu B Hegde, K R Prajwal, Rudrabha Mukhopadhyay +2
In this work, we address the problem of generating speech from silent lip videos for any speaker in the wild. In stark contrast to previous works, our method (i) is not restricted…
Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors
Sindhu B Hegde, Rudrabha Mukhopadhyay, Vinay P Namboodiri +1
In this paper, we explore an interesting question of what can be obtained from an pixel video sequence. Surprisingly, it turns out to be quite a lot. We show that when w…
TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual Environments
Shubham Dokania, Anbumani Subramanian, Manmohan Chandraker +1
High-quality structured data with rich annotations are critical components in intelligent vehicle systems dealing with road scenes. However, data curation and annotation require in…
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or improve one's lipreading sk…
FaceOff: A Video-to-Video Face Swapping System
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays multiple characters. The…
Detecting, Tracking and Counting Motorcycle Rider Traffic Violations on Unconstrained Roads
Aman Goyal, Dev Agarwal, Anbumani Subramanian +3
In many Asian countries with unconstrained road traffic conditions, driving violations such as not wearing helmets and triple-riding are a significant source of fatalities involvin…
Classification of histopathology images using ConvNets to detect Lupus Nephritis
Akash Gupta, Anirudh Reddy, CV Jawahar +1
Systemic lupus erythematosus (SLE) is an autoimmune disease in which the immune system of the patient starts attacking healthy tissues of the body. Lupus Nephritis (LN) refers to t…
ICDAR 2021 Competition on Document VisualQuestion Answering
Rubèn Tito, Minesh Mathew, C. V. Jawahar +2
In this report we present results of the ICDAR 2021 edition of the Document Visual Question Challenges. This edition complements the previous tasks on Single Document VQA and Docum…
Multi-Domain Incremental Learning for Semantic Segmentation
Prachi Garg, Rohit Saluja, Vineeth N Balasubramanian +3
Recent efforts in multi-domain learning for semantic segmentation attempt to learn multiple geographical datasets in a universal, joint model. A simple fine-tuning experiment perfo…
Efficient and Generic Interactive Segmentation Framework to Correct Mispredictions during Clinical Evaluation of Medical Images
Bhavani Sambaturu, Ashutosh Gupta, C. V. Jawahar +1
Semantic segmentation of medical images is an essential first step in computer-aided diagnosis systems for many applications. However, given many disparate imaging modalities and i…
Towards Automatic Speech to Sign Language Generation
Parul Kapoor, Rudrabha Mukhopadhyay, Sindhu B Hegde +2
We aim to solve the highly challenging task of generating continuous sign language videos solely from speech segments for the first time. Recent efforts in this space have focused…