65 citations · 171 across the 20 of their papers we have counts for
28 papers
RobustL2S: Speaker-Specific Lip-to-Speech Synthesis exploiting Self-Supervised Representations
Neha Sahipjohn, Neil Shah, Vishal Tambrahalli +1
Significant progress has been made in speaker dependent Lip-to-Speech synthesis, which aims to generate speech from silent videos of talking faces. Current state-of-the-art approac…
Instance-Level Semantic Maps for Vision Language Navigation
Laksh Nanwani, Anmol Agarwal, Kanishk Jain +7
Humans have a natural ability to perform semantic associations with the surrounding objects in the environment. This allows them to create a mental map of the environment, allowing…
MParrotTTS: Multilingual Multi-speaker Text to Speech Synthesis in Low Resource Setting
Neil Shah, Vishal Tambrahalli, Saiteja Kosgi +2
We present MParrotTTS, a unified multilingual, multi-speaker text-to-speech (TTS) synthesis model that can produce high-quality speech. Benefiting from a modularized training parad…
Test-Time Amendment with a Coarse Classifier for Fine-Grained Classification
Kanishk Jain, Shyamgopal Karthik, Vineet Gandhi
We investigate the problem of reducing mistake severity for fine-grained classification. Fine-grained classification can be challenging, mainly due to the requirement of domain exp…
Ground then Navigate: Language-guided Navigation in Dynamic Scenes
Kanishk Jain, Varun Chhangani, Amogh Tiwari +2
We investigate the Vision-and-Language Navigation (VLN) problem in the context of autonomous driving in outdoor settings. We solve the problem by explicitly grounding the navigable…
Grounding Linguistic Commands to Navigable Regions
Nivedita Rufus, Kanishk Jain, Unni Krishnan R Nair +2
Humans have a natural ability to effortlessly comprehend linguistic commands such as "park next to the yellow sedan" and instinctively know which region of the road the vehicle sho…
Emotional Prosody Control for Speech Generation
Sarath Sivaprasad, Saiteja Kosgi, Vineet Gandhi
Machine-generated speech is characterized by its limited or unnatural emotional variation. Current text to speech systems generates speech with either a flat emotion, emotion selec…
Reappraising Domain Generalization in Neural Networks
Sarath Sivaprasad, Akshay Goindani, Vaibhav Garg +3
Given that Neural Networks generalize unreasonably well in the IID setting (with benign overfitting and betterment in performance with more parameters), OOD presents a consistent f…
Bringing Generalization to Deep Multi-View Pedestrian Detection
Jeet Vora, Swetanjal Dutta, Kanishk Jain +2
Multi-view Detection (MVD) is highly effective for occlusion reasoning in a crowded environment. While recent works using deep learning have made significant advances in the field,…
High-Resolution Depth Maps Based on TOF-Stereo Fusion
Vineet Gandhi, Jan Cech, Radu Horaud
The combination of range sensors with color cameras can be very useful for robot navigation, semantic perception, manipulation, and telepresence. Several methods of combining range…
Comprehensive Multi-Modal Interactions for Referring Image Segmentation
Kanishk Jain, Vineet Gandhi
We investigate Referring Image Segmentation (RIS), which outputs a segmentation map corresponding to the natural language description. Addressing RIS efficiently requires consideri…
No Cost Likelihood Manipulation at Test Time for Making Better Mistakes in Deep Networks
Shyamgopal Karthik, Ameya Prabhu, Puneet K. Dokania +1
There has been increasing interest in building deep hierarchy-aware classifiers that aim to quantify and reduce the severity of mistakes, and not just reduce the number of errors.…
ViNet: Pushing the limits of Visual Modality for Audio-Visual Saliency Prediction
Samyak Jain, Pradeep Yarlagadda, Shreyank Jyoti +3
We propose the ViNet architecture for audio-visual saliency prediction. ViNet is a fully convolutional encoder-decoder architecture. The encoder uses visual features from a network…
GAZED- Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings
K L Bhanu Moorthy, Moneish Kumar, Ramanathan Subramaniam +1
We present GAZED- eye GAZe-guided EDiting for videos captured by a solitary, static, wide-angle and high-resolution camera. Eye-gaze has been effectively employed in computational…
Cosine meets Softmax: A tough-to-beat baseline for visual grounding
Nivedita Rufus, Unni Krishnan R Nair, K. Madhava Krishna +1
In this paper, we present a simple baseline for visual grounding for autonomous driving which outperforms the state of the art methods, while retaining minimal design choices. Our…
Simple Unsupervised Multi-Object Tracking
Shyamgopal Karthik, Ameya Prabhu, Vineet Gandhi
Multi-object tracking has seen a lot of progress recently, albeit with substantial annotation costs for developing better and larger labeled datasets. In this work, we remove the n…
The Curious Case of Convex Neural Networks
Sarath Sivaprasad, Ankur Singh, Naresh Manwani +1
In this paper, we investigate a constrained formulation of neural networks where the output is a convex function of the input. We show that the convexity constraints can be enforce…
LiDAR guided Small obstacle Segmentation
Aasheesh Singh, Aditya Kamireddypalli, Vineet Gandhi +1
Detecting small obstacles on the road is critical for autonomous driving. In this paper, we present a method to reliably detect such obstacles through a multi-modal framework of sp…
Tidying Deep Saliency Prediction Architectures
Navyasri Reddy, Samyak Jain, Pradeep Yarlagadda +1
Learning computational models for visual attention (saliency estimation) is an effort to inch machines/robots closer to human visual cognitive abilities. Data-driven efforts have d…
CineFilter: Unsupervised Filtering for Real Time Autonomous Camera Systems
Sudheer Achary, K L Bhanu Moorthy, Syed Ashar Javed +3
Autonomous camera systems are often subjected to an optimization/filtering operation to smoothen and stabilize the rough trajectory estimates. Most common filtering techniques do r…
Exploring 3 R's of Long-term Tracking: Re-detection, Recovery and Reliability
Shyamgopal Karthik, Abhinav Moudgil, Vineet Gandhi
Recent works have proposed several long term tracking benchmarks and highlight the importance of moving towards long-duration tracking to bridge the gap with application requiremen…
Nose, eyes and ears: Head pose estimation by locating facial keypoints
Aryaman Gupta, Kalpit Thakkar, Vineet Gandhi +1
Monocular head pose estimation requires learning a model that computes the intrinsic Euler angles for pose (yaw, pitch, roll) from an input image of human face. Annotating ground t…
Watch to Edit: Video Retargeting using Gaze
Kranthi Kumar, Moneish Kumar, Vineet Gandhi +1
We present a novel approach to optimally retarget videos for varied displays with differing aspect ratios by preserving salient scene content discovered via eye tracking. Our algor…
MergeNet: A Deep Net Architecture for Small Obstacle Discovery
Krishnam Gupta, Syed Ashar Javed, Vineet Gandhi +1
We present here, a novel network architecture called MergeNet for discovering small obstacles for on-road scenes in the context of autonomous driving. The basis of the architecture…