9 citations · 18 across the 16 of their papers we have counts for
20 papers
Low-Bitrate Video Compression through Semantic-Conditioned Diffusion
Lingdong Wang, Guan-Ming Su, Divya Kothandaraman +3
Traditional video codecs optimized for pixel fidelity collapse at ultra-low bitrates and produce severe artifacts. This failure arises from a fundamental misalignment between pixel…
Zero-Shot Personalized Camera Motion Control for Image-to-Video Synthesis
Pooja Guhan, Divya Kothandaraman, Geonsun Lee +3
Specifying nuanced and compelling camera motion remains a significant hurdle for non-expert creators using generative tools, creating an "expressive gap" where generic text prompts…
Scene-Action Prompt Fusion for Coherent Text-to-Video Storytelling
Taewon Kang, Divya Kothandaraman, Ming C. Lin
Generating coherent long-form video sequences from discrete text prompts remains challenging due to difficulties in maintaining temporal coherence, semantic consistency, and scene-…
ImPoster: Text and Frequency Guidance for Subject Driven Action Personalization using Diffusion Models
Divya Kothandaraman, Kuldeep Kulkarni, Sumit Shekhar +2
We present ImPoster, a novel algorithm for generating a target image of a 'source' subject performing a 'driving' action. The inputs to our algorithm are a single pair of a source…
3D-free meets 3D priors: Novel View Synthesis from a Single Image with Pretrained Diffusion Guidance
Taewon Kang, Divya Kothandaraman, Dinesh Manocha +1
Recent 3D novel view synthesis (NVS) methods often require extensive 3D data for training, and also typically lack generalization beyond the training distribution. Moreover, they t…
Text Prompting for Multi-Concept Video Customization by Autoregressive Generation
Divya Kothandaraman, Kihyuk Sohn, Ruben Villegas +3
We present a method for multi-concept customization of pretrained text-to-video (T2V) models. Intuitively, the multi-concept customized video can be derived from the (non-linear) i…
Financial Models in Generative Art: Black-Scholes-Inspired Concept Blending in Text-to-Image Diffusion
Divya Kothandaraman, Ming Lin, Dinesh Manocha
We introduce a novel approach for concept blending in pretrained text-to-image diffusion models, aiming to generate images at the intersection of multiple text prompts. At each tim…
HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View
Divya Kothandaraman, Tianyi Zhou, Ming Lin +1
We present HawkI, for synthesizing aerial-view images from text and an exemplar image, without any additional multi-view or 3D information for finetuning or at inference. HawkI use…
PMI Sampler: Patch Similarity Guided Frame Selection for Aerial Action Recognition
Ruiqi Xian, Xijun Wang, Divya Kothandaraman +1
We present a new algorithm for selection of informative frames in video action recognition. Our approach is designed for aerial videos captured using a moving camera where human ac…
Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models
Divya Kothandaraman, Tianyi Zhou, Ming Lin +1
We present a novel method, Aerial Diffusion, for generating aerial views from a single ground-view image using text guidance. Aerial Diffusion leverages a pretrained text-image dif…
Differentiable Frequency-based Disentanglement for Aerial Video Action Recognition
Divya Kothandaraman, Ming Lin, Dinesh Manocha
We present a learning algorithm for human activity recognition in videos. Our approach is designed for UAV videos, which are mainly acquired from obliquely placed dynamic cameras t…
Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes
James F. Mullen, Divya Kothandaraman, Aniket Bera +1
We present a novel method for placing a 3D human animation into a 3D scene while maintaining any human-scene interactions in the animation. We use the notion of computing the most…
SALAD: Source-free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection
Divya Kothandaraman, Sumit Shekhar, Abhilasha Sancheti +3
We present a novel method, SALAD, for the challenging vision task of adapting a pre-trained "source" domain network to a "target" domain, with a small budget for annotation in the…
FAR: Fourier Aerial Video Recognition
Divya Kothandaraman, Tianrui Guan, Xijun Wang +3
We present an algorithm, Fourier Activity Recognition (FAR), for UAV video activity recognition. Our formulation uses a novel Fourier object disentanglement method to innately sepa…
GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environments
Tianrui Guan, Divya Kothandaraman, Rohan Chandra +3
We propose GANav, a novel group-wise attention mechanism to identify safe and navigable regions in off-road terrains and unstructured environments from RGB images. Our approach cla…
SS-SFDA : Self-Supervised Source-Free Domain Adaptation for Road Segmentation in Hazardous Environments
Divya Kothandaraman, Rohan Chandra, Dinesh Manocha
We present a novel approach for unsupervised road segmentation in adverse weather conditions such as rain or fog. This includes a new algorithm for source-free domain adaptation (S…
Domain Adaptive Knowledge Distillation for Driving Scene Semantic Segmentation
Divya Kothandaraman, Athira Nambiar, Anurag Mittal
Practical autonomous driving systems face two crucial challenges: memory constraints and domain gap issues. In this paper, we present a novel approach to learn domain adaptive know…
BoMuDANet: Unsupervised Adaptation for Visual Scene Understanding in Unstructured Driving Environments
Divya Kothandaraman, Rohan Chandra, Dinesh Manocha
We present an unsupervised adaptation approach for visual scene understanding in unstructured traffic environments. Our method is designed for unstructured real-world scenarios wit…
Deep Atrous Guided Filter for Image Restoration in Under Display Cameras
Varun Sundar, Sumanth Hegde, Divya Kothandaraman +1
Under Display Cameras present a promising opportunity for phone manufacturers to achieve bezel-free displays by positioning the camera behind semi-transparent OLED screens. Unfortu…
UDC 2020 Challenge on Image Restoration of Under-Display Camera: Methods and Results
Yuqian Zhou, Michael Kwan, Kyle Tolentino +42
This paper is the report of the first Under-Display Camera (UDC) image restoration challenge in conjunction with the RLQ workshop at ECCV 2020. The challenge is based on a newly-co…