1 citations · 1 across the 4 of their papers we have counts for
8 papers
Interpreting Physics in Video Encoders using Multi-Object Interaction Videos
Ayushi Mehrotra, Sai Vidyaranya Nuthalapati
Video encoder models are increasingly used as world models for physical AI, where a policy plans by rolling out the latent, so what physics the latent holds bounds what the agent c…
LOCI: Localized Continuous Control for Multi-Subject Image Editing
Sai Vidyaranya Nuthalapati, Shlok Kumar Mishra
Recent instruction-following image editors such as Flux.1-Kontext enable text-driven editing but lack fine-grained control over where and how much an edit is applied. Existing appr…
An Attribute-Based Measure of Video Complexity
Aditya Sarkar, Yi Li, Zihao Wang +8
A new framework for the estimation of the complexity posed by video-question pairs to video-LLMs, Video Attribute-Based Complexity (VideoABC), is proposed. Video complexity is defi…
Unifying Contrastive and Generative Objectives for Visual Understanding and Text-to-Image Generation
Chao Li, Tianhong Li, Sai Vidyaranya Nuthalapati +9
Unifying text-image contrastive learning and text-to-image (T2I) generation in a single end-to-end model is challenging because the two objectives demand opposing masking regimes:…
GEM: Empowering LLM for both Embedding Generation and Language Understanding
Caojin Zhang, Qiang Zhang, Ke Li +6
Large decoder-only language models (LLMs) have achieved remarkable success in generation and reasoning tasks, where they generate text responses given instructions. However, many a…
Using Deep Learning-based Features Extracted from CT scans to Predict Outcomes in COVID-19 Patients
Sai Vidyaranya Nuthalapati, Marcela Vizcaychipi, Pallav Shah +6
The COVID-19 pandemic has had a considerable impact on day-to-day life. Tackling the disease by providing the necessary resources to the affected is of paramount importance. Howeve…
Multi-Domain Few-Shot Learning and Dataset for Agricultural Applications
Sai Vidyaranya Nuthalapati, Anirudh Tunga
Automatic classification of pests and plants (both healthy and diseased) is of paramount importance in agriculture to improve yield. Conventional deep learning models based on conv…
Pose-based Sign Language Recognition using GCN and BERT
Anirudh Tunga, Sai Vidyaranya Nuthalapati, Juan Wachs
Sign language recognition (SLR) plays a crucial role in bridging the communication gap between the hearing and vocally impaired community and the rest of the society. Word-level si…