78 citations · 196 across the 72 of their papers we have counts for
79 papers
WaveCommitments: Private and Verifiable Speech-Agent Marketplaces
Oguzhan Baser, Kaan Kale, Sriram Vishwanath +1
Modern speech systems are evolving into ecosystems of autonomous speech agents that interact, negotiate, and trade assets such as embeddings, spectrograms, or raw data. In such mar…
ModalFidelity: Routing Modalities for Deepfake Detection on a Budget
Oguzhan Baser, Kaan Kale, Sriram Vishwanath +1
Deepfakes no longer need to fake a whole video. Generators that read the transcript now alter only the few seconds in which a video's meaning turns, so a forgery hides in a small,…
FORM: Robot Manipulation through Direct Material Law Identification
Stepan Tretiakov, Ruihan Zhao, Cheng-Hsi Hsiao +6
When interacting with an unfamiliar deformable material, a robot lacks prior knowledge of its physical properties and how it will respond to applied forces and motion. Rapid online…
Chameleon: Dynamic Format Adapter for Efficient Diffusion
Arnab Sanyal, Sandeep Chinchali
Post-training quantization (PTQ) is the standard way to run modern diffusion models on memory-constrained accelerators, yet every existing diffusion PTQ scheme fixes the $\mathit{n…
Bayesian Partner Modelling enables Adaptive Replanning for LLM Coordination
Harsh Goel, Aditya Sai Ellendula, Vaishnav Tadiparthi +3
Multi-agent Large Language Model (LLM) systems often struggle to collaborate with new teammates whose strategies shift mid-task. Because agents execute multi-step or temporally ext…
If, Then, Otherwise: Diagnosing Conditional Branching in Vision-Language Navigation
Seoyoung Lee, Neel P. Bhatt, Pranay Samineni +8
Vision-language navigation agents are often evaluated on their ability to follow route-like instructions toward a fixed goal. Yet, real navigation instructions often depend on obse…
CrossView: Can Vision-Language Models Reason Across Cameras?
Sahil Shah, S P Sharan, Harsh Goel +4
Video understanding benchmarks have long centered on single-camera settings, where modern multi-modal language models achieve strong performance across image and video tasks. Yet,…
ViewMind3D: Modular View-Aware Inference for Training-Free 3D-QA
Ping-Kun Chiang, Kun-Ru Wu, Po-han Li +3
Recent advances in large language models (LLMs) and vision-language models (VLMs) have enabled new possibilities for 3D question answering (3D-QA), a key capability for embodied AI…
RoboShape: Information-Theoretic Point Cloud Representations for Privacy-Aware Robot Perception
Oguzhan Baser, Mirac Sozen, Kaan Kale +2
With the increased adoption of robotic agents operating in human environments by scanning and sharing 3D representations (e.g., for fleet learning, cloud-based planning, or collabo…
VEGAS: Human-Aligned Video Caption Evaluation via Gaze
Shenghui Chen, Po-han Li, Ximeng Sun +5
Vision-language models excel at video captioning, yet typically generate descriptions that fail to capture individual viewers' attention. We propose VEGAS (Video caption Evaluation…
Incentivizing Vision Language Models to Search for Long Video Question Answering
Harsh Goel, S P Sharan, Sahil Shah +4
We introduce VSeek, an agentic framework that transforms long-video question answering (LVQA) from a passive, single-pass perception task into a multi-turn retrieval process. VSeek…
What We are Missing in Multimodal LLM Evaluation?
Po-han Li, Shenghui Chen, Sandeep Chinchali +1
Multimodal large language models (MLLMs) can process diverse inputs, e.g., text, images, audio, and video, and generate textual responses. While their capabilities have advanced ra…
A Flow Matching Algorithm for Many-Shot Adaptation to Unseen Distributions
Tyler Ingebrand, Ruihan Zhao, Kushagra Gupta +3
While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation from example data points remains a…
CoordLight: Learning Decentralized Coordination for Network-Wide Traffic Signal Control
Yifeng Zhang, Harsh Goel, Peizhuo Li +3
Adaptive traffic signal control (ATSC) is crucial in alleviating congestion, maximizing throughput and promoting sustainable mobility in ever-expanding cities. Multi-Agent Reinforc…
SSR: A Generic Framework for Text-Aided Map Compression for Localization
Mohammad Omama, Po-han Li, Harsh Goel +6
Mapping is crucial in robotics for localization and downstream decision-making. As robots are deployed in ever-broader settings, the maps they rely on continue to increase in size.…
TensorCommitments: A Lightweight Verifiable Inference for Language Models
Oguzhan Baser, Elahe Sadeghi, Eric Wang +6
Most large language models (LLMs) run on external clouds: users send a prompt, pay for inference, and must trust that the remote GPU executes the LLM without any adversarial tamper…
RT-NeuS: Towards Real-Time Neuro-Symbolic Video Understanding via Adaptive Temporal Verification
Shawn Liang, Sahil Shah, Chengwei Zhou +5
Long-form video question answering (LVQA) requires answering natural-language queries about videos spanning minutes to hours, demanding temporal reasoning across thousands of frame…
ViSIL: Unified Evaluation of Information Loss in Multimodal Video Captioning
Po-han Li, Shenghui Chen, Ufuk Topcu +1
Multimodal video captioning condenses dense footage into a structured format of keyframes and natural language. By creating a cohesive multimodal summary, this approach anchors gen…
ObjectAlign: Neuro-Symbolic Object Consistency Verification and Correction
Mustafa Munir, Harsh Goel, Xiwen Wei +6
Video editing and synthesis often introduce object inconsistencies, such as frame flicker and identity drift that degrade perceptual quality. To address these issues, we introduce…
MoS-VLA: A Vision-Language-Action Model with One-Shot Skill Adaptation
Ruihan Zhao, Tyler Ingebrand, Sandeep Chinchali +1
Vision-Language-Action (VLA) models trained on large robot datasets promise general-purpose, robust control across diverse domains and embodiments. However, existing approaches oft…
UNCAP: Uncertainty-Guided Neurosymbolic Planning Using Natural Language Communication for Cooperative Autonomous Vehicles
Neel P. Bhatt, Po-han Li, Kushagra Gupta +7
Safe large-scale coordination of multiple cooperative connected autonomous vehicles (CAVs) hinges on communication that is both efficient and interpretable. Existing approaches eit…
AttentionViG: Cross-Attention-Based Dynamic Neighbor Aggregation in Vision GNNs
Hakan Emre Gedik, Andrew Martin, Mustafa Munir +4
Vision Graph Neural Networks (ViGs) have demonstrated promising performance in image recognition tasks against Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs).…
Fair Resource Allocation for Fleet Intelligence
Oguzhan Baser, Kaan Kale, Po-han Li +1
Resource allocation is crucial for the performance optimization of cloud-assisted multi-agent intelligence. Traditional methods often overlook agents' diverse computational capabil…
NeuS-QA: Grounding Long-Form Video Understanding in Temporal Logic and Neuro-Symbolic Reasoning
Sahil Shah, S P Sharan, Harsh Goel +5
While vision-language models (VLMs) excel at tasks involving single images or short videos, they still struggle with Long Video Question Answering (LVQA) due to its demand for comp…