From the 1 of 8 linked papers with an AI index.
8 papers
Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
Dwip Dalal, Shivansh Patel, Chahit Jain +7
The paper introduces Anchor-Align, a method that adds representation anchoring and language-action alignment to behavior‑cloning finetuning of vision‑language models for robot mani…
CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposing
Cheng Qian, Hyeonjeong Ha, Jiayu Liu +10
Recent advances in large language models have led to strong performance on reasoning and environment-interaction tasks, yet their ability for creative problem-solving remains under…
Constructive Distortion: Improving MLLMs with Attention-Guided Image Warping
Dwip Dalal, Gautam Vashishtha, Utkarsh Mishra +6
Multimodal large language models (MLLMs) often miss small details and spatial relations in cluttered scenes, leading to errors in fine-grained perceptual grounding. We introduce At…
City Navigation in the Wild: Exploring Emergent Navigation from Web-Scale Knowledge in MLLMs
Dwip Dalal, Utkarsh Mishra, Narendra Ahuja +1
Leveraging multimodal large language models (MLLMs) to develop embodied agents offers significant promise for addressing complex real-world tasks. However, current evaluation bench…
MMT: A Multilingual and Multi-Topic Indian Social Media Dataset
Dwip Dalal, Vivek Srivastava, Mayank Singh
Social media plays a significant role in cross-cultural communication. A vast amount of this occurs in code-mixed and multilingual form, posing a significant challenge to Natural L…
DeHate: A Stable Diffusion-based Multimodal Approach to Mitigate Hate Speech in Images
Dwip Dalal, Gautam Vashishtha, Anku Rani +11
The rise in harmful online content not only distorts public discourse but also poses significant challenges to maintaining a healthy digital environment. In response to this, we in…