6 papers
OverLay++: Dense-Overlap Layout-to-Image Generation Dataset
Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava +7
Layout-to-Image generation has made substantial progress in spatial and object-level control. However, existing methods still struggle with complex scenes containing many overlappi…
EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning
Lihan Zha, Shresth Grover, Tenny Yin +7
Egocentric human data offer a path to scaling robot learning beyond costly robot demonstrations, yet the embodiment gap makes raw human trajectories a poor supervisory target for c…
How Do Inpainting Artifacts Propagate to Language?
Pratham Yashwante, Davit Abrahamyan, Shresth Grover +1
We study how visual artifacts introduced by diffusion-based inpainting affect language generation in vision-language models. We use a two-stage diagnostic setup in which masked ima…
CoSPlan: Corrective Sequential Planning via Scene Graph Incremental Updates
Shresth Grover, Priyank Pathak, Akash Kumar +1
Vision Language Models (VLMs) have shown promising planning capabilities, yet their success remains confined to the text domain, leaving visual decision-making relatively underexpl…
Enhancing Generalization in Vision-Language-Action Models by Preserving Pretrained Representations
Shresth Grover, Akshay Gopalkrishnan, Bo Ai +3
Vision-language-action (VLA) models finetuned from vision-language models (VLMs) hold the promise of leveraging rich pretrained representations to build generalist robots across di…
Navigating Hallucinations for Reasoning of Unintentional Activities
Shresth Grover, Vibhav Vineet, Yogesh S Rawat
In this work we present a novel task of understanding unintentional human activities in videos. We formalize this problem as a reasoning task under zero-shot scenario, where given…