4 papers
Pause and Think: A Dataset and Benchmark for Video-Grounded Assistive Action Suggestion
Shivam Singh, Saptarshi Majumder, Pratik Prabhanjan Brahma +2
Recent Vision-Language Models (VLMs) struggle with grounded reasoning, temporal consistency, and context aware planning in videos. We introduce pause-and-think-T, a reasoning-centr…
Anticipate, Adapt, Act: A Hybrid Framework for Task Planning
Nabanita Dash, Ayush Kaura, Shivam Singh +4
Anticipating and adapting to failures is a key capability robots need to collaborate effectively with humans in complex domains. This continues to be a challenge despite the impres…
AdaptBot: Combining LLM with Knowledge Graphs and Human Input for Generic-to-Specific Task Decomposition and Knowledge Refinement
Shivam Singh, Karthik Swaminathan, Nabanita Dash +4
An embodied agent assisting humans is often asked to complete new tasks, and there may not be sufficient time or labeled examples to train the agent to perform these new tasks. Lar…
Anticipate & Act : Integrating LLMs and Classical Planning for Efficient Task Execution in Household Environments
Raghav Arora, Shivam Singh, Karthik Swaminathan +6
Assistive agents performing household tasks such as making the bed or cooking breakfast often compute and execute actions that accomplish one task at a time. However, efficiency ca…