113 citations · 308 across the 23 of their papers we have counts for
4 papers · 1 filter
Prompting Large Pre-trained Vision-Language Models For Compositional Concept Learning
Guangyue Xu, Parisa Kordjamshidi, Joyce Chai
This work explores the zero-shot compositional learning ability of large pre-trained vision-language models(VLMs) within the prompt-based learning framework and propose a model (\t…
DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents
Ziqiao Ma, Ben VanDerPloeg, Cristian-Paul Bara +5
In the real world, autonomous driving agents navigate in highly dynamic environments full of unexpected situations where pre-trained models are unreliable. In these situations, wha…
DANLI: Deliberative Agent for Following Natural Language Instructions
Yichi Zhang, Jianing Yang, Jiayi Pan +6
Recent years have seen an increasing amount of work on embodied AI agents that can perform tasks by following human language instructions. However, most of these agents are reactiv…
Learning to Mediate Disparities Towards Pragmatic Communication
Yuwei Bao, Sayan Ghosh, Joyce Chai
Human communication is a collaborative process. Speakers, on top of conveying their own intent, adjust the content and language expressions by taking the listeners into account, in…