69 citations · 130 across the 8 of their papers we have counts for
16 papers
Retrieval-Augmented Embodied Agents
Yichen Zhu, Zhicai Ou, Xiaofeng Mou +1
Embodied agents operating in complex and uncertain environments face considerable challenges. While some advanced agents handle complex manipulation tasks with proficiency, their s…
LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Model
Yichen Zhu, Minjie Zhu, Ning Liu +3
In this paper, we introduce LLaVA- (LLaVA-Phi), an efficient multi-modal assistant that harnesses the power of the recently advanced small language model, Phi-2, to facilitate m…
A Survey on Robotics with Foundation Models: toward Embodied AI
Zhiyuan Xu, Kun Wu, Junjie Wen +4
While the exploration for embodied AI has spanned multiple decades, it remains a persistent challenge to endow agents with human-level intelligence, including perception, learning,…
Language-Conditioned Robotic Manipulation with Fast and Slow Thinking
Minjie Zhu, Yichen Zhu, Jinming Li +8
The language-conditioned robotic manipulation aims to transfer natural language instructions into executable actions, from simple pick-and-place to tasks requiring intent recogniti…
Object-Centric Instruction Augmentation for Robotic Manipulation
Junjie Wen, Yichen Zhu, Minjie Zhu +8
Humans interpret scenes by recognizing both the identities and positions of objects in their observations. For a robot to perform tasks such as \enquote{pick and place}, understand…
Unsupervised Discovery of Steerable Factors When Graph Deep Generative Models Are Entangled
Shengchao Liu, Chengpeng Wang, Jiarui Lu +5
Deep generative models (DGMs) have been widely developed for graph data. However, much less investigation has been carried out on understanding the latent space of such pretrained…