13 citations · 21 across the 11 of their papers we have counts for
13 papers
NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
Ziye Wang, Modi Shi, Chaojun Ni +5
How can pretrained Vision-Language-Action (VLA) models retain long-horizon visual histories with high-frequency updates without sacrificing efficiency? Existing approaches rely on…
StateVLM: A State-Aware Vision-Language Model for Robotic Affordance Reasoning
Xiaowen Sun, Matthias Kerzel, Mengdi Li +3
Vision-language models have demonstrated strong performance across robotic perception and instruction-following tasks. However, they still struggle with precise spatial reasoning,…
HoloBrain-0 Technical Report
Xuewu Lin, Tianwei Lin, Yun Du +12
In this work, we introduce HoloBrain-0, a comprehensive Vision-Language-Action (VLA) framework that bridges the gap between foundation model research and reliable real-world robot…
Curriculum-RLAIF: Curriculum Alignment with Reinforcement Learning from AI Feedback
Jiaye Lin, Mengdi Li, Xufeng Zhao +4
Reward models trained through Reinforcement Learning from AI Feedback (RLAIF) methods frequently suffer from limited generalizability, which hinders the alignment performance of po…
Large Language Models for Orchestrating Bimanual Robots
Kun Chu, Xufeng Zhao, Cornelius Weber +3
Although there has been rapid progress in endowing robots with the ability to solve complex manipulation tasks, generating control policies for bimanual robots to solve tasks invol…
Causal State Distillation for Explainable Reinforcement Learning
Wenhao Lu, Xufeng Zhao, Thilo Fryen +4
Reinforcement learning (RL) is a powerful technique for training intelligent agents, but understanding why these agents make specific decisions can be quite challenging. This lack…
Accelerating Reinforcement Learning of Robotic Manipulations via Feedback from Large Language Models
Kun Chu, Xufeng Zhao, Cornelius Weber +2
Reinforcement Learning (RL) plays an important role in the robotic manipulation domain since it allows self-learning from trial-and-error interactions with the environment. Still,…
Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic
Xufeng Zhao, Mengdi Li, Wenhao Lu +4
Recent advancements in large language models have showcased their remarkable generalizability across various domains. However, their reasoning abilities still have significant room…
Chat with the Environment: Interactive Multimodal Perception Using Large Language Models
Xufeng Zhao, Mengdi Li, Cornelius Weber +2
Programming robot behavior in a complex world faces challenges on multiple levels, from dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large Lan…
Internally Rewarded Reinforcement Learning
Mengdi Li, Xufeng Zhao, Jae Hee Lee +2
We study a class of reinforcement learning problems where the reward signals for policy learning are generated by an internal reward model that is dependent on and jointly optimize…
Visually Grounded Commonsense Knowledge Acquisition
Yuan Yao, Tianyu Yu, Ao Zhang +8
Large-scale commonsense knowledge bases empower a broad range of AI applications, where the automatic extraction of commonsense knowledge (CKE) is a fundamental and challenging pro…
Robotic Occlusion Reasoning for Efficient Object Existence Prediction
Mengdi Li, Cornelius Weber, Matthias Kerzel +4
Reasoning about potential occlusions is essential for robots to efficiently predict whether an object exists in an environment. Though existing work shows that a robot with active…
Visual Distant Supervision for Scene Graph Generation
Yuan Yao, Ao Zhang, Xu Han +5
Scene graph generation aims to identify objects and their relations in images, providing structured image representations that can facilitate numerous applications in computer visi…