11 papers
SafeRelBench: A Spatial-Relation-Aware Benchmark for Process-Level Safety in VLM-Driven Embodied Agents
Huaigang Yang, Ya Li, Min Ren +3
Vision-language models (VLMs) are increasingly used as the reasoning backbone of embodied agents, enabling robots to interpret visual scenes, follow language instructions, and plan…
BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions
Zhe Sun, Meng Wang, Lei Wang +4
Robot storytelling offers a unique blend of technological innovation and creative expression that engages children in unprecedented ways. However, the technical aspects are often t…
NormAct: Benchmarking Embodied Agents' Proactive Compliance with Unspoken Social Norms
Shiyun Zhao, Xinwei Song, Tianyu Guo +7
Embodied agents driven by multimodal large language models (MLLMs) can often complete everyday tasks from visual observations, but goal achievement does not establish whether they…
TeachAnything: A Multimodal Crowdsourcing Platform for Training Embodied AI Agents in Symmetrical Reality
Zidong Liu, Rongkai Liu, Yue Li +1
Symmetrical Reality (SR) is emerging as a future trend for human-agent coexistence, placing higher demands on agents to acquire human-like intelligence. It calls for richer and mor…
Exploring Human-Machine Coexistence in Symmetrical Reality
Zhenliang Zhang
In the context of the evolution of artificial intelligence (AI), the interaction between humans and AI entities has become increasingly salient, challenging the conventional human-…
TongSIM: A General Platform for Simulating Intelligent Machines
Zhe Sun, Kunlun Wu, Chuanjian Fu +24
As artificial intelligence (AI) rapidly advances, especially in multimodal large language models (MLLMs), research focus is shifting from single-modality text processing to the mor…
SIT: A Benchmark for Spatially Situated Social Intelligence Test
Zhe Sun, Xueyuan Yang, Yujie Lu +1
The integration of embodied agents into human environments demands embodied social intelligence: reasoning over both social norms and physical constraints. However, existing evalua…
Evaluating Multimodal Large Language Models with Daily Composite Tasks in Home Environments
Zhenliang Zhang, Yuxi Wang, Hongzhao Xie +6
A key feature differentiating artificial general intelligence (AGI) from traditional AI is that AGI can perform composite tasks that require a wide range of capabilities. Although…
Learning Long Short-Term Intention within Human Daily Behaviors
Zhe Sun, Rujie Wu, Xiaodong Yang +4
In the domain of autonomous household robots, it is of utmost importance for robots to understand human behaviors and provide appropriate services. This requires the robots to poss…
Body Discovery of Embodied AI
Zhe Sun, Pengfei Tian, Xiaozhu Hu +3
In the pursuit of realizing artificial general intelligence (AGI), the importance of embodied artificial intelligence (AI) becomes increasingly apparent. Following this trend, rese…
On the Emergence of Symmetrical Reality
Zhenliang Zhang, Zeyu Zhang, Ziyuan Jiao +4
Artificial intelligence (AI) has revolutionized human cognitive abilities and facilitated the development of new AI entities capable of interacting with humans in both physical and…