5 papers
BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions
Zhe Sun, Meng Wang, Lei Wang +4
Robot storytelling offers a unique blend of technological innovation and creative expression that engages children in unprecedented ways. However, the technical aspects are often t…
TongSIM: A General Platform for Simulating Intelligent Machines
Zhe Sun, Kunlun Wu, Chuanjian Fu +24
As artificial intelligence (AI) rapidly advances, especially in multimodal large language models (MLLMs), research focus is shifting from single-modality text processing to the mor…
SIT: A Benchmark for Spatially Situated Social Intelligence Test
Zhe Sun, Xueyuan Yang, Yujie Lu +1
The integration of embodied agents into human environments demands embodied social intelligence: reasoning over both social norms and physical constraints. However, existing evalua…
Learning Long Short-Term Intention within Human Daily Behaviors
Zhe Sun, Rujie Wu, Xiaodong Yang +4
In the domain of autonomous household robots, it is of utmost importance for robots to understand human behaviors and provide appropriate services. This requires the robots to poss…
Body Discovery of Embodied AI
Zhe Sun, Pengfei Tian, Xiaozhu Hu +3
In the pursuit of realizing artificial general intelligence (AGI), the importance of embodied artificial intelligence (AI) becomes increasingly apparent. Following this trend, rese…