54 citations · 146 across the 24 of their papers we have counts for
26 papers
Trajectory-Level Automatic Curriculum Learning for Legged Locomotion on Unstructured Terrain
Rocky Liu, Tengyu Liu, Baoxiong Jia +4
Training locomotion policies for complex unstructured terrain requires a curriculum to avoid early exploration failures. However, since unstructured terrain lacks explicit difficul…
Prefrontal scaling of reward prediction error readout gates reinforcement-derived adaptive behavior in primates
Tian Sang, Yichun Huang, Fangwei Zhong +10
Reinforcement learning (RL) driven by reward prediction errors (RPEs) enables adaptive behavior across species. While midbrain-striatal encoding of RPEs is well-documented, how pre…
Reinforced Context Order Recovery for Adaptive Reasoning and Planning
Long Ma, Fangwei Zhong, Yizhou Wang
Modern causal language models, followed by rapid developments in discrete diffusion models, can now produce a wide variety of interesting and useful content. However, these familie…
VLM Can Be a Good Assistant: Enhancing Embodied Visual Tracking with Self-Improving Vision-Language Models
Kui Wu, Shuhang Xu, Hao Chen +4
We introduce a novel self-improving framework that enhances Embodied Visual Tracking (EVT) with Vision-Language Models (VLMs) to address the limitations of current active visual tr…
Hierarchical Instruction-aware Embodied Visual Tracking
Kui Wu, Hao Chen, Churan Wang +4
User-Centric Embodied Visual Tracking (UC-EVT) presents a novel challenge for reinforcement learning-based models due to the substantial gap between high-level user instructions an…
Communication-Efficient Desire Alignment for Embodied Agent-Human Adaptation
Yuanfei Wang, Xinju Huang, Fangwei Zhong +4
While embodied agents have made significant progress in performing complex physical tasks, real-world applications demand more than pure task execution. The agents must collaborate…
Clinical Inspired MRI Lesion Segmentation
Lijun Yan, Churan Wang, Fangwei Zhong +1
Magnetic resonance imaging (MRI) is a potent diagnostic tool for detecting pathological tissues in various diseases. Different MRI sequences have different contrast mechanisms and…
UnrealZoo: Enriching Photo-realistic Virtual Worlds for Embodied AI
Fangwei Zhong, Kui Wu, Churan Wang +4
We introduce UnrealZoo, a collection of over 100 photo-realistic 3D virtual worlds built on Unreal Engine, designed to reflect the complexity and variability of open-world environm…
Simulating Human-like Daily Activities with Desire-driven Autonomy
Yiding Wang, Yuxuan Chen, Fangwei Zhong +2
Desires motivate humans to interact autonomously with the complex world. In contrast, current AI agents require explicit task specifications, such as instructions or reward functio…
Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacy
Zhenyu Guan, Xiangyu Kong, Fangwei Zhong +1
Diplomacy is one of the most sophisticated activities in human society, involving complex interactions among multiple parties that require skills in social reasoning, negotiation,…
SocialGFs: Learning Social Gradient Fields for Multi-Agent Reinforcement Learning
Qian Long, Fangwei Zhong, Mingdong Wu +2
Multi-agent systems (MAS) need to adaptively cope with dynamic environments, changing agent populations, and diverse tasks. However, most of the multi-agent systems cannot easily h…
Empowering Embodied Visual Tracking with Visual Foundation Models and Offline RL
Fangwei Zhong, Kui Wu, Hai Ci +2
Embodied visual tracking is to follow a target object in dynamic 3D environments using an agent's egocentric vision. This is a vital and challenging skill for embodied agents. Howe…
Fast Peer Adaptation with Context-aware Exploration
Long Ma, Yuanfei Wang, Fangwei Zhong +2
Fast adapting to unknown peers (partners or opponents) with different strategies is a key challenge in multi-agent games. To do so, it is crucial for the agent to probe and identif…
RSPT: Reconstruct Surroundings and Predict Trajectories for Generalizable Active Object Tracking
Fangwei Zhong, Xiao Bi, Yudi Zhang +2
Active Object Tracking (AOT) aims to maintain a specific relation between the tracker and object(s) by autonomously controlling the motion system of a tracker given observations. A…
Learning Semantic-Agnostic and Spatial-Aware Representation for Generalizable Visual-Audio Navigation
Hongcheng Wang, Yuxuan Wang, Fangwei Zhong +4
Visual-audio navigation (VAN) is attracting more and more attention from the robotic community due to its broad applications, \emph{e.g.}, household robots and rescue robots. In th…
Proactive Multi-Camera Collaboration For 3D Human Pose Estimation
Hai Ci, Mickel Liu, Xuehai Pan +2
This paper presents a multi-agent reinforcement learning (MARL) scheme for proactive Multi-Camera Collaboration in 3D Human Pose Estimation in dynamic human crowds. Traditional fix…
GFPose: Learning 3D Human Pose Prior with Gradient Fields
Hai Ci, Mingdong Wu, Wentao Zhu +4
Learning 3D human pose prior is essential to human-centered AI. Here, we present GFPose, a versatile framework to model plausible 3D human poses for various applications. At the co…
TarGF: Learning Target Gradient Field to Rearrange Objects without Explicit Goal Specification
Mingdong Wu, Fangwei Zhong, Yulong Xia +1
Object Rearrangement is to move objects from an initial state to a goal state. Here, we focus on a more practical setting in object rearrangement, i.e., rearranging objects from sh…
GraspARL: Dynamic Grasping via Adversarial Reinforcement Learning
Tianhao Wu, Fangwei Zhong, Yiran Geng +4
Grasping moving objects, such as goods on a belt or living animals, is an important but challenging task in robotics. Conventional approaches rely on a set of manually defined obje…
ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mind
Yuanfei Wang, Fangwei Zhong, Jing Xu +1
Being able to predict the mental states of others is a key factor to effective social interaction. It is also crucial for distributed multi-agent systems, where agents are required…
Towards Distraction-Robust Active Visual Tracking
Fangwei Zhong, Peng Sun, Wenhan Luo +2
In active visual tracking, it is notoriously difficult when distracting objects appear, as distractors often mislead the tracker by occluding the target or bringing a confusing app…
Learning Multi-Agent Coordination for Enhancing Target Coverage in Directional Sensor Networks
Jing Xu, Fangwei Zhong, Yizhou Wang
Maximum target coverage by adjusting the orientation of distributed sensors is an important problem in directional sensor networks (DSNs). This problem is challenging as the target…
Pose-Assisted Multi-Camera Collaboration for Active Object Tracking
Jing Li, Jing Xu, Fangwei Zhong +3
Active Object Tracking (AOT) is crucial to many visionbased applications, e.g., mobile robot, intelligent surveillance. However, there are a number of challenges when deploying act…
CRAVES: Controlling Robotic Arm with a Vision-based Economic System
Yiming Zuo, Weichao Qiu, Lingxi Xie +3
Training a robotic arm to accomplish real-world tasks has been attracting increasing attention in both academia and industry. This work discusses the role of computer vision algori…