Multimodal Fusion for Sim2real Transfer in Visual Reinforcement Learning

Zichun Xu, Jingdong Zhao, Chenyu Guo +6

Depth information is robust to scene appearance variations and inherently carries 3D spatial details. Thus, a visual backbone based on the vision transformer is proposed to fuse RG…